kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Guozhang Wang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-3522) Consider adding version information into rocksDB storage format
Date Fri, 11 Nov 2016 21:05:58 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Guozhang Wang updated KAFKA-3522:
    Priority: Critical  (was: Major)

> Consider adding version information into rocksDB storage format
> ---------------------------------------------------------------
>                 Key: KAFKA-3522
>                 URL: https://issues.apache.org/jira/browse/KAFKA-3522
>             Project: Kafka
>          Issue Type: Bug
>          Components: streams
>            Reporter: Guozhang Wang
>            Assignee: Ishita Mandhan
>            Priority: Critical
>              Labels: architecture
>             Fix For:
> Kafka Streams does not introduce any modifications to the data format in the underlying
Kafka protocol, but it does use RocksDB for persistent state storage, and currently its data
format is fixed and hard-coded. We want to consider the evolution path in the future we we
change the data format, and hence having some version info stored along with the storage file
/ directory would be useful.
> And this information could be even out of the storage file; for example, we can just
use a small "version indicator" file in the rocksdb directory for this purposes. Thoughts?
[~enothereska] [~jkreps]

This message was sent by Atlassian JIRA

View raw message