kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Guozhang Wang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-6711) GlobalStateManagerImpl should not write offsets of in-memory stores in checkpoint file
Date Mon, 26 Mar 2018 18:41:00 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-6711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Guozhang Wang updated KAFKA-6711:
---------------------------------
    Summary: GlobalStateManagerImpl should not write offsets of in-memory stores in checkpoint
file  (was: Checkpoint of InMemoryStore along with GlobalKTable )

> GlobalStateManagerImpl should not write offsets of in-memory stores in checkpoint file
> --------------------------------------------------------------------------------------
>
>                 Key: KAFKA-6711
>                 URL: https://issues.apache.org/jira/browse/KAFKA-6711
>             Project: Kafka
>          Issue Type: Bug
>          Components: streams
>    Affects Versions: 1.0.1
>            Reporter: Cemalettin Koç
>            Priority: Major
>              Labels: newbie
>
> We are using an InMemoryStore along with GlobalKTable and I noticed that after each restart
I am losing all my data. When I debug it, `/tmp/kafka-streams/category-client-1/global/.checkpoint`
file contains offset for my GlobalKTable topic. I had checked GlobalStateManagerImpl implementation
and noticed that it is not guarded for cases similar to mine. I am fairly new to Kafka land
and probably there might be another way to fix issue. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message