kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Richard Yu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-5696) SourceConnector does not commit offset on rebalance
Date Tue, 05 Sep 2017 03:21:00 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-5696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153069#comment-16153069

Richard Yu commented on KAFKA-5696:

bq. I see this in logs.
Could you tells us what exactly you saw in logs? 

> SourceConnector does not commit offset on rebalance
> ---------------------------------------------------
>                 Key: KAFKA-5696
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5696
>             Project: Kafka
>          Issue Type: Bug
>          Components: KafkaConnect
>            Reporter: Oleg Kuznetsov
>            Priority: Critical
>              Labels: newbie
> I'm running SourceConnector, that reads files from storage and put data in kafka. I want,
in case of reconfiguration, offsets to be flushed. 
> Say, a file is completely processed, but source records are not yet committed and in
case of reconfiguration their offsets might be missing in store.
> Is it possible to force committing offsets on reconfiguration?

This message was sent by Atlassian JIRA

View raw message