kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Oleg Kuznetsov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-5696) SourceConnector does not commit offset on rebalance
Date Wed, 16 Aug 2017 17:19:00 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-5696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129105#comment-16129105

Oleg Kuznetsov commented on KAFKA-5696:

[~rhauch] I believe yes, finally block is not executed - since WorkerTask.stop does not wait
for the end of event loop.

> SourceConnector does not commit offset on rebalance
> ---------------------------------------------------
>                 Key: KAFKA-5696
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5696
>             Project: Kafka
>          Issue Type: Bug
>          Components: KafkaConnect
>            Reporter: Oleg Kuznetsov
>              Labels: newbie
>             Fix For:
> I'm running SourceConnector, that reads files from storage and put data in kafka. I want,
in case of reconfiguration, offsets to be flushed. 
> Say, a file is completely processed, but source records are not yet committed and in
case of reconfiguration their offsets might be missing in store.
> Is it possible to force committing offsets on reconfiguration?

This message was sent by Atlassian JIRA

View raw message