flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-2386) Implement Kafka connector using the new Kafka Consumer API
Date Tue, 11 Aug 2015 11:53:46 GMT

    [ https://issues.apache.org/jira/browse/FLINK-2386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681686#comment-14681686

ASF GitHub Bot commented on FLINK-2386:

Github user StephanEwen commented on the pull request:

    I'll take a stab at checking out this monster ;-)

> Implement Kafka connector using the new Kafka Consumer API
> ----------------------------------------------------------
>                 Key: FLINK-2386
>                 URL: https://issues.apache.org/jira/browse/FLINK-2386
>             Project: Flink
>          Issue Type: Improvement
>          Components: Kafka Connector
>            Reporter: Robert Metzger
>            Assignee: Robert Metzger
> Once Kafka has released its new consumer API, we should provide a connector for that
> The release will probably be called 0.9 or 0.8.3.
> The connector will be mostly compatible with Kafka 0.8.2.x, except for committing offsets
to the broker (the new connector expects a coordinator to be available on Kafka). To work
around that, we can provide a configuration option to commit offsets to zookeeper (managed
by flink code).
> For 0.9/0.8.3 it will be fully compatible.
> It will not be compatible with 0.8.1 because of mismatching Kafka messages.

This message was sent by Atlassian JIRA

View raw message