flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tzu-Li (Gordon) Tai (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-4155) Get Kafka producer partition info in open method instead of constructor
Date Tue, 22 Nov 2016 16:18:59 GMT

    [ https://issues.apache.org/jira/browse/FLINK-4155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15687157#comment-15687157
] 

Tzu-Li (Gordon) Tai commented on FLINK-4155:
--------------------------------------------

Resolved for master with http://git-wip-us.apache.org/repos/asf/flink/commit/1f9c0cf

> Get Kafka producer partition info in open method instead of constructor
> -----------------------------------------------------------------------
>
>                 Key: FLINK-4155
>                 URL: https://issues.apache.org/jira/browse/FLINK-4155
>             Project: Flink
>          Issue Type: Bug
>          Components: Kafka Connector
>    Affects Versions: 1.1.0, 1.0.3
>            Reporter: Gyula Fora
>            Assignee: Tzu-Li (Gordon) Tai
>             Fix For: 1.2.0
>
>
> Currently the Flink Kafka producer does not really do any error handling if something
is wrong with the partition metadata as it is serialized with the user function.
> This means that in some cases the job can go into an error loop when using the checkpoints.
Getting the partition info in the open method would solve this problem (like restarting from
a savepoint which re-runs the constructor).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message