flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tzu-Li (Gordon) Tai (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-6263) Leader error in Kafka producer on leader change (broker restart/failrue)
Date Thu, 15 Jun 2017 08:32:07 GMT

    [ https://issues.apache.org/jira/browse/FLINK-6263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16050152#comment-16050152
] 

Tzu-Li (Gordon) Tai commented on FLINK-6263:
--------------------------------------------

Could you briefly describe how / when this error occurred? Was the Kafka brokers undergoing
some operation?
It could make sense to introduce some pluggable error handler for these cases.

> Leader error in Kafka producer on leader change (broker restart/failrue)
> ------------------------------------------------------------------------
>
>                 Key: FLINK-6263
>                 URL: https://issues.apache.org/jira/browse/FLINK-6263
>             Project: Flink
>          Issue Type: Bug
>          Components: Kafka Connector
>    Affects Versions: 1.2.0
>            Reporter: Gyula Fora
>
> We have observed the following error in the Kafka producer
> java.lang.Exception: Failed to send data to Kafka: This server is not the leader for
that topic-partition.
> 	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase.checkErroneous(FlinkKafkaProducerBase.java:376)
> 	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase.invoke(FlinkKafkaProducerBase.java:293)
> 	at org.apache.flink.streaming.api.operators.StreamSink.processElement(StreamSink.java:38)
> 	at org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput(StreamInputProcessor.java:185)
> 	at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run(OneInputStreamTask.java:63)
> 	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:261)
> 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:656)
> 	at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.kafka.common.errors.NotLeaderForPartitionException: This server
is not the leader for that topic-partition.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message