flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tzu-Li (Gordon) Tai" <tzuli...@apache.org>
Subject Re: Flink streaming (1.3.2) KafkaConsumer08 - Unable to retrieve any partitions
Date Tue, 23 Jan 2018 09:21:08 GMT
Hi Tarandeep,

The error you are seeing only occurs when on startup of the consumer, it couldn’t retrieve
any partition information from Kafka.
Therefore, according to your description, there should be another error that caused the previous
execution of the job to fail. Could you check that? Maybe that would give more insight into
why this is happening.

Cheers,
Gordon

On 23 January 2018 at 5:37:15 AM, Tarandeep Singh (tarandeep@gmail.com) wrote:

Hi,

Our flink streaming job that is reading from old version of Kafka keeps failing (every 9 minutes
or so) with this error:

java.lang.RuntimeException: Unable to retrieve any partitions for the requested topics [extracted-dimensions].
Please check previous log entries
        at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer08.getKafkaPartitions(FlinkKafkaConsumer08.java:220)
        at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.open(FlinkKafkaConsumerBase.java:381)
        at org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:36)
        at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:111)
        at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:376)
        at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:253)
        at org.apache.flink.runtime.taskmanager.Task.run(Task.java:702)
        at java.lang.Thread.run(Thread.java:748)


Sometimes it runs for a long time but when it starts to fail, it is predictable failure every
9 minutes. The topic does exist in the Kafka cluster.

Can someone help me understand what could be going wrong?

Thank you,
Tarandeep

Mime
View raw message