flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From static-max <flasha...@googlemail.com>
Subject Re: Flink job throws ClassNotFoundException on job restart
Date Wed, 05 Oct 2016 14:09:07 GMT
I went back to commit 2afc092461cf68cf0f3c26a3ab4c58a7bd68cf71 on MASTER,
seems to work.

2016-10-05 15:48 GMT+02:00 static-max <flashacid@googlemail.com>:

> Hi Stephan,
>
> thanks for the quick answer! I try to go to an older revision,
>
> Best,
> Max
>
> 2016-10-05 12:10 GMT+02:00 Stephan Ewen <sewen@apache.org>:
>
>> Hi!
>>
>> The master has a temporary regression due to the Work In Progress for the
>> "changing parallelism of savepoints" feature.
>> We'll try and complete the change today, then it should work again.
>>
>> Sorry for the inconvenience. Can you work with a revision from last week
>> for today?
>>
>> Stephan
>>
>>
>> On Wed, Oct 5, 2016 at 11:50 AM, none none <flashacid@googlemail.com>
>> wrote:
>>
>>> I'm running Flink on YARN with two taskmanagers. I wrote a simple job
>>> that consumes messages from Kafka. The job runs on taskmanager 1. When I
>>> kill taskmanager 1 (via *kill PID*), the job gets restarted on
>>> taskmanager 2. So far so good. But right after starting the consumer the
>>> execution fails:
>>>
>>> java.lang.RuntimeException: Could not deserialize NFA. at org.apache.flink.api.java.typeutils.runtime.JavaSerializer.deserialize(JavaSerializer.java:86)
>>>     at org.apache.flink.api.java.typeutils.runtime.JavaSerializer.deserialize(JavaSerializer.java:31)
>>>     at org.apache.flink.runtime.state.DefaultOperatorStateBackend.getPartitionableState(DefaultOperatorStateBackend.java:107)
>>>     at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.initializeState(FlinkKafkaConsumerBase.java:323)
>>>     at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:105)
>>>     at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:396)
>>>     at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:269)
>>>     at org.apache.flink.runtime.taskmanager.Task.run(Task.java:608)
>>>     at java.lang.Thread.run(Thread.java:745)Caused by: java.lang.ClassNotFoundException:
org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition
>>>     at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>>>     at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>>>     at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>>>     at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>>>     at java.lang.Class.forName0(Native Method)
>>>     at java.lang.Class.forName(Class.java:348)
>>>     at java.io.ObjectInputStream.resolveClass(ObjectInputStream.java:626)
>>>     at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613)
>>>     at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518)
>>>     at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774)
>>>     at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
>>>     at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000)
>>>     at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924)
>>>     at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801)
>>>     at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
>>>     at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371)
>>>     at org.apache.flink.api.java.typeutils.runtime.JavaSerializer.deserialize(JavaSerializer.java:83)
>>>     ... 8 more
>>>
>>> I build the jar file with:
>>>
>>> mvn clean package -Pbuild-jar
>>>
>>> I also tried this but makes no difference:
>>>
>>> mvn clean package
>>>
>>> It's strange that my job runs fine on the first attempt, but I get CNFEs
>>> on job restart. What am I doing wrong? (I'm using Flink 1.2-SNAPSHOT
>>> because I need the BucketSink). I compared the classpaths of both
>>> taskmanagers, they are equal.
>>>
>>
>>
>

Mime
View raw message