flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From static-max <flasha...@googlemail.com>
Subject Re: Flink job throws ClassNotFoundException on job restart
Date Wed, 05 Oct 2016 13:48:57 GMT
Hi Stephan,

thanks for the quick answer! I try to go to an older revision,

Best,
Max

2016-10-05 12:10 GMT+02:00 Stephan Ewen <sewen@apache.org>:

> Hi!
>
> The master has a temporary regression due to the Work In Progress for the
> "changing parallelism of savepoints" feature.
> We'll try and complete the change today, then it should work again.
>
> Sorry for the inconvenience. Can you work with a revision from last week
> for today?
>
> Stephan
>
>
> On Wed, Oct 5, 2016 at 11:50 AM, none none <flashacid@googlemail.com>
> wrote:
>
>> I'm running Flink on YARN with two taskmanagers. I wrote a simple job
>> that consumes messages from Kafka. The job runs on taskmanager 1. When I
>> kill taskmanager 1 (via *kill PID*), the job gets restarted on
>> taskmanager 2. So far so good. But right after starting the consumer the
>> execution fails:
>>
>> java.lang.RuntimeException: Could not deserialize NFA. at org.apache.flink.api.java.typeutils.runtime.JavaSerializer.deserialize(JavaSerializer.java:86)
>>     at org.apache.flink.api.java.typeutils.runtime.JavaSerializer.deserialize(JavaSerializer.java:31)
>>     at org.apache.flink.runtime.state.DefaultOperatorStateBackend.getPartitionableState(DefaultOperatorStateBackend.java:107)
>>     at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.initializeState(FlinkKafkaConsumerBase.java:323)
>>     at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:105)
>>     at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:396)
>>     at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:269)
>>     at org.apache.flink.runtime.taskmanager.Task.run(Task.java:608)
>>     at java.lang.Thread.run(Thread.java:745)Caused by: java.lang.ClassNotFoundException:
org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition
>>     at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>>     at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>>     at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>>     at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>>     at java.lang.Class.forName0(Native Method)
>>     at java.lang.Class.forName(Class.java:348)
>>     at java.io.ObjectInputStream.resolveClass(ObjectInputStream.java:626)
>>     at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613)
>>     at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518)
>>     at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774)
>>     at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
>>     at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000)
>>     at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924)
>>     at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801)
>>     at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
>>     at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371)
>>     at org.apache.flink.api.java.typeutils.runtime.JavaSerializer.deserialize(JavaSerializer.java:83)
>>     ... 8 more
>>
>> I build the jar file with:
>>
>> mvn clean package -Pbuild-jar
>>
>> I also tried this but makes no difference:
>>
>> mvn clean package
>>
>> It's strange that my job runs fine on the first attempt, but I get CNFEs
>> on job restart. What am I doing wrong? (I'm using Flink 1.2-SNAPSHOT
>> because I need the BucketSink). I compared the classpaths of both
>> taskmanagers, they are equal.
>>
>
>

Mime
View raw message