flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stefano Bortoli <s.bort...@gmail.com>
Subject Re: kryo exception due to race condition
Date Fri, 02 Oct 2015 07:46:10 GMT
here it is: https://issues.apache.org/jira/browse/FLINK-2800

saluti,
Stefano

2015-10-01 18:50 GMT+02:00 Stephan Ewen <sewen@apache.org>:

> This looks to me like a bug where type registrations are not properly
> forwarded to all Serializers.
>
> Can you open a JIRA ticket for this?
>
> On Thu, Oct 1, 2015 at 6:46 PM, Stefano Bortoli <s.bortoli@gmail.com>
> wrote:
>
>> Hi guys,
>>
>> I hit a Kryo exception while running a process 'crossing' POJOs datasets.
>> I am using the 0.10-milestone-1.
>> Checking the serializer:
>> org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.deserialize(KryoSerializer.java:210)
>>
>> I have noticed that the Kryo instance is reused along serialization calls
>> (e.g. line 187).  However, Kryo is not threadsafe, and therefore I think it
>> may cause the problem due to possible race condition. We had these types of
>> issues solved with a KryoFactory implementing a pool. Perhaps it should
>> just a matter of calling the
>>
>> what should I do? Open a ticket?
>>
>> Thanks a lot guys for the great job!
>>
>> saluti,
>> Stefano
>>
>> -----------------------------------------
>> com.esotericsoftware.kryo.KryoException: Encountered unregistered class
>> ID: 114
>>     at
>> com.esotericsoftware.kryo.util.DefaultClassResolver.readClass(DefaultClassResolver.java:119)
>>     at com.esotericsoftware.kryo.Kryo.readClass(Kryo.java:641)
>>     at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:752)
>>     at
>> org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.deserialize(KryoSerializer.java:210)
>>     at
>> org.apache.flink.api.java.typeutils.runtime.TupleSerializer.deserialize(TupleSerializer.java:127)
>>     at
>> org.apache.flink.api.java.typeutils.runtime.TupleSerializer.deserialize(TupleSerializer.java:30)
>>     at
>> org.apache.flink.runtime.operators.resettable.AbstractBlockResettableIterator.getNextRecord(AbstractBlockResettableIterator.java:180)
>>     at
>> org.apache.flink.runtime.operators.resettable.BlockResettableMutableObjectIterator.next(BlockResettableMutableObjectIterator.java:111)
>>     at
>> org.apache.flink.runtime.operators.CrossDriver.runBlockedOuterSecond(CrossDriver.java:309)
>>     at
>> org.apache.flink.runtime.operators.CrossDriver.run(CrossDriver.java:162)
>>     at
>> org.apache.flink.runtime.operators.RegularPactTask.run(RegularPactTask.java:489)
>>     at
>> org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:354)
>>     at org.apache.flink.runtime.taskmanager.Task.run(Task.java:581)
>>     at java.lang.Thread.run(Thread.java:745)
>>
>
>

Mime
View raw message