flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jay vyas <jayunit100.apa...@gmail.com>
Subject Re: Serialization and kryo
Date Sun, 16 Aug 2015 14:54:31 GMT
   1. Just wanted to updated.. possibly I'm hitting ? FLINK-1417
   Automatically register nested types at Kryo
   <https://issues.apache.org/jira/browse/FLINK-1417> ...


On Sun, Aug 16, 2015 at 10:38 AM, jay vyas <jayunit100.apache@gmail.com>
wrote:

> Hi flink.
>
> I just ran into the following serialization error in BigPetStore Flink.
> It appears to be that someone is trying to add elements to a map during
> serialization.   I doubt this is a bug in flink because it would have
> surely been caught early on.
>
> Some possible explanations ...
>
> 1 - Probably its a conflict caused by my application's dependencies ?
>
> 2 - Or maybe just something about the way the mini-cluster sets up its
> dependencies?.
>
> 3 - Or... Is this related to a guava transitive dependency conflict?
>
> DETAILS
>
> Our data generator library has these dependencies... Just FYI...
> [INFO] \-
> com.github.rnowling.bigpetstore:bigpetstore-data-generator:jar:0.2.1:compile
> [INFO]    +- com.google.guava:guava:jar:18.0:compile
> [INFO]    \- com.google.code.gson:gson:jar:2.3:compile
>
>
> And, heres the exception:
>
> Caused by: com.esotericsoftware.kryo.KryoException:
> java.lang.UnsupportedOperationException
> Serialization trace:
> fields (com.github.rnowling.bps.datagenerator.datamodels.Product)
> products (com.github.rnowling.bps.datagenerator.datamodels.Transaction)
> at
> com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:125)
> at
> com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:528)
> at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:761)
> at
> com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:116)
> at
> com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:22)
> at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:679)
> at
> com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)
> at
> com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:528)
> at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:761)
>
> Caused by: java.lang.UnsupportedOperationException
> at com.google.common.collect.ImmutableMap.put(ImmutableMap.java:326)
> at
> com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.java:144)
> at
> com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.java:21)
> at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:679)
> at
> com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)
> ... 18 more
>



-- 
jay vyas

Mime
View raw message