flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jay vyas <jayunit100.apa...@gmail.com>
Subject Serialization and kryo
Date Sun, 16 Aug 2015 14:38:12 GMT
Hi flink.

I just ran into the following serialization error in BigPetStore Flink.
It appears to be that someone is trying to add elements to a map during
serialization.   I doubt this is a bug in flink because it would have
surely been caught early on.

Some possible explanations ...

1 - Probably its a conflict caused by my application's dependencies ?

2 - Or maybe just something about the way the mini-cluster sets up its
dependencies?.

3 - Or... Is this related to a guava transitive dependency conflict?

DETAILS

Our data generator library has these dependencies... Just FYI...
[INFO] \-
com.github.rnowling.bigpetstore:bigpetstore-data-generator:jar:0.2.1:compile
[INFO]    +- com.google.guava:guava:jar:18.0:compile
[INFO]    \- com.google.code.gson:gson:jar:2.3:compile


And, heres the exception:

Caused by: com.esotericsoftware.kryo.KryoException:
java.lang.UnsupportedOperationException
Serialization trace:
fields (com.github.rnowling.bps.datagenerator.datamodels.Product)
products (com.github.rnowling.bps.datagenerator.datamodels.Transaction)
at
com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:125)
at
com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:528)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:761)
at
com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:116)
at
com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:22)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:679)
at
com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)
at
com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:528)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:761)

Caused by: java.lang.UnsupportedOperationException
at com.google.common.collect.ImmutableMap.put(ImmutableMap.java:326)
at
com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.java:144)
at
com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.java:21)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:679)
at
com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)
... 18 more

Mime
View raw message