flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Metzger <rmetz...@apache.org>
Subject Re: Another serialization error
Date Tue, 17 May 2016 10:00:57 GMT
Hi Flavio,

which datatype are you using?

On Tue, May 17, 2016 at 11:42 AM, Flavio Pompermaier <pompermaier@okkam.it>
wrote:

> Hi to all,
> during these days we've run a lot of Flink jobs and from time to time
> (apparently randomly) a different Exception arise during their executions...
> I hope one of them could help in finding the source of the problem..This
> time the exception is:
>
> An error occurred while reading the next record.
>      at
> org.apache.flink.runtime.util.NonReusingKeyGroupedIterator.advanceToNext(NonReusingKeyGroupedIterator.java:148)
>      at
> org.apache.flink.runtime.util.NonReusingKeyGroupedIterator.access$300(NonReusingKeyGroupedIterator.java:32)
>      at
> org.apache.flink.runtime.util.NonReusingKeyGroupedIterator$ValuesIterator.next(NonReusingKeyGroupedIterator.java:192)
>      at
> org.okkam.entitons.mapping.flink.IndexMappingExecutor$TupleToEntitonJsonNode.reduce(IndexMappingExecutor.java:61)
>      at
> org.apache.flink.runtime.operators.GroupReduceDriver.run(GroupReduceDriver.java:125)
>      at
> org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:480)
>      at
> org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:345)
>      at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559)
>      at java.lang.Thread.run(Thread.java:745)
> Caused by: java.io.UTFDataFormatException: malformed input around byte 42
>      at
> org.apache.flink.runtime.memory.AbstractPagedInputView.readUTF(AbstractPagedInputView.java:488)
>      at
> org.apache.flink.api.java.typeutils.runtime.PojoSerializer.deserialize(PojoSerializer.java:403)
>      at
> org.apache.flink.api.java.typeutils.runtime.TupleSerializer.deserialize(TupleSerializer.java:135)
>      at
> org.apache.flink.api.java.typeutils.runtime.TupleSerializer.deserialize(TupleSerializer.java:30)
>      at
> org.apache.flink.runtime.io.disk.ChannelReaderInputViewIterator.next(ChannelReaderInputViewIterator.java:100)
>      at
> org.apache.flink.runtime.operators.sort.MergeIterator$HeadStream.nextHead(MergeIterator.java:161)
>      at
> org.apache.flink.runtime.operators.sort.MergeIterator.next(MergeIterator.java:113)
>      at
> org.apache.flink.runtime.util.NonReusingKeyGroupedIterator.advanceToNext(NonReusingKeyGroupedIterator.java:130
>
> Could this error be cause by a missing implementation of hashCode() and
> equals()?
>
> Thanks in advance,
> Flavio
>

Mime
View raw message