flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephan Ewen <se...@apache.org>
Subject Re: Unexpected out of bounds error in UnilateralSortMerger
Date Wed, 20 Jan 2016 10:39:23 GMT
Hi!

Does this error occur in 0.10 or im 1.0-SNAPSHOT?

It is probably an incorrectly configured Kryo instance (not a problem of
the sorter).
What is strange is that it occurs in the "MapReferenceResolver" - there
should be no reference resolution during serialization / deserialization.

Can you try what happens when you explicitly register the type SparseVector
at the ExecutionEnvironment?

Stephan


On Wed, Jan 20, 2016 at 11:24 AM, Theodore Vasiloudis <
theodoros.vasiloudis@gmail.com> wrote:

> Hello all,
>
> I'm trying to run a job using FlinkML and I'm confused about the source of
> an error.
>
> The job reads a libSVM formatted file and trains an SVM classifier on it.
>
> I've tried this with small datasets and everything works out fine.
>
> When trying to run the same job on a large dataset (~11GB uncompressed)
> however, I get the following error:
>
>
>> java.lang.RuntimeException: Error obtaining the sorted input: Thread
>> 'SortMerger spilling thread' terminated due to an exception:
>> java.lang.IndexOutOfBoundsException: Index: 14, Size: 2
>> Serialization trace:
>> indices (org.apache.flink.ml.math.SparseVector)
>>         at
>> org.apache.flink.runtime.operators.sort.UnilateralSortMerger.getIterator(UnilateralSortMerger.java:619)
>>         at
>> org.apache.flink.runtime.operators.BatchTask.getInput(BatchTask.java:1089)
>>         at
>> org.apache.flink.runtime.operators.NoOpDriver.run(NoOpDriver.java:78)
>>         at
>> org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:489)
>>         at
>> org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:354)
>>         at org.apache.flink.runtime.taskmanager.Task.run(Task.java:584)
>>         at java.lang.Thread.run(Thread.java:745)
>> Caused by: java.io.IOException: Thread 'SortMerger spilling thread'
>> terminated due to an exception: java.lang.IndexOutOfBoundsException: Index:
>> 14, Size: 2
>> Serialization trace:
>> indices (org.apache.flink.ml.math.SparseVector)
>>         at
>> org.apache.flink.runtime.operators.sort.UnilateralSortMerger$ThreadBase.run(UnilateralSortMerger.java:800)
>> Caused by: com.esotericsoftware.kryo.KryoException:
>> java.lang.IndexOutOfBoundsException: Index: 14, Size: 2
>> Serialization trace:
>> indices (org.apache.flink.ml.math.SparseVector)
>>         at
>> com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:125)
>>         at
>> com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:528)
>>         at
>> com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:761)
>>         at
>> org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.deserialize(KryoSerializer.java:222)
>>         at
>> org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.deserialize(KryoSerializer.java:236)
>>         at
>> org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.copy(KryoSerializer.java:246)
>>         at
>> org.apache.flink.api.java.typeutils.runtime.TupleSerializerBase.copy(TupleSerializerBase.java:73)
>>         at
>> org.apache.flink.api.java.typeutils.runtime.TupleSerializerBase.copy(TupleSerializerBase.java:73)
>>         at
>> org.apache.flink.runtime.operators.sort.NormalizedKeySorter.writeToOutput(NormalizedKeySorter.java:499)
>>         at
>> org.apache.flink.runtime.operators.sort.UnilateralSortMerger$SpillingThread.go(UnilateralSortMerger.java:1344)
>>         at
>> org.apache.flink.runtime.operators.sort.UnilateralSortMerger$ThreadBase.run(UnilateralSortMerger.java:796)
>> Caused by: java.lang.IndexOutOfBoundsException: Index: 14, Size: 2
>>         at java.util.ArrayList.rangeCheck(ArrayList.java:653)
>>         at java.util.ArrayList.set(ArrayList.java:444)
>>         at
>> com.esotericsoftware.kryo.util.MapReferenceResolver.setReadObject(MapReferenceResolver.java:38)
>>         at com.esotericsoftware.kryo.Kryo.reference(Kryo.java:823)
>>         at com.esotericsoftware.kryo.Kryo.readObjectOrNull(Kryo.java:731)
>>         at
>> com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:113)
>>         ... 10 more
>
>
>
> Any idea what might be causing this? I'm running the job in local mode, 1
> TM with 8 slots and ~32GB heap size.
>
> All the vectors created by the libSVM loader have the correct size.
>

Mime
View raw message