flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Flavio Pompermaier <pomperma...@okkam.it>
Subject Re: Bug in Hybrid Hash Join
Date Tue, 13 Oct 2015 10:30:16 GMT
I ensured that I was using the latest version and I showed to program to
Fabian right now.
The stack trace is:

Caused by: java.lang.RuntimeException: Bug in Hybrid Hash Join: Request to
spill a partition with less than two buffers.
at
org.apache.flink.runtime.operators.hash.HashPartition.spillPartition(HashPartition.java:301)
at
org.apache.flink.runtime.operators.hash.MutableHashTable.spillPartition(MutableHashTable.java:1108)
at
org.apache.flink.runtime.operators.hash.MutableHashTable.nextSegment(MutableHashTable.java:1277)
at
org.apache.flink.runtime.operators.hash.HashPartition$BuildSideBuffer.nextSegment(HashPartition.java:523)
at
org.apache.flink.runtime.memory.AbstractPagedOutputView.advance(AbstractPagedOutputView.java:140)
at
org.apache.flink.runtime.memory.AbstractPagedOutputView.write(AbstractPagedOutputView.java:201)
at
org.apache.flink.api.java.typeutils.runtime.DataOutputViewStream.write(DataOutputViewStream.java:39)
at com.esotericsoftware.kryo.io.Output.flush(Output.java:163)
at
org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.serialize(KryoSerializer.java:187)
at
org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:116)
at
org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:30)
at
org.apache.flink.runtime.operators.hash.HashPartition.insertIntoBuildBuffer(HashPartition.java:256)
at
org.apache.flink.runtime.operators.hash.MutableHashTable.insertIntoTable(MutableHashTable.java:856)
at
org.apache.flink.runtime.operators.hash.MutableHashTable.buildInitialTable(MutableHashTable.java:685)
at
org.apache.flink.runtime.operators.hash.MutableHashTable.open(MutableHashTable.java:443)
at
org.apache.flink.runtime.operators.hash.NonReusingBuildSecondHashMatchIterator.open(NonReusingBuildSecondHashMatchIterator.java:85)
at
org.apache.flink.runtime.operators.JoinDriver.prepare(JoinDriver.java:195)
at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:459)
... 3 more


On Tue, Oct 13, 2015 at 5:20 AM, Sachin Goel <sachingoel0101@gmail.com>
wrote:

> Hi Flavio
> This was addressed in Flink-2763. Can you check if you're using the latest
> version?
>
> Cheers!
> Sachin
> On Oct 13, 2015 5:04 AM, "Flavio Pompermaier" <pompermaier@okkam.it>
> wrote:
>
>> Hi guys,
>> my job fails on Flink 0.10-snapshot with the following message: Bug in
>> Hybrid Hash Join: Request to spill a partition with less than two buffers.I
>> tried to double network buffers but I still got the error :(
>>
>> Is it a real bug or am I doing something wrong?
>>
>> See you very soon :)
>> Flavio
>>
>

Mime
View raw message