flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Flavio Pompermaier <pomperma...@okkam.it>
Subject Re: Gelly EOFException
Date Thu, 16 Jul 2015 18:43:46 GMT
but isn't something that cause problem to have multiple vertices with the
same id?
On 16 Jul 2015 19:34, "Andra Lungu" <lungu.andra@gmail.com> wrote:

> For now, there is a validator that checks whether the vertex ids
> correspond to the target/src ids in the edges. If you want to check for
> vertex ID uniqueness, you'll have to implement your own custom validator...
> I know people with the same error outside Gelly, so I doubt that the lack
> of unique ids triggered the exception :)
>
> On Thu, Jul 16, 2015 at 6:14 PM, Flavio Pompermaier <pompermaier@okkam.it>
> wrote:
>
>> I thought a bit about this error..in my job I was generating multiple
>> vertices with the same id.
>> Could this cause such errors? Maybe there could be a check about such
>> situations in Gelly..
>>
>> On Tue, Jul 14, 2015 at 10:00 PM, Andra Lungu <lungu.andra@gmail.com>
>> wrote:
>>
>>> Hello,
>>>
>>> Sorry for the delay. The bug is not in Gelly, but is, as hinted in the
>>> exception and as can be seen in the logs, in Flink's Runtime. Mihail may
>>> actually be on to something. The bug is actually very similar to the one
>>> described in FLINK-1916.
>>>
>>> However, as can be seen in the discussion thread there, it's a bit
>>> difficult to fix it without some steps to reproduce. I unfortunately
>>> managed to reproduce it and have opened a Jira... FLINK-2360
>>> <https://issues.apache.org/jira/browse/FLINK-2360>. It's a similar
>>> delta iteration setting. Hope we can get some help with this.
>>>
>>> Thanks!
>>> Andra
>>>
>>> On Tue, Jul 14, 2015 at 2:12 PM, Mihail Vieru <
>>> vieru@informatik.hu-berlin.de> wrote:
>>>
>>>>  Hi,
>>>>
>>>> looks very similar to this bug:
>>>> https://issues.apache.org/jira/browse/FLINK-1916
>>>>
>>>> Best,
>>>> Mihail
>>>>
>>>>
>>>> On 14.07.2015 14:09, Andra Lungu wrote:
>>>>
>>>> Hi Flavio,
>>>>
>>>> Could you also show us a code snippet?
>>>>
>>>> On Tue, Jul 14, 2015 at 2:06 PM, Flavio Pompermaier <
>>>> pompermaier@okkam.it> wrote:
>>>>
>>>>> Hi to all,
>>>>> in my vertex centric iteration I get the following exception, am I
>>>>> doing something wrong or is it a bug of Gelly?
>>>>>
>>>>>  starting iteration [1]:  CoGroup (Messaging) (6/8)
>>>>> IterationHead(WorksetIteration (Vertex-centric iteration
>>>>> (test.gelly.functions.VUpdateFunction@1814786f
>>>>> | test.gelly.functions.VMessagingFunction@67eecbc2))) (4/8) switched
>>>>> to FAILED with exception.
>>>>> java.io.EOFException
>>>>>  at
>>>>> org.apache.flink.runtime.operators.hash.InMemoryPartition$WriteView.nextSegment(InMemoryPartition.java:333)
>>>>>  at
>>>>> org.apache.flink.runtime.memorymanager.AbstractPagedOutputView.advance(AbstractPagedOutputView.java:140)
>>>>>  at
>>>>> org.apache.flink.runtime.memorymanager.AbstractPagedOutputView.write(AbstractPagedOutputView.java:201)
>>>>>  at
>>>>> org.apache.flink.api.java.typeutils.runtime.DataOutputViewStream.write(DataOutputViewStream.java:39)
>>>>>  at com.esotericsoftware.kryo.io.Output.flush(Output.java:163)
>>>>>  at
>>>>> org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.serialize(KryoSerializer.java:187)
>>>>>  at
>>>>> org.apache.flink.api.java.typeutils.runtime.PojoSerializer.serialize(PojoSerializer.java:372)
>>>>>  at
>>>>> org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:116)
>>>>>  at
>>>>> org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:30)
>>>>>  at
>>>>> org.apache.flink.runtime.operators.hash.InMemoryPartition.appendRecord(InMemoryPartition.java:219)
>>>>>  at
>>>>> org.apache.flink.runtime.operators.hash.CompactingHashTable.insertOrReplaceRecord(CompactingHashTable.java:536)
>>>>>  at
>>>>> org.apache.flink.runtime.operators.hash.CompactingHashTable.buildTableWithUniqueKey(CompactingHashTable.java:347)
>>>>>  at
>>>>> org.apache.flink.runtime.iterative.task.IterationHeadPactTask.readInitialSolutionSet(IterationHeadPactTask.java:209)
>>>>>  at
>>>>> org.apache.flink.runtime.iterative.task.IterationHeadPactTask.run(IterationHeadPactTask.java:270)
>>>>>  at
>>>>> org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:362)
>>>>>  at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559)
>>>>>  at java.lang.Thread.run(Thread.java:745)
>>>>>
>>>>>
>>>>>  Best,
>>>>> Flavio
>>>>>
>>>>
>>>>
>>>>
>>>
>>
>>
>

Mime
View raw message