flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephan Ewen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-945) Iterations sometimes release memory prematurely
Date Thu, 07 Aug 2014 20:33:15 GMT

    [ https://issues.apache.org/jira/browse/FLINK-945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089788#comment-14089788
] 

Stephan Ewen commented on FLINK-945:
------------------------------------

I have a (prospective) fix for the bug in https://github.com/apache/incubator-flink/pull/91

> Iterations sometimes release memory prematurely
> -----------------------------------------------
>
>                 Key: FLINK-945
>                 URL: https://issues.apache.org/jira/browse/FLINK-945
>             Project: Flink
>          Issue Type: Bug
>          Components: Iterations, Local Runtime
>    Affects Versions: 0.6-incubating, pre-apache-0.5.2
>            Reporter: Stephan Ewen
>            Priority: Critical
>
> It seems that the iteration tail is sometimes releasing the memory prematurely, causing
still working operations to fail.
> {code}
> java.lang.NullPointerException
> 	at eu.stratosphere.core.memory.MemorySegment.put(MemorySegment.java:186)
> 	at eu.stratosphere.nephele.services.memorymanager.AbstractPagedOutputView.writeByte(AbstractPagedOutputView.java:214)
> 	at eu.stratosphere.nephele.services.memorymanager.AbstractPagedOutputView.write(AbstractPagedOutputView.java:167)
> 	at eu.stratosphere.types.Record.serialize(Record.java:1208)
> 	at eu.stratosphere.api.java.typeutils.runtime.record.RecordSerializer.serialize(RecordSerializer.java:79)
> 	at eu.stratosphere.api.java.typeutils.runtime.record.RecordSerializer.serialize(RecordSerializer.java:27)
> 	at eu.stratosphere.pact.runtime.iterative.io.WorksetUpdateOutputCollector.collect(WorksetUpdateOutputCollector.java:52)
> 	at eu.stratosphere.test.recordJobs.kmeans.KMeansBroadcast$RecomputeClusterCenter.reduce(KMeansBroadcast.java:255)
> 	at eu.stratosphere.pact.runtime.task.GroupReduceDriver.run(GroupReduceDriver.java:103)
> 	at eu.stratosphere.pact.runtime.task.RegularPactTask.run(RegularPactTask.java:505)
> 	at eu.stratosphere.pact.runtime.iterative.task.AbstractIterativePactTask.run(AbstractIterativePactTask.java:132)
> 	at eu.stratosphere.pact.runtime.iterative.task.IterationTailPactTask.run(IterationTailPactTask.java:100)
> 	at eu.stratosphere.pact.runtime.task.RegularPactTask.invoke(RegularPactTask.java:370)
> 	at eu.stratosphere.nephele.execution.RuntimeEnvironment.run(RuntimeEnvironment.java:284)
> 	at java.lang.Thread.run(Thread.java:744)
> {code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message