flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ufuk Celebi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-2089) "Buffer recycled" IllegalStateException during cancelling
Date Mon, 24 Aug 2015 12:42:45 GMT

    [ https://issues.apache.org/jira/browse/FLINK-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14709191#comment-14709191
] 

Ufuk Celebi commented on FLINK-2089:
------------------------------------

Hey Min Jiang,

is it possible for you to build a custom version of Flink? I can only think of a situation
where this problem can arise, namely when there is another error in the execution. If you
can share the data and program, I can also test it myself.

{code}
git clone -b illegal-2089-master  --single-branch https://github.com/uce/flink.git
cd flink
mvn package -DskipTests
{code}

Then execute the program as before against this version.

> "Buffer recycled" IllegalStateException during cancelling
> ---------------------------------------------------------
>
>                 Key: FLINK-2089
>                 URL: https://issues.apache.org/jira/browse/FLINK-2089
>             Project: Flink
>          Issue Type: Bug
>          Components: Distributed Runtime
>    Affects Versions: master
>            Reporter: Ufuk Celebi
>            Assignee: Ufuk Celebi
>             Fix For: 0.9
>
>
> [~rmetzger] reported the following stack trace during cancelling of high parallelism
jobs:
> {code}
> Error: java.lang.IllegalStateException: Buffer has already been recycled.
> at org.apache.flink.shaded.com.google.common.base.Preconditions.checkState(Preconditions.java:173)
> at org.apache.flink.runtime.io.network.buffer.Buffer.ensureNotRecycled(Buffer.java:142)
> at org.apache.flink.runtime.io.network.buffer.Buffer.getMemorySegment(Buffer.java:78)
> at org.apache.flink.runtime.io.network.api.serialization.SpillingAdaptiveSpanningRecordDeserializer.setNextBuffer(SpillingAdaptiveSpanningRecordDeserializer.java:72)
> at org.apache.flink.runtime.io.network.api.reader.AbstractRecordReader.getNextRecord(AbstractRecordReader.java:80)
> at org.apache.flink.runtime.io.network.api.reader.MutableRecordReader.next(MutableRecordReader.java:34)
> at org.apache.flink.runtime.operators.util.ReaderIterator.next(ReaderIterator.java:73)
> at org.apache.flink.runtime.operators.MapDriver.run(MapDriver.java:96)
> at org.apache.flink.runtime.operators.RegularPactTask.run(RegularPactTask.java:496)
> at org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:362)
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559)
> at java.lang.Thread.run(Thread.java:745)
> {code}
> This looks like a concurrent buffer pool release/buffer usage error. I'm investing this
today.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message