flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gabor Gevay (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-2540) LocalBufferPool.requestBuffer gets into infinite loop
Date Tue, 18 Aug 2015 09:44:45 GMT
Gabor Gevay created FLINK-2540:

             Summary: LocalBufferPool.requestBuffer gets into infinite loop
                 Key: FLINK-2540
                 URL: https://issues.apache.org/jira/browse/FLINK-2540
             Project: Flink
          Issue Type: Bug
            Reporter: Gabor Gevay

I'm trying to run a complicated computation that looks like this: [1].
One of the DataSource->Filter->Map chains finishes fine, but the other one freezes.
Debugging shows that it is spinning in the while loop in LocalBufferPool.requestBuffer.

askToRecycle is false. Both numberOfRequestedMemorySegments and currentPoolSize is 128, so
it never goes into that if either.

This is a stack trace: [2]

And here is the code, if you would like to run it: [3]. Unfortunately, I can't make it more
minimal, becuase if I remove some operators, the problem disappears. The class to start is
malom.Solver. (On first run, it calculates some lookuptables for a few minutes, and puts them
into /tmp/movegen)

[1] http://compalg.inf.elte.hu/~ggevay/flink/plan.txt
[2] http://compalg.inf.elte.hu/~ggevay/flink/stacktrace.txt
[3] https://github.com/ggevay/flink/tree/deadlock-malom

This message was sent by Atlassian JIRA

View raw message