flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ufuk Celebi (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-1404) Trigger recycling of buffers held by historic intermediate result partitions
Date Wed, 14 Jan 2015 15:41:35 GMT
Ufuk Celebi created FLINK-1404:
----------------------------------

             Summary: Trigger recycling of buffers held by historic intermediate result partitions
                 Key: FLINK-1404
                 URL: https://issues.apache.org/jira/browse/FLINK-1404
             Project: Flink
          Issue Type: Improvement
          Components: Distributed Runtime
            Reporter: Ufuk Celebi
            Assignee: Ufuk Celebi


With blocking intermediate results (FLINK-1350) and proper partition state management (FLINK-1359)
it is necessary to allow the network buffer pool to request eviction of historic intermediate
results when not enough buffers are available. With the currently available pipelined intermediate
partitions this is not an issue, because buffer pools can be released as soon as a partition
is consumed.

We need to be able to trigger the recycling of buffers held by historic intermediate results
when not enough buffers are available for new local pools.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message