flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kostas (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-2319) Collect size limitation due to akka.
Date Sun, 05 Jul 2015 17:53:05 GMT
Kostas created FLINK-2319:
-----------------------------

             Summary: Collect size limitation due to akka.
                 Key: FLINK-2319
                 URL: https://issues.apache.org/jira/browse/FLINK-2319
             Project: Flink
          Issue Type: New Feature
          Components: JobManager, TaskManager
    Affects Versions: 0.10
            Reporter: Kostas


Each TaksManager keeps the results of a local task in a set of Accumulators. Upon termination
of the task, the Accumulators are sent back to the JobManager, who merges them, before sending
them back to the Client. 

To exchange the Accumulators and their content, akka is used. This limits the size of the
output of a task to no more than akka.framesize bytes. In other case, akka would drop the
message.

This ticket is to propose the removal of this limitation so that results can be of arbitrary
size.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message