flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gyula Fora (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-2283) Make grouped reduce/fold/aggregations stateful using Partitioned state
Date Sat, 27 Jun 2015 17:37:04 GMT
Gyula Fora created FLINK-2283:
---------------------------------

             Summary: Make grouped reduce/fold/aggregations stateful using Partitioned state
                 Key: FLINK-2283
                 URL: https://issues.apache.org/jira/browse/FLINK-2283
             Project: Flink
          Issue Type: Improvement
          Components: Streaming
    Affects Versions: 0.10
            Reporter: Gyula Fora
            Priority: Minor


Currently the inner state of the grouped aggregations are not persisted as an operator state.


These operators should be reimplemented to use the newly introduced partitioned state abstractions
which will make them fault tolerant and scalable for the future.

A suggested implementation would be to use a stateful mapper to implement the desired behaviour.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message