flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-2283) Make grouped reduce/fold/aggregations stateful using Partitioned state
Date Mon, 21 Sep 2015 11:25:04 GMT

    [ https://issues.apache.org/jira/browse/FLINK-2283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14900523#comment-14900523

ASF GitHub Bot commented on FLINK-2283:

Github user gyfora commented on the pull request:

    I still think that we should use PartitionedOperatorStates here, that will also help in
case we start thinking about dynamic repartitioning. It's not hard to modify the tests so
that they use some partitioning info (so if it unit testable with local state it is unit testable
with partitioned state).

> Make grouped reduce/fold/aggregations stateful using Partitioned state
> ----------------------------------------------------------------------
>                 Key: FLINK-2283
>                 URL: https://issues.apache.org/jira/browse/FLINK-2283
>             Project: Flink
>          Issue Type: Improvement
>          Components: Streaming
>    Affects Versions: 0.10
>            Reporter: Gyula Fora
>            Assignee: Márton Balassi
>            Priority: Minor
> Currently the inner state of the grouped aggregations are not persisted as an operator
> These operators should be reimplemented to use the newly introduced partitioned state
abstractions which will make them fault tolerant and scalable for the future.
> A suggested implementation would be to use a stateful mapper to implement the desired

This message was sent by Atlassian JIRA

View raw message