flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gyula Fora (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-1591) Remove window merge before flatten as an optimization
Date Fri, 20 Feb 2015 14:35:11 GMT
Gyula Fora created FLINK-1591:
---------------------------------

             Summary: Remove window merge before flatten as an optimization
                 Key: FLINK-1591
                 URL: https://issues.apache.org/jira/browse/FLINK-1591
             Project: Flink
          Issue Type: Improvement
          Components: Streaming
            Reporter: Gyula Fora


After a Window Reduce or Map transformation there is always a merge step when the transformation
was parallel or grouped.

This merge step should be removed when the windowing operator is followed by flatten to avoid
unnecessary bottlenecks in the program.

This feature should be added as an optimization step to the WindowingOptimizer class.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message