flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gyula Fora (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-2335) Rework iteration construction in StreamGraph
Date Thu, 09 Jul 2015 10:51:04 GMT
Gyula Fora created FLINK-2335:

             Summary: Rework iteration construction in StreamGraph
                 Key: FLINK-2335
                 URL: https://issues.apache.org/jira/browse/FLINK-2335
             Project: Flink
          Issue Type: Improvement
          Components: Streaming
            Reporter: Gyula Fora
            Assignee: Gyula Fora

Currently the nodes representing the extra sinks and sources are incrementally added to the
streamgraph when the user creates the iterative parts of the program.

This makes it difficult to enforce different partitioning schemes on the feedback edges and
also makes it virtually impossible to handle more iteration heads with different parallelism.

The actual nodes in the streamgraph for the iteration sinks/sources should only be created
when the program is finalized  after the user calls execute and before we create the jobgraph.

This message was sent by Atlassian JIRA

View raw message