flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gyula Fora (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-1279) Change default partitioning setting for low parallelism stream sources from forward to distribute
Date Wed, 26 Nov 2014 00:03:12 GMT
Gyula Fora created FLINK-1279:
---------------------------------

             Summary: Change default partitioning setting for low parallelism stream sources
from forward to distribute
                 Key: FLINK-1279
                 URL: https://issues.apache.org/jira/browse/FLINK-1279
             Project: Flink
          Issue Type: Improvement
          Components: Streaming
            Reporter: Gyula Fora


The default partitioning setting for all operators including stream sources are forward at
the moment. 

In many cases sources have lower parallelism therefore the forward connection might cause
that only a subset of the operators will receive data.

Partitioning from source to the first operators should be changed to distribute data to all
parallel instances of the first operators, when the source parallelism is lower.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message