flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Till Rohrmann (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-1237) Add custom partitioners for shuffle steps
Date Wed, 12 Nov 2014 17:18:34 GMT
Till Rohrmann created FLINK-1237:
------------------------------------

             Summary: Add custom partitioners for shuffle steps
                 Key: FLINK-1237
                 URL: https://issues.apache.org/jira/browse/FLINK-1237
             Project: Flink
          Issue Type: Improvement
            Reporter: Till Rohrmann
            Assignee: Stephan Ewen


It would be helpful to be able to specify a custom partitioner for shuffle steps. This would
users allow to control how their data is distributed across the cluster. Especially in situations
where the number of data records is equal to the number of slots it might be a possibility
to avoid skewed data distributions due to the default hashing function.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message