flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-1237) Add custom partitioners for shuffle steps
Date Mon, 17 Nov 2014 10:09:33 GMT

    [ https://issues.apache.org/jira/browse/FLINK-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14214481#comment-14214481

ASF GitHub Bot commented on FLINK-1237:

Github user fhueske commented on the pull request:

    Oh, yes. Sure.

> Add custom partitioners for shuffle steps
> -----------------------------------------
>                 Key: FLINK-1237
>                 URL: https://issues.apache.org/jira/browse/FLINK-1237
>             Project: Flink
>          Issue Type: Improvement
>            Reporter: Till Rohrmann
>            Assignee: Stephan Ewen
> It would be helpful to be able to specify a custom partitioner for shuffle steps. This
would users allow to control how their data is distributed across the cluster. Especially
in situations where the number of data records is equal to the number of slots it might be
a possibility to avoid skewed data distributions due to the default hashing function.

This message was sent by Atlassian JIRA

View raw message