Return-Path: X-Original-To: apmail-flink-issues-archive@minotaur.apache.org Delivered-To: apmail-flink-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 307FBC06F for ; Mon, 17 Nov 2014 10:09:55 +0000 (UTC) Received: (qmail 44638 invoked by uid 500); 17 Nov 2014 10:09:55 -0000 Delivered-To: apmail-flink-issues-archive@flink.apache.org Received: (qmail 44602 invoked by uid 500); 17 Nov 2014 10:09:55 -0000 Mailing-List: contact issues-help@flink.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.incubator.apache.org Delivered-To: mailing list issues@flink.incubator.apache.org Received: (qmail 44592 invoked by uid 99); 17 Nov 2014 10:09:55 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Nov 2014 10:09:55 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Mon, 17 Nov 2014 10:09:54 +0000 Received: (qmail 44392 invoked by uid 99); 17 Nov 2014 10:09:33 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Nov 2014 10:09:33 +0000 Date: Mon, 17 Nov 2014 10:09:33 +0000 (UTC) From: "ASF GitHub Bot (JIRA)" To: issues@flink.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (FLINK-1237) Add custom partitioners for shuffle steps MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/FLINK-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14214481#comment-14214481 ] ASF GitHub Bot commented on FLINK-1237: --------------------------------------- Github user fhueske commented on the pull request: https://github.com/apache/incubator-flink/pull/207#issuecomment-63283090 Oh, yes. Sure. > Add custom partitioners for shuffle steps > ----------------------------------------- > > Key: FLINK-1237 > URL: https://issues.apache.org/jira/browse/FLINK-1237 > Project: Flink > Issue Type: Improvement > Reporter: Till Rohrmann > Assignee: Stephan Ewen > > It would be helpful to be able to specify a custom partitioner for shuffle steps. This would users allow to control how their data is distributed across the cluster. Especially in situations where the number of data records is equal to the number of slots it might be a possibility to avoid skewed data distributions due to the default hashing function. -- This message was sent by Atlassian JIRA (v6.3.4#6332)