Return-Path: X-Original-To: apmail-tez-issues-archive@minotaur.apache.org Delivered-To: apmail-tez-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B0EDE10213 for ; Tue, 27 Aug 2013 21:14:18 +0000 (UTC) Received: (qmail 67344 invoked by uid 500); 27 Aug 2013 21:14:18 -0000 Delivered-To: apmail-tez-issues-archive@tez.apache.org Received: (qmail 67309 invoked by uid 500); 27 Aug 2013 21:14:18 -0000 Mailing-List: contact issues-help@tez.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@tez.incubator.apache.org Delivered-To: mailing list issues@tez.incubator.apache.org Received: (qmail 67302 invoked by uid 99); 27 Aug 2013 21:14:18 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Aug 2013 21:14:18 +0000 X-ASF-Spam-Status: No, hits=-2002.2 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Tue, 27 Aug 2013 21:14:16 +0000 Received: (qmail 66844 invoked by uid 99); 27 Aug 2013 21:13:54 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Aug 2013 21:13:54 +0000 Date: Tue, 27 Aug 2013 21:13:54 +0000 (UTC) From: "Achal Soni (JIRA)" To: issues@tez.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (TEZ-393) Handle custom partitioners MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/TEZ-393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13751734#comment-13751734 ] Achal Soni commented on TEZ-393: -------------------------------- I believe that when runtime parallelism is enabled, the reducers are picking up ranges of partitions to optimize sequential reads, so the range partitioning should still work. > Handle custom partitioners > -------------------------- > > Key: TEZ-393 > URL: https://issues.apache.org/jira/browse/TEZ-393 > Project: Apache Tez > Issue Type: Sub-task > Reporter: Rohini Palaniswamy > > With dynamic allocation of reducers, cases like range partitioning (for ORDER BY) need to be handled properly. Also many users have other custom partitioners. So might be good to have an option to turn of dynamic reducer allocation in case they don't work well with dynamic allocation. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira