tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Achal Soni (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (TEZ-393) Handle custom partitioners
Date Tue, 27 Aug 2013 21:13:54 GMT

    [ https://issues.apache.org/jira/browse/TEZ-393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13751734#comment-13751734
] 

Achal Soni commented on TEZ-393:
--------------------------------

I believe that when runtime parallelism is enabled, the reducers are picking up ranges of
partitions to optimize sequential reads, so the range partitioning should still work.
                
> Handle custom partitioners
> --------------------------
>
>                 Key: TEZ-393
>                 URL: https://issues.apache.org/jira/browse/TEZ-393
>             Project: Apache Tez
>          Issue Type: Sub-task
>            Reporter: Rohini Palaniswamy
>
>   With dynamic allocation of reducers, cases like range partitioning (for ORDER BY) need
to be handled properly. Also many users have other custom partitioners. So might be good to
have an option to turn of dynamic reducer allocation in case they don't work well with dynamic
allocation. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message