hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-4771) KeyFieldBasedPartitioner not partitioning properly when configured
Date Mon, 05 Nov 2012 19:16:12 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13490838#comment-13490838
] 

Jason Lowe commented on MAPREDUCE-4771:
---------------------------------------

The regression from 1.x occurs because KeyFieldBasedPartitioner implements Configurable and
JobConfigurable.  In 1.x it only implemented JobConfigurable, so it was only configured once.
                
> KeyFieldBasedPartitioner not partitioning properly when configured
> ------------------------------------------------------------------
>
>                 Key: MAPREDUCE-4771
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4771
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.3, 2.0.1-alpha
>            Reporter: Jason Lowe
>            Assignee: Jason Lowe
>
> Relative to Hadoop 0.20/1.x, KeyFieldBasedPartitioner is not distributing across partitions
properly when configured.  This is related to the double-configure issue as described in HADOOP-7425.
 KeyFieldBasedPartitioner is getting configured twice, and that ends up duplicating the keyspecs
and causing the keys to be hashed twice.
> KeyFieldBasedPartitioner should not duplicate keyspecs when configured twice.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message