hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-4771) KeyFieldBasedPartitioner not partitioning properly when configured
Date Mon, 05 Nov 2012 19:16:12 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13490838#comment-13490838

Jason Lowe commented on MAPREDUCE-4771:

The regression from 1.x occurs because KeyFieldBasedPartitioner implements Configurable and
JobConfigurable.  In 1.x it only implemented JobConfigurable, so it was only configured once.
> KeyFieldBasedPartitioner not partitioning properly when configured
> ------------------------------------------------------------------
>                 Key: MAPREDUCE-4771
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4771
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.3, 2.0.1-alpha
>            Reporter: Jason Lowe
>            Assignee: Jason Lowe
> Relative to Hadoop 0.20/1.x, KeyFieldBasedPartitioner is not distributing across partitions
properly when configured.  This is related to the double-configure issue as described in HADOOP-7425.
 KeyFieldBasedPartitioner is getting configured twice, and that ends up duplicating the keyspecs
and causing the keys to be hashed twice.
> KeyFieldBasedPartitioner should not duplicate keyspecs when configured twice.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message