hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harsh J (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-2632) Avoid calling the partitioner when the numReduceTasks is 1.
Date Thu, 30 Jun 2011 05:44:28 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Harsh J updated MAPREDUCE-2632:

    Hadoop Flags: [Incompatible change]

This would be an incompatible change since API users may always expect a partitioner logic
to get called despite reducer # settings, and the change may not even initialize it.

> Avoid calling the partitioner when the numReduceTasks is 1.
> -----------------------------------------------------------
>                 Key: MAPREDUCE-2632
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2632
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: tasktracker
>    Affects Versions: 0.23.0
>            Reporter: Ravi Teja Ch N V
> We can avoid the call to the partitioner when the number of reducers is 1.This will avoid
the unnecessary computations by the partitioner.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message