hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravi Teja Ch N V (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2632) Avoid calling the partitioner when the numReduceTasks is 1.
Date Thu, 30 Jun 2011 05:44:28 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13057630#comment-13057630

Ravi Teja Ch N V commented on MAPREDUCE-2632:

The fix was missed in this case.

 public static <K extends WritableComparable<?>, V extends Writable>
      Writable getEntry(MapFile.Reader[] readers, 
      Partitioner<K, V> partitioner, K key, V value) throws IOException {
    int part = partitioner.getPartition(key, value, readers.length);
    return readers[part].get(key, value);

> Avoid calling the partitioner when the numReduceTasks is 1.
> -----------------------------------------------------------
>                 Key: MAPREDUCE-2632
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2632
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: tasktracker
>    Affects Versions: 0.23.0
>            Reporter: Ravi Teja Ch N V
> We can avoid the call to the partitioner when the number of reducers is 1.This will avoid
the unnecessary computations by the partitioner.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message