hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-939) No-sort optimization
Date Sat, 04 Aug 2007 07:27:53 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12517690
] 

Arun C Murthy commented on HADOOP-939:
--------------------------------------

@Joydeep

You can control key-partions using a custom partitioner: http://lucene.apache.org/hadoop/api/org/apache/hadoop/mapred/Partitioner.html


Does that help?

> No-sort optimization
> --------------------
>
>                 Key: HADOOP-939
>                 URL: https://issues.apache.org/jira/browse/HADOOP-939
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: mapred
>         Environment: all
>            Reporter: Doug Judd
>
> There should be a way to tell the mapred framework that the output of the map() phase
will already be sorted.  The Reduce phase can just merge the intermediate files together without
sorting.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message