hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-939) No-sort optimization
Date Sat, 04 Aug 2007 07:27:53 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12517690

Arun C Murthy commented on HADOOP-939:


You can control key-partions using a custom partitioner: http://lucene.apache.org/hadoop/api/org/apache/hadoop/mapred/Partitioner.html

Does that help?

> No-sort optimization
> --------------------
>                 Key: HADOOP-939
>                 URL: https://issues.apache.org/jira/browse/HADOOP-939
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: mapred
>         Environment: all
>            Reporter: Doug Judd
> There should be a way to tell the mapred framework that the output of the map() phase
will already be sorted.  The Reduce phase can just merge the intermediate files together without

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message