hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-1786) Add method to support pre-partitioned data
Date Thu, 13 May 2010 03:34:42 GMT
Add method to support pre-partitioned data

                 Key: MAPREDUCE-1786
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1786
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: task
            Reporter: Owen O'Malley
            Assignee: Owen O'Malley

There are some applications where the map wants to partition the data itself. This happens
in Pipes, if the user has a C++ partitioner. It would make sense to support it in streaming
too. There is also use case where the Java partitioner needs the context object to update
counters, etc.

This jira is only about adding the method to the mapreduce Java API. The Pipes interface can
be updated in a follow up Jira.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message