hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tom White (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-3607) Port missing new API mapreduce lib classes to 1.x
Date Thu, 29 Dec 2011 06:10:30 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-3607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Tom White updated MAPREDUCE-3607:

    Attachment: MAPREDUCE-3607.patch

Here's an initial patch which adds support (and tests) for the DB classes, CombineFileInputFormat,
KeyValueInputFormat, MultipleInputs, MultipleOutputs, and BinaryPartitioner.

This is a work in progress - I intend to add more classes.
> Port missing new API mapreduce lib classes to 1.x
> -------------------------------------------------
>                 Key: MAPREDUCE-3607
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3607
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: client
>    Affects Versions: 1.0.0
>            Reporter: Tom White
>            Assignee: Tom White
>         Attachments: MAPREDUCE-3607.patch
> There are a number of classes under mapreduce.lib that are not present in the 1.x series.
Including these would help users and downstream projects using the new MapReduce API migrate
to later versions of Hadoop in the future.
> A few examples of where this would help:
> * Sqoop uses mapreduce.lib.db.DBWritable and mapreduce.lib.input.CombineFileInputFormat
> * Mahout uses mapreduce.lib.output.MultipleOutputs (MAHOUT-822).
> * HBase has a backport of mapreduce.lib.partition.InputSampler and TotalOrderPartitioner
(in org.apache.hadoop.hbase.mapreduce.hadoopbackport) - it would be better if it used the
ones in Hadoop.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message