Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7B86272AE for ; Thu, 29 Dec 2011 06:10:55 +0000 (UTC) Received: (qmail 90392 invoked by uid 500); 29 Dec 2011 06:10:55 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 90237 invoked by uid 500); 29 Dec 2011 06:10:54 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 90001 invoked by uid 99); 29 Dec 2011 06:10:52 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Dec 2011 06:10:52 +0000 X-ASF-Spam-Status: No, hits=-2001.3 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Dec 2011 06:10:51 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id BFDD612EBA1 for ; Thu, 29 Dec 2011 06:10:30 +0000 (UTC) Date: Thu, 29 Dec 2011 06:10:30 +0000 (UTC) From: "Tom White (Updated) (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: <965438130.50594.1325139030787.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1409452323.50575.1325138191904.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Updated] (MAPREDUCE-3607) Port missing new API mapreduce lib classes to 1.x MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-3607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated MAPREDUCE-3607: --------------------------------- Attachment: MAPREDUCE-3607.patch Here's an initial patch which adds support (and tests) for the DB classes, CombineFileInputFormat, KeyValueInputFormat, MultipleInputs, MultipleOutputs, and BinaryPartitioner. This is a work in progress - I intend to add more classes. > Port missing new API mapreduce lib classes to 1.x > ------------------------------------------------- > > Key: MAPREDUCE-3607 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-3607 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: client > Affects Versions: 1.0.0 > Reporter: Tom White > Assignee: Tom White > Attachments: MAPREDUCE-3607.patch > > > There are a number of classes under mapreduce.lib that are not present in the 1.x series. Including these would help users and downstream projects using the new MapReduce API migrate to later versions of Hadoop in the future. > A few examples of where this would help: > * Sqoop uses mapreduce.lib.db.DBWritable and mapreduce.lib.input.CombineFileInputFormat (SQOOP-384). > * Mahout uses mapreduce.lib.output.MultipleOutputs (MAHOUT-822). > * HBase has a backport of mapreduce.lib.partition.InputSampler and TotalOrderPartitioner (in org.apache.hadoop.hbase.mapreduce.hadoopbackport) - it would be better if it used the ones in Hadoop. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira