Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B3537D77E for ; Tue, 11 Sep 2012 15:39:11 +0000 (UTC) Received: (qmail 81885 invoked by uid 500); 11 Sep 2012 15:39:09 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 81842 invoked by uid 500); 11 Sep 2012 15:39:09 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 81784 invoked by uid 99); 11 Sep 2012 15:39:09 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Sep 2012 15:39:09 +0000 Date: Wed, 12 Sep 2012 02:39:08 +1100 (NCT) From: "Tony Burton (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: <1848520708.63889.1347377949029.JavaMail.jiratomcat@arcas> In-Reply-To: <86497586.21537.1346408167753.JavaMail.jiratomcat@arcas> Subject: [jira] [Updated] (MAPREDUCE-4616) Improvement to MultipleOutputs javadocs MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-4616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Burton updated MAPREDUCE-4616: ----------------------------------- Status: Patch Available (was: Open) Documentation changes to describe how to use MultipleOutputs and LazyOutputFormat to mimic behaviour in the now-deprecated MultipleTextOutputFormat (and similar) > Improvement to MultipleOutputs javadocs > --------------------------------------- > > Key: MAPREDUCE-4616 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4616 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: documentation > Affects Versions: 1.0.3 > Reporter: Tony Burton > Priority: Minor > Labels: hadoop, mapreduce > Fix For: trunk > > Attachments: MAPREDUCE-4616.patch > > > In the new API, and using MultipleOutputs it is possible to segment output into directories by using MultipleOutputs.write(KEYOUT key, VALUEOUT value, String baseOutputPath) in the Reducer to determine the output directory, and by using LazyOutputFormat at the job-level config to suppress normal output [eg use LazyOutputFormat.setOutputFormatClass(job, TextOutputFormat.class); instead of job.setOutputFormatClass(TextOutputFormat.class);] > This recreates the functionality previously provided in the old API by using MultipleTextOutputFormat (etc) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira