Return-Path: Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: (qmail 1853 invoked from network); 5 Apr 2010 14:35:36 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 5 Apr 2010 14:35:36 -0000 Received: (qmail 89009 invoked by uid 500); 5 Apr 2010 14:35:36 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 88980 invoked by uid 500); 5 Apr 2010 14:35:35 -0000 Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-user@hadoop.apache.org Delivered-To: mailing list mapreduce-user@hadoop.apache.org Received: (qmail 88972 invoked by uid 99); 5 Apr 2010 14:35:35 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 05 Apr 2010 14:35:35 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [208.97.132.5] (HELO homiemail-a38.g.dreamhost.com) (208.97.132.5) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 05 Apr 2010 14:35:26 +0000 Received: from darsys12 (cpe-66-108-142-190.nyc.res.rr.com [66.108.142.190]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by homiemail-a38.g.dreamhost.com (Postfix) with ESMTP id D91B3D5079 for ; Mon, 5 Apr 2010 07:35:04 -0700 (PDT) Received: from [10.1.0.2] by darsys12 with esmtp (Exim 4.71) (envelope-from ) id 1Nyne8-0000du-31 for mapreduce-user@hadoop.apache.org; Mon, 05 Apr 2010 10:51:24 -0400 Message-ID: <4BB9F518.6070003@darose.net> Date: Mon, 05 Apr 2010 10:35:04 -0400 From: David Rosenstrauch User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.1.9) Gecko/20100330 Shredder/3.0.4 MIME-Version: 1.0 To: mapreduce-user@hadoop.apache.org Subject: Re: Partitioning Reducer Output References: In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org On 04/02/2010 08:32 PM, rakesh kothari wrote: > > Hi, > > What's the best way to partition data generated from Reducer into multiple = > directories in Hadoop 0.20.1. I was thinking of using MultipleTextOutputFor= > mat but that's not backward compatible with other API's in this version of = > hadoop. > > Thanks, > -Rakesh Use a partitioner? http://hadoop.apache.org/common/docs/r0.20.1/api/org/apache/hadoop/mapreduce/Job.html#setPartitionerClass%28java.lang.Class%29 HTH, DR