hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Rosenstrauch <dar...@darose.net>
Subject Re: Partitioning Reducer Output
Date Mon, 05 Apr 2010 14:35:04 GMT
On 04/02/2010 08:32 PM, rakesh kothari wrote:
>
> Hi,
>
> What's the best way to partition data generated from Reducer into multiple =
> directories in Hadoop 0.20.1. I was thinking of using MultipleTextOutputFor=
> mat but that's not backward compatible with other API's in this version of =
> hadoop.
>
> Thanks,
> -Rakesh 		 	   		

Use a partitioner?

http://hadoop.apache.org/common/docs/r0.20.1/api/org/apache/hadoop/mapreduce/Job.html#setPartitionerClass%28java.lang.Class%29

HTH,

DR

Mime
View raw message