hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Amareshwari Sri Ramadasu <amar...@yahoo-inc.com>
Subject Re: Multiple file output
Date Wed, 06 Jan 2010 04:59:24 GMT
In branch 0.21, You can get the functionality of both org.apache.hadoop.mapred.lib.MultipleOutputs
and org.apache.hadop.mapred.lib.MultipleOutputFormat in org.apache.hadoop.mapreduce.lib.output.MultipleOutputs.
Please see MAPREDUCE-370 for more details.


On 1/5/10 5:56 PM, "松柳" <lamfeeling2@gmail.com> wrote:

I'm afraid you have to write it by yourself, since there are no equivalent
classes in new API.

2009/12/28 Huazhong Ning <ning@akiira.com>

> Hi all,
> I need your help on multiple file output. I have many big files and I hope
> the processing result of each file is outputted to a separate file. I know
> in the old Hadoop APIs, the class MultipleOutputFormat works for this
> propose. But I cannot find the same class in new APIs. Does anybody know in
> the new APIs how to solve this problem?
> Thanks a lot.
> Ning, Huazhong

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message