hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Koji Noguchi <knogu...@yahoo-inc.com>
Subject Re: How to use combiner in hadoop streaming
Date Tue, 18 Jan 2011 19:47:55 GMT
(Bcc general@. This is for Hadoop project level announcements and
discussions. http://hadoop.apache.org/mailing_lists.html . Using
mapreduce-user@)

Yeshan, 

Which version of hadoop are you using?

Officially, combiner for non-java command was added in 0.21
https://issues.apache.org/jira/browse/HADOOP-4842

but I¹d bet some of those 0.20s have this backported.

Koji



On 1/18/11 12:06 AM, "Harsh J" <qwertymaniac@gmail.com> wrote:

> Right now, the Combiner has to be a Java Class. A command is
> unacceptable, as noted here:
> http://wiki.apache.org/hadoop/HadoopStreaming
> 
> On Tue, Jan 18, 2011 at 1:30 PM, xieyeshan <xieyeshan@software.ict.ac.cn>
> wrote:
>> hi,all
>> 
>>     I want to use combiner in hadoop streaming, but combiner is not the same
>> as mapper or reducer in streaming.How could I do this?
>>     Thanks!
>> 
>> 
>> Yours,
>> 
>> Yeshan Xie
>> 
>> 2011-01-18
>> 
>> 
>> 
>> xieyeshan
>> 
> 
> 
> 
> --
> Harsh J
> www.harshj.com
> 


Mime
View raw message