hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "xieyeshan" <xieyes...@software.ict.ac.cn>
Subject Re: Re: How to use combiner in hadoop streaming
Date Thu, 20 Jan 2011 16:17:41 GMT

Hadoop 0.21.0's combiner could be cmd and it just solves my problem.Thank all of you.Thanks^_^



2011-01-21 



xieyeshan 



发件人: Koji Noguchi 
发送时间: 2011-01-19  03:48:31 
收件人: mapreduce-user@hadoop.apache.org 
抄送: 
主题: Re: How to use combiner in hadoop streaming 
 
(Bcc general@. This is for Hadoop project level announcements and
discussions. http://hadoop.apache.org/mailing_lists.html . Using
mapreduce-user@)
Yeshan, 
Which version of hadoop are you using?
Officially, combiner for non-java command was added in 0.21
https://issues.apache.org/jira/browse/HADOOP-4842
but I¹d bet some of those 0.20s have this backported.
Koji
On 1/18/11 12:06 AM, "Harsh J" <qwertymaniac@gmail.com> wrote:
> Right now, the Combiner has to be a Java Class. A command is
> unacceptable, as noted here:
> http://wiki.apache.org/hadoop/HadoopStreaming
> 
> On Tue, Jan 18, 2011 at 1:30 PM, xieyeshan <xieyeshan@software.ict.ac.cn>
> wrote:
>> hi,all
>> 
>>     I want to use combiner in hadoop streaming, but combiner is not the same
>> as mapper or reducer in streaming.How could I do this?
>>     Thanks!
>> 
>> 
>> Yours,
>> 
>> Yeshan Xie
>> 
>> 2011-01-18
>> 
>> 
>> 
>> xieyeshan
>> 
> 
> 
> 
> --
> Harsh J
> www.harshj.com
> 
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message