hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gang Luo <lgpub...@yahoo.com.cn>
Subject Re: Re: Re: map output not euqal to reduce input
Date Thu, 10 Dec 2009 23:02:00 GMT
In the mapper of this job, I get something I am interested in for each
line and then output all of them. So the number of map input records is
equal to the map output records. Actually, I am doing semi join in this
job. There is no failure during execution.

-Gang



----- 原始邮件 ----
发件人: Todd Lipcon <todd@cloudera.com>
收件人: common-user@hadoop.apache.org
发送日期: 2009/12/10 (周四) 4:43:52 下午
主   题: Re: Re: Re: map output not euqal to reduce input

On Thu, Dec 10, 2009 at 1:15 PM, Gang Luo <lgpublic@yahoo.com.cn> wrote:
> Hi Todd,
> I didn't change the partitioner, just use the default one. Will the default partitioner
cause the lost of the records?
>
> -Gang
>

Do the maps output data nondeterministically? Did you experience any
task failures in the run of the job?

-Todd



      ___________________________________________________________ 
  好玩贺卡等你发,邮箱贺卡全新上线! 
http://card.mail.cn.yahoo.com/

Mime
View raw message