hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sonal Goyal <sonalgoy...@gmail.com>
Subject Re: return in map
Date Sun, 06 Dec 2009 15:03:25 GMT
Hi,

Maybe you could post your code/logic for doing this. One way would be to set
a flag once your criteria is met and emit keys based on the flag.

Thanks and Regards,
Sonal


2009/12/5 Gang Luo <lgpublic@yahoo.com.cn>

> Hi all,
> I got a tricky problem. I input a small file manually to do some filtering
> work on each line in map function. I check if the line satisfy the constrain
> then I output it, otherwise I return, without doing any other work below.
>
> For the map function will be called on each line, I think the logic is
> correct. But it doesn't work like this. If there are 5 line for a map task,
> and only the 2nd line satisfies the constrain, then the output will be line
> 2, 3, 4, and 5. If the 3rd line satisfies, then output will be line 3, 4, 5.
> It seems that once a map task meet the first satisfying line, the filter
> doesn't work for following lines.
>
> It is interesting problem. I am checking it now. I also hope someone could
> give me some ideas on this. Thanks.
>
>
> -Gang
>
>
>      ___________________________________________________________
>  好玩贺卡等你发,邮箱贺卡全新上线!
> http://card.mail.cn.yahoo.com/
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message