hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From JAGANADH G <jagana...@gmail.com>
Subject Re: Working of combiner in hadoop
Date Fri, 04 Jul 2014 06:41:43 GMT
On Fri, Jul 4, 2014 at 10:59 AM, Chhaya Vishwakarma <
Chhaya.Vishwakarma@lntinfotech.com> wrote:

>  Hi,
>
>
>
> If have two map tasks running on one node , i have written combiner class
> also.
>
> Will combiner be called once for each map task or just once for both the
> map tasks
>
>
>
> Can i write a logic inside map which will work as combiner ? if yes will
> there be any side effect?
>
>
>
>
>

Hi Chaya,

Refer the following URLS
http://java.dzone.com/articles/designing-mapreduce-algorithms
http://isaacslavitt.com/2014/01/01/in-mapper-combiner-pattern-for-mapreduce/
http://alpinenow.com/blog/in-mapper-combiner/

Best regards
 --
**********************************
JAGANADH G
http://jaganadhg.in
*ILUGCBE*
http://ilugcbe.org.in

Mime
View raw message