hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Mawata <chris.maw...@gmail.com>
Subject Re: Working of combiner in hadoop
Date Fri, 04 Jul 2014 06:00:08 GMT
The key/value pairs are processes by the mapper independently of each
other. The combiner logic deals with all the outputs from multiple
key/value pairs do that logic can not be in the map method.
 On Jul 4, 2014 1:29 AM, "Chhaya Vishwakarma" <
Chhaya.Vishwakarma@lntinfotech.com> wrote:

>  Hi,
>
>
>
> If have two map tasks running on one node , i have written combiner class
> also.
>
> Will combiner be called once for each map task or just once for both the
> map tasks
>
>
>
> Can i write a logic inside map which will work as combiner ? if yes will
> there be any side effect?
>
>
>
> Regards,
>
> Chhaya Vishwakarma
>
>
>
> ------------------------------
> The contents of this e-mail and any attachment(s) may contain confidential
> or privileged information for the intended recipient(s). Unintended
> recipients are prohibited from taking action on the basis of information in
> this e-mail and using or disseminating the information, and must notify the
> sender and delete it from their system. L&T Infotech will not accept
> responsibility or liability for the accuracy or completeness of, or the
> presence of any virus or disabling code in this e-mail"
>

Mime
View raw message