hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rishi Yadav <ri...@infoobjects.com>
Subject Re: Map Shuffle Bytes
Date Wed, 26 Dec 2012 06:30:23 GMT
 Shuffled bytes go to reducers not mappers and the inbuilt counter for that
is "Reduce Shuffle Bytes".

I am not sure how you can implement user defined java counter here because
this phase is in between map and reduce.

Thanks and Regards,

Rishi Yadav

(o) 408.988.2000x113 ||  (f) 408.716.2726

InfoObjects Inc || http://www.infoobjects.com *(Big Data Solutions)*

*INC 500 Fastest growing company in 2012 || 2011*

*Best Place to work in Bay Area 2012 - *SF Business Times and the Silicon
Valley / San Jose Business Journal

2041 Mission College Boulevard, #280 || Santa Clara, CA 95054




On Tue, Dec 25, 2012 at 4:33 AM, Eduard Skaley <e.v.skaley@gmail.com> wrote:

> Hello guys,
>
> I need a counter for shuffled bytes to the mappers.
> Is there existing one or should I define one myself ?
> How can I implement such a counter?
>
> Thank you and happy Christmas time,
> Eduard
>

Mime
View raw message