Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: neutral (athena.apache.org: local policy)
MIME-Version: 1.0
In-Reply-To: <50D99D23.9030902@gmail.com>
References: <50D99D23.9030902@gmail.com>
Date: Tue, 25 Dec 2012 22:30:23 -0800
Message-ID: 
 <CAAE8jddmWnCMtGtKi9-oY+Hud8nJDos3LcbjBzUyKXpyc_Z6XA@mail.gmail.com>
Subject: Re: Map Shuffle Bytes
From: Rishi Yadav <rishi@infoobjects.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=f46d04446909b68eea04d1bb9044

--f46d04446909b68eea04d1bb9044
Content-Type: text/plain; charset=ISO-8859-1

 Shuffled bytes go to reducers not mappers and the inbuilt counter for that
is "Reduce Shuffle Bytes".

I am not sure how you can implement user defined java counter here because
this phase is in between map and reduce.

Thanks and Regards,

Rishi Yadav

(o) 408.988.2000x113 ||  (f) 408.716.2726

InfoObjects Inc || http://www.infoobjects.com *(Big Data Solutions)*

*INC 500 Fastest growing company in 2012 || 2011*

*Best Place to work in Bay Area 2012 - *SF Business Times and the Silicon
Valley / San Jose Business Journal

2041 Mission College Boulevard, #280 || Santa Clara, CA 95054


On Tue, Dec 25, 2012 at 4:33 AM, Eduard Skaley <e.v.skaley@gmail.com> wrote:

> Hello guys,
>
> I need a counter for shuffled bytes to the mappers.
> Is there existing one or should I define one myself ?
> How can I implement such a counter?
>
> Thank you and happy Christmas time,
> Eduard
>

--f46d04446909b68eea04d1bb9044
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">=A0Shuffled bytes go to reducers not mappers and the inbui=
lt counter for that is &quot;Reduce Shuffle Bytes&quot;.=A0<div><br></div><=
div style>I am not sure how you can implement user defined java counter her=
e because this phase is in between map and reduce.</div>
</div><div class=3D"gmail_extra"><br clear=3D"all"><div>


<p><font size=3D"1">Thanks and Regards,</font></p><p><font size=3D"1">Rishi=
 Yadav</font></p><p></p><p><font size=3D"1" face=3D"&#39;arial narrow&#39;,=
 sans-serif">(o) 408.988.2000x113 || =A0(f) 408.716.2726</font></p><p></p>
<p><font size=3D"1" face=3D"&#39;arial narrow&#39;, sans-serif">InfoObjects=
 Inc ||=A0<a href=3D"http://www.infoobjects.com/" target=3D"_blank">http://=
www.infoobjects.com</a>=A0<b>(Big Data Solutions)</b></font></p><p><font si=
ze=3D"1" face=3D"&#39;arial narrow&#39;, sans-serif"><b>INC 500 Fastest gro=
wing company in 2012 || 2011</b></font></p>
<p><font size=3D"1"><b><font face=3D"&#39;arial narrow&#39;, sans-serif">Be=
st Place to work in Bay Area 2012 </font>-<font color=3D"#333333">=A0</font=
></b></font><span style=3D"background-color:rgb(255,255,255);line-height:20=
px"><font size=3D"1" color=3D"#333333" face=3D"&#39;arial narrow&#39;, sans=
-serif">SF Business Times and the Silicon Valley / San Jose Business Journa=
l</font></span></p>
<p><span style=3D"font-size:x-small"><font face=3D"&#39;arial narrow&#39;, =
sans-serif">2041 Mission College Boulevard, #280 ||=A0Santa Clara, CA 95054=
=A0</font></span></p><p><br></p><p></p></div>
<br><br><div class=3D"gmail_quote">On Tue, Dec 25, 2012 at 4:33 AM, Eduard =
Skaley <span dir=3D"ltr">&lt;<a href=3D"mailto:e.v.skaley@gmail.com" target=
=3D"_blank">e.v.skaley@gmail.com</a>&gt;</span> wrote:<br><blockquote class=
=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padd=
ing-left:1ex">
Hello guys,<br>
<br>
I need a counter for shuffled bytes to the mappers.<br>
Is there existing one or should I define one myself ?<br>
How can I implement such a counter?<br>
<br>
Thank you and happy Christmas time,<br>
Eduard<br>
</blockquote></div><br></div>

--f46d04446909b68eea04d1bb9044--