Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of justlooks@gmail.com
 designates 74.125.82.182 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAAoqQ5Ybq7zF_TEkQOaMA2hQynNQt03CWt9k4O3foHHH9H9XvQ@mail.gmail.com>
References: 
 <CAAoqQ5bg1SVYw1=04HWc4zRuEZgi9_+=JxMtp0mt08mvJgU-JQ@mail.gmail.com>
	<CAAoqQ5Ybq7zF_TEkQOaMA2hQynNQt03CWt9k4O3foHHH9H9XvQ@mail.gmail.com>
Date: Fri, 6 Dec 2013 11:31:55 +0800
Message-ID: 
 <CACeqxwST4Me_eVMS+jnEbqpgqNKV97QP5VNEd4Wh9UCH8meD=g@mail.gmail.com>
Subject: Re: Monitor network traffic in hadoop
From: ch huang <justlooks@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=089e012286caae60e704ecd54903

--089e012286caae60e704ecd54903
Content-Type: text/plain; charset=ISO-8859-1

hi, Abdul Navaz:
assign shuffle port in each NM using option "mapreduce.shuffle.port" in
mapred-site.xml,then
monitor this port use tcpdump or wireshark ,hope this info can help you

On Fri, Dec 6, 2013 at 11:22 AM, navaz <navaz.enc@gmail.com> wrote:

> Hello
>
> I am following the tutorial hadoop on single node cluster and I am able
> test word count program  map reduce. its working fine.
>
> I would like to know
> How to monitor when shuffle phase network traffic occurs via wireshark or
> someother means.
>
> Pls guide me.
>
> Thanks
> Abdul Navaz
> Graduate student
> On Dec 5, 2013 6:56 PM, "navaz" <navaz.enc@gmail.com> wrote:
>
>> Hello
>>
>> I am following the tutorial hadoop on single node cluster and I am able
>> test word count map reduce. its working fine.
>>
>> I would like to know
>> How to monitor when shuffle phase network traffic occurs via wireshark or
>> someother means.
>>
>> Pls guide me.
>>
>> Thanks
>> Abdul Navaz
>> Graduate student
>> University of Houston ,TX
>>
>

--089e012286caae60e704ecd54903
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div>hi, Abdul Navaz:<br></div>
<div>assign shuffle port in each NM using option=A0&quot;<a name=3D"mapredu=
ce.shuffle.port">mapreduce.shuffle.port</a>&quot;=A0in mapred-site.xml,then=
</div>
<div>monitor this port use tcpdump or wireshark ,hope this info can help yo=
u<br><br></div>
<div class=3D"gmail_quote">On Fri, Dec 6, 2013 at 11:22 AM, navaz <span dir=
=3D"ltr">&lt;<a href=3D"mailto:navaz.enc@gmail.com" target=3D"_blank">navaz=
.enc@gmail.com</a>&gt;</span> wrote:<br>
<blockquote style=3D"BORDER-LEFT:#ccc 1px solid;MARGIN:0px 0px 0px 0.8ex;PA=
DDING-LEFT:1ex" class=3D"gmail_quote">
<p dir=3D"ltr">Hello</p>
<p dir=3D"ltr">I am following the tutorial hadoop on single node cluster an=
d I am able test word count program=A0 map reduce. its working fine.</p>
<p dir=3D"ltr">I would like to know <br>How to monitor when shuffle phase n=
etwork traffic occurs via wireshark or someother means.</p>
<p dir=3D"ltr">Pls guide me.</p>
<p dir=3D"ltr">Thanks<br>Abdul Navaz<br>Graduate student<br></p>
<div class=3D"gmail_quote">On Dec 5, 2013 6:56 PM, &quot;navaz&quot; &lt;<a=
 href=3D"mailto:navaz.enc@gmail.com" target=3D"_blank">navaz.enc@gmail.com<=
/a>&gt; wrote:<br type=3D"attribution">
<blockquote style=3D"BORDER-LEFT:#ccc 1px solid;MARGIN:0px 0px 0px 0.8ex;PA=
DDING-LEFT:1ex" class=3D"gmail_quote">
<p dir=3D"ltr">Hello</p>
<p dir=3D"ltr">I am following the tutorial hadoop on single node cluster an=
d I am able test word count map reduce. its working fine.</p>
<p dir=3D"ltr">I would like to know <br>How to monitor when shuffle phase n=
etwork traffic occurs via wireshark or someother means. </p>
<p dir=3D"ltr">Pls guide me. </p>
<p dir=3D"ltr">Thanks<br>Abdul Navaz<br>Graduate student<br>University of H=
ouston ,TX</p></blockquote></div></blockquote></div><br>

--089e012286caae60e704ecd54903--