hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ch huang <justlo...@gmail.com>
Subject Re: Monitor network traffic in hadoop
Date Fri, 06 Dec 2013 03:31:55 GMT
hi, Abdul Navaz:
assign shuffle port in each NM using option "mapreduce.shuffle.port" in
mapred-site.xml,then
monitor this port use tcpdump or wireshark ,hope this info can help you

On Fri, Dec 6, 2013 at 11:22 AM, navaz <navaz.enc@gmail.com> wrote:

> Hello
>
> I am following the tutorial hadoop on single node cluster and I am able
> test word count program  map reduce. its working fine.
>
> I would like to know
> How to monitor when shuffle phase network traffic occurs via wireshark or
> someother means.
>
> Pls guide me.
>
> Thanks
> Abdul Navaz
> Graduate student
> On Dec 5, 2013 6:56 PM, "navaz" <navaz.enc@gmail.com> wrote:
>
>> Hello
>>
>> I am following the tutorial hadoop on single node cluster and I am able
>> test word count map reduce. its working fine.
>>
>> I would like to know
>> How to monitor when shuffle phase network traffic occurs via wireshark or
>> someother means.
>>
>> Pls guide me.
>>
>> Thanks
>> Abdul Navaz
>> Graduate student
>> University of Houston ,TX
>>
>

Mime
View raw message