hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abdul Navaz <navaz....@gmail.com>
Subject Where the output of mappers are saved ?
Date Fri, 12 Dec 2014 06:36:39 GMT
Hello,


I am interested in efficiently manage the Hadoop shuffling traffic and
utilize the network bandwidth effectively. To do this I want to know how
much shuffling traffic generated by each Datanodes ? Shuffling traffic is
nothing but the output of mappers. So where this mapper output is saved ?
How can i get the size of mapper output from each datanodes in a real time ?
Appreciate your help.

Thanks & Regards,

Abdul Navaz




Mime
View raw message