hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alexandru Calin <alexandrucali...@gmail.com>
Subject [No Subject]
Date Tue, 30 Aug 2016 20:15:04 GMT

I want to measure the time taken to read/write from HDFS and feed data to
the mapper/reducer vs the actual map/reduce time for the WordCount example.
I have enabled HTrace
Zipkin, and I've got a bunch of execution times for the underlying function
calls (too many to post here).

How can I make sense of the tracing that I see in Zipkin to get the
information I need ? What would be the function calls that split the
desired time measurements that I am after? (before&after) mapper & reducer.

I have an lxc based cluster with Hadoop 2.6.0 ( 1 namenode + 3 datanodes ).

View raw message