hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From abhishek sharma <absha...@usc.edu>
Subject measuring the split reading time in Hadoop
Date Sun, 04 Apr 2010 03:11:28 GMT
Hi all,

I wanted to measure the time it takes to read input split for a map
task. For my cluster, I am interested in measuring the overhead of
fetching the input to a map task over the network as opposed to
reading from the local disk.

Is there an easy way to instrument some function to log this
information (say, in the TaskTracker logs)?


View raw message