hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raj V <rajv...@yahoo.com>
Subject Counters Question.
Date Fri, 29 Apr 2011 00:22:36 GMT
I am trying to understand the relationship,if any,  between HDFS_BYTES_READ and FILE_BYTES_READ.
Since HDFS is laid on top of the local file system is FILE_BYTES_READ include the bytes read
by HDFS_BYTES_READ.. For example in my word count program 
HDFS_BYTES_READ is 1,000,000,415,344 and FILE_BYTES_READ is 679,397,984,899. Does it mean
that  679,397,984,899 bytes were read by the data local map jobs or are the two counters
completely independent of each other?

Many thanks in advance.

Best regards,
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message