hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From YouPeng Yang <yypvsxf19870...@gmail.com>
Subject Re: Relations ship between HDFS_BYTE_READ and Map input bytes
Date Tue, 30 Apr 2013 10:33:38 GMT
Hi Pralabh
*   *
 1.The Map input bytes couter belongs to the MapReduce FrameWork. The
hadoop defintive explains that:
   The number of bytes of uncompressed input consumed by all the maps in the
   job. Incremented every time a record is read from a RecordReader and
passed
   to the map’s map() method by the framework.

 2.HDFS_BYTE_READ is the bulid in counter of the  HDFS filesystem :
   The number of bytes read by each filesystem by map and reduce tasks.





2013/4/29 Pralabh Kumar <pralabhkumar@gmail.com>

> Hi
>
> What's the relationship between HDFS_BYTE_READ and Map input bytes counter
> . Why can they be different for particular MR job.
>
> Thanks and Regards
>
>> Pralabh Kumar
>
>
>

Mime
View raw message