hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Niels Basjes <Ni...@basjes.nl>
Subject Re: FILE_BYTES_WRITTEN and HDFS_BYTES_WRITTEN
Date Tue, 30 Nov 2010 20:43:33 GMT
For some parts of a task the system stores information on the local
(non-HDFS) file system of the node that is actually running the job.
That is the FILE_.. Stuff written to HDFS is the HDFS_...

HTH

2010/11/30  <psdc1978@gmail.com>:
> When an hadoop MapReduce example is executed, at the end of the example it's
> showed a table with all the information about the execution, like the number
> of Map and Reduce tasks executed, the number of bytes read and written.
>
> In this information it exists 2 fields FILE_BYTES_WRITTEN and
> HDFS_BYTES_WRITTEN. What's the difference between these 2 fields?
>
> Thanks,
> Pedro



-- 
Met vriendelijke groeten,

Niels Basjes

Mime
View raw message