hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nathan Marz <nat...@rapleaf.com>
Subject HDFS bytes read job counters?
Date Wed, 18 Feb 2009 02:25:47 GMT

I'm seeing very odd numbers from the HDFS job tracker page. I have a  
job that operates over approximately 200 GB of data (209715200047  
bytes to be exact), and HDFS bytes read is 2,103,170,802,501 (2 TB).

The "Map input bytes" is set to "209,714,811,510", which is a correct  

The job only took 10 minutes to run, so there's no way that that much  
data was actually read. Anyone have any idea of what's going on here?

Nathan Marz

View raw message