hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suhas Gogate (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-5936) MAP_OUTPUT_BYTES counter is not recorded in Job history log for Map only jobs
Date Thu, 28 May 2009 21:05:45 GMT
MAP_OUTPUT_BYTES counter is not recorded in Job history log for Map only jobs
-----------------------------------------------------------------------------

                 Key: HADOOP-5936
                 URL: https://issues.apache.org/jira/browse/HADOOP-5936
             Project: Hadoop Core
          Issue Type: Bug
          Components: mapred
    Affects Versions: 0.20.0
            Reporter: Suhas Gogate


Here is an example Map task entry in job history log, it has MAP_OUTPUT_RECORDS but no MAP_OUTPUT_BYTES

Task TASKID="task_200905250540_0578_m_000000" TASK_TYPE="MAP" TASK_STATUS="SUCCESS" FINISH_TIME="1243294056346"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(56630)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(28327)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(MAP_INPUT_RECORDS)(Map input records)(2681)][(SPILLED_RECORDS)(Spilled Records)(0)][(MAP_INPUT_BYTES)(Map
input bytes)(28327)][(MAP_OUTPUT_RECORDS)(Map output records)(2681)]}" .
MapAttempt TASK_TYPE="MAP" TASKID="task_200905250540_0578_m_000001" TASK_ATTEMPT_ID="attempt_200905250540_0578_m_000001_0"
START
_TIME="1243294026959" TRACKER_NAME="tracker_xxx1031\.xxxx\.com:localhost/127\.0\.0\.1:56939"
HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_200905250540_0578_m_000001" TASK_ATTEMPT_ID="attempt_200905250540_0578_m_000001_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1243294041638" HOSTNAME="/xx\.xx\.xx\.xxx/xxx1031\.xxxx\.com"
STATE_STRING="Records R/W\=2634/1" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(28316)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(28303)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(MAP_INPUT_RECORDS)(Map input records)(2634)][(SPILLED_RECORDS)(Spilled Records)(0)][(MAP_INPUT_BYTES)(Map
input bytes)(28303)][(MAP_OUTPUT_RECORDS)(Map output records)(2634)]}" .


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message