hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rekha Joshi <rekha...@yahoo-inc.com>
Subject Re: about the task statistics in the history directory
Date Fri, 12 Nov 2010 05:53:25 GMT
Hi Chengwei,

If it helps, reading the hadoop tutorial, the configuration files along with API JobHistory*
pages would provide you the main details.
For eg: http://hadoop.apache.org/common/docs/r0.20.2/api/org/apache/hadoop/mapred/JobHistory.MapAttempt.html
http://hadoop.apache.org/common/docs/r0.20.2/api/org/apache/hadoop/mapred/JobHistory.Keys.html

There is a typo on api - http://hadoop.apache.org/common/docs/r0.20.2/api/org/apache/hadoop/mapred/JobHistory
"JobHistory.ReduceAttempt <http://hadoop.apache.org/common/docs/r0.20.2/api/org/apache/hadoop/mapred/JobHistory.ReduceAttempt.html>
          Helper class for logging or reading back events related to start, finish or failure
of  a Map Attempt on a node."

It should be "Reduce" instead of "Map".Use your judgment. :)

Just an example that only code is gospel truth, api/document are guiding force.

Thanks & Regards,
/Rekha.

On 11/12/10 7:57 AM, "Wang, Chengwei" <wangcw@gatech.edu> wrote:

HI All,

I just wonder if there is any doc explaining the terms in the task statistics in the logs/history/
? For example 'SPLITS', 'MapAttempt'?

Thanks a lot for enlightening.

Regards
Chengwei



Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message