hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arun C Murthy <...@yahoo-inc.com>
Subject Re: Listing Hadoop Job History Statistics
Date Thu, 12 Aug 2010 04:52:24 GMT
Moving to mapreduce-user@, bcc general@.

There isn't a direct way. One possible option is just use the per-job  
job-history file which is on HDFS (See http://hadoop.apache.org/common/docs/r0.20.0/mapred_tutorial.html#Job+Submission+and+Monitoring

  for info on job-history).

Hope that helps.


On Aug 11, 2010, at 8:54 AM, Scott Whitecross wrote:

> Hi -
> What's the best way to list and query information on Hadoop job  
> histories?
> For example, I'd like to see the job names from the past week  
> against a
> Hadoop cluster I'm using.   I don't see an API call or a way through  
> the
> command line to pull the information.  Is the best way writing a quick
> script to process the job history files?
> Thanks.
> Scott

View raw message