hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Start time, end time, and task tracker of individual tasks of a job
Date Tue, 20 Nov 2012 17:15:05 GMT
Hey Jeff,

Yes, we expose some information for each task completion event..

For Old API, use RunningJob, specifically:
http://hadoop.apache.org/docs/current/api/org/apache/hadoop/mapred/RunningJob.html#getTaskCompletionEvents(int)

For New API, use Job, specifically:
http://hadoop.apache.org/docs/current/api/org/apache/hadoop/mapreduce/Job.html#getTaskCompletionEvents(int)

On Tue, Nov 20, 2012 at 9:43 PM, Jeff LI <uniquejeff@gmail.com> wrote:
> Hello,
>
> Is there a way to obtain the information of each individual task of a
> map-reduce job, including start time, end time, which task tracker runs this
> task and so on?
>
> I know this information can be found through the web interface running on
> the jobtracter.  But is it possible to redirect the information to a nicely
> formatted log file for each job?
>
> By the way, I'm running hadoop 0.20.2-cdh3u5.
>
> Thanks advance for the help.
>
> Cheers
>
> Jeff
>



-- 
Harsh J

Mime
View raw message