hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sanjay Dahiya (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-263) task status should include timestamps for when a job transitions
Date Fri, 08 Sep 2006 11:41:24 GMT
     [ http://issues.apache.org/jira/browse/HADOOP-263?page=all ]

Sanjay Dahiya updated HADOOP-263:

    Attachment: Hadoop-263_2.patch

Here is an updated patch. 
Task finish time is now set to failed time in case task fails. If the task fails at task tracker
then failed time is set there and sent over to jobtracker. if the task tracker itself goes
down then job tracker sets the failed time to when it discovers task failed. 
A side effect is that in case a task starts and before it could send its first status, task
tracker dies, in that case the failed time will be recorded but task start time will not be
recorded as task tracker went down before it could report that. We rely on task tracker to
report the correct task launch time. Start/finish times for TIPs will be available in any

> task status should include timestamps for when a job transitions
> ----------------------------------------------------------------
>                 Key: HADOOP-263
>                 URL: http://issues.apache.org/jira/browse/HADOOP-263
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.2.1
>            Reporter: Owen O'Malley
>         Assigned To: Sanjay Dahiya
>             Fix For: 0.6.0
>         Attachments: Hadoop-263.patch, Hadoop-263_1.patch, Hadoop-263_2.patch, patch.txt,
patch.txt, patch.txt, patch.txt
> It would help users to understand what happened if the task status included information
about when the task transitioned:
> Map:
>    started
>    finished
> Reduce:
>    started
>    shuffle finished
>    sort finished
>    finished

This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message