hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amar Kamat (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5067) Failed/Killed attempts column in jobdetails.jsp does not show the number of failed/killed attempts correctly
Date Fri, 06 Feb 2009 08:07:59 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12671040#action_12671040
] 

Amar Kamat commented on HADOOP-5067:
------------------------------------

Looks like the problem is with 
{code}
boolean isPresent = this.activeTasks.remove(taskid) != null;
{code}
This check is made to avoid wrong/incorrect updates for stray attempts (attempts for which
there is no entry in the jobhistory). Consider a case where the attempt _start_ and _end_
lines are still in buffer when the jobtracker dies. In such a case the reducers might get
the map completion event but the restarted jobtracker might not know about the attempt. So
ideally any complaint about this map attempt should be ignored as the map will be re-executed.
The idea was to update only if the {{TaskInProgress}} knows about the attempt. May be we should
use {{tasks.keySet().contains()}} instead of  {{activeTasks.remove()}}. Thoughts?

> Failed/Killed attempts column in jobdetails.jsp does not show the number of failed/killed
attempts correctly
> ------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-5067
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5067
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.19.0
>            Reporter: Amareshwari Sriramadasu
>            Assignee: Amareshwari Sriramadasu
>             Fix For: 0.19.1, 0.20.0, 0.21.0
>
>
> I see one of the task failures when i see it from the taskdetails.jsp page, but  failed/killed
attempts column show it as zero.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message