hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harsh J (Resolved) (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HADOOP-3386) the job directory of a failed task may stay forever on a tasktracker node
Date Thu, 29 Dec 2011 06:56:32 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-3386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Harsh J resolved HADOOP-3386.
-----------------------------

    Resolution: Cannot Reproduce

I'm not seeing failed task dirs flood my local directories during runtime. Possibly was fixed
long ago.
                
> the job directory of a failed task may stay forever on a tasktracker node
> -------------------------------------------------------------------------
>
>                 Key: HADOOP-3386
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3386
>             Project: Hadoop Common
>          Issue Type: Bug
>            Reporter: Zheng Shao
>
> See https://issues.apache.org/jira/browse/HADOOP-3370 for details of the problem.
> A tasktracker only cleans out the job dir when the job tracker sends a "KILLJOB" action
in the heartbeat response message.
> However, in a corner case, the job tracker will NOT send the "KILLJOB" action to the
task tracker. The case is when there is only failed tasks of this job on this task tracker;
no successful tasks of this job is on this task tracker.
> In this case, jobtracker.trackerToTaskMap will not contain an entry of this task tracker
to any tasks of this job. As a result, the job tracker will not send a KILLJOB action to the
task tracker.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message