hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tom White (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-4850) Job recovery may fail if staging directory has been deleted
Date Wed, 05 Dec 2012 16:16:59 GMT
Tom White created MAPREDUCE-4850:
------------------------------------

             Summary: Job recovery may fail if staging directory has been deleted
                 Key: MAPREDUCE-4850
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4850
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: mrv1
    Affects Versions: 1.1.1
            Reporter: Tom White
            Assignee: Tom White


The job staging directory is deleted in the job cleanup task, which happens before the job-info
file is deleted from the system directory (by the JobInProgress garbageCollect() method).
If the JT shuts down between these two operations, then when the JT restarts and tries to
recover the job, it fails since the job.xml and splits are no longer available.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message