hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Nauroth (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-5405) Job recovery can fail if task log directory symlink from prior run still exists
Date Fri, 19 Jul 2013 19:00:48 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-5405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chris Nauroth updated MAPREDUCE-5405:
-------------------------------------

    Attachment: MAPREDUCE-5405.branch-1.1.patch

I'm attaching a patch that does the following:
# If the symlink exists before creating it, try to delete it.
# Clean up numerous file handle leaks in the test suite.
# Use unique job output directories in the test suite.
# Fix race condition around validating job cleanup (which runs asynchronously) in the test
suite.
With this patch, {{TestRecoveryManager}} passes consistently for me on both Mac and Windows.
                
> Job recovery can fail if task log directory symlink from prior run still exists
> -------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5405
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5405
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv1
>    Affects Versions: 1-win, 1.3.0
>            Reporter: Chris Nauroth
>            Assignee: Chris Nauroth
>         Attachments: MAPREDUCE-5405.branch-1.1.patch
>
>
> During recovery, the task attempt log dir symlink from the prior run might still exist.
 If it does, then the recovered attempt will fail while trying to create a symlink at that
path.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message