hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sandy Ryza (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5367) Local jobs all use same local working directory
Date Thu, 18 Jul 2013 23:48:48 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713112#comment-13713112

Sandy Ryza commented on MAPREDUCE-5367:

Uploading a patch that adds the job ID to the local job dir.  As with MAPREDUCE-4278, it's
difficult to write a test for this, because it requires two separate LocalJobRunner processes
to reproduce the issue.  I've run the existing LocalJobRunner tests as well as run concurrent
jobs locally and verified that they use different directories.
> Local jobs all use same local working directory
> -----------------------------------------------
>                 Key: MAPREDUCE-5367
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5367
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>    Affects Versions: 1.2.0
>            Reporter: Sandy Ryza
>            Assignee: Sandy Ryza
>         Attachments: MAPREDUCE-5367-b1.patch
> This means that local jobs, even in different JVMs, can't run concurrently because they
might delete each other's files during work directory setup.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message