hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-2570) streaming jobs fail after HADOOP-2227
Date Fri, 11 Jan 2008 19:50:34 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-2570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12558087#action_12558087

Arun C Murthy commented on HADOOP-2570:

Sigh, this exception seems to stem from the fact that the LocalDirAllocator is not used to
create the *taskTracker/jobcache/<jobid>/work* directory at all. It is always created
in the same partition as the *taskTracker/jobcache/<jobid>/* directory.

This means LocalDirAllocator doesn't know about the *taskTracker/jobcache/<jobid>/work*
directory at all and hence the DiskErrorException.

> streaming jobs fail after HADOOP-2227
> -------------------------------------
>                 Key: HADOOP-2570
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2570
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>    Affects Versions: 0.15.2
>            Reporter: lohit vijayarenu
>            Assignee: Amareshwari Sri Ramadasu
>            Priority: Blocker
>             Fix For: 0.15.3
>         Attachments: patch-2570.txt
> HADOOP-2227 changes jobCacheDir. In streaming, jobCacheDir was constructed like this
> {code}
> File jobCacheDir = new File(currentDir.getParentFile().getParent(), "work");
> {code}
> We should change this to get it working. Referring to the changes made in HADOOP-2227,
I see that the APIs used in there to construct the path are not public. And hard coding the
path in streaming does not look good. thought?

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message