Return-Path: 
 <hadoop-dev-return-27498-apmail-lucene-hadoop-dev-archive=lucene.apache.org@lucene.apache.org>
Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org
Received: (qmail 70575 invoked from network); 11 Jan 2008 19:50:56 -0000
Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2)
  by minotaur.apache.org with SMTP; 11 Jan 2008 19:50:56 -0000
Received: (qmail 500 invoked by uid 500); 11 Jan 2008 19:50:44 -0000
Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org
Received: (qmail 476 invoked by uid 500); 11 Jan 2008 19:50:44 -0000
Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:hadoop-dev-help@lucene.apache.org>
List-Unsubscribe: <mailto:hadoop-dev-unsubscribe@lucene.apache.org>
List-Post: <mailto:hadoop-dev@lucene.apache.org>
List-Id: <hadoop-dev.lucene.apache.org>
Reply-To: hadoop-dev@lucene.apache.org
Delivered-To: mailing list hadoop-dev@lucene.apache.org
Received: (qmail 467 invoked by uid 99); 11 Jan 2008 19:50:44 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Jan 2008 11:50:44 -0800
X-ASF-Spam-Status: No, hits=-100.0 required=10.0
	tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.4] (HELO brutus.apache.org) (140.211.11.4)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Jan 2008 19:50:28 +0000
Received: from brutus (localhost [127.0.0.1])
	by brutus.apache.org (Postfix) with ESMTP id 2F793714243
	for <hadoop-dev@lucene.apache.org>; Fri, 11 Jan 2008 11:50:34 -0800 (PST)
Message-ID: <13744591.1200081034191.JavaMail.jira@brutus>
Date: Fri, 11 Jan 2008 11:50:34 -0800 (PST)
From: "Arun C Murthy (JIRA)" <jira@apache.org>
To: hadoop-dev@lucene.apache.org
Subject: [jira] Commented: (HADOOP-2570) streaming jobs fail after
 HADOOP-2227
In-Reply-To: <17918362.1199922994044.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-Virus-Checked: Checked by ClamAV on apache.org


    [ https://issues.apache.org/jira/browse/HADOOP-2570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12558087#action_12558087 ] 

Arun C Murthy commented on HADOOP-2570:
---------------------------------------

Sigh, this exception seems to stem from the fact that the LocalDirAllocator is not used to create the *taskTracker/jobcache/<jobid>/work* directory at all. It is always created in the same partition as the *taskTracker/jobcache/<jobid>/* directory.

This means LocalDirAllocator doesn't know about the *taskTracker/jobcache/<jobid>/work* directory at all and hence the DiskErrorException.

> streaming jobs fail after HADOOP-2227
> -------------------------------------
>
>                 Key: HADOOP-2570
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2570
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>    Affects Versions: 0.15.2
>            Reporter: lohit vijayarenu
>            Assignee: Amareshwari Sri Ramadasu
>            Priority: Blocker
>             Fix For: 0.15.3
>
>         Attachments: patch-2570.txt
>
>
> HADOOP-2227 changes jobCacheDir. In streaming, jobCacheDir was constructed like this
> {code}
> File jobCacheDir = new File(currentDir.getParentFile().getParent(), "work");
> {code}
> We should change this to get it working. Referring to the changes made in HADOOP-2227, I see that the APIs used in there to construct the path are not public. And hard coding the path in streaming does not look good. thought?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.