Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 79996 invoked from network); 27 Feb 2009 11:31:47 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 27 Feb 2009 11:31:47 -0000 Received: (qmail 17493 invoked by uid 500); 27 Feb 2009 11:31:43 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 17467 invoked by uid 500); 27 Feb 2009 11:31:43 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 17456 invoked by uid 99); 27 Feb 2009 11:31:43 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 27 Feb 2009 03:31:43 -0800 X-ASF-Spam-Status: No, hits=-1996.0 required=10.0 tests=ALL_TRUSTED,URIBL_WS_SURBL X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 27 Feb 2009 11:31:34 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id A5D60234C4A8 for ; Fri, 27 Feb 2009 03:31:13 -0800 (PST) Message-ID: <2047775337.1235734273677.JavaMail.jira@brutus> Date: Fri, 27 Feb 2009 03:31:13 -0800 (PST) From: "Amareshwari Sriramadasu (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Commented: (HADOOP-5146) LocalDirAllocator misses files on the local filesystem In-Reply-To: <1409173029.1233283139565.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-5146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12677325#action_12677325 ] Amareshwari Sriramadasu commented on HADOOP-5146: ------------------------------------------------- I think -1 for core and contrib tests is due to downtime in the svn. I'm not able to view the testReport or even console output. Giri, can you please confirm? As I commented earlier All tests passed on my machine. > LocalDirAllocator misses files on the local filesystem > ------------------------------------------------------ > > Key: HADOOP-5146 > URL: https://issues.apache.org/jira/browse/HADOOP-5146 > Project: Hadoop Core > Issue Type: Bug > Components: mapred > Affects Versions: 0.20.0 > Reporter: Arun C Murthy > Assignee: Devaraj Das > Priority: Blocker > Fix For: 0.20.0 > > Attachments: 5146.patch, 5146.patch, 5146_20090204job.output.txt, localdirallocator.patch, localdirallocator.patch > > > For some reason the LocalDirAllocator.getLocaPathToRead doesn't find files which are present, extra logging shows: > {noformat} > 2009-01-30 06:43:32,312 INFO org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext: in ifExists, /grid/2/arunc/mapred-local/taskTracker/archive/xxx.yyy.com/tera/in/_partition.lst exists > 2009-01-30 06:43:32,389 WARN org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext: in getLocalPathToRead, taskTracker/archive/xxx.yyy.com/tera/in/_partition.lst doesn't exist > 2009-01-30 06:43:32,390 WARN org.apache.hadoop.mapred.TaskRunner: attempt_200901300512_0007_m_000055_0 Child Error > org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/archive/xx.yyy.com/tera/in/_partition.lst in any of the configured local directories > at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:388) > at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:138) > at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:172) > {noformat} -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.