From common-issues-return-38441-apmail-hadoop-common-issues-archive=hadoop.apache.org@hadoop.apache.org Thu Oct 11 23:03:04 2012 Return-Path: X-Original-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 93711D5E1 for ; Thu, 11 Oct 2012 23:03:04 +0000 (UTC) Received: (qmail 27473 invoked by uid 500); 11 Oct 2012 23:03:03 -0000 Delivered-To: apmail-hadoop-common-issues-archive@hadoop.apache.org Received: (qmail 27434 invoked by uid 500); 11 Oct 2012 23:03:03 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-issues@hadoop.apache.org Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 27394 invoked by uid 99); 11 Oct 2012 23:03:03 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Oct 2012 23:03:03 +0000 Date: Thu, 11 Oct 2012 23:03:03 +0000 (UTC) From: "Sanjay Radia (JIRA)" To: common-issues@hadoop.apache.org Message-ID: <882053943.33565.1349996583855.JavaMail.jiratomcat@arcas> In-Reply-To: <405409018.38924.1342049257031.JavaMail.jiratomcat@issues-vm> Subject: [jira] [Commented] (HADOOP-8589) ViewFs tests fail when tests and home dirs are nested MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HADOOP-8589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13474598#comment-13474598 ] Sanjay Radia commented on HADOOP-8589: -------------------------------------- I had missed this jira and recently fixed this in another jira (will I will close as a duplicate). This fixes the buig by linking the first component in tests and home dir (same as what others have suggested in this jira). It also fixes the tests when run via eclipse where the test dir is relative to wd - ie it sets up wd correctly for viewfs. I have cleaned up things so that all the set up is done in a single setup routing (one for viewFs and one viewFileSystem) As part of this testing I found another bug for homedir and chrootedfs - also fixed this. I have attached the patch here. > ViewFs tests fail when tests and home dirs are nested > ----------------------------------------------------- > > Key: HADOOP-8589 > URL: https://issues.apache.org/jira/browse/HADOOP-8589 > Project: Hadoop Common > Issue Type: Bug > Components: fs, test > Affects Versions: 0.23.1, 2.0.0-alpha > Reporter: Andrey Klochkov > Assignee: Andrey Klochkov > Attachments: HADOOP-8589.patch, HADOOP-8589.patch, hadoop-8589-sanjay.patch, HADOOP-8859.patch > > > TestFSMainOperationsLocalFileSystem fails in case when the test root directory is under the user's home directory, and the user's home dir is deeper than 2 levels from /. This happens with the default 1-node installation of Jenkins. > This is the failure log: > {code} > org.apache.hadoop.fs.FileAlreadyExistsException: Path /var already exists as dir; cannot create link here > at org.apache.hadoop.fs.viewfs.InodeTree.createLink(InodeTree.java:244) > at org.apache.hadoop.fs.viewfs.InodeTree.(InodeTree.java:334) > at org.apache.hadoop.fs.viewfs.ViewFileSystem$1.(ViewFileSystem.java:167) > at org.apache.hadoop.fs.viewfs.ViewFileSystem.initialize(ViewFileSystem.java:167) > at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2094) > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:79) > at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2128) > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2110) > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:290) > at org.apache.hadoop.fs.viewfs.ViewFileSystemTestSetup.setupForViewFileSystem(ViewFileSystemTestSetup.java:76) > at org.apache.hadoop.fs.viewfs.TestFSMainOperationsLocalFileSystem.setUp(TestFSMainOperationsLocalFileSystem.java:40) > ... > Standard Output > 2012-07-11 22:07:20,239 INFO mortbay.log (Slf4jLog.java:info(67)) - Home dir base /var/lib > {code} > The reason for the failure is that the code tries to mount links for both "/var" and "/var/lib", and it fails for the 2nd one as the "/var" is mounted already. > The fix was provided in HADOOP-8036 but later it was reverted in HADOOP-8129. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira