Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hdfs-issues@hadoop.apache.org
Date: Fri, 16 Jan 2015 18:21:36 +0000 (UTC)
From: "Chris Nauroth (JIRA)" <jira@apache.org>
To: hdfs-issues@hadoop.apache.org
Message-ID: <JIRA.12767939.1421388709000.103812.1421432496807@Atlassian.JIRA>
In-Reply-To: <JIRA.12767939.1421388709000@Atlassian.JIRA>
References: <JIRA.12767939.1421388709000@Atlassian.JIRA>
 <JIRA.12767939.1421388709966@arcas>
Subject: [jira] [Commented] (HDFS-7632) MiniDFSCluster configures DataNode
 data directories incorrectly if using more than 1 DataNode and more than 2
 storage locations per DataNode.
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HDFS-7632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280599#comment-14280599 ] 

Chris Nauroth commented on HDFS-7632:
-------------------------------------

Thank you for the review, Arpit.  The failure in {{TestFileTruncate}} is unrelated.  This appears to be a flaky test.

It turns out that branch-2 still has an old test suite, {{TestCorruptFilesJsp}}, which would fail to compile after this patch.  The test suite is obsolete since the removal of the jsp code, and it's actually failing right now.  I filed HDFS-7635 to remove it.  Arpit, would you mind reviewing that too?  I think it's pretty straightforward.  After that goes in, this patch will work fine for branch-2.


> MiniDFSCluster configures DataNode data directories incorrectly if using more than 1 DataNode and more than 2 storage locations per DataNode.
> ---------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-7632
>                 URL: https://issues.apache.org/jira/browse/HDFS-7632
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: test
>            Reporter: Chris Nauroth
>            Assignee: Chris Nauroth
>         Attachments: HDFS-7632.001.patch
>
>
> {{MiniDFSCluster}} allows the caller to set the number of storage locations per DataNode.  If this number is set higher than 2, and if the cluster is configured with more than 1 DataNode, then the calculation of the storage directory paths will be incorrect.  Multiple DataNodes will attempt to use the same storage directory, and one of them will fail while trying to acquire the file lock.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)