hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Nauroth (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7632) MiniDFSCluster configures DataNode data directories incorrectly if using more than 1 DataNode and more than 2 storage locations per DataNode.
Date Fri, 16 Jan 2015 18:21:36 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280599#comment-14280599
] 

Chris Nauroth commented on HDFS-7632:
-------------------------------------

Thank you for the review, Arpit.  The failure in {{TestFileTruncate}} is unrelated.  This
appears to be a flaky test.

It turns out that branch-2 still has an old test suite, {{TestCorruptFilesJsp}}, which would
fail to compile after this patch.  The test suite is obsolete since the removal of the jsp
code, and it's actually failing right now.  I filed HDFS-7635 to remove it.  Arpit, would
you mind reviewing that too?  I think it's pretty straightforward.  After that goes in, this
patch will work fine for branch-2.


> MiniDFSCluster configures DataNode data directories incorrectly if using more than 1
DataNode and more than 2 storage locations per DataNode.
> ---------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-7632
>                 URL: https://issues.apache.org/jira/browse/HDFS-7632
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: test
>            Reporter: Chris Nauroth
>            Assignee: Chris Nauroth
>         Attachments: HDFS-7632.001.patch
>
>
> {{MiniDFSCluster}} allows the caller to set the number of storage locations per DataNode.
 If this number is set higher than 2, and if the cluster is configured with more than 1 DataNode,
then the calculation of the storage directory paths will be incorrect.  Multiple DataNodes
will attempt to use the same storage directory, and one of them will fail while trying to
acquire the file lock.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message