hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7632) MiniDFSCluster configures DataNode data directories incorrectly if using more than 1 DataNode and more than 2 storage locations per DataNode.
Date Sat, 17 Jan 2015 14:38:40 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14281375#comment-14281375
] 

Hudson commented on HDFS-7632:
------------------------------

FAILURE: Integrated in Hadoop-Hdfs-trunk #2008 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2008/])
HDFS-7632. MiniDFSCluster configures DataNode data directories incorrectly if using more than
1 DataNode and more than 2 storage locations per DataNode. Contributed by Chris Nauroth. (cnauroth:
rev ec4389cf7270cff4cc96313b4190422ea7c70ced)
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/shortcircuit/TestShortCircuitLocalRead.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestBlockReaderLocal.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDatanodeBlockScanner.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestMissingBlocksAlert.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestOverReplicatedBlocks.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestProcessCorruptBlocks.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestPendingCorruptDnMessages.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestReplication.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlocksWithNotEnoughRacks.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestCachingStrategy.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestScrLazyPersistFiles.java


> MiniDFSCluster configures DataNode data directories incorrectly if using more than 1
DataNode and more than 2 storage locations per DataNode.
> ---------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-7632
>                 URL: https://issues.apache.org/jira/browse/HDFS-7632
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: test
>            Reporter: Chris Nauroth
>            Assignee: Chris Nauroth
>             Fix For: 2.7.0
>
>         Attachments: HDFS-7632.001.patch
>
>
> {{MiniDFSCluster}} allows the caller to set the number of storage locations per DataNode.
 If this number is set higher than 2, and if the cluster is configured with more than 1 DataNode,
then the calculation of the storage directory paths will be incorrect.  Multiple DataNodes
will attempt to use the same storage directory, and one of them will fail while trying to
acquire the file lock.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message