hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9282) Make data directory count and storage raw capacity related tests FsDataset-agnostic
Date Thu, 05 Nov 2015 21:44:28 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992541#comment-14992541
] 

Hudson commented on HDFS-9282:
------------------------------

FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #632 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/632/])
HDFS-9282. Make data directory count and storage raw capacity related (lei: rev 46e78a7a1694407d176218c20cb7438ab1335490)
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/FsDatasetTestUtils.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/FsDatasetImplTestUtilsFactory.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMultipleRegistrations.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNamenodeCapacityReport.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImplTestUtils.java


> Make data directory count and storage raw capacity related tests FsDataset-agnostic
> -----------------------------------------------------------------------------------
>
>                 Key: HDFS-9282
>                 URL: https://issues.apache.org/jira/browse/HDFS-9282
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: HDFS, test
>    Affects Versions: 2.7.1
>            Reporter: Tony Wu
>            Assignee: Tony Wu
>            Priority: Minor
>             Fix For: 3.0.0, 2.8.0
>
>         Attachments: HDFS-9282.001.patch, HDFS-9282.002.patch, HDFS-9282.003.patch, HDFS-9282.004.patch
>
>
> DFSMiniCluster and several tests have hard coded assumption of the underlying storage
having 2 data directories (volumes). As HDFS-9188 pointed out, with new FsDataset implementations,
these hard coded assumption about number of data directories and raw capacities of storage
may change as well.
> We need to extend FsDatasetTestUtils to provide:
> * Number of data directories of underlying storage per DataNode
> * Raw storage capacity of underlying storage per DataNode.
> * Have MiniDFSCluster automatically pick up the correct values.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message