hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tony Wu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9282) Make data directory count and storage raw capacity related tests FsDataset-agnostic
Date Thu, 05 Nov 2015 16:05:27 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14991879#comment-14991879
] 

Tony Wu commented on HDFS-9282:
-------------------------------

The failed test {[TestDeleteRace}} is not relevant to the change. Also manually verified the
test passes on a Linux machine.

> Make data directory count and storage raw capacity related tests FsDataset-agnostic
> -----------------------------------------------------------------------------------
>
>                 Key: HDFS-9282
>                 URL: https://issues.apache.org/jira/browse/HDFS-9282
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: HDFS, test
>    Affects Versions: 2.7.1
>            Reporter: Tony Wu
>            Assignee: Tony Wu
>            Priority: Minor
>         Attachments: HDFS-9282.001.patch, HDFS-9282.002.patch, HDFS-9282.003.patch, HDFS-9282.004.patch
>
>
> DFSMiniCluster and several tests have hard coded assumption of the underlying storage
having 2 data directories (volumes). As HDFS-9188 pointed out, with new FsDataset implementations,
these hard coded assumption about number of data directories and raw capacities of storage
may change as well.
> We need to extend FsDatasetTestUtils to provide:
> * Number of data directories of underlying storage per DataNode
> * Raw storage capacity of underlying storage per DataNode.
> * Have MiniDFSCluster automatically pick up the correct values.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message