hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9188) Make block corruption related tests FsDataset-agnostic.
Date Thu, 15 Oct 2015 08:42:05 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958515#comment-14958515
] 

Hudson commented on HDFS-9188:
------------------------------

FAILURE: Integrated in Hadoop-Hdfs-trunk #2436 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2436/])
HDFS-9188. Make block corruption related tests FsDataset-agnostic. (lei) (lei: rev c80b3a804f5222f95a266f84424af9cb9c229483)
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestFileAppend3.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestProcessCorruptBlocks.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestScrLazyPersistFiles.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestRBWBlockInvalidation.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestMissingBlocksAlert.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestOverReplicatedBlocks.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlocksWithNotEnoughRacks.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImplTestUtils.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/DataNodeTestUtils.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/FsDatasetImplTestUtilsFactory.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestClientReportBadBlock.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/FsDatasetTestUtils.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java


> Make block corruption related tests FsDataset-agnostic. 
> --------------------------------------------------------
>
>                 Key: HDFS-9188
>                 URL: https://issues.apache.org/jira/browse/HDFS-9188
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: HDFS, test
>    Affects Versions: 2.7.1
>            Reporter: Lei (Eddy) Xu
>            Assignee: Lei (Eddy) Xu
>             Fix For: 3.0.0, 2.8.0
>
>         Attachments: HDFS-9188.000.patch, HDFS-9188.001.patch, HDFS-9188.002.patch, HDFS-9188.003.patch,
HDFS-9188.004.patch, HDFS-9188.005.patch, HDFS-9188.006.patch
>
>
> Currently, HDFS does block corruption tests by directly accessing the files stored on
the storage directories, which assumes {{FsDatasetImpl}} is the dataset implementation. However,
with works like OZone (HDFS-7240) and HDFS-8679, there will be different FsDataset implementations.

> So we need a general way to run whitebox tests like corrupting blocks and crc files.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message