hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8005) Erasure Coding: simplify striped block recovery work computation and add tests
Date Wed, 30 Sep 2015 19:36:38 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938515#comment-14938515
] 

Hudson commented on HDFS-8005:
------------------------------

FAILURE: Integrated in Hadoop-Mapreduce-trunk #2408 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2408/])
HDFS-8005. Erasure Coding: simplify striped block recovery work (zhezhang: rev cd655ee817a3307bc1a1a119eb4266978ecd7fb2)
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestAddStripedBlocks.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestRecoverStripedBlocks.java
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestRecoverStripedBlocks.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockManager.java
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeDescriptor.java
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java


> Erasure Coding: simplify striped block recovery work computation and add tests
> ------------------------------------------------------------------------------
>
>                 Key: HDFS-8005
>                 URL: https://issues.apache.org/jira/browse/HDFS-8005
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Jing Zhao
>            Assignee: Jing Zhao
>             Fix For: HDFS-7285
>
>         Attachments: HDFS-8005.000.patch, HDFS-8005.000.patch, HDFS-8005.001.patch
>
>
> HDFS-7369 adds the functionality to distribute recovery work of striped blocks to datanodes.
There are still some pending issues:
> # In {{BlockManager#chooseSourceNode}}, a node is added into {{healthyIndices}} without
checking if its block is live and healthy
> # The test {{TestRecoverStripedBlcoks#testMissingStripedBlock}} has not tested striped
blocks because the file is created before setting the storage policy
> # In {{computeRecoveryWorkForBlocks}}, instead of using {{BlockCollection#isStriped}},
we'd better use {{BlockInfo#isStriped}}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message