hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8619) Erasure Coding: revisit replica counting for striped blocks
Date Wed, 30 Sep 2015 17:25:36 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937919#comment-14937919
] 

Hudson commented on HDFS-8619:
------------------------------

FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #473 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/473/])
HDFS-8619. Erasure Coding: revisit replica counting for striped blocks. (yliu: rev f32d9a175837c5b6c3d008089e46475d27a0935c)
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestAddStripedBlocks.java
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfoContiguous.java
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfo.java
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlocksMap.java
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestReadStripedFileWithDecoding.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-EC-7285.txt
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfoStriped.java


> Erasure Coding: revisit replica counting for striped blocks
> -----------------------------------------------------------
>
>                 Key: HDFS-8619
>                 URL: https://issues.apache.org/jira/browse/HDFS-8619
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Jing Zhao
>            Assignee: Jing Zhao
>         Attachments: HDFS-8619-HDFS-7285.001.patch, HDFS-8619.000.patch
>
>
> Currently we use the same {{BlockManager#countNodes}} method for striped blocks, which
simply treat each internal block as a replica. However, for a striped block, we may have more
complicated scenario, e.g., we have multiple replicas of the first internal block while we
miss some other internal blocks. Using the current {{countNodes}} methods can lead to wrong
decision in these scenarios.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message