hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8669) Erasure Coding: handle missing internal block locations in DFSStripedInputStream
Date Wed, 30 Sep 2015 17:48:08 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937972#comment-14937972
] 

Hudson commented on HDFS-8669:
------------------------------

FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #439 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/439/])
HDFS-8669. Erasure Coding: handle missing internal block locations in (jing9: rev b1e6429a6be382c93e894e46f63037819a5608a6)
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/StripedFileTestUtil.java
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSStripedInputStream.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestWriteReadStripedFile.java
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/BlockReader.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-EC-7285.txt
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/util/StripedBlockUtil.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestReadStripedFileWithMissingBlocks.java


> Erasure Coding: handle missing internal block locations in DFSStripedInputStream
> --------------------------------------------------------------------------------
>
>                 Key: HDFS-8669
>                 URL: https://issues.apache.org/jira/browse/HDFS-8669
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Jing Zhao
>            Assignee: Jing Zhao
>             Fix For: HDFS-7285
>
>         Attachments: HDFS-8669-HDFS-7285.001.patch, HDFS-8669.000.patch, HDFS-8669.001.patch
>
>
> Currently DFSStripedInputStream assumes we always have complete internal block location
information, i.e., we can always get all the DataNodes for a striped block group. In a lot
of scenarios the client cannot get complete block location info, e.g., some internal blocks
are missing and the NameNode has not finished the recovery yet. We should add functionality
to handle missing block locations in DFSStripedInputStream.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message