hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8760) Erasure Coding: reuse BlockReader when reading the same block in pread
Date Wed, 30 Sep 2015 16:39:48 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937684#comment-14937684
] 

Hudson commented on HDFS-8760:
------------------------------

FAILURE: Integrated in Hadoop-Yarn-trunk #1203 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/1203/])
HDFS-8760. Erasure Coding: reuse BlockReader when reading the same block (jing9: rev f8f7a923b76abcd1d0242c15a536b20af1c1695e)
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/util/StripedBlockUtil.java
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/mover/Mover.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-EC-7285.txt
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSStripedInputStream.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestWriteReadStripedFile.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/StripedFileTestUtil.java
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java


> Erasure Coding: reuse BlockReader when reading the same block in pread
> ----------------------------------------------------------------------
>
>                 Key: HDFS-8760
>                 URL: https://issues.apache.org/jira/browse/HDFS-8760
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Jing Zhao
>            Assignee: Jing Zhao
>             Fix For: HDFS-7285
>
>         Attachments: HDFS-8760-HDFS-7285.001.patch, HDFS-8760.000.patch
>
>
> Currently in pread, we create a new block reader for each aligned stripe even though
these stripes belong to the same block. It's better to reuse them to avoid unnecessary block
reader creation overhead. This can also avoid reading from the same bad DataNode.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message