hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jing Zhao (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-7782) Erasure coding: pread from files in striped layout
Date Fri, 03 Apr 2015 06:06:54 GMT

     [ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Jing Zhao updated HDFS-7782:
    Attachment: HDFS-7782.007.patch

So I just extended Zhe's 005 and 006 patch and tried to demo the idea that avoiding either
data copy or recreating BlockReader by extending the current {{actualGetFromOneDataNode}}

Still need to add more tests and find/fix possible bugs. But please see if this way makes
sense in general.

> Erasure coding: pread from files in striped layout
> --------------------------------------------------
>                 Key: HDFS-7782
>                 URL: https://issues.apache.org/jira/browse/HDFS-7782
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Li Bo
>            Assignee: Zhe Zhang
>         Attachments: HDFS-7782-000.patch, HDFS-7782-001.patch, HDFS-7782-002.patch, HDFS-7782-003.patch,
HDFS-7782-004.patch, HDFS-7782-005.patch, HDFS-7782-006.patch, HDFS-7782.007.patch
> If client wants to read a file, he is not necessary to know and handle what layout the
file is. This sub task adds logic to DFSInputStream to support reading striping layout files.

This message was sent by Atlassian JIRA

View raw message