hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jing Zhao (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-7782) Erasure coding: pread from files in striped layout
Date Fri, 03 Apr 2015 06:06:54 GMT

     [ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jing Zhao updated HDFS-7782:
----------------------------
    Attachment: HDFS-7782.007.patch

So I just extended Zhe's 005 and 006 patch and tried to demo the idea that avoiding either
data copy or recreating BlockReader by extending the current {{actualGetFromOneDataNode}}
method.

Still need to add more tests and find/fix possible bugs. But please see if this way makes
sense in general.

> Erasure coding: pread from files in striped layout
> --------------------------------------------------
>
>                 Key: HDFS-7782
>                 URL: https://issues.apache.org/jira/browse/HDFS-7782
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Li Bo
>            Assignee: Zhe Zhang
>         Attachments: HDFS-7782-000.patch, HDFS-7782-001.patch, HDFS-7782-002.patch, HDFS-7782-003.patch,
HDFS-7782-004.patch, HDFS-7782-005.patch, HDFS-7782-006.patch, HDFS-7782.007.patch
>
>
> If client wants to read a file, he is not necessary to know and handle what layout the
file is. This sub task adds logic to DFSInputStream to support reading striping layout files.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message