hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhe Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8014) Erasure Coding: local and remote block reader for coding work in DataNode
Date Mon, 27 Apr 2015 04:49:38 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14513526#comment-14513526
] 

Zhe Zhang commented on HDFS-8014:
---------------------------------

Thanks Yi for sharing the insights. Directly using {{BlockReader}} actually sounds fine. The
main additional logic in {{actualGetFromOneDataNode}} is about retrying. We might need a different
retry logic anyway, since each internal block only has 1 replica (it doesn't make sense trying
to find another location). 

> Erasure Coding: local and remote block reader for coding work in DataNode
> -------------------------------------------------------------------------
>
>                 Key: HDFS-8014
>                 URL: https://issues.apache.org/jira/browse/HDFS-8014
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Kai Zheng
>            Assignee: Zhe Zhang
>
> As a task of HDFS-7344 ECWorker, in either stripping or non-stripping erasure coding,
to perform encoding or decoding, we need first to be able to read locally or remotely data
blocks. This is to come up block reader facility in DataNode side. Better to think about the
similar work done in client side, so in future it's possible to unify the both.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message