hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yi Liu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8014) Erasure Coding: local and remote block reader for coding work in DataNode
Date Fri, 24 Apr 2015 08:50:39 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510667#comment-14510667
] 

Yi Liu commented on HDFS-8014:
------------------------------

Hi Zhe, thanks for the discussion, as we discussed, I thought using {{actualGetFromOneDataNode}}
is OK. 
I am doing the real implementation for block recovery, and {{actualGetFromOneDataNode}} is
coupled a lot with {{DFSInputStream}} which actually uses the BlockReader, and currently it's
good to use {{BlockReader}} directly in the block recovery.  Also I don't construct DFSClient
instance which is a bit heavy.

> Erasure Coding: local and remote block reader for coding work in DataNode
> -------------------------------------------------------------------------
>
>                 Key: HDFS-8014
>                 URL: https://issues.apache.org/jira/browse/HDFS-8014
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Kai Zheng
>            Assignee: Zhe Zhang
>
> As a task of HDFS-7344 ECWorker, in either stripping or non-stripping erasure coding,
to perform encoding or decoding, we need first to be able to read locally or remotely data
blocks. This is to come up block reader facility in DataNode side. Better to think about the
similar work done in client side, so in future it's possible to unify the both.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message