hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kai Zheng (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-7679) Unifying erasure coder work, block reader and block writer across client and DataNode
Date Mon, 30 Mar 2015 11:43:53 GMT

     [ https://issues.apache.org/jira/browse/HDFS-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Kai Zheng updated HDFS-7679:
----------------------------
    Summary: Unifying erasure coder work, block reader and block writer across client and
DataNode  (was: EC encode/decode framework)

> Unifying erasure coder work, block reader and block writer across client and DataNode
> -------------------------------------------------------------------------------------
>
>                 Key: HDFS-7679
>                 URL: https://issues.apache.org/jira/browse/HDFS-7679
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Li Bo
>            Assignee: Li Bo
>         Attachments: ECEncodeDecodeFramework.patch
>
>
> EC tasks such as client striping write, encode replicated file to EC style,  transform
block layout from contiguous to striping, reconstruct some corrupt blocks, etc, have similar
behavior. They all read data from client/BlockGroup, encode/decode them, and write the results
to some datanodes. So we can use a unified framework to handle all these tasks. We can use
different BlockGroupReader, Coder(ECEncoder/ECDecoder) and BlockWriter to handle different
EC tasks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message