hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhe Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7344) Erasure Coding worker and support in DataNode
Date Thu, 08 Jan 2015 17:26:35 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14269698#comment-14269698
] 

Zhe Zhang commented on HDFS-7344:
---------------------------------

Thanks Bo! 

Quick comment: as Andrew also pointed out in this [comment|https://issues.apache.org/jira/browse/HDFS-7337?focusedCommentId=14266816&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14266816],
let's use patch files instead of raw java/zip files.

> Erasure Coding worker and support in DataNode
> ---------------------------------------------
>
>                 Key: HDFS-7344
>                 URL: https://issues.apache.org/jira/browse/HDFS-7344
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode
>            Reporter: Kai Zheng
>            Assignee: Li Bo
>         Attachments: HDFS ECWorker Design.pdf, hdfs-ec-datanode.0108.zip, hdfs-ec-datanode.0108.zip
>
>
> According to HDFS-7285 and the design, this handles DataNode side extension and related
support for Erasure Coding, and implements ECWorker. It mainly covers the following aspects,
and separate tasks may be opened to handle each of them.
> * Process encoding work, calculating parity blocks as specified in block groups and codec
schema;
> * Process decoding work, recovering data blocks according to block groups and codec schema;
> * Handle client requests for passive recovery blocks data and serving data on demand
while reconstructing;
> * Write parity blocks according to storage policy.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message