hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kai Zheng (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-7344) Erasure Coding worker and support in DataNode
Date Tue, 04 Nov 2014 06:43:34 GMT
Kai Zheng created HDFS-7344:

             Summary: Erasure Coding worker and support in DataNode
                 Key: HDFS-7344
                 URL: https://issues.apache.org/jira/browse/HDFS-7344
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: datanode
    Affects Versions: HDFS-EC
            Reporter: Kai Zheng
            Assignee: Kai Zheng

According to HDFS-7285 and the design, this handles DataNode side extension and related support
for Erasure Coding, and implements ECWorker. It mainly covers the following aspects, and separate
tasks may be opened to handle each of them.
* Process encoding work, calculating parity blocks as specified in block groups and codec
* Process decoding work, recovering data blocks according to block groups and codec schema;
* Handle client requests for passive recovery blocks data and serving data on demand while
* Write parity blocks according to storage policy.

This message was sent by Atlassian JIRA

View raw message