hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uma Maheswara Rao G (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-7344) [umbrella] Erasure Coding worker and support in DataNode
Date Sat, 18 Apr 2015 18:59:00 GMT

     [ https://issues.apache.org/jira/browse/HDFS-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Uma Maheswara Rao G updated HDFS-7344:
--------------------------------------
    Summary: [umbrella] Erasure Coding worker and support in DataNode  (was: [umbella] Erasure
Coding worker and support in DataNode)

> [umbrella] Erasure Coding worker and support in DataNode
> --------------------------------------------------------
>
>                 Key: HDFS-7344
>                 URL: https://issues.apache.org/jira/browse/HDFS-7344
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode
>            Reporter: Kai Zheng
>            Assignee: Li Bo
>         Attachments: ECWorker-design-v2.pdf, HDFS ECWorker Design.pdf, hdfs-ec-datanode.0108.zip,
hdfs-ec-datanode.0108.zip
>
>
> According to HDFS-7285 and the design, this handles DataNode side extension and related
support for Erasure Coding, and implements ECWorker. The handled use cases:
> * Converting replica blocks into stripping erasure coding blocks;
> * Converting replica blocks into non-stripping erasure coding blocks;
> * Recovering erased stripping erasure coding blocks;
> * Recovering erased non-stripping erasure coding blocks;
> * On-demand recovering serving client request for erased non-stripping erasure coding
blocks.
> It generally needs to restore BlockGroup and schema information from coding commands
from NameNode or other entities, and construct specific coding work to execute. The required
block reader, writer, either local or remote, encoder and decoder, will be implemented separately
as sub-tasks. 
> This JIRA will track all the linked sub-tasks, and is responsible for general discussions
and integration for ECWorker. It won't resolve until all the related tasks are done.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message