hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Li Bo (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-7679) EC encode/decode framework
Date Mon, 26 Jan 2015 11:24:35 GMT

     [ https://issues.apache.org/jira/browse/HDFS-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Li Bo updated HDFS-7679:
    Assignee: Li Bo

> EC encode/decode framework
> --------------------------
>                 Key: HDFS-7679
>                 URL: https://issues.apache.org/jira/browse/HDFS-7679
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Li Bo
>            Assignee: Li Bo
> EC tasks such as client striping write, encode replicated file to EC style,  transform
block layout from contiguous to striping, reconstruct some corrupt blocks, etc, have similar
behavior. They all read data from client/BlockGroup, encode/decode them, and write the results
to some datanodes. So we can use a unified framework to handle all these tasks. We can use
different BlockGroupReader, Coder(ECEncoder/ECDecoder) and BlockWriter to handle different
EC tasks.

This message was sent by Atlassian JIRA

View raw message