hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Li Bo (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-7679) EC encode/decode framework
Date Mon, 26 Jan 2015 11:23:34 GMT
Li Bo created HDFS-7679:

             Summary: EC encode/decode framework
                 Key: HDFS-7679
                 URL: https://issues.apache.org/jira/browse/HDFS-7679
             Project: Hadoop HDFS
          Issue Type: Sub-task
            Reporter: Li Bo

EC tasks such as client striping write, encode replicated file to EC style,  transform block
layout from contiguous to striping, reconstruct some corrupt blocks, etc, have similar behavior.
They all read data from client/BlockGroup, encode/decode them, and write the results to some
datanodes. So we can use a unified framework to handle all these tasks. We can use different
BlockGroupReader, Coder(ECEncoder/ECDecoder) and BlockWriter to handle different EC tasks.

This message was sent by Atlassian JIRA

View raw message