hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhe Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7662) Erasure Coder API for encoding and decoding of block group
Date Tue, 27 Jan 2015 23:48:34 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14294423#comment-14294423

Zhe Zhang commented on HDFS-7662:

Thanks [~drankye]. Some high level comments:
# {{coder}} and {{rawcoder}} packages should be better named and placed.
#* I think the difference is that {{rawcoder}} works on packet, or chunk units, while {{coder}}
works with HDFS blocks and block groups. If that's the case, is it better to keep {{rawcoder}}
under hadoop common, and move {{coder}} to hdfs?
#* Maybe change {{coder}} to {{blockcoder}}?
# {{ECBlock}} class has no pointer to identify an HDFS block. How should the client / DN specify
what HDFS blocks to encode / decode?
# Could you post an example how to use the callback class under this JIRA?

> Erasure Coder API for encoding and decoding of block group
> ----------------------------------------------------------
>                 Key: HDFS-7662
>                 URL: https://issues.apache.org/jira/browse/HDFS-7662
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Kai Zheng
>            Assignee: Kai Zheng
>         Attachments: HDFS-7662-v1.patch
> This is to define ErasureCoder API for encoding and decoding of BlockGroup. Given a BlockGroup,
ErasureCoder extracts data chunks from the blocks and leverages RawErasureCoder defined in
HDFS-7353 to perform concrete encoding or decoding.

This message was sent by Atlassian JIRA

View raw message