hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhe Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-11514) Raw Erasure Coder API for concrete encoding and decoding
Date Wed, 28 Jan 2015 20:38:35 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14295813#comment-14295813
] 

Zhe Zhang commented on HADOOP-11514:
------------------------------------

bq. In fact whole ECChunk class itself is unnecessary in Common, as this is specific to 'striped'
design of the erasure encoding
bq. ECChunk can be converted 'ByteBuffer' before passing to encode()/decode() of RawEncoder/RawDecoder
in higher levels.
Good point. Conceptually, the EC code under Common should only focus on arithmetic calculations.
_Always converting to ByteBuffer_ is also a simple rule to follow before calling codec functions.

> Raw Erasure Coder API for concrete encoding and decoding
> --------------------------------------------------------
>
>                 Key: HADOOP-11514
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11514
>             Project: Hadoop Common
>          Issue Type: Sub-task
>    Affects Versions: HDFS-EC
>            Reporter: Kai Zheng
>            Assignee: Kai Zheng
>         Attachments: HDFS-7353-v1.patch, HDFS-7353-v2.patch, HDFS-7353-v3.patch, HDFS-7353-v4.patch,
HDFS-7353-v5.patch, HDFS-7353-v6.patch, HDFS-7353-v7.patch
>
>
> This is to abstract and define raw erasure coder API across different codes algorithms
like RS, XOR and etc. Such API can be implemented by utilizing various library support, such
as Intel ISA library and Jerasure library.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message