hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kai Zheng (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-11540) Raw Reed-Solomon coder using Intel ISA-L library
Date Thu, 02 Apr 2015 09:01:53 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-11540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392409#comment-14392409
] 

Kai Zheng commented on HADOOP-11540:
------------------------------------

I had an initial patch for this. For the rather initial RS coder based on ISA-L, using the
benchmark test framework in HADOOP-11588, I got the following results, in my development machine.
The speed up is about 20X !  Will test it on serious servers.
{noformat}
Run encoding for JavaRSCoder takes: 12 seconds
Run decoding for JavaRSCoder takes: 12 seconds
Run encoding for ISARSCoder takes: 624 milliseconds
Run decoding for ISARSCoder takes: 737 milliseconds
{noformat}

> Raw Reed-Solomon coder using Intel ISA-L library
> ------------------------------------------------
>
>                 Key: HADOOP-11540
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11540
>             Project: Hadoop Common
>          Issue Type: Sub-task
>    Affects Versions: HDFS-7285
>            Reporter: Zhe Zhang
>            Assignee: Kai Zheng
>
> This is to provide RS codec implementation using Intel ISA-L library for encoding and
decoding.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message