hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kai Zheng (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.
Date Thu, 16 Jun 2016 12:14:05 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333655#comment-15333655
] 

Kai Zheng commented on HDFS-8668:
---------------------------------

Hi Liran,

As mentioned in the description, this family was to revisit all the buffers for erasure coding
computing and make all the places  use ByteBuffer and even direct ByteBuffer consistently
according to the used erasure coder. The main purpose is to improve the performance, particularly
for the native coders. Unfortunately we're slow to commit the native coder in HADOOP-11540,
so without that being in, quite a few issues after that like this family are pending here
to proceed. 

What cases do you meet to have this in for the release?

> Erasure Coding: revisit buffer used for encoding and decoding.
> --------------------------------------------------------------
>
>                 Key: HDFS-8668
>                 URL: https://issues.apache.org/jira/browse/HDFS-8668
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Yi Liu
>            Assignee: Kai Zheng
>         Attachments: HDFS-8668-v1.patch, HDFS-8668-v2.patch
>
>
> For encoding and decoding buffers, currently some places use java heap ByteBuffer,  some
use direct byteBUffer, and some use java byte array.  If the coder implementation is native,
we should use direct ByteBuffer. This jira is to  revisit all encoding/decoding buffers and
improve them.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message