hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read
Date Thu, 08 Sep 2016 19:20:20 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15474757#comment-15474757
] 

Hudson commented on HDFS-8901:
------------------------------

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10410 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/10410/])
HDFS-8901. Use ByteBuffer in striping positional read. Contributed by (zhz: rev 401db4fc65140979fe7665983e36905e886df971)
* (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/util/StripedBlockUtil.java
* (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSStripedInputStream.java
* (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/util/TestStripedBlockUtil.java
* (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/DataChecksum.java
* (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSStripedInputStream.java
* (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java


> Use ByteBuffer in striping positional read
> ------------------------------------------
>
>                 Key: HDFS-8901
>                 URL: https://issues.apache.org/jira/browse/HDFS-8901
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: erasure-coding
>    Affects Versions: 3.0.0-alpha2
>            Reporter: Kai Zheng
>            Assignee: SammiChen
>             Fix For: 3.0.0-alpha2
>
>         Attachments: HDFS-8901-v10.patch, HDFS-8901-v17.patch, HDFS-8901-v18.patch, HDFS-8901-v19.patch,
HDFS-8901-v2.patch, HDFS-8901-v20.patch, HDFS-8901-v3.patch, HDFS-8901-v4.patch, HDFS-8901-v5.patch,
HDFS-8901-v6.patch, HDFS-8901-v7.patch, HDFS-8901-v8.patch, HDFS-8901-v9.patch, HDFS-8901.v11.patch,
HDFS-8901.v12.patch, HDFS-8901.v13.patch, HDFS-8901.v14.patch, HDFS-8901.v15.patch, HDFS-8901.v16.patch,
initial-poc.patch
>
>
> Native erasure coder prefers to direct ByteBuffer for performance consideration. To prepare
for it, this change uses ByteBuffer through the codes in implementing striping position read.
It will also fix avoiding unnecessary data copying between striping read chunk buffers and
decode input buffers.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message