hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "James Thomas (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-3528) Use native CRC32 in DFS write path
Date Fri, 20 Jun 2014 17:55:27 GMT

    [ https://issues.apache.org/jira/browse/HDFS-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14039098#comment-14039098

James Thomas commented on HDFS-3528:

Moved patch to DN subtask.

> Use native CRC32 in DFS write path
> ----------------------------------
>                 Key: HDFS-3528
>                 URL: https://issues.apache.org/jira/browse/HDFS-3528
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode, hdfs-client, performance
>    Affects Versions: 2.0.0-alpha
>            Reporter: Todd Lipcon
>            Assignee: James Thomas
> HDFS-2080 improved the CPU efficiency of the read path by using native SSE-enabled code
for CRC verification. Benchmarks of the write path show that it's often CPU bound by checksums
as well, so we should make the same improvement there.

This message was sent by Atlassian JIRA

View raw message