hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-3528) Use native CRC32 in DFS write path
Date Tue, 12 Jun 2012 22:24:43 GMT
Todd Lipcon created HDFS-3528:

             Summary: Use native CRC32 in DFS write path
                 Key: HDFS-3528
                 URL: https://issues.apache.org/jira/browse/HDFS-3528
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: data-node, hdfs client, performance
    Affects Versions: 2.0.0-alpha
            Reporter: Todd Lipcon
            Assignee: Todd Lipcon

HDFS-2080 improved the CPU efficiency of the read path by using native SSE-enabled code for
CRC verification. Benchmarks of the write path show that it's often CPU bound by checksums
as well, so we should make the same improvement there.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message