hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-3429) DataNode reads checksums even if client does not need them
Date Wed, 16 May 2012 06:12:16 GMT
Todd Lipcon created HDFS-3429:

             Summary: DataNode reads checksums even if client does not need them
                 Key: HDFS-3429
                 URL: https://issues.apache.org/jira/browse/HDFS-3429
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: data-node, performance
    Affects Versions: 2.0.0
            Reporter: Todd Lipcon

Currently, even if the client does not want to verify checksums, the datanode reads them anyway
and sends them over the wire. This means that performance improvements like HBase's application-level
checksums don't have much benefit when reading through the datanode, since the DN is still
causing seeks into the checksum file.

(Credit goes to Dhruba for discovering this - filing on his behalf)

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message