hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Varun Sharma (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-4960) Unnecessary .meta seeks even when skip checksum is true
Date Sun, 07 Jul 2013 16:35:49 GMT
Varun Sharma created HDFS-4960:

             Summary: Unnecessary .meta seeks even when skip checksum is true
                 Key: HDFS-4960
                 URL: https://issues.apache.org/jira/browse/HDFS-4960
             Project: Hadoop HDFS
          Issue Type: Improvement
    Affects Versions: 3.0.0, 2.1.0-beta
            Reporter: Varun Sharma

While attempting to benchmark an HBase + Hadoop 2.0 setup on SSDs, we found unnecessary seeks
into .meta files, each seek was a 7 byte read at the head of the file - this attempts to validate
the version #. Since the client is requesting no-checksum, we should not be needing to touch
the .meta file at all.

Since the purpose of skip checksum is to also avoid the performance penalty of the extra seek,
we should not be seeking into .meta if skip checksum is true

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message