hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Enis Soztutar (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-8323) Low hanging checksum improvements
Date Thu, 11 Apr 2013 00:59:15 GMT
Enis Soztutar created HBASE-8323:

             Summary: Low hanging checksum improvements
                 Key: HBASE-8323
                 URL: https://issues.apache.org/jira/browse/HBASE-8323
             Project: HBase
          Issue Type: Improvement
            Reporter: Enis Soztutar

Over at Hadoop land, [~tlipcon] had done some improvements for checksums, a native implementation
for CRC32C (HADOOP-7445) and bulk verify of checksums (HADOOP-7444). 

In HBase, we can do
 - Also develop a bulk verify API. Regardless of hbase.hstore.bytes.per.checksum we always
want to verify of the whole checksum for the hfile block.
 - Enable NativeCrc32 to be used as a checksum algo. It is not clear how much gain we can
expect over pure java CRC32. 

Though, longer term we should focus on convincing hdfs guys for inline checksums (HDFS-2699)

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message