hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anoop Sam John (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-6798) HDFS always read checksum form meta file
Date Tue, 18 Sep 2012 04:39:07 GMT

    [ https://issues.apache.org/jira/browse/HBASE-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13457593#comment-13457593
] 

Anoop Sam John commented on HBASE-6798:
---------------------------------------

bq.I did not realize hbase checksumming was a local-reads only facility.

Stack - In HBase handled checksum we write the checksum info also into the HFile blocks and
do comparison once block data is fetched into RS. Does it related with only local reads? Pls
correct me if my understanding is wrong..
Here when we fetch data from HDFS I guess we were using diff APIs or so to tell HDFS not to
do the checksum check
                
> HDFS always read checksum form meta file
> ----------------------------------------
>
>                 Key: HBASE-6798
>                 URL: https://issues.apache.org/jira/browse/HBASE-6798
>             Project: HBase
>          Issue Type: Bug
>          Components: performance
>    Affects Versions: 0.94.0, 0.94.1
>            Reporter: LiuLei
>            Priority: Blocker
>
> I use hbase0.941 and hadoop-0.20.2-cdh3u5 version.
> The HBase support checksums in HBase block cache in HBASE-5074 jira.
> The  HBase  support checksums for decrease the iops of  HDFS, so that HDFS
> dont't need to read the checksum from meta file of block file.
> But in hadoop-0.20.2-cdh3u5 version, BlockSender still read the metadata file even if
the
>  hbase.regionserver.checksum.verify property is ture.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message