hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stack <st...@duboce.net>
Subject Re: support checksums in HBase block
Date Sat, 15 Sep 2012 20:30:54 GMT
On Sat, Sep 15, 2012 at 10:31 AM, jlei liu <liulei412@gmail.com> wrote:
> I use Hbase0.94.1 and  hadoop-0.20.2-cdh3u5.
> The Hbase0.94.1 write checksums in HBase block, so we don't need to read
> checksums from metadata file of block file. But I find the BlockSender
> still read checksums from metadata file of block file every time,

How are you figuring this?   That sounds like a regression.

In 0.94.x the default is that hbase.regionserver.checksum.verify is
true which should have hbase doing checksum verify on read rather than

>  so the
> Hbase0.94.1 can't decrease the iops, that is right? If that is right,
> should I set the  hbase.regionserver.checksum.verify property to false in
> order to  avoid the Hbase0.94.1 to verify th checksum?

It would be interesting flipping the switch.  If things went faster,
then for sure there is a regression.

View raw message