hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Varun Sharma <va...@pinterest.com>
Subject Mysterious 7 byte reads from .meta files
Date Sat, 06 Jul 2013 00:25:53 GMT

We are running hbase with application level checksums turned on. We
basically have the following configuration:

dfs.client.read.shortcircuit.skip.checksum -> true
hbase.regionserver.checksum.verify -> true

We have shortcircuit reads enabled and have verified that its working -
only the HBase region server is accessing the disk. However, an strace on
the region server shows some mysterious 7 byte seeks on the .meta files
(which are also supposed to contain the checksum). We are running

Do 7 byte reads from .meta files ring a bell to someone's ears - I am not
totally sure if these are checksums or not and I also don't know enough
about hdfs ?


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message