hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Manuel de Ferran <manuel.defer...@gmail.com>
Subject NullPointerException while using HFile tool
Date Thu, 25 Oct 2012 07:50:11 GMT
Greetings,

on HBase 0.90.3, I faced something strange with the HFile tool :

It runs fine on most HFiles :
/opt/hbase/bin/hbase org.apache.hadoop.hbase.io.hfile.HFile -m -v -f
/hbase/endSession/1ca3357131f88a681d69097c37e9e818/meta/145140814060533270

Scanning -> /hbase/endSession/1ca3357131f88a681d69097c37e9e818/meta/145140814060533270
12/10/25 07:30:53 INFO util.NativeCodeLoader: Loaded the native-hadoop library
12/10/25 07:30:53 INFO zlib.ZlibFactory: Successfully loaded & initialized nativ
e-zlib library
12/10/25 07:30:53 INFO compress.CodecPool: Got brand-new compressor
12/10/25 07:30:53 INFO compress.CodecPool: Got brand-new decompressor
Scanned kv count -> 10560
Block index size as per heapsize: 1584
reader=/hbase/endSession/1ca3357131f88a681d69097c37e9e818/meta/145140814060533270,
compression=gz, inMemory=false,
firstKey=CF6D603314024291A654E26EEEBFB223/meta:imei/1350514978607/Put,
lastKey=D53FE25C1EAB48C3812E3DA36BE00771/meta:timestamp/1350483867302/Put,
avgKeyLen=54, avgValueLen=22, entries=10560, length=332427
fileinfoOffset=331129, dataIndexOffset=331414, dataIndexCount=14,
metaIndexOffset=0, metaIndexCount=0, totalBytes=897712,
entryCount=10560, version=1
Fileinfo:
MAJOR_COMPACTION_KEY = \x00
MAX_SEQ_ID_KEY = 8546108533
TIMERANGE = 1308494981621....1350534767544
hfile.AVG_KEY_LEN = 54
hfile.AVG_VALUE_LEN = 22
hfile.COMPARATOR = org.apache.hadoop.hbase.KeyValue$KeyComparator
hfile.LASTKEY = \x00 D53FE25C1EAB48C3812E3DA36BE00771\x04metatimestamp\x00\x00\x
01:o\x1Cv\xA6\x04
Could not get bloom data from meta block

But fails with an NPE on a couple :
Scanning -> /hbase/endSession/1ca3357131f88a681d69097c37e9e818/meta/3161479420247034516.9bfed875ece19b6ae11d797935eda98c
java.lang.NullPointerException
        at org.apache.hadoop.hdfs.DFSClient$DFSInputStream.readBuffer(DFSClient.java:2175)
        at org.apache.hadoop.hdfs.DFSClient$DFSInputStream.read(DFSClient.java:2227)
        at java.io.DataInputStream.readFully(DataInputStream.java:178)
        at java.io.DataInputStream.readFully(DataInputStream.java:152)
        at org.apache.hadoop.hbase.io.hfile.HFile$FixedFileTrailer.deserialize(HFile.java:1521)
        at org.apache.hadoop.hbase.io.hfile.HFile$Reader.readTrailer(HFile.java:885)
        at org.apache.hadoop.hbase.io.hfile.HFile$Reader.loadFileInfo(HFile.java:819)
        at org.apache.hadoop.hbase.io.hfile.HFile.main(HFile.java:1907)


I have the same problem for 2 other HFiles
3549998716962250246.9bfed875ece19b6ae11d797935eda98c and
7918385474221842009.9bfed875ece19b6ae11d797935eda98c

hadoop fs -lsr /hbase:
<SNIP>
/hbase/endSession/194b477bc8d6f073da3da038a08ed716/meta/1976253343823690736
/hbase/endSession/194b477bc8d6f073da3da038a08ed716/meta/4982620464093345138
/hbase/endSession/194b477bc8d6f073da3da038a08ed716/meta/8057496066832993718
/hbase/endSession/194b477bc8d6f073da3da038a08ed716/recovered.edits
/hbase/endSession/1ca3357131f88a681d69097c37e9e818
/hbase/endSession/1ca3357131f88a681d69097c37e9e818/.regioninfo
/hbase/endSession/1ca3357131f88a681d69097c37e9e818/.tmp
/hbase/endSession/1ca3357131f88a681d69097c37e9e818/data
/hbase/endSession/1ca3357131f88a681d69097c37e9e818/meta
/hbase/endSession/1ca3357131f88a681d69097c37e9e818/meta/145140814060533270
/hbase/endSession/1ca3357131f88a681d69097c37e9e818/meta/3161479420247034516.9bfed875ece19b6ae11d797935eda98c
/hbase/endSession/1ca3357131f88a681d69097c37e9e818/meta/3549998716962250246.9bfed875ece19b6ae11d797935eda98c
/hbase/endSession/1ca3357131f88a681d69097c37e9e818/meta/7918385474221842009.9bfed875ece19b6ae11d797935eda98c
/hbase/endSession/1ca3357131f88a681d69097c37e9e818/meta/8273804188489817380
/hbase/endSession/1ca3357131f88a681d69097c37e9e818/meta/87639549996503441
<SNIP>

Looks like daughter regions ?

Mime
View raw message