hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Manish Sethi <manishse...@in.ibm.com>
Subject HBase with RawLocalFileSystem
Date Fri, 09 Dec 2011 19:53:19 GMT
Hi, 

I'm trying to run HBase 0.92 build #177 from Jenkins Server with 
RawLocalFileSystem in order to avoid checksum. I have added a property 
(fs.file.impl) in hbase-site.xml for this.
Writes go fine with this. However, during scans, occasionally, it passes 
through but most of the time it fails with following exception.

Please let me know, if I an missing something here.

Thanks,
Manish

java.io.IOException: Could not seek StoreFileScanner[HFileScanner for 
reader reader=<hfilepath>, ...]
        at 
org.apache.hadoop.hbase.regionserver.StoreFileScanner.reseek(StoreFileScanner.java:131)
        at 
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekExactly(StoreFileScanner.java:219)
        at 
org.apache.hadoop.hbase.regionserver.KeyValueHeap$SeekType$2.seek(KeyValueHeap.java:64)
        at 
org.apache.hadoop.hbase.regionserver.KeyValueHeap.generalizedSeek(KeyValueHeap.java:277)
        at 
org.apache.hadoop.hbase.regionserver.KeyValueHeap.seekExactly(KeyValueHeap.java:257)
        at 
org.apache.hadoop.hbase.regionserver.StoreScanner.reseek(StoreScanner.java:421)
        at 
org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:285)
        at 
org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:138)
        at 
org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:2936)
        at 
org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:2892)
        at 
org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:2909)
        at 
org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2121)
        at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
        at java.lang.reflect.Method.invoke(Unknown Source)
        at 
org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
        at 
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1325)
Caused by: java.io.IOException: Invalid HFile block magic:  assessm
        at 
org.apache.hadoop.hbase.io.hfile.BlockType.parse(BlockType.java:110)
        at 
org.apache.hadoop.hbase.io.hfile.BlockType.read(BlockType.java:121)
        at 
org.apache.hadoop.hbase.io.hfile.HFileBlock.<init>(HFileBlock.java:167)
        at 
org.apache.hadoop.hbase.io.hfile.HFileBlock.<init>(HFileBlock.java:76)
        at 
org.apache.hadoop.hbase.io.hfile.HFileBlock$FSReaderV2.readBlockData(HFileBlock.java:1324)
        at 
org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:269)
        at 
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.readNextDataBlock(HFileReaderV2.java:454)
        at 
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:418)
        at 
org.apache.hadoop.hbase.regionserver.StoreFileScanner.reseekAtOrAfter(StoreFileScanner.java:200)
        at 
org.apache.hadoop.hbase.regionserver.StoreFileScanner.reseek(StoreFileScanner.java:124)
        ... 16 more
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message