hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alex Newman (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-1495) IllegalArgumentException in halfhfilereader#next
Date Tue, 09 Jun 2009 00:14:07 GMT

    [ https://issues.apache.org/jira/browse/HBASE-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12717494#action_12717494
] 

Alex Newman commented on HBASE-1495:
------------------------------------

try {
            block.position(block.position() + currKeyLen + currValueLen);
        } catch (IllegalArgumentException e){
            LOG.warn(e.getMessage());
            LOG.warn("block.position():"+block.position());
            LOG.warn("block.capacity():"+block.capacity());
            LOG.warn("block.String():"+block.toString());
            LOG.warn("block.array():"+block.array());
            LOG.warn("block.array().length:"+block.array().length);
            LOG.warn("currKeyLen:"+currKeyLen);
            LOG.warn("currValueLen:"+currValueLen);
        }
        if (block.remaining() <= 0) {

results in 

2009-06-08 17:45:48,706 WARN org.apache.hadoop.hbase.io.hfile.HFile: block.position():67551
2009-06-08 17:45:48,706 WARN org.apache.hadoop.hbase.io.hfile.HFile: block.capacity():67559
2009-06-08 17:45:48,706 WARN org.apache.hadoop.hbase.io.hfile.HFile: block.String():java.nio.HeapByteBuffer[pos=67551
lim=67551 cap=67559]
2009-06-08 17:45:48,706 WARN org.apache.hadoop.hbase.io.hfile.HFile: block.array():[B@77932b46
2009-06-08 17:45:48,706 WARN org.apache.hadoop.hbase.io.hfile.HFile: block.array().length:67559
2009-06-08 17:45:48,706 WARN org.apache.hadoop.hbase.io.hfile.HFile: currKeyLen:37
2009-06-08 17:45:48,706 WARN org.apache.hadoop.hbase.io.hfile.HFile: currValueLen:3557
2009-06-08 17:45:48,706 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2009-06-08 17:45:48,709 INFO org.apache.hadoop.hdfs.DFSClient: Could not obtain block blk_-8600012014215763562_6667788
from any node:  java.io.IOException: No live nodes contain current block
2009-06-08 17:45:51,714 INFO org.apache.hadoop.hdfs.DFSClient: Could not obtain block blk_-8600012014215763562_6667788
from any node:  java.io.IOException: No live nodes contain current block
2009-06-08 17:45:54,716 WARN org.apache.hadoop.hdfs.DFSClient: DFS Read: java.io.IOException:
Cannot open filename /hbase/t3/299987382/block/2277509959628818760
        at org.apache.hadoop.hdfs.DFSClient$DFSInputStream.openInfo(DFSClient.java:1444)
        at org.apache.hadoop.hdfs.DFSClient$DFSInputStream.chooseDataNode(DFSClient.java:1769)
        at org.apache.hadoop.hdfs.DFSClient$DFSInputStream.blockSeekTo(DFSClient.java:1585)
        at org.apache.hadoop.hdfs.DFSClient$DFSInputStream.read(DFSClient.java:1712)
        at java.io.DataInputStream.read(DataInputStream.java:132)
        at org.apache.hadoop.hbase.io.hfile.BoundedRangeFileInputStream.read(BoundedRangeFileInputStream.java:99)
        at org.apache.hadoop.io.compress.DecompressorStream.getCompressedData(DecompressorStream.java:96)
        at org.apache.hadoop.io.compress.DecompressorStream.decompress(DecompressorStream.java:86)
        at org.apache.hadoop.io.compress.DecompressorStream.read(DecompressorStream.java:74)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
        at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:100)
        at org.apache.hadoop.hbase.io.hfile.HFile$Reader.decompress(HFile.java:950)
        at org.apache.hadoop.hbase.io.hfile.HFile$Reader.readBlock(HFile.java:906)
        at org.apache.hadoop.hbase.io.hfile.HFile$Reader$Scanner.next(HFile.java:1093)
        at org.apache.hadoop.hbase.io.HalfHFileReader$1.next(HalfHFileReader.java:108)
        at org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:52)
        at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:79)
        at org.apache.hadoop.hbase.regionserver.MinorCompactingStoreScanner.next(MinorCompactingStoreScanner.java:101)
        at org.apache.hadoop.hbase.regionserver.Store.compact(Store.java:852)
        at org.apache.hadoop.hbase.regionserver.Store.compact(Store.java:717)
        at org.apache.hadoop.hbase.regionserver.HRegion.compactStores(HRegion.java:766)
        at org.apache.hadoop.hbase.regionserver.HRegion.compactStores(HRegion.java:723)
        at org.apache.hadoop.hbase.regionserver.CompactSplitThread.run(CompactSplitThread.java:105)

> IllegalArgumentException in halfhfilereader#next
> ------------------------------------------------
>
>                 Key: HBASE-1495
>                 URL: https://issues.apache.org/jira/browse/HBASE-1495
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: stack
>             Fix For: 0.20.0
>
>
> From posix4e up on IRC
> {code}
> #
> 2009-06-07 20:22:33,367 ERROR org.apache.hadoop.hbase.regionserver.CompactSplitThread:
Compaction failed for region t3,*******************,1244420117045
> #
> java.lang.IllegalArgumentException
> #
>         at java.nio.Buffer.position(Buffer.java:218)
> #
>         at org.apache.hadoop.hbase.io.hfile.HFile$Reader$Scanner.next(HFile.java:1072)
> #
>         at org.apache.hadoop.hbase.io.HalfHFileReader$1.next(HalfHFileReader.java:108)
> #
>         at org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:52)
> #
>         at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:79)
> #
>         at org.apache.hadoop.hbase.regionserver.MinorCompactingStoreScanner.next(MinorCompactingSto
> #
> reScanner.java:101)
> #
>         at org.apache.hadoop.hbase.regionserver.Store.compact(Store.java:849)
> #
>         at org.apache.hadoop.hbase.regionserver.Store.compact(Store.java:714)
> #
>         at org.apache.hadoop.hbase.regionserver.HRegion.compactStores(HRegion.java:766)
> #
>         at org.apache.hadoop.hbase.regionserver.HRegion.compactStores(HRegion.java:723)
> #
>         at org.apache.hadoop.hbase.regionserver.CompactSplitThread.run(CompactSplitThread.java:105)
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message