Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hbase-dev@hadoop.apache.org
Message-ID: <1813751919.1244870467338.JavaMail.jira@brutus>
Date: Fri, 12 Jun 2009 22:21:07 -0700 (PDT)
From: "stack (JIRA)" <jira@apache.org>
To: hbase-dev@hadoop.apache.org
Subject: [jira] Commented: (HBASE-1495) IllegalArgumentException in
 halfhfilereader#next
In-Reply-To: <442716859.1244475607655.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HBASE-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719084#action_12719084 ] 

stack commented on HBASE-1495:
------------------------------

Here is example from logs of item 1. that would seem to indicate the issue is in Scanners.  I've instrumented meta scanner so that on each next, I print out what was found.  Immediately, I do a get on the row and I print that too.  Usually the two match.  When they don't is when I have issue:

{code}
  794 2009-06-12 22:41:18,377 [RegionManager.metaScanner] INFO org.apache.hadoop.hbase.master.BaseScanner: REMOVE NEXT VALUES keyvalues={TestTable,,1244846310969/info:regioninfo/1244846397895/Put/vlen=277, TestTable,,1244846310969/info:server/1244846319501/Put/vle      n=19, TestTable,,1244846310969/info:serverstartcode/1244846319501/Put/vlen=8, TestTable,,1244846310969/info:splitA/1244846397895/Put/vlen=277, TestTable,,1244846310969/info:splitB/1244846397895/Put/vlen=297}
  795 2009-06-12 22:41:18,379 [RegionManager.metaScanner] INFO org.apache.hadoop.hbase.master.BaseScanner: REMOVE GET keyvalues={TestTable,,1244846310969/historian:assignment/1244846315138/Put/vlen=71, TestTable,,1244846310969/historian:compaction/1244846393353/Pu      t/vlen=36, TestTable,,1244846310969/historian:open/1244846319510/Put/vlen=51, TestTable,,1244846310969/historian:split/1244846312701/Put/vlen=43, TestTable,,1244846310969/info:regioninfo/1244846397895/Put/vlen=277, TestTable,,1244846310969/info:server/124484      6319501/Put/vlen=19, TestTable,,1244846310969/info:serverstartcode/1244846319501/Put/vlen=8, TestTable,,1244846310969/info:splitA/1244846397895/Put/vlen=277, TestTable,,1244846310969/info:splitB/1244846397895/Put/vlen=297}
{code}

When above scan finishes, is when we remove splitA.  On next meta scan, I see this:

{code}
  840 2009-06-12 22:41:28,390 [RegionManager.metaScanner] INFO org.apache.hadoop.hbase.master.BaseScanner: REMOVE NEXT VALUES keyvalues={TestTable,,1244846310969/info:regioninfo/1244846397895/Put/vlen=277, TestTable,,1244846310969/info:server/1244846319501/Put/vle      n=19, TestTable,,1244846310969/info:serverstartcode/1244846319501/Put/vlen=8}
  841 2009-06-12 22:41:28,403 [RegionManager.metaScanner] INFO org.apache.hadoop.hbase.master.BaseScanner: REMOVE GET keyvalues={TestTable,,1244846310969/historian:assignment/1244846315138/Put/vlen=71, TestTable,,1244846310969/historian:compaction/1244846393353/Pu      t/vlen=36, TestTable,,1244846310969/historian:open/1244846319510/Put/vlen=51, TestTable,,1244846310969/historian:split/1244846312701/Put/vlen=43, TestTable,,1244846310969/info:regioninfo/1244846397895/Put/vlen=277, TestTable,,1244846310969/info:server/124484      6319501/Put/vlen=19, TestTable,,1244846310969/info:serverstartcode/1244846319501/Put/vlen=8, TestTable,,1244846310969/info:splitB/1244846397895/Put/vlen=297}
{code}

Above, the splitB is present in the Get but not in the Scan next.


> IllegalArgumentException in halfhfilereader#next
> ------------------------------------------------
>
>                 Key: HBASE-1495
>                 URL: https://issues.apache.org/jira/browse/HBASE-1495
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: stack
>             Fix For: 0.20.0
>
>         Attachments: 1495.patch
>
>
> From posix4e up on IRC
> {code}
> #
> 2009-06-07 20:22:33,367 ERROR org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction failed for region t3,*******************,1244420117045
> #
> java.lang.IllegalArgumentException
> #
>         at java.nio.Buffer.position(Buffer.java:218)
> #
>         at org.apache.hadoop.hbase.io.hfile.HFile$Reader$Scanner.next(HFile.java:1072)
> #
>         at org.apache.hadoop.hbase.io.HalfHFileReader$1.next(HalfHFileReader.java:108)
> #
>         at org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:52)
> #
>         at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:79)
> #
>         at org.apache.hadoop.hbase.regionserver.MinorCompactingStoreScanner.next(MinorCompactingSto
> #
> reScanner.java:101)
> #
>         at org.apache.hadoop.hbase.regionserver.Store.compact(Store.java:849)
> #
>         at org.apache.hadoop.hbase.regionserver.Store.compact(Store.java:714)
> #
>         at org.apache.hadoop.hbase.regionserver.HRegion.compactStores(HRegion.java:766)
> #
>         at org.apache.hadoop.hbase.regionserver.HRegion.compactStores(HRegion.java:723)
> #
>         at org.apache.hadoop.hbase.regionserver.CompactSplitThread.run(CompactSplitThread.java:105)
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.