Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Date: Thu, 26 Jan 2017 17:28:24 +0000 (UTC)
From: "Ted Yu (JIRA)" <jira@apache.org>
To: issues@hbase.apache.org
Message-ID: <JIRA.13037553.1485315109000.4795.1485451704618@Atlassian.JIRA>
In-Reply-To: <JIRA.13037553.1485315109000@Atlassian.JIRA>
References: <JIRA.13037553.1485315109000@Atlassian.JIRA> <JIRA.13037553.1485315109668@jira-lw-us.apache.org>
Subject: [jira] [Commented] (HBASE-17529) MergeTableRegionsProcedure failed
 due to ArrayIndexOutOfBoundsException
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Thu, 26 Jan 2017 17:28:37 -0000


    [ https://issues.apache.org/jira/browse/HBASE-17529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840094#comment-15840094 ] 

Ted Yu commented on HBASE-17529:
--------------------------------

Looking at MergeTableRegionsProcedure#MoveRegionsToSameRS() :
{code}
      if (loadOfRegionA != null && loadOfRegionB != null
          && loadOfRegionA.getRequestsCount() < loadOfRegionB.getRequestsCount()) {
{code}
We decide which region server should receive the regions by checking snapshot of request counts.

[~syuanjiang]:
Do you think we should check request counts in a sliding window manner ?
Such information can be exposed by load balancer.

> MergeTableRegionsProcedure failed due to ArrayIndexOutOfBoundsException
> -----------------------------------------------------------------------
>
>                 Key: HBASE-17529
>                 URL: https://issues.apache.org/jira/browse/HBASE-17529
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Ted Yu
>            Assignee: Ted Yu
>         Attachments: 17529-master.log
>
>
> I built tar ball using master branch based on commit 616f4801b06a8427a03ceca9fb8345700ce1ad71.
> Was running the following command:
> hbase org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList -DinMemoryCompaction=BASIC Loop 4 6 1000000 /tmp/hbase-biglinkedlist-verify 6 --monkey slowDeterministic
> Here was related snippet:
> {code}
> 2017-01-24 21:29:00,107 DEBUG [RpcServer.deafult.FPBQ.Fifo.handler=0,queue=0,port=16000] procedure2.ProcedureExecutor: Stored MergeTableRegionsProcedure (table=IntegrationTestBigLinkedList regions=[IntegrationTestBigLinkedList,,1485292220242.4c5ea240e86ef22ec7264b1153dd557d., IntegrationTestBigLinkedList,\x0E8\xE3\x8E8\xE3\x8E8,1485292220242.6cdb98dfed41ea689b3cd66478c2c580. ] forcible=false), procId=12, owner=hbase, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE
> 2017-01-24 21:29:00,108 DEBUG [ProcedureExecutorWorker-14] wal.WALProcedureStore: Set running procedure count=1, slots=24
> 2017-01-24 21:29:00,127 ERROR [ProcedureExecutorWorker-14] procedure2.ProcedureExecutor: CODE-BUG: Uncatched runtime exception for procedure: MergeTableRegionsProcedure (table=IntegrationTestBigLinkedList regions=[IntegrationTestBigLinkedList,,1485292220242.4c5ea240e86ef22ec7264b1153dd557d., IntegrationTestBigLinkedList,\x0E8\xE3\x8E8\xE3\x8E8,1485292220242.6cdb98dfed41ea689b3cd66478c2c580. ] forcible=false), procId=12, owner=hbase, state=RUNNABLE:MERGE_TABLE_REGIONS_MOVE_REGION_TO_SAME_RS
> java.lang.ArrayIndexOutOfBoundsException
>         at org.apache.hadoop.hbase.util.ByteBufferUtils.copyFromBufferToArray(ByteBufferUtils.java:1024)
>         at org.apache.hadoop.hbase.nio.MultiByteBuff.get(MultiByteBuff.java:628)
>         at org.apache.hadoop.hbase.ipc.RpcServer$ByteBuffByteInput.read(RpcServer.java:1483)
>         at org.apache.hadoop.hbase.shaded.com.google.protobuf.ByteInputByteString.copyToInternal(ByteInputByteString.java:105)
>         at org.apache.hadoop.hbase.shaded.com.google.protobuf.ByteString.toByteArray(ByteString.java:651)
>         at org.apache.hadoop.hbase.RegionLoad.getName(RegionLoad.java:50)
>         at org.apache.hadoop.hbase.ServerLoad.getRegionsLoad(ServerLoad.java:236)
>         at org.apache.hadoop.hbase.master.procedure.MergeTableRegionsProcedure.getRegionLoad(MergeTableRegionsProcedure.java:774)
>         at org.apache.hadoop.hbase.master.procedure.MergeTableRegionsProcedure.MoveRegionsToSameRS(MergeTableRegionsProcedure.java:461)
>         at org.apache.hadoop.hbase.master.procedure.MergeTableRegionsProcedure.executeFromState(MergeTableRegionsProcedure.java:142)
>         at org.apache.hadoop.hbase.master.procedure.MergeTableRegionsProcedure.executeFromState(MergeTableRegionsProcedure.java:72)
>         at org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:154)
>         at org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:708)
>         at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1332)
>         at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1133)
>         at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$800(ProcedureExecutor.java:76)
>         at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1588)
> {code}
> Master log to be attached.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)