Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id C5A93200CC3 for ; Sat, 1 Jul 2017 03:56:10 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id C41D6160BEB; Sat, 1 Jul 2017 01:56:10 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 173BC160BF9 for ; Sat, 1 Jul 2017 03:56:09 +0200 (CEST) Received: (qmail 14733 invoked by uid 500); 1 Jul 2017 01:56:09 -0000 Mailing-List: contact dev-help@phoenix.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@phoenix.apache.org Delivered-To: mailing list dev@phoenix.apache.org Received: (qmail 14512 invoked by uid 99); 1 Jul 2017 01:56:08 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Jul 2017 01:56:08 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 66CED1AFAEC for ; Sat, 1 Jul 2017 01:56:08 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id chhwvxf8F6AM for ; Sat, 1 Jul 2017 01:56:07 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 0FBED5FB96 for ; Sat, 1 Jul 2017 01:56:07 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 66773E0933 for ; Sat, 1 Jul 2017 01:56:05 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 10E35245E4 for ; Sat, 1 Jul 2017 01:56:03 +0000 (UTC) Date: Sat, 1 Jul 2017 01:56:03 +0000 (UTC) From: "Andrew Purtell (JIRA)" To: dev@phoenix.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (PHOENIX-3969) Delete from table more than 100 rows fails with IndexOutOfBould MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Sat, 01 Jul 2017 01:56:11 -0000 [ https://issues.apache.org/jira/browse/PHOENIX-3969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16070946#comment-16070946 ] Andrew Purtell commented on PHOENIX-3969: ----------------------------------------- +1 > Delete from table more than 100 rows fails with IndexOutOfBould > --------------------------------------------------------------- > > Key: PHOENIX-3969 > URL: https://issues.apache.org/jira/browse/PHOENIX-3969 > Project: Phoenix > Issue Type: Bug > Affects Versions: 4.11.0 > Reporter: Sergey Soldatov > Assignee: Sergey Soldatov > Priority: Critical > Attachments: PHOENIX-3969.patch > > > That happens because in UngroupedAggregateRegionObserver to check whether we have something to commit we call readyToCommit. We do that for both - data table mutations and local indexes ( indexMutations). In this method we check only rows count from original table, but not the size of mutations list. Since indexMutations is using only for local indexes, in regular cases the list will be empty and when we call commitBatch for empty list it fails with an exception : > {noformat} > Error: org.apache.phoenix.exception.PhoenixIOException: org.apache.hadoop.hbase.DoNotRetryIOException: GIGANTIC_TABLE,,1498079753609.137788ceb573b20bbbb7cdcaeb6ba489.: Index: 0, Size: 0 > at org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:92) > at org.apache.phoenix.util.ServerUtil.throwIOException(ServerUtil.java:58) > at org.apache.phoenix.coprocessor.BaseScannerRegionObserver$RegionScannerHolder.overrideDelegate(BaseScannerRegionObserver.java:240) > at org.apache.phoenix.coprocessor.BaseScannerRegionObserver$RegionScannerHolder.nextRaw(BaseScannerRegionObserver.java:266) > at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2506) > at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32385) > at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2141) > at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112) > at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:187) > at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:167) > Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0 > at java.util.ArrayList.rangeCheck(ArrayList.java:653) > at java.util.ArrayList.get(ArrayList.java:429) > at org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver.commitBatch(UngroupedAggregateRegionObserver.java:193) > at org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver.doPostScannerOpen(UngroupedAggregateRegionObserver.java:713) > at org.apache.phoenix.coprocessor.BaseScannerRegionObserver$RegionScannerHolder.overrideDelegate(BaseScannerRegionObserver.java:221) > ... 7 more (state=08000,code=101) > {noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029)