Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id D1186200CBD for ; Thu, 6 Jul 2017 23:18:44 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id CFCCB16775B; Thu, 6 Jul 2017 21:18:44 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 23456167759 for ; Thu, 6 Jul 2017 23:18:43 +0200 (CEST) Received: (qmail 51816 invoked by uid 500); 6 Jul 2017 21:18:43 -0000 Mailing-List: contact dev-help@phoenix.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@phoenix.apache.org Delivered-To: mailing list dev@phoenix.apache.org Received: (qmail 51801 invoked by uid 99); 6 Jul 2017 21:18:43 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Jul 2017 21:18:43 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id B82621A0763 for ; Thu, 6 Jul 2017 21:18:42 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id hdOiuqPJtEKB for ; Thu, 6 Jul 2017 21:18:41 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id B8AC562634 for ; Thu, 6 Jul 2017 21:13:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 4EE3EE0012 for ; Thu, 6 Jul 2017 21:13:01 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 1B4CF23FF4 for ; Thu, 6 Jul 2017 21:13:00 +0000 (UTC) Date: Thu, 6 Jul 2017 21:13:00 +0000 (UTC) From: "Thomas D'Silva (JIRA)" To: dev@phoenix.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (PHOENIX-3969) Delete from table more than 100 rows fails with IndexOutOfBould MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Thu, 06 Jul 2017 21:18:45 -0000 [ https://issues.apache.org/jira/browse/PHOENIX-3969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077205#comment-16077205 ] Thomas D'Silva commented on PHOENIX-3969: ----------------------------------------- I think my patch for PHOENIX-3986 should fix this issue. I was running in to this failure for the test I added. > Delete from table more than 100 rows fails with IndexOutOfBould > --------------------------------------------------------------- > > Key: PHOENIX-3969 > URL: https://issues.apache.org/jira/browse/PHOENIX-3969 > Project: Phoenix > Issue Type: Bug > Affects Versions: 4.11.0 > Reporter: Sergey Soldatov > Assignee: Sergey Soldatov > Priority: Critical > Attachments: PHOENIX-3969.patch > > > That happens because in UngroupedAggregateRegionObserver to check whether we have something to commit we call readyToCommit. We do that for both - data table mutations and local indexes ( indexMutations). In this method we check only rows count from original table, but not the size of mutations list. Since indexMutations is using only for local indexes, in regular cases the list will be empty and when we call commitBatch for empty list it fails with an exception : > {noformat} > Error: org.apache.phoenix.exception.PhoenixIOException: org.apache.hadoop.hbase.DoNotRetryIOException: GIGANTIC_TABLE,,1498079753609.137788ceb573b20bbbb7cdcaeb6ba489.: Index: 0, Size: 0 > at org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:92) > at org.apache.phoenix.util.ServerUtil.throwIOException(ServerUtil.java:58) > at org.apache.phoenix.coprocessor.BaseScannerRegionObserver$RegionScannerHolder.overrideDelegate(BaseScannerRegionObserver.java:240) > at org.apache.phoenix.coprocessor.BaseScannerRegionObserver$RegionScannerHolder.nextRaw(BaseScannerRegionObserver.java:266) > at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2506) > at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32385) > at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2141) > at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112) > at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:187) > at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:167) > Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0 > at java.util.ArrayList.rangeCheck(ArrayList.java:653) > at java.util.ArrayList.get(ArrayList.java:429) > at org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver.commitBatch(UngroupedAggregateRegionObserver.java:193) > at org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver.doPostScannerOpen(UngroupedAggregateRegionObserver.java:713) > at org.apache.phoenix.coprocessor.BaseScannerRegionObserver$RegionScannerHolder.overrideDelegate(BaseScannerRegionObserver.java:221) > ... 7 more (state=08000,code=101) > {noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029)