From dev-return-78192-archive-asf-public=cust-asf.ponee.io@hbase.apache.org Thu Mar 5 15:27:05 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id C717E180667 for ; Thu, 5 Mar 2020 16:27:04 +0100 (CET) Received: (qmail 12092 invoked by uid 500); 5 Mar 2020 15:27:02 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 11920 invoked by uid 99); 5 Mar 2020 15:27:02 -0000 Received: from mailrelay1-us-west.apache.org (HELO mailrelay1-us-west.apache.org) (209.188.14.139) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Mar 2020 15:27:02 +0000 Received: from jira-he-de.apache.org (static.172.67.40.188.clients.your-server.de [188.40.67.172]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 7CAB8E313D for ; Thu, 5 Mar 2020 15:27:01 +0000 (UTC) Received: from jira-he-de.apache.org (localhost.localdomain [127.0.0.1]) by jira-he-de.apache.org (ASF Mail Server at jira-he-de.apache.org) with ESMTP id 4E439782317 for ; Thu, 5 Mar 2020 15:27:00 +0000 (UTC) Date: Thu, 5 Mar 2020 15:27:00 +0000 (UTC) From: "Michael Stack (Jira)" To: dev@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Reopened] (HBASE-23931) CatalogJanitor consistency check adds merging regions to orphan list (tooo) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-23931?page=3Dcom.atlassi= an.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Stack reopened HBASE-23931: ----------------------------------- Let me reopen. This came of an upgrade from 2.1 to 2.3 with more to follow.= Will see this again. Need to take a snapshot of meta pre-upgrade Here is s= toryline.=C2=A0 * On restart, region is assigned. * CJ runs and reports overlap (Region an 'overlap' pre-upgrade? * Run hbck2 fixMeta * {{It schedules a merge but merge fails with MergeTableRegionsProcedure: = Skip merging [8d4e9d9dbae0a90d47b9f72c89973693, 62dbb839b3a70d5b670b9a30b0a= 05648], because parent [8d4e9d9dbae0a90d47b9f72c89973693] has a merge quali= fier}} > CatalogJanitor consistency check adds merging regions to orphan list (too= o) > -------------------------------------------------------------------------= -- > > Key: HBASE-23931 > URL: https://issues.apache.org/jira/browse/HBASE-23931 > Project: HBase > Issue Type: Bug > Components: hbck2 > Reporter: Michael Stack > Priority: Major > > When the CJ runs, it does its consistency checking first before figuring = if the current row is that of a splitting or merging region. Down in the gu= ts of consistency we will check if its a splitting region and then cater ap= propriately accommodating daughters, etc. For merge we don't do the same. W= e'll actually add merge children parents as orphans. Its transitory but con= fusing. > =C2=A0 > Here is an (ugly) example. Here is how the merge shows in orphans section= of HBCK Report > {code:java} > {ENCODED =3D> 8d4e9d9dbae0a90d47b9f72c89973693, NAME =3D> 'scooter_analyt= ics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8d4e9d9dbae0a90d47b9f72c= 89973693.', STARTKEY =3D> '\x01\x03\x04\x01\x02\x03', ENDKEY =3D> '\x01\x03= \x04\x02\x02\x03'}{ENCODED =3D> 62dbb839b3a70d5b670b9a30b0a05648, NAME =3D>= 'scooter_analytics_segment,\x01\x03\x04\x01\x02\x03\x02\x01\x01\x022019040= 90000\x00\x00qwest\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x0DW:S:P:D\x03\x= 00\x00\x03,1554833869031.62dbb839b3a70d5b670b9a30b0a05648.', STARTKEY =3D> = '\x01\x03\x04\x01\x02\x03\x02\x01\x01\x02201904090000\x00\x00qwest\x00\x00\= x00\x00\x00\x00\x00\x00\x00\x00\x0DW:S:P:D\x03\x00\x00\x03', ENDKEY =3D> '\= x01\x03\x04\x02\x01\x01'}{ENCODED =3D> 8d4e9d9dbae0a90d47b9f72c89973693, NA= ME =3D> 'scooter_analytics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8= d4e9d9dbae0a90d47b9f72c89973693.', STARTKEY =3D> '\x01\x03\x04\x01\x02\x03'= , ENDKEY =3D> '\x01\x03\x04\x02\x02\x03'}{ENCODED =3D> 2666b87ae4b58b05e815= a3f14cc33215, NAME =3D> 'scooter_analytics_segment,\x01\x03\x04\x02\x01\x01= ,1583365243857.2666b87ae4b58b05e815a3f14cc33215.', STARTKEY =3D> '\x01\x03\= x04\x02\x01\x01', ENDKEY =3D> '\x01\x03\x04\x02\x02\x03'}{code} > Then... here is the row in meta... > =C2=A0 > {code:java} > scooter_analytics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8d4e9d= 9dbae0a90d47b9f72c89973693. column=3Dinfo:merge0000, timestamp=3D1583364483= 794, value=3DPBUF\x08\xE6\xE8\xFC\x9C\xA0-\x12$\x0A\x07default\x12\x19scoot= er_analytics_segment\x1A\x06\x01\x03\x04\x01\x02\x03"\x06\x01\x03\x04\x02\x= 02\x03(\x000\x008\x00B d097cacbd74c36e84a599926547e3249 > scooter_analytics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8d4e9d= 9dbae0a90d47b9f72c89973693. column=3Dinfo:merge0001, timestamp=3D1583364483= 794, value=3DPBUF\x08\xC8\xF3\xF3\xBD\x8A.\x12$\x0A\x07default\x12\x19scoot= er_analytics_segment\x1A\x06\x01\x03\x04\x02\x01\x01"\x06\x01\x03\x04\x02\x= 02\x03(\x000\x008\x00B 6b2ac2d1878e688da50483014fc5ab58 > scooter_analytics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8d4e9d= 9dbae0a90d47b9f72c89973693. column=3Dinfo:regioninfo, timestamp=3D158336448= 4283, value=3D{ENCODED =3D> 8d4e9d9dbae0a90d47b9f72c89973693, NAME =3D> 'sc= ooter_analytics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8d4e9d9dbae0= a90d47b9f72c89973693.', STARTKEY =3D> '\x01\x03\x04\x01\x02\x03', ENDK= EY =3D> '\x01\x03\x04\x02\x02\x03'} > scooter_analytics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8d4e9d= 9dbae0a90d47b9f72c89973693. column=3Dinfo:seqnumDuringOpen, timestamp=3D158= 3364484283, value=3D\x00\x00\x00\x00\x00\x00\x010 > scooter_analytics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8d4e9d= 9dbae0a90d47b9f72c89973693. column=3Dinfo:server, timestamp=3D1583364484283= , value=3Da.example.com:16020 > scooter_analytics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8d4e9d= 9dbae0a90d47b9f72c89973693. column=3Dinfo:serverstartcode, timestamp=3D1583= 364484283, value=3D1583349446638 > scooter_analytics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8d4e9d= 9dbae0a90d47b9f72c89973693. column=3Dinfo:sn, timestamp=3D1583364483948, va= lue=3Da.example.com,16020,1583349446638 > scooter_analytics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8d4e9d= 9dbae0a90d47b9f72c89973693. column=3Dinfo:state, timestamp=3D1583364484283,= value=3DOPEN > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)