Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9CDD719624 for ; Thu, 28 Apr 2016 16:15:30 +0000 (UTC) Received: (qmail 40046 invoked by uid 500); 28 Apr 2016 16:15:30 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 39947 invoked by uid 500); 28 Apr 2016 16:15:29 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 39935 invoked by uid 99); 28 Apr 2016 16:15:29 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 28 Apr 2016 16:15:29 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 3BE9EC020E for ; Thu, 28 Apr 2016 16:15:29 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.879 X-Spam-Level: *** X-Spam-Status: No, score=3.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_BL_SPAMCOP_NET=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx2-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id sYo8rRWTk5Jk for ; Thu, 28 Apr 2016 16:15:28 +0000 (UTC) Received: from mail-yw0-f170.google.com (mail-yw0-f170.google.com [209.85.161.170]) by mx2-lw-eu.apache.org (ASF Mail Server at mx2-lw-eu.apache.org) with ESMTPS id 76C525F23A for ; Thu, 28 Apr 2016 16:15:27 +0000 (UTC) Received: by mail-yw0-f170.google.com with SMTP id t10so127303223ywa.0 for ; Thu, 28 Apr 2016 09:15:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to; bh=9Zvuw2oEMpsiOXQjyGpMgsMz1AAqSWrJI++u4VLT75I=; b=opG+dn37/sqPf6BzulWc7wlP0ZhaMFNC6PdGCJVGNm2/9nmbksj0a7OxqK0hQaAPsL XxekuzTmpwxsUcEJTl6NKVdHPTlpgFtJp8NynmalJWcEoCPwmM2PYzIh4j+nMJF+b2mn vEfnXhR7ZWPBtu4wdnWpqrolx3zYvTduaLauQIYJY8PIr7B+AmULnqbZ3RqOgTb3LzYu KhFSm2bArxgOuXBgGIxLmG5aFHO5BescKkEiEkegTH53AXbFmKsqCk5vmNN7jtUf6hzO S5zSROPaxXasCzKioqRPI88g8wga5UE2KK4ztpAYugQ4Je4qbrQagoJ7mZxrhPRW1Frd J50g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to; bh=9Zvuw2oEMpsiOXQjyGpMgsMz1AAqSWrJI++u4VLT75I=; b=ERVZKKJFDyfPjzEUZMxTLG9U4jPdGkzn6ChBoGhvkZcOUDaY26Kdr2xUHSg/4vp0xs Mk0bg2GrIqvulY0KyTDXheKw6Nr4NjUch8MF/vSI6mhQ7g/EdeHIKm+4kh6i1QDd1Q7t ZQDxxkrzhku5KDGGl44BjPiGs7xdBV8hQQ7gj9TtHWThUx2IrUMSTbTk1mumLIe08Vyp fwxUSbFazFTouKvolOYXGg8Fm9cCzVC75HO+HHFyXJR95AdQv3c9N4WRln3+c49Y3Roz oA5atjn8/ZKewtlTXg9f9hx1WC46W36bWmWDVEFntRDdmeT2VzybY+OfZK8w7K2TjVLe j8Ig== X-Gm-Message-State: AOPr4FVU6fu38HmUdHQQ56jD/60zs4ZrzvUx2QxZW0FjXsApbB00EqL6vFDV8lOVLC6GT2orlE9gXJBcn8BlCg== MIME-Version: 1.0 X-Received: by 10.13.206.196 with SMTP id q187mr8275993ywd.34.1461860126557; Thu, 28 Apr 2016 09:15:26 -0700 (PDT) Received: by 10.37.101.195 with HTTP; Thu, 28 Apr 2016 09:15:26 -0700 (PDT) In-Reply-To: References: Date: Thu, 28 Apr 2016 09:15:26 -0700 Message-ID: Subject: Re: coprocessors in split region From: Ted Yu To: "dev@hbase.apache.org" Content-Type: multipart/alternative; boundary=001a114e58428e131305318dd55a --001a114e58428e131305318dd55a Content-Type: text/plain; charset=UTF-8 Looks like Phoenix makes use of PONR methods: phoenix-core/src/main/java/org/apache/hadoop/hbase/regionserver/IndexSplitTransaction.java: this.parent.getCoprocessorHost().preSplitAfterPONR(); phoenix-core/src/main/java/org/apache/hadoop/hbase/regionserver/LocalIndexSplitter.java: public void preSplitAfterPONR(ObserverContext ctx) phoenix-core/src/main/java/org/apache/phoenix/coprocessor/DelegateRegionObserver.java: public void preSplitAfterPONR(ObserverContext ctx) phoenix-core/src/main/java/org/apache/phoenix/coprocessor/DelegateRegionObserver.java: delegate.preSplitAfterPONR(ctx); phoenix-core/src/main/java/org/apache/hadoop/hbase/regionserver/IndexSplitTransaction.java: preSplitBeforePONR(this.splitrow, metaEntries)) { phoenix-core/src/main/java/org/apache/hadoop/hbase/regionserver/LocalIndexSplitter.java: public void preSplitBeforePONR(ObserverContext ctx, phoenix-core/src/main/java/org/apache/phoenix/coprocessor/DelegateRegionObserver.java: public void preSplitBeforePONR(ObserverContext ctx, phoenix-core/src/main/java/org/apache/phoenix/coprocessor/DelegateRegionObserver.java: delegate.preSplitBeforePONR(ctx, splitKey, metaEntries); FYI On Thu, Apr 28, 2016 at 9:06 AM, Stephen Jiang wrote: > during split region, we have a lot of coprocessors in > RegionCoprocessorHost (some of them were added by > https://issues.apache.org/jira/browse/HBASE-6633) > > public void preSplit(final byte[] splitRow) throws IOException {} > public void postSplit(final Region l, final Region r) throws IOException > {} > public boolean preSplitBeforePONR(final byte[] splitKey, > final List metaEntries) throws IOException {} > public void preSplitAfterPONR() throws IOException {} > public void preRollBackSplit() throws IOException {} > public void postRollBackSplit() throws IOException {} > public void postCompleteSplit() throws IOException {} > > I am in the process of moving split region a procedure-based from MASTER, > which means I should move those coprocessors to MasterCoprocessorHost. > > Looking at the names, it seems to me that we exposed PONR implementation > details of split operation (what if we don't have PONR in future > implementation? what if a new implementation always PONR from the > beginning). I just wondering whether any customer leverage all the > coprocessors in split? > > Also anyone sees any problem moving those CP to Master? Your insight is > helpful. > > Thanks > Stephen > --001a114e58428e131305318dd55a--