Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id BF702200CE7 for ; Thu, 3 Aug 2017 03:34:52 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id BDFF016A97F; Thu, 3 Aug 2017 01:34:52 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 0EE0916A97A for ; Thu, 3 Aug 2017 03:34:51 +0200 (CEST) Received: (qmail 44147 invoked by uid 500); 3 Aug 2017 01:34:50 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 44129 invoked by uid 99); 3 Aug 2017 01:34:50 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Aug 2017 01:34:50 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id C658CC19C7 for ; Thu, 3 Aug 2017 01:34:49 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.481 X-Spam-Level: ** X-Spam-Status: No, score=2.481 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.001, HTML_MESSAGE=2, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id ZB3idLUXbzfQ for ; Thu, 3 Aug 2017 01:34:44 +0000 (UTC) Received: from mail-yw0-f171.google.com (mail-yw0-f171.google.com [209.85.161.171]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id C1E735F6D2 for ; Thu, 3 Aug 2017 01:34:43 +0000 (UTC) Received: by mail-yw0-f171.google.com with SMTP id u207so61966ywc.3 for ; Wed, 02 Aug 2017 18:34:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to; bh=jsQopiLJ1aMLtma27MumzqjpKNvWEPvfgetQVcw4rg0=; b=BYGYNYT3TuSfQcp0YI86Yl7LWnNwA1S2nAqcbp+Zy5Y23jbRhO6SG+7UaaqdqcQ5dE Hczf4ONHWWh+XfxRbIt4KpekvEqxd6wtkPYZPhDvER2WPxQNMq7JVY4uH8g7xk95+bfC AocL5cc0SZkIQVVuwuoMhvbhszgeUP8eI55K4aHsGd2V96gUqtnn1m/2/34YfOL9jphv uUWpXlrrzm99DsfuvHOWNyF09frD0y/EEzNv0At5SzIkbgg3n1yisjdZyySYC+g3/WBZ v9f6waVRVspREAwcGQNj4B1P4rSz/tesL4KJK3Q3Sw2c3EX23j3p63IC4j7cGYqoyVWr jB9A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to; bh=jsQopiLJ1aMLtma27MumzqjpKNvWEPvfgetQVcw4rg0=; b=NozfI9LFgvgHhoqpcu9GReYzqSP1+pXQFVBwdC5f0N4F+Uak0kuGDkEi0TIVqZzCbT hLosvwea4/9skdxsEVIF66uHi3nO5I1dY05QYTmK/lB5TR6591P4jL2F27mCwpEcu6ku qgscRnWN752Jhe7TOPAMEqsno7rrxA+b+lGoYFA996CWaIB2rG1bjpjnPY+cV6EdSKx4 sZ376u+6a86/SxrdYrrH+OCigsdGV8ZvZk9dwzBBi66cEhFUVHBHbTrk/0gxaBDSpddr /tzCPTopXnW4EqrmkLLJDeqNgznVhayq3qKY+r4zuNqkt3hnWTjKS66lzKvtCFaI2q9t z2QQ== X-Gm-Message-State: AIVw1132xlNXbxpaTeIqXZHquNIY2YJKrfIH8L83/NB+70M0RRK2ko/b zLEChMIb1pj7VqWmUwf1x74SyZAMm4Ok X-Received: by 10.37.214.214 with SMTP id n205mr22043827ybg.233.1501724083170; Wed, 02 Aug 2017 18:34:43 -0700 (PDT) MIME-Version: 1.0 Sender: saint.ack@gmail.com Received: by 10.37.105.7 with HTTP; Wed, 2 Aug 2017 18:34:42 -0700 (PDT) In-Reply-To: References: From: Stack Date: Wed, 2 Aug 2017 18:34:42 -0700 X-Google-Sender-Auth: r-bSw1k7XEwPSbirh1CE4T0ziC8 Message-ID: Subject: Re: [DISCUSS] hbase-2.0.0 compatibility expectations To: HBase Dev List Content-Type: multipart/alternative; boundary="94eb2c065a408732b00555cf62d8" archived-at: Thu, 03 Aug 2017 01:34:52 -0000 --94eb2c065a408732b00555cf62d8 Content-Type: text/plain; charset="UTF-8" On Wed, Aug 2, 2017 at 5:25 PM, Zach York wrote: > Do we know what the major pain points for migration are? Can we discuss > that/get a list going? > > Here's a few in outline: + There is issue of formats, of hbase-2.x being able to read hbase-1.x data whether from HDFS or ZooKeeper or off the wire. + An hbase-1.x client should be able to Get/Put and Scan an hbase-2.x cluster; no holes in the API or unintelligible serializations. + There is then the little dance that has us rolling restart from an hbase-1.x cluster to hbase-2.x; i.e. upgrade master first and then it will assign regions to the new hbase-2.x regionservers as they come on line. TBD. Is this what you mean sir? S > I think without that knowledge it is hard (for me at least :) ) to > determine where we should set our sights in terms of migration. > > Thanks, > Zach > > On Wed, Aug 2, 2017 at 4:38 PM, Stack wrote: > > > What are our expectations regards compatibility between hbase1 and > hbase2? > > > > Lets have a chat about it. Here are some goal posts. > > > > + You have to upgrade to hbase-1.x before you can migrate to hbase-2. No > > migration from < hbase-1 (Is this too onerous? Should we support 0.98 => > > 2.0?). > > + You do NOT have to upgrade to the latest release of hbase1 to migrate > to > > hbase2; being up on hbase-1.0.0+ will be sufficient. > > + You'll have to update your hbase1 coprocessors to deploy them on > hbase2. > > A bunch of CP API has/will change by the time hbase2 comes out; e.g. > > watching for region split on RegionServer no longer makes sense given > > Master runs all splits now. > > + An hbase1 client can run against an hbase2 cluster but it will only be > > able to do DML (Get/Put/Scan, etc.). We do not allow being able to do > admin > > ops using an hbase1 Admin client against an hbase2 cluster. We have some > > egregious API violations in branch-1; e.g. we have protobuf in our API > (See > > HBASE-15607). The notion is that we can't afford a deprecation cycle > > purging this stuff from our Admin API. > > > > What you all think? > > > > St.Ack > > > --94eb2c065a408732b00555cf62d8--