Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5225C1097D for ; Wed, 31 Jul 2013 04:11:57 +0000 (UTC) Received: (qmail 59964 invoked by uid 500); 31 Jul 2013 04:11:50 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 59900 invoked by uid 500); 31 Jul 2013 04:11:49 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 59888 invoked by uid 99); 31 Jul 2013 04:11:47 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 31 Jul 2013 04:11:47 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of ndimiduk@gmail.com designates 209.85.212.43 as permitted sender) Received: from [209.85.212.43] (HELO mail-vb0-f43.google.com) (209.85.212.43) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 31 Jul 2013 04:11:41 +0000 Received: by mail-vb0-f43.google.com with SMTP id h11so224156vbh.16 for ; Tue, 30 Jul 2013 21:11:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=K+0oz5PhO796uOG6f2g9azzrfYVimttbXIdXXyMIQLk=; b=yYpwrSCra+HxLbRs3mQHHL68gZAGHr7mgJCI/KKZ87zjQ6J2Vro1JI2P6RHkwfaMm7 Y6ibu3yVd/SZmC6fFLjvArnATSbFPIXexjaOZb3TyHj7h+bPNTiZR+Kl+IjdOahLj1fw kisHkHPKxumG/ke19MTvm0NuHSd0LA5wnK8+nv+SON9eYsPTlrzV4PaN6THUhBpX2lvM 7cbZ032jec/tn5rGISN35O9B9h0QbFa1fVsz3H2e3oRKAmvnhkApoR80TgQ4/oacVEn0 EaUHnqhWC9IfW2CCF138g3WxI1umVZGWZi3gRwKbEHJ0hM1HhV49+8yBzkZNjxsqU0kQ DlBQ== X-Received: by 10.58.233.204 with SMTP id ty12mr19792626vec.61.1375243880341; Tue, 30 Jul 2013 21:11:20 -0700 (PDT) MIME-Version: 1.0 Received: by 10.58.97.204 with HTTP; Tue, 30 Jul 2013 21:11:00 -0700 (PDT) In-Reply-To: References: From: Nick Dimiduk Date: Tue, 30 Jul 2013 21:11:00 -0700 Message-ID: Subject: Re: [UPDATE] Finishing up 0.96 --> WAS Re: 0.95 and 0.96 remaining issues To: dev@hbase.apache.org Content-Type: multipart/alternative; boundary=089e0102f010f7a70504e2c6ea9f X-Virus-Checked: Checked by ClamAV on apache.org --089e0102f010f7a70504e2c6ea9f Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On Tue, Jul 30, 2013 at 8:20 PM, James Taylor wrote= : > What's the functionality that we'll lose without the order-preserving par= t > being included? > Well, order preservation ;) Lacking 8201, we'd get all the existing Bytes goodness but wrapped up in 8693's API. The framework is laid for other HBase components, user applications, and downstream projects to start building on it immediately. I'd like to start pluming it into some new Filters, a couple of the MapReduce tools, Hive's interop layer, maybe even replace PDataType with DataType if you're open to such a patch. The OrderedBytes stuff will require applications to have a plan for data migration when they decide to transition over to it, but they can get a head-start on the boiler-plate code. On Tue, Jul 30, 2013 at 5:39 PM, Nick Dimiduk wrote: > > > On Tue, Jul 30, 2013 at 3:28 PM, Enis S=C3=B6ztutar > wrote: > > > > > Let me elaborate. There are at least new RPC PB, PB structures in > HFiles > > / > > > hlogs, and zk, table locks, bucket cache, online merge, stochastic LB= , > > > hbase on windows, *new data types*, AM changes, favorite node > assignment, > > > dist log replay, and tons of MTTR changes that are not run in > production > > so > > > far. > > > > > > Re: new data types, allow me to throw my hat into the ring as well. I > spoke > > with Stack this morning about a plan that I hope will allow the new dat= a > > type API to squeeze in without requiring the order-preserving encoding. > I'd > > like to get this API out with 0.96 so that users interested in adopting > > this feature can start migrating their applications sooner than later. > > Jealously, I want to start work on the Hive/HBase plumbing using this A= PI > > and the Hive guys are only willing to accept code that is built against= a > > labeled HBase release. I'm hoping other projects (*cough* Phoenix, > Impala, > > Kiji *cough*) are keen to follow suit. It also allows for the feature t= o > > fan out internally -- Filters, Coprocessors, ImportTsv, &c. Using this > > approach, DataType and Legacy* friends come in for 0.96.0 and > OrderedBytes > > can join the party in a 0.96.x when it's ready for adoption. > > > > Thanks, > > Nick > > > --089e0102f010f7a70504e2c6ea9f--