Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7DEDABE56 for ; Thu, 12 Jan 2012 06:06:04 +0000 (UTC) Received: (qmail 95950 invoked by uid 500); 12 Jan 2012 06:06:02 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 95245 invoked by uid 500); 12 Jan 2012 06:05:50 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 95225 invoked by uid 99); 12 Jan 2012 06:05:44 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 Jan 2012 06:05:44 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of saint.ack@gmail.com designates 209.85.214.169 as permitted sender) Received: from [209.85.214.169] (HELO mail-tul01m020-f169.google.com) (209.85.214.169) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 Jan 2012 06:05:37 +0000 Received: by obbuo9 with SMTP id uo9so345519obb.14 for ; Wed, 11 Jan 2012 22:05:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type :content-transfer-encoding; bh=3oA11WCStDgoNGgIQTHJAa6Z5qJ+pa7PAOH5WXes3G4=; b=PGFKBNiW3aLOT4EWaIpqkyTtCPbq+EvqP+QuZ2A9fwikez98xRDBFx551C9txeeh9O rwGiEP45gRGYQxxZi/4w5Au2znNe4w3keUI/z45felqPTpxdz1oKAS552IlAqEFipivp YE6qqZ3PJmKCg0Ud23NEy/ZorwrwrOCCms8sQ= MIME-Version: 1.0 Received: by 10.182.193.41 with SMTP id hl9mr1852048obc.44.1326348316804; Wed, 11 Jan 2012 22:05:16 -0800 (PST) Sender: saint.ack@gmail.com Received: by 10.182.246.99 with HTTP; Wed, 11 Jan 2012 22:05:16 -0800 (PST) In-Reply-To: <1326325156.84307.YahooMailNeo@web121701.mail.ne1.yahoo.com> References: <1326325156.84307.YahooMailNeo@web121701.mail.ne1.yahoo.com> Date: Wed, 11 Jan 2012 22:05:16 -0800 X-Google-Sender-Auth: WdmTDBo2qngzGg-o5bMOu-ltVw8 Message-ID: Subject: Re: rowlock advice for book From: Stack To: dev@hbase.apache.org, lars hofhansl Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org On Wed, Jan 11, 2012 at 3:39 PM, lars hofhansl wrote: > Shouldn't we deprecate them? > Yes. But what to replace them with? I think they haven't been deprecated up to this because we've not done the work to put in place an alternative. We could just drop the functionality (after deprecating). I'd be fine w/ that. St.Ack > They are only guaranteed to work for the duration of a region server oper= ation. > If there are splits/etc the lock would be silently gone. > > -- Lars > > > > ________________________________ > =A0From: Jean-Daniel Cryans > To: dev@hbase.apache.org > Sent: Wednesday, January 11, 2012 2:36 PM > Subject: Re: rowlock advice for book > > Row locks aren't deprecated officially but it's really that type of > feature that you should use at your own risk / you might not enjoy > life after that. > > J-D > > On Wed, Jan 11, 2012 at 1:08 PM, Doug Meil > wrote: >> >> Hey dev-list, regarding this... >> >> re: =A0"Be careful using hbase row locks. =A0They are (unofficially -- w= e need >> to make it official) deprecated." >> >> >> >> >> ... is this the official advice? =A0Should I update the book with this? >> >> >> >> >> On 1/3/12 4:37 PM, "Stack" wrote: >> >>>On Tue, Jan 3, 2012 at 12:38 PM, Joe Stein >>> wrote: >>>> when the event happened so if we see something from November 3rd today >>>>then >>>> we will only keep it for 4 more months (and for events that we see tod= ay >>>> those stay for 6 months) . =A0so it sounds like this might be a viable >>>>option >>>> and when we set the timestamp in our checkAndPut we make the timestamp >>>>be >>>> the value that represents it as November 3rd, right? cool >>>> >>> >>>This should be fine. >>> >>>You might want to protect against future dates. >>> >>>> well what i was thinking is that my client code would know to use the >>>> november table and put the data in the november table (it is all just >>>> strings) but I am leaning now towards the TTL option (need to futz wit= h >>>>it >>>> all more though). =A0One issue/concern with TTL is when all of a sudde= n we >>>> want to keep things for only 4 months or maybe 8 months and then havin= g >>>>to >>>> re-TTL trillions of rows =3D8^( (which is nagging thought in the back = of >>>>my >>>> head about ttls, requirements change).... >>> >>>This schema attribute is kept at the table level, not per row. =A0You'll >>>have to change the table schema which in 0.90.x hbase means offlining >>>table (in 0.92 hbase, there is an online schema edit but needs to be >>>enabled and can be problematic in the face of splitting.... more on >>>this later). >>> >>>> That makes sense why a narrow long schema works well then, got it (I a= m >>>>use >>>> to Cassandra and do lots of wide column range slices on those columns >>>>this >>>> is like inverting everything up on myself but the row locks and >>>>checkAndPut >>>> (and co-processors) hit so many of my uses cases (as Cassandra still >>>>does >>>> also) >>>> >>> >>>Be careful using hbase row locks. =A0They are (unofficially -- we need >>>to make it official) deprecated. =A0You can lock yourself out of a >>>regionserver if all incoming handlers end up waiting on a particular >>>row lock to clear. =A0Check back in this mailing list for other rowlock >>>downsides. >>> >>>You can column range slices in hbase if you use filters (if you need to)= . >>> >>>checkAndPut shouldn't care if row is wide or not? >>> >>> >>>> right now I am on 0.90.4 but right now I am going back and forth in >>>> changing our hadoop cluster, HBase is the primary driver for that so I >>>>am >>>> currently wrestling on the decision with upgrading from existing clust= er >>>> CDH2 to CDH3 or going with MapR ... >>> >>>Go to CDH3 if you are on CDH2. =A0Does CDH2 have a working sync? >>>(CDH3u3 when it arrives has some nice perf improvements). >>> >>>> my preference is to run my own version >>>> of HBase (like I do with Kafka and Cassandra) I feel I can do this >>>>though I >>>> am not comfortable with running my own Hadoop build (already overloade= d >>>> with things). =A00.92 is exciting for co-processors too and it is cool >>>>system >>>> to hack on, maybe I will pull from trunk build and test it out some to= o. >>>> >>> >>>Don't do hbase trunk. =A0Do tip of 0.92 branch if you want to hack. >>>HBase Trunk is different from 0.92 already and will get even more >>>"differenter"; it'll be hard to help you if you are pulling from trunk >>> >>>St.Ack >>> >> >>