Return-Path: Delivered-To: apmail-zookeeper-user-archive@www.apache.org Received: (qmail 32367 invoked from network); 28 Feb 2011 15:00:41 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 28 Feb 2011 15:00:41 -0000 Received: (qmail 52402 invoked by uid 500); 28 Feb 2011 15:00:40 -0000 Delivered-To: apmail-zookeeper-user-archive@zookeeper.apache.org Received: (qmail 52108 invoked by uid 500); 28 Feb 2011 15:00:36 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Received: (qmail 52096 invoked by uid 99); 28 Feb 2011 15:00:35 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Feb 2011 15:00:35 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of rajkumar.w93@gmail.com designates 209.85.161.42 as permitted sender) Received: from [209.85.161.42] (HELO mail-fx0-f42.google.com) (209.85.161.42) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Feb 2011 15:00:30 +0000 Received: by fxm20 with SMTP id 20so4482239fxm.15 for ; Mon, 28 Feb 2011 07:00:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type :content-transfer-encoding; bh=gFxBqMWwDc0hYtKpabjwanftXC5VLJKsGo44dg5q6sg=; b=B8z5TroMqLe32YvvBTUoXIDDWo4L3otwP5S1FJosHIb4KcAzlFXjj7RlcN/Tt/rNsA /8KAfnqnOaSSG/9BEimZ4Y6QoyC+H460JSCn6VbZlre2tegEtJxzlyJ6EF3BL/YF2ZHi 1GZUH5hIME1WzRz4EAdDwB4xf9QpWv8WgFrq8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type :content-transfer-encoding; b=iaWrf4IOyga/0so0buMF0sqQ/pYGFKXFKCiP0MUOq3f3srwQrwCQm3jnRwFDq4ZgFv 1T08mDVSFpCOVfhPhWoyGJ4BKJyDNgT1pEz/VLHTX6WfzLNZl7/SqYmyVUuxWzIbN9GZ SPxmTFGxYZxDxgqc8/UP9jnxm30NjspZpcWkE= MIME-Version: 1.0 Received: by 10.223.112.81 with SMTP id v17mr6141391fap.102.1298905207668; Mon, 28 Feb 2011 07:00:07 -0800 (PST) Sender: rajkumar.w93@gmail.com Received: by 10.223.23.26 with HTTP; Mon, 28 Feb 2011 07:00:07 -0800 (PST) In-Reply-To: References: Date: Mon, 28 Feb 2011 20:30:07 +0530 X-Google-Sender-Auth: HNjFJSciBFu7jqKOsF9LtQkGomA Message-ID: Subject: Re: Zookeeper for generating sequential IDs From: Ertio Lew To: user@zookeeper.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Thanks Patrick, I considered your suggestion. But sadly it could not fit my use case. I am looking for a solution that could help me generate 64 bits Ids but in those 64 bits I would like atleast 4 free bits so that I could manage with those free bits to distinguish the type of data for a particular entity in the same columnfamily. If I could keep the snowflake's Id size to around 60 bits, that would have been great.. On Sat, Feb 26, 2011 at 5:13 AM, Patrick Hunt wrote: > Keep in mind that blog post is pretty old. I see comments like this in > the commit log > > "hard to call it alpha/experimental after serving billions of ids" > > so it seems it's in production at twitter at least... > > Patrick > > On Fri, Feb 25, 2011 at 2:58 PM, Ertio Lew wrote: >> Thanks Patrick, >> >> The fact that it is still in the alpha stage and twitter is not yet >> using it, makes me look to other solutions as well, which have a large >> community/users base & are more mature. >> >> I do not know much about the snowflake if it is being used in >> production by anyone .. >> >> >> >> >> On Fri, Feb 25, 2011 at 11:21 PM, Patrick Hunt wrote: >>> Have you looked at snowflake? >>> >>> http://engineering.twitter.com/2010/06/announcing-snowflake.html >>> >>> Patrick >>> >>> On Fri, Feb 25, 2011 at 9:43 AM, Ted Dunning wr= ote: >>>> If your id's don't need to be exactly sequential or if the generation = rate >>>> is less than a few thousand per second, ZK is a fine choice. >>>> >>>> To get very high generation rates, what is typically done is to alloca= te >>>> blocks of id's using ZK and then allocate out of the block locally. = =A0This >>>> can cause you to wind up with a slightly swiss-cheesed id space and it= means >>>> that the ordering of id's only approximates the time ordering of when = the >>>> id's were assigned. =A0Neither of these is typically a problem. >>>> >>>> On Fri, Feb 25, 2011 at 1:50 AM, Ertio Lew wrote: >>>> >>>>> Hi all, >>>>> >>>>> I am involved in a project where we're building a social application >>>>> using Cassandra DB and Java. I am looking for a solution to generate >>>>> unique sequential IDs for the content on the application. I have been >>>>> suggested by some people to have a look =A0to Zookeeper for this. I >>>>> would highly appreciate if anyone can suggest if zookeeper is suitabl= e >>>>> for this purpose and any good resources to gain information about >>>>> zookeeper. >>>>> >>>>> Since the application is based on a eventually consistent distributed >>>>> platform using Cassandra, we have felt a need to look over to other >>>>> solutions instead of building our own using our DB. >>>>> >>>>> Any kind of comments, suggestions are highly welcomed! :) >>>>> >>>>> Regards >>>>> Ertio Lew. >>>>> >>>> >>> >> >