Return-Path: Delivered-To: apmail-zookeeper-user-archive@www.apache.org Received: (qmail 82396 invoked from network); 9 Mar 2011 05:28:37 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 9 Mar 2011 05:28:37 -0000 Received: (qmail 11268 invoked by uid 500); 9 Mar 2011 05:28:36 -0000 Delivered-To: apmail-zookeeper-user-archive@zookeeper.apache.org Received: (qmail 11215 invoked by uid 500); 9 Mar 2011 05:28:36 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Received: (qmail 11207 invoked by uid 99); 9 Mar 2011 05:28:35 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Mar 2011 05:28:35 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of rajkumar.w93@gmail.com designates 209.85.161.42 as permitted sender) Received: from [209.85.161.42] (HELO mail-fx0-f42.google.com) (209.85.161.42) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Mar 2011 05:28:30 +0000 Received: by fxm20 with SMTP id 20so225131fxm.15 for ; Tue, 08 Mar 2011 21:28:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type :content-transfer-encoding; bh=bBUXJBYIF0ettql7+iuJ7fERq1M3PTcG2W9iQ9ZCRGE=; b=CbEHqvN6e4Q0pzciuL4EXSPKlftU0oh+kTClL7v9SBUvRQHfVke5N+cpJajyE5q5m8 S+eByGKjnb3SBazHLe5E0AVoyWwdcGoeJJfBDASi4P753iBSdcIDPmRA+O7EpEeateeC e9qeieBLNPRnQa7+Ur4JlVe99kigYOg4iBGgI= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type :content-transfer-encoding; b=wXdjr9Ihd3Db7NrPH9A5ZEUQ6v1Yp6fRtiMjmk2AgZHfCnh3Poq+Za0cX4tS5YQ34O mtBh2aQbVle7wqdwfmCKurliZYQR9R/6Ddsem31tSOvyz3/eSI4nUiB4u8HmuFXAd4vv MAs9LITUxCy/lBXHWm7CHQAGoyFDjFNVuX3gE= MIME-Version: 1.0 Received: by 10.223.143.86 with SMTP id t22mr492867fau.68.1299648489239; Tue, 08 Mar 2011 21:28:09 -0800 (PST) Sender: rajkumar.w93@gmail.com Received: by 10.223.23.26 with HTTP; Tue, 8 Mar 2011 21:28:08 -0800 (PST) In-Reply-To: <4D77066D.8070202@darose.net> References: <4D7670D5.4050301@darose.net> <4D7671E1.6070104@darose.net> <4D77066D.8070202@darose.net> Date: Wed, 9 Mar 2011 10:58:08 +0530 X-Google-Sender-Auth: YFJcNMo0XAPm5mVhkbJSASS0BQc Message-ID: Subject: Re: Zookeeper for generating sequential IDs From: Ertio Lew To: user@zookeeper.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable We also wanted a facility for 4 byte integers but still this may be of interest to us. Thanks Ertio Lew On Wed, Mar 9, 2011 at 10:17 AM, David Rosenstrauch wro= te: > The library currently generates ID's as java longs. =A0(i.e., 8 byte > integers). =A0Does that work for you? > > I keep trying to free up time to release this, but I keep getting buried = at > work! =A0:-( =A0Will try my best to get this out soon. > > HTH, > > DR > > On 03/08/2011 01:21 PM, Ertio Lew wrote: >> >> Thanks so much David !! >> >> Your solution seems to perfectly fulfill our requirements of >> continuous and monotonically =A0increasing Ids. What is the size of your >> Ids in bytes?? >> >> We are particularly looking for i32 and i64 sized ids. >> Are you planning to release this work to community anytime sooner ? >> >> Thanks anyways for sharing knowledge. >> >> >> On Tue, Mar 8, 2011 at 11:43 PM, David Rosenstrauch >> =A0wrote: >>> >>> On 03/08/2011 01:09 PM, David Rosenstrauch wrote: >>>> >>>> On 02/25/2011 04:50 AM, Ertio Lew wrote: >>>>> >>>>> Hi all, >>>>> >>>>> I am involved in a project where we're building a social application >>>>> using Cassandra DB and Java. I am looking for a solution to generate >>>>> unique sequential IDs for the content on the application. I have been >>>>> suggested by some people to have a look to Zookeeper for this. I >>>>> would highly appreciate if anyone can suggest if zookeeper is suitabl= e >>>>> for this purpose and any good resources to gain information about >>>>> zookeeper. >>>>> >>>>> Since the application is based on a eventually consistent distributed >>>>> platform using Cassandra, we have felt a need to look over to other >>>>> solutions instead of building our own using our DB. >>>>> >>>>> Any kind of comments, suggestions are highly welcomed! :) >>>>> >>>>> Regards >>>>> Ertio Lew. >>>> >>>> I ran into a similar id-generation issue, and wrote a library for it. >>>> (Details described in this msg: >>>> >>>> >>>> http://mail-archives.apache.org/mod_mbox/hadoop-zookeeper-user/201008.= mbox/%3C4C5B7656.4020200@darose.net%3E >>>> .) >>>> >>>> Been planning to release it to the community, but haven't gotten aroun= d >>>> to it yet. >>>> >>>> Not sure my solution is exactly what you're looking for though. >>>> >>>> HTH, >>>> >>>> DR >>> >>> BTW, that email is old. =A0We now have had this running quite reliably = in >>> production for several months now. =A0It's being used by M/R jobs runni= ng >>> 100 >>> simultaneous reducers, each accessing the ID generator, and assigning >>> nearly >>> 1 million ID's per job in total. >>> >>> DR >>> > >