Return-Path: X-Original-To: apmail-zookeeper-user-archive@www.apache.org Delivered-To: apmail-zookeeper-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B0AA99F72 for ; Wed, 25 Jan 2012 09:27:00 +0000 (UTC) Received: (qmail 56293 invoked by uid 500); 25 Jan 2012 09:26:58 -0000 Delivered-To: apmail-zookeeper-user-archive@zookeeper.apache.org Received: (qmail 52918 invoked by uid 500); 25 Jan 2012 09:26:36 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Received: (qmail 52818 invoked by uid 99); 25 Jan 2012 09:26:32 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 25 Jan 2012 09:26:32 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of stan.ieugen@gmail.com designates 74.125.83.42 as permitted sender) Received: from [74.125.83.42] (HELO mail-ee0-f42.google.com) (74.125.83.42) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 25 Jan 2012 09:26:23 +0000 Received: by eeit10 with SMTP id t10so2141496eei.15 for ; Wed, 25 Jan 2012 01:26:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:subject :content-type:content-transfer-encoding; bh=R04ZAizwbEt06hlCEdhwPcvcHM0b0wzahAm5Zks1xok=; b=xHiEYmW+VKGwq1zIVuFtXAZjON7g+112yScfz+bu2qT+vDAESZlaQ2qaFMiVB4mSL6 c5KkiUORTTPPfeHDeJaYwFov53gQ3rjHtpmlc01RTLzzTlriwUOxFzwM/Wj3rlqe2vRH oyjBrLCPmqaG+nYOUOB3zpwgamT4Teehg/A74= Received: by 10.14.16.12 with SMTP id g12mr5861111eeg.57.1327483563261; Wed, 25 Jan 2012 01:26:03 -0800 (PST) Received: from [172.28.125.107] (et-0-nat-1.gw-nat-a.sme.buh.ro.oneandone.net. [212.227.35.137]) by mx.google.com with ESMTPS id w46sm47278975eeb.0.2012.01.25.01.26.01 (version=SSLv3 cipher=OTHER); Wed, 25 Jan 2012 01:26:02 -0800 (PST) Message-ID: <4F1FCAA8.6090806@gmail.com> Date: Wed, 25 Jan 2012 11:26:00 +0200 From: Ioan Eugen Stan User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.24) Gecko/20111108 Lightning/1.0b2 Thunderbird/3.1.16 MIME-Version: 1.0 To: user@zookeeper.apache.org, eric.charles@u-mangate.com, norman@apache.org Subject: building an distribuited mail-store UID generator using zookeeper Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org Hello, I'm pretty new to Zk and I wish to design a distribuited uid generator with it. I'm working on Apache James (email server) and we have a HBase Mailbox implementation but we are missing this piece to go closer to full distributed mail store. The problem: Each message in the mail-store has a unique UID that is 32 bits long. They all have to be unique for one mailbox and must be (generated) in ascending order. It's similar to the sequence znode type available in Zk. A new UID is required for every new email, moved email, and some other operations. I wish to store uid's for mailboxes as ZK paths: /m/${mailbox-uuid-or-name}/uid- My question is if Zookeeper can support a huge amount of sequence znodes in the range of let's say 15 milion and do update on a fraction of those. Thanks, -- Ioan Eugen Stan http://ieugen.blogspot.com