zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Rosenstrauch <dar...@darose.net>
Subject Re: Zookeeper for generating sequential IDs
Date Wed, 09 Mar 2011 04:47:41 GMT
The library currently generates ID's as java longs.  (i.e., 8 byte 
integers).  Does that work for you?

I keep trying to free up time to release this, but I keep getting buried 
at work!  :-(  Will try my best to get this out soon.



On 03/08/2011 01:21 PM, Ertio Lew wrote:
> Thanks so much David !!
> Your solution seems to perfectly fulfill our requirements of
> continuous and monotonically  increasing Ids. What is the size of your
> Ids in bytes??
> We are particularly looking for i32 and i64 sized ids.
> Are you planning to release this work to community anytime sooner ?
> Thanks anyways for sharing knowledge.
> On Tue, Mar 8, 2011 at 11:43 PM, David Rosenstrauch<darose@darose.net>  wrote:
>> On 03/08/2011 01:09 PM, David Rosenstrauch wrote:
>>> On 02/25/2011 04:50 AM, Ertio Lew wrote:
>>>> Hi all,
>>>> I am involved in a project where we're building a social application
>>>> using Cassandra DB and Java. I am looking for a solution to generate
>>>> unique sequential IDs for the content on the application. I have been
>>>> suggested by some people to have a look to Zookeeper for this. I
>>>> would highly appreciate if anyone can suggest if zookeeper is suitable
>>>> for this purpose and any good resources to gain information about
>>>> zookeeper.
>>>> Since the application is based on a eventually consistent distributed
>>>> platform using Cassandra, we have felt a need to look over to other
>>>> solutions instead of building our own using our DB.
>>>> Any kind of comments, suggestions are highly welcomed! :)
>>>> Regards
>>>> Ertio Lew.
>>> I ran into a similar id-generation issue, and wrote a library for it.
>>> (Details described in this msg:
>>> http://mail-archives.apache.org/mod_mbox/hadoop-zookeeper-user/201008.mbox/%3C4C5B7656.4020200@darose.net%3E
>>> .)
>>> Been planning to release it to the community, but haven't gotten around
>>> to it yet.
>>> Not sure my solution is exactly what you're looking for though.
>>> HTH,
>>> DR
>> BTW, that email is old.  We now have had this running quite reliably in
>> production for several months now.  It's being used by M/R jobs running 100
>> simultaneous reducers, each accessing the ID generator, and assigning nearly
>> 1 million ID's per job in total.
>> DR

View raw message