zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ertio Lew <ertio...@gmail.com>
Subject Re: Zookeeper for generating sequential IDs
Date Wed, 09 Mar 2011 05:28:08 GMT
We also wanted a facility for 4 byte integers but still this may be of
interest to us.

Thanks
Ertio Lew

On Wed, Mar 9, 2011 at 10:17 AM, David Rosenstrauch <darose@darose.net> wrote:
> The library currently generates ID's as java longs.  (i.e., 8 byte
> integers).  Does that work for you?
>
> I keep trying to free up time to release this, but I keep getting buried at
> work!  :-(  Will try my best to get this out soon.
>
> HTH,
>
> DR
>
> On 03/08/2011 01:21 PM, Ertio Lew wrote:
>>
>> Thanks so much David !!
>>
>> Your solution seems to perfectly fulfill our requirements of
>> continuous and monotonically  increasing Ids. What is the size of your
>> Ids in bytes??
>>
>> We are particularly looking for i32 and i64 sized ids.
>> Are you planning to release this work to community anytime sooner ?
>>
>> Thanks anyways for sharing knowledge.
>>
>>
>> On Tue, Mar 8, 2011 at 11:43 PM, David Rosenstrauch<darose@darose.net>
>>  wrote:
>>>
>>> On 03/08/2011 01:09 PM, David Rosenstrauch wrote:
>>>>
>>>> On 02/25/2011 04:50 AM, Ertio Lew wrote:
>>>>>
>>>>> Hi all,
>>>>>
>>>>> I am involved in a project where we're building a social application
>>>>> using Cassandra DB and Java. I am looking for a solution to generate
>>>>> unique sequential IDs for the content on the application. I have been
>>>>> suggested by some people to have a look to Zookeeper for this. I
>>>>> would highly appreciate if anyone can suggest if zookeeper is suitable
>>>>> for this purpose and any good resources to gain information about
>>>>> zookeeper.
>>>>>
>>>>> Since the application is based on a eventually consistent distributed
>>>>> platform using Cassandra, we have felt a need to look over to other
>>>>> solutions instead of building our own using our DB.
>>>>>
>>>>> Any kind of comments, suggestions are highly welcomed! :)
>>>>>
>>>>> Regards
>>>>> Ertio Lew.
>>>>
>>>> I ran into a similar id-generation issue, and wrote a library for it.
>>>> (Details described in this msg:
>>>>
>>>>
>>>> http://mail-archives.apache.org/mod_mbox/hadoop-zookeeper-user/201008.mbox/%3C4C5B7656.4020200@darose.net%3E
>>>> .)
>>>>
>>>> Been planning to release it to the community, but haven't gotten around
>>>> to it yet.
>>>>
>>>> Not sure my solution is exactly what you're looking for though.
>>>>
>>>> HTH,
>>>>
>>>> DR
>>>
>>> BTW, that email is old.  We now have had this running quite reliably in
>>> production for several months now.  It's being used by M/R jobs running
>>> 100
>>> simultaneous reducers, each accessing the ID generator, and assigning
>>> nearly
>>> 1 million ID's per job in total.
>>>
>>> DR
>>>
>
>

Mime
View raw message