zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Fernando Padilla <f...@alum.mit.edu>
Subject Re: Task/Job distribution using ZooKeeper
Date Wed, 16 Mar 2011 18:02:29 GMT
are you guys trying to describe Fork/Join?

I guess planning for menagerie to implement Fork/Join (slated for java 
7) would be a good thing? :)

On 3/8/11 4:52 AM, Scott Fines wrote:
> Just to throw it in, https://github.com/openutility/menagerie also has
> blocking and synchronous queue implementations.
>
> If we had a deque, this would be a great opportunity for a work stealing
> scenario as well. You could give each consumer its own deque,  then the
> leader could use round robin to load balance. When a consumer has finished a
> task, it removes that item from the deque. Once a consumer runs out of items
> on its deque, it starts taking items off the back of someone else's. That
> way, when a machine dies or becomes slow, another machine can seamlessly
> take over its work.
>
> I'm working on a general purpose implementation for menagerie  now, but a
> deque shouldn't be that hard to make, if you follow the queue recipe
> mentioned above
> On Mar 8, 2011 2:50 AM, "Віталій Тимчишин"<tivv00@gmail.com>  wrote:
>

Mime
View raw message