zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Prabhjot Bharaj <prabhbha...@gmail.com>
Subject Distributed Task Queue with client node failovers
Date Wed, 02 Sep 2015 08:47:41 GMT
Hello Folks,

I am trying to design a distributed queue with Zookeeper. The use case is
like this:-

A set of 't' tasks to be executed by 'n' nodes in round-robin fashion. But,
if any node goes down, the other nodes should take the task.

For this purpose, I'm reading about zookeeper Queue recipe. The Queue
recipe relies on client watcher.

Initially, all clients run their respective tasks. But, after one
iteration, lets say one client node goes down.
In this case, that client node itself is unavailable to get a Watch Event,
can the task be transferred to another node ?

The worst case will be -
All the client nodes, but one, are down. Can this one node still pick up
all tasks sequentially and execute them ?


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message