Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@zookeeper.apache.org
MIME-Version: 1.0
Date: Wed, 2 Sep 2015 14:17:41 +0530
Message-ID: 
 <CANXk_5kRYzsHiXOGPabbi+KcrNx8o3t3eQsPiOiETeHTUCjDLQ@mail.gmail.com>
Subject: Distributed Task Queue with client node failovers
From: Prabhjot Bharaj <prabhbharaj@gmail.com>
To: user@zookeeper.apache.org
Content-Type: multipart/alternative; boundary=047d7bdc189a2ec6c6051ebfb8ea

--047d7bdc189a2ec6c6051ebfb8ea
Content-Type: text/plain; charset=UTF-8

Hello Folks,

I am trying to design a distributed queue with Zookeeper. The use case is
like this:-

A set of 't' tasks to be executed by 'n' nodes in round-robin fashion. But,
if any node goes down, the other nodes should take the task.

For this purpose, I'm reading about zookeeper Queue recipe. The Queue
recipe relies on client watcher.

Initially, all clients run their respective tasks. But, after one
iteration, lets say one client node goes down.
In this case, that client node itself is unavailable to get a Watch Event,
can the task be transferred to another node ?

The worst case will be -
All the client nodes, but one, are down. Can this one node still pick up
all tasks sequentially and execute them ?

Thanks,
Prabhjot

--047d7bdc189a2ec6c6051ebfb8ea--