hadoop-zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Rouchy <drou...@gmail.com>
Subject Using Zookeeper to distribute tasks
Date Tue, 27 Apr 2010 07:23:41 GMT
Hi all,

We are studying using ZooKeeper to manage configuration across multiple
processes & server. What would be also interesting, as ZooKeeper know the
list of process running, would be to use it to distribute tasks.

We have some long running tasks, so we used multiple servers to process
multiple tasks in the same time. My idea would be to use multiple ephemeral
watcher connected to one znode. A process will send data to this node when a
new task has to be launched. But here is my issue, I would like only one
watcher to be triggered of this change (a random watcher in the list). Is
there way to do such thing in ZooKeeper?

Regards,

David Rouchy

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message