hadoop-zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <ted.dunn...@gmail.com>
Subject Re: Managing multi-site clusters with Zookeeper
Date Sat, 06 Mar 2010 18:29:43 GMT
What you describe is relatively reasonable, even though Zookeeper is not
normally distributed across multiple data centers with all members getting
full votes.  If you account for the limited throughput that this will impose
on your applications that use ZK, then I think that this can work well.
Probably, you would have local ZK clusters for higher transaction rate
applications.

You should also consider very carefully whether having multiple data centers
increases or decreases your overall reliability.  Unless you design very
carefully, this will normally substantially degrade reliability.  Making
sure that it increases reliability is a really big task that involves a lot
of surprising (it was to me) considerations and considerable hardware and
time investments.

Good luck!

On Sat, Mar 6, 2010 at 1:50 AM, Martin Waite <waite.134@googlemail.com>wrote:

> Is this a viable approach, or am I taking Zookeeper out of its application
> domain and just asking for trouble ?
>



-- 
Ted Dunning, CTO
DeepDyve

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message