zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Henry Robinson <he...@cloudera.com>
Subject Re: Zookeeper on two clusters?
Date Fri, 26 Aug 2011 21:04:56 GMT
Aleksey -

The clusters must be able to communicate over TCP through some user
configurable ports. If this is possible, then as Camille says, you can
configure ZK normally with machines in both locations - no need for any
special quorum setup.

Henry

On 26 August 2011 13:39, Aleksey Yakovlev <aleksey.yakovlev@gmail.com>wrote:

> Camille:
>
> Sorry to say, I can't ping one cluster from another...
> You are saying, that all the servers mutual pingability is necessary and
> sufficient for ZK to operate, right?
>
> Thanks
> AY
>
> On Fri, Aug 26, 2011 at 12:05 PM, Fournier, Camille F. <
> Camille.Fournier@gs.com> wrote:
>
> > As long as the two clusters can ping each other, just set up a single ZK
> > cluster spread across the two, 3 or 5 nodes (total, not per cluster).
> Note
> > that if these two clusters are used for business continuity purposes
> (spread
> > across 2 data centers), you still risk the outage of the zookeeper if you
> > lose one of the data centers (the one containing the majority of the ZK
> > nodes).
> >
> > There's no reason to set up 2 ZK quorums and merge them.
> >
> > C
> >
> > -----Original Message-----
> > From: Aleksey Yakovlev [mailto:aleksey.yakovlev@gmail.com]
> > Sent: Friday, August 26, 2011 10:09 AM
> > To: user@zookeeper.apache.org
> > Subject: Re: Zookeeper on two clusters?
> >
> > Mahadev:
> >
> > I need these two clusters to communicate somehow, because our distributed
> > system works on both of them - so we need some coordination, for example,
> > to
> > recover after failures. I could create my own servers/protocols for that,
> > but why - the ZooKeeper does just that, right?
> >
> > The number 5 isn't important here, configuration and communication is
> >
> > Thanks
> > AY
> >
> > On Fri, Aug 26, 2011 at 1:55 AM, Mahadev Konar <mahadev@hortonworks.com
> > >wrote:
> >
> > > Aleksey,
> > >  I am a little confused. Whats the motivation behind merging the
> > > quorums? Why do you want 5 on each cluster?
> > >
> > > thanks
> > > mahadev
> > >
> > > On Tue, Aug 23, 2011 at 10:24 AM, Aleksey Yakovlev
> > > <aleksey.yakovlev@gmail.com> wrote:
> > > > Hi,
> > > >
> > > > We have two clusters but I can't just ssh from one cluster to another
> -
> > I
> > > > have to enter a password, use some authentication, go through a load
> > > > balancer etc
> > > > It would be very useful for us to use the Zookeeper as a common
> storage
> > > > place for small configuration data, accessible from both these
> > clusters.
> > > >
> > > > So, I'm thinking about starting like 5 servers on each cluster and
> > merge
> > > > them into a single quorum - anybody did that?
> > > > If yes, how to configure this double-side quorum?
> > > >
> > > > (I'm completely new to the Zookeeper)
> > > >
> > > > Thanks
> > > > AY
> > > >
> > >
> >
>



-- 
Henry Robinson
Software Engineer
Cloudera
415-994-6679

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message