hadoop-zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Daniel Cryans <jdcry...@apache.org>
Subject Re: How large an ensemble can one build with Zookeeper?
Date Wed, 04 Mar 2009 14:02:40 GMT
David,

This is exactly what we are doing in the HBase project (www.hbase.org).
Zookeeper is currently being integrated for our next major version and some
parts are already in place.

Regards,

J-D

On Wed, Mar 4, 2009 at 9:00 AM, David Pollak
<feeder.of.the.bears@gmail.com>wrote:

> On Tue, Mar 3, 2009 at 9:33 PM, Ted Dunning <ted.dunning@gmail.com> wrote:
>
> > zookeeper is not really what you would call a scalable system because all
> > transactions that are updates go through the leader for serialization.
> > Zookeeper is, instead, a high throughput HA system. That said, the
> > throughput of a modest zookeeper  cluster is fairly prodigous so for the
> > normal application of coordinating a large cluster, these limits are
> beyond
> > what just about anyone needs.
> >
> > For other uses, though, 50 K updates per second wouldn't cut it.
>
>
> I understand that Google uses Chubby (a ZooKeeper clone... or vice versa
> :-)
> ) as the coordination mechanism for Big Table.  Do you have any insight
> into
> Chubby's performance characteristics... and if it would be possible to
> build
> a Big Table clone that had scalability characteristics of Big Table with
> ZooKeeper as the underlying coordinator?
>
>
> >
> >
> >
> > Sent from my iPhone
> >
> >
> > On Mar 3, 2009, at 17:30, Chad Harrington <charrington@datascaler.com>
> > wrote:
> >
> >  Clearly Zookeeper can handle ensembles of a dozen or so servers.  How
> >> large
> >> an ensemble can one build with Zookeeper?  100 servers?  10,000 servers?
> >> Are there limitations that make the system unusable at large numbers of
> >> servers?
> >>
> >> Thanks,
> >>
> >> --
> >> Chad Harrington
> >> CEO
> >> DataScaler, Inc.
> >> charrington@datascaler.com
> >> 201A Ravendale Dr.
> >> Mountain View, CA  94043
> >> Phone: 650-515-3437
> >> Fax: 650-887-1544
> >>
> >
>
>
> --
> Lift, the simply functional web framework http://liftweb.net
> Beginning Scala http://www.apress.com/book/view/1430219890
> Follow me: http://twitter.com/dpp
> Git some: http://github.com/dpp
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message