hadoop-zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Pollak <feeder.of.the.be...@gmail.com>
Subject Re: How large an ensemble can one build with Zookeeper?
Date Wed, 04 Mar 2009 14:25:19 GMT
JD,
When I last looked at HBase (about a year ago), the performance was lacking.
 Have there been material improvements in HBase's performance in the last
year?

Thanks,

David

PS -- If this is not the correct list for such questions, I pre-apologize.
 Just whack me with a 2x4 and I'll take the discussion off the ZooKeeper
list.

On Wed, Mar 4, 2009 at 6:02 AM, Jean-Daniel Cryans <jdcryans@apache.org>wrote:

> David,
>
> This is exactly what we are doing in the HBase project (www.hbase.org).
> Zookeeper is currently being integrated for our next major version and some
> parts are already in place.
>
> Regards,
>
> J-D
>
> On Wed, Mar 4, 2009 at 9:00 AM, David Pollak
> <feeder.of.the.bears@gmail.com>wrote:
>
> > On Tue, Mar 3, 2009 at 9:33 PM, Ted Dunning <ted.dunning@gmail.com>
> wrote:
> >
> > > zookeeper is not really what you would call a scalable system because
> all
> > > transactions that are updates go through the leader for serialization.
> > > Zookeeper is, instead, a high throughput HA system. That said, the
> > > throughput of a modest zookeeper  cluster is fairly prodigous so for
> the
> > > normal application of coordinating a large cluster, these limits are
> > beyond
> > > what just about anyone needs.
> > >
> > > For other uses, though, 50 K updates per second wouldn't cut it.
> >
> >
> > I understand that Google uses Chubby (a ZooKeeper clone... or vice versa
> > :-)
> > ) as the coordination mechanism for Big Table.  Do you have any insight
> > into
> > Chubby's performance characteristics... and if it would be possible to
> > build
> > a Big Table clone that had scalability characteristics of Big Table with
> > ZooKeeper as the underlying coordinator?
> >
> >
> > >
> > >
> > >
> > > Sent from my iPhone
> > >
> > >
> > > On Mar 3, 2009, at 17:30, Chad Harrington <charrington@datascaler.com>
> > > wrote:
> > >
> > >  Clearly Zookeeper can handle ensembles of a dozen or so servers.  How
> > >> large
> > >> an ensemble can one build with Zookeeper?  100 servers?  10,000
> servers?
> > >> Are there limitations that make the system unusable at large numbers
> of
> > >> servers?
> > >>
> > >> Thanks,
> > >>
> > >> --
> > >> Chad Harrington
> > >> CEO
> > >> DataScaler, Inc.
> > >> charrington@datascaler.com
> > >> 201A Ravendale Dr.
> > >> Mountain View, CA  94043
> > >> Phone: 650-515-3437
> > >> Fax: 650-887-1544
> > >>
> > >
> >
> >
> > --
> > Lift, the simply functional web framework http://liftweb.net
> > Beginning Scala http://www.apress.com/book/view/1430219890
> > Follow me: http://twitter.com/dpp
> > Git some: http://github.com/dpp
> >
>



-- 
Lift, the simply functional web framework http://liftweb.net
Beginning Scala http://www.apress.com/book/view/1430219890
Follow me: http://twitter.com/dpp
Git some: http://github.com/dpp

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message