zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <ted.dunn...@gmail.com>
Subject Re: ZooKeeper performance
Date Mon, 03 Oct 2011 18:25:35 GMT
Correct.

But if your state is changing that fast, pub-sub might well be a useful way
to direct the firehose in the right direction.

On Mon, Oct 3, 2011 at 10:58 AM, Dima Gutzeit
<dima.gutzeit@mailvision.com>wrote:

> I read about Kafka as you suggested but it looks to me as a
> memory-less pub-sub while I want to keep a state in addition of
> notifying other watchers ...
>
> Regards,
> Dima Gutzeit.
>
> Sent from my iPhone
>
> On 3 באוק 2011, at 19:40, Ted Dunning <ted.dunning@gmail.com> wrote:
>
> > I think that these levels are achievable with a correctly tuned ZK
> cluster,
> > but you won't have as much head-room as I would like.  I really think
> that
> > using other systems built on top of ZK might be more useful.
> >
> > On Mon, Oct 3, 2011 at 10:35 AM, Dima Gutzeit
> > <dima.gutzeit@mailvision.com>wrote:
> >
> >> Inline.
> >>
> >> Regards,
> >> Dima Gutzeit.
> >>
> >> Sent from my iPhone
> >>
> >> On 3 באוק 2011, at 19:31, Ted Dunning <ted.dunning@gmail.com> wrote:
> >>
> >>> Questions in-line
> >>>
> >>> On Mon, Oct 3, 2011 at 10:19 AM, Dima Gutzeit
> >>> <dima.gutzeit@mailvision.com>wrote:
> >>>
> >>>> Hi,
> >>>>
> >>>> I have some performance related question.
> >>>>
> >>>> I am running a cluster of 5 zookeeper machines, each one has dual quad
> >>>> core Xeon 2.5 Ghz, 8 gb RAM.
> >>>>
> >>>> I want achieve the following numbers:
> >>>>
> >>>> 10 clients producing in total (at peaks):
> >>>>
> >>>
> >>> Each producing this?
> >>
> >> Total.
> >>>
> >>>
> >>>> 3K add nodes, 3K delete nodes and 10K watches. Per second.
> >>>>
> >>>
> >>> What do you mean by 10K watches?  10,000 watch notifications?
> >>
> >> Yes.
> >>>
> >>> Does those numbers make any sense ?
> >>>>
> >>>
> >>> This is a bit high.  It sounds like you are trying to use ZK as a
> message
> >>> bus rather than a coordination service.  You can do this, but the
> >> throughput
> >>> you can achieve is limited.  If you want higher throughput, it is
> better
> >> to
> >>> have ZK coordinate a higher performance messaging system such as Kafka.
> >>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message