zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sun liwei <slivey...@gmail.com>
Subject Re: Zookeeper in Kafka has gets a very low Performance
Date Thu, 13 Sep 2012 01:24:54 GMT
On Thu, Sep 13, 2012 at 2:49 AM, Henry Robinson <henry@cloudera.com> wrote:

> On 12 September 2012 03:07, sun liwei <sliveysun@gmail.com> wrote:
>
> > Here is what I haveļ¼š
> >
> >
> >    - zookeeper cluster with 3 severs
> >    - 1700+ kafka topics (that means there are 1700+ children under path
> >    '/brokers/topics'), these topics are written frequently by kafka.
> >    - log file size is 67108880 byte,  snapshot file size is 4192072
> >    byte, new log/snapshot files are created every one or two minutes
> >
> > The problem is that it takes more than 40ms to getData of a single
> topic. I
> > have another zookeeper cluster and the getData takes no more than 2ms to
> > getData of a single path. This cluster doesn't server kafka.
> >
> > Any body knows why the performance is so bad?
> >
>
> How big (in terms of bytes) are the topic nodes that you are getting? Are
> they the same size as the nodes in the better-performing cluster?
>
actually, the data of the topic is null. yes, they are the same.

>
> Henry
>
>
> >
> > Many thanks and best regards.
> >
> > Liwei
> >
>
>
>
> --
> Henry Robinson
> Software Engineer
> Cloudera
> 415-994-6679
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message