zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Henry Robinson <he...@cloudera.com>
Subject Re: Zookeeper in Kafka has gets a very low Performance
Date Wed, 12 Sep 2012 18:49:49 GMT
On 12 September 2012 03:07, sun liwei <sliveysun@gmail.com> wrote:

> Here is what I haveļ¼š
>
>
>    - zookeeper cluster with 3 severs
>    - 1700+ kafka topics (that means there are 1700+ children under path
>    '/brokers/topics'), these topics are written frequently by kafka.
>    - log file size is 67108880 byte,  snapshot file size is 4192072
>    byte, new log/snapshot files are created every one or two minutes
>
> The problem is that it takes more than 40ms to getData of a single topic. I
> have another zookeeper cluster and the getData takes no more than 2ms to
> getData of a single path. This cluster doesn't server kafka.
>
> Any body knows why the performance is so bad?
>

How big (in terms of bytes) are the topic nodes that you are getting? Are
they the same size as the nodes in the better-performing cluster?

Henry


>
> Many thanks and best regards.
>
> Liwei
>



-- 
Henry Robinson
Software Engineer
Cloudera
415-994-6679

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message