zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kathleen Ting <kathl...@apache.org>
Subject Re: Zookeeper in Kafka has gets a very low Performance
Date Wed, 12 Sep 2012 18:47:30 GMT
Hi Liwei,

Could JVM warm-up account for the additional time required to getData?

Or do you have log4j logging set to something other than INFO?
DEBUG/TRACE can slow things down.

Regards, Kathleen


On Wed, Sep 12, 2012 at 3:33 AM, sun liwei <sliveysun@gmail.com> wrote:
> The version of zookeeper is 3.3.4.
>
> On Wed, Sep 12, 2012 at 6:07 PM, sun liwei <sliveysun@gmail.com> wrote:
>
>> Here is what I haveļ¼š
>>
>>
>>    - zookeeper cluster with 3 severs
>>    - 1700+ kafka topics (that means there are 1700+ children under path
>>    '/brokers/topics'), these topics are written frequently by kafka.
>>    - log file size is 67108880 byte,  snapshot file size is 4192072
>>    byte, new log/snapshot files are created every one or two minutes
>>
>> The problem is that it takes more than 40ms to getData of a single topic.
>> I have another zookeeper cluster and the getData takes no more than 2ms to
>> getData of a single path. This cluster doesn't server kafka.
>>
>> Any body knows why the performance is so bad?
>>
>> Many thanks and best regards.
>>
>> Liwei
>>

Mime
View raw message