Return-Path: X-Original-To: apmail-zookeeper-user-archive@www.apache.org Delivered-To: apmail-zookeeper-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E2316D9FF for ; Wed, 12 Sep 2012 10:08:20 +0000 (UTC) Received: (qmail 61972 invoked by uid 500); 12 Sep 2012 10:08:20 -0000 Delivered-To: apmail-zookeeper-user-archive@zookeeper.apache.org Received: (qmail 61259 invoked by uid 500); 12 Sep 2012 10:08:13 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Received: (qmail 61230 invoked by uid 99); 12 Sep 2012 10:08:12 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 12 Sep 2012 10:08:12 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of sliveysun@gmail.com designates 209.85.214.170 as permitted sender) Received: from [209.85.214.170] (HELO mail-ob0-f170.google.com) (209.85.214.170) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 12 Sep 2012 10:08:05 +0000 Received: by obbwc18 with SMTP id wc18so2049787obb.15 for ; Wed, 12 Sep 2012 03:07:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=QWbVPgIPaAqH5Z9+u8LR6+p4ZehYj5luEWAba3czyXo=; b=0Kayi95avCs/SAn9GAHGCKWAjEbjCZpcsweEuZJbdTq2TPUuCkVzOHgzuu0iioHHf3 1otlC+kGhfgVymDoJlWGL56CCv+/Ocv2Rk0/zkjLFtAoUdLYR/5ejOBxURixkdv82dn4 gP+81SYrmI/djFWQ3xV9uMocR8MVVXqoUssrSFF2re0/tfNYT8lezpqbyb8JQrkNkEpe xQlJFeP6+bFuyq5P2BkBNsTNsOE5/Dt/qCKYOroWu9e1FRu4HOgG5lGh8T4FkUVVHBPr aWaB5qrbI/3E/QPe7n73888qVcJ1n+nrwd68p6lt/Xtv1PT5NBCF8sl/M8DZdzknMQ9C 8sGA== MIME-Version: 1.0 Received: by 10.60.27.9 with SMTP id p9mr21329536oeg.69.1347444464378; Wed, 12 Sep 2012 03:07:44 -0700 (PDT) Received: by 10.76.163.65 with HTTP; Wed, 12 Sep 2012 03:07:44 -0700 (PDT) Date: Wed, 12 Sep 2012 18:07:44 +0800 Message-ID: Subject: Zookeeper in Kafka has gets a very low Performance From: sun liwei To: user@zookeeper.apache.org Content-Type: multipart/alternative; boundary=e89a8fb2062ea761ca04c97e5cb0 --e89a8fb2062ea761ca04c97e5cb0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Here is what I have=EF=BC=9A - zookeeper cluster with 3 severs - 1700+ kafka topics (that means there are 1700+ children under path '/brokers/topics'), these topics are written frequently by kafka. - log file size is 67108880 byte, snapshot file size is 4192072 byte, new log/snapshot files are created every one or two minutes The problem is that it takes more than 40ms to getData of a single topic. I have another zookeeper cluster and the getData takes no more than 2ms to getData of a single path. This cluster doesn't server kafka. Any body knows why the performance is so bad? Many thanks and best regards. Liwei --e89a8fb2062ea761ca04c97e5cb0--