Return-Path: X-Original-To: apmail-zookeeper-user-archive@www.apache.org Delivered-To: apmail-zookeeper-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BD576FCCD for ; Mon, 8 Apr 2013 10:51:21 +0000 (UTC) Received: (qmail 84563 invoked by uid 500); 8 Apr 2013 10:51:21 -0000 Delivered-To: apmail-zookeeper-user-archive@zookeeper.apache.org Received: (qmail 84051 invoked by uid 500); 8 Apr 2013 10:51:18 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Received: (qmail 84022 invoked by uid 99); 8 Apr 2013 10:51:17 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Apr 2013 10:51:17 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of mathias.hodler@gmail.com designates 74.125.83.42 as permitted sender) Received: from [74.125.83.42] (HELO mail-ee0-f42.google.com) (74.125.83.42) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Apr 2013 10:51:11 +0000 Received: by mail-ee0-f42.google.com with SMTP id d4so1468059eek.1 for ; Mon, 08 Apr 2013 03:50:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=jhqZNfJSm053BZcFwGSWvsS+I3tNRkppis8VTrOHjcA=; b=smZ470i32077F8w3TCqglXTNgs22d3XTrfSlBpu2pNolAsK2JT8ypSgtUvHRv0boUH ftROH30ZiF1RZOUrZyBzXc+cpdqjqsS8rqdojqCICkXd6ZQ5S75OFcVwWcySHNttyODz uHlLx5ARegHzM9663dgjRPj2dr/ENQmHrHPKfKrXTDQZ5GKxJpRmJoA9Ymfp9W/Hk0nv sKt5YdxxLWPL427oPkkjHKexG5g+spP3Tdlh83I8vkaI4T1vg16xaPFbDquD5z5dEhBX HBvNJ4n3ARX1NeSMh0suViDjlNmtxJ2CCdmZifXG8nlwf+QYSrmjF0H0oCvihj5XKf2y 9ZaA== MIME-Version: 1.0 X-Received: by 10.14.179.201 with SMTP id h49mr47280395eem.26.1365417759337; Mon, 08 Apr 2013 03:42:39 -0700 (PDT) Received: by 10.14.144.10 with HTTP; Mon, 8 Apr 2013 03:42:39 -0700 (PDT) In-Reply-To: References: Date: Mon, 8 Apr 2013 12:42:39 +0200 Message-ID: Subject: Fwd: Zookeeper does not clean up deleted nodes From: Mathias Hodler To: user@zookeeper.apache.org Content-Type: multipart/alternative; boundary=047d7b603e7c841f8304d9d718e7 X-Virus-Checked: Checked by ClamAV on apache.org --047d7b603e7c841f8304d9d718e7 Content-Type: text/plain; charset=ISO-8859-1 Hi, I've made some tests and it seems like zookeeper doesn't clean up the last 500 deleted nodes. In my test I created nodes and deleted each node after it was created. I repeated this step 1000 times and then triggered a full gc. These are the results Creating 1000 Nodes and deleting 1000 Nodes and each node has... ...1000kb data = 529MB heap used after FullGC ...500kb data = 281MB heap used after FullGC ...256kb data = 140MB heap used after FullGC ...128kb data = 68MB heap used after FullGC If I'm creating 1000 nodes with each 1000kb data and then deleting the nodes and after that creating 1000 nodes with 128kb data and deleting the nodes again, 68MB heap space is used. So it seems Zookeeper caches / doesn't clean up the last 500 deleted nodes. Is this a bug or are there configuration parameter to change that behaviour? --047d7b603e7c841f8304d9d718e7--