Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@zookeeper.apache.org
Received-SPF: pass (nike.apache.org: domain of fpjunqueira@yahoo.com
 designates 216.109.115.190 as permitted sender)
Date: Thu, 16 Apr 2015 09:14:52 +0000 (UTC)
From: Flavio Junqueira <fpjunqueira@yahoo.com.INVALID>
Reply-To: Flavio Junqueira <fpjunqueira@yahoo.com>
To: "user@zookeeper.apache.org" <user@zookeeper.apache.org>
Message-ID: <1909203117.5120341.1429175693097.JavaMail.yahoo@mail.yahoo.com>
In-Reply-To: <1458C6B4EF2B37428F20085D75DD94DB0179DE038B@MARY.main.mobik.si>
References: <1458C6B4EF2B37428F20085D75DD94DB0179DE038B@MARY.main.mobik.si>
Subject: Re: Transaction logs and snapshots
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_5120340_362825495.1429175693091"

------=_Part_5120340_362825495.1429175693091
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hi Dejan,
Check if the autopurge feature solves your problem:
http://zookeeper.apache.org/doc/r3.4.6/zookeeperAdmin.html#sc_advancedConfi=
guration
=20
-Flavio=C2=A0


     On Thursday, April 16, 2015 9:17 AM, Dejan Markic <Dejan.Markic@mobik-=
ics.com> wrote:
  =20
=20

 Hello all!

We are running 3 ZK servers in ensemble, and ZK is processing a lot of comm=
ands per seconds. There are probably around 300 nodes created/checked/set/g=
et per second.
Since we have only information about live sessions we handle in ZK, we don'=
t need any data persistency - eg: we can stop all nodes, clean all transact=
ion logs/snapshots, and start them up again, without any issues.
Since we have a lot of requests/changes, we have moved dataDir onto ramdisk=
, so we have no problems with disk IOPS, etc.
Is there a way, to minimze the usage of snapshots/logs so ramdisk would not=
 get filled up? It happens that transaction logs/snapshots grow so large, t=
hat we run out of space on ramdisk.
We issue >/usr/share/zookeeper/bin/zkCleanup.sh -n 3< every 2 minutes, so t=
his should cleanup the dataDir quite often. Why is >count number of snapsho=
ts/logs to keep< limited to 3 and not below?
I assume, in my setup, I don't even need snapshots/logs to be stored after =
they are not actively needed?=20
So my basic questions are:=C2=A0=20
- can I somehow get rid of snapshot/logs sooner, more often ... ?
- when is snapshot created? Can it be created sooner, so it would be smalle=
r?=20
- Is it possible to get rid of snapshot/logs all together?

Thank you for all your inputs and kind regards,
Dejan Markic

=20
  
------=_Part_5120340_362825495.1429175693091--