zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From rammohan ganapavarapu <rammohanga...@gmail.com>
Subject Re: How to find the actual size of zk data
Date Mon, 19 Mar 2018 15:05:47 GMT
zkTreeutil has option to dump every thing into a directory and create same
tree in filesystem under that directory, i am talking about that size.

Ram

On Mon, Mar 19, 2018 at 5:42 AM, Mark Fenes <mfenes@cloudera.com> wrote:

>
> Hi Ram,
>
> If the format of the snapshot file and the zktreeutil dump file is
> different, they will have different sizes. Does zktreeutil export the zk
> data in XML format?
>
> Mark
>
>
> On Fri, Mar 16, 2018 at 2:58 AM, rammohan ganapavarapu <
> rammohanganap@gmail.com> wrote:
>
>> Jordan,
>>
>> Thank you, even though you have multiple snapshot files in dataDir
>> zookeeper uses only one latest file right? If my latest snapshot file is
>> 1GB means my total zk data side is 1GB ?  But when I use zktreeutil and
>> dump to filesystem i am getting lot more GB space then snapshot size.
>>
>> Ram
>>
>> On Thu, Mar 15, 2018, 4:02 PM Jordan Zimmerman <
>> jordan@jordanzimmerman.com>
>> wrote:
>>
>> > > How to find  actual size of zookeeper data since it store and operate
>> > from
>> > > in-memory? and snapshot may not give me actual size?
>> >
>> > ZooKeeper transactions/snapshots are stored on disk in a series of
>> files.
>> > You can use your file system to get the combined sizes of these files.
>> The
>> > directory is specified by the "dataDir" value in zoo.cfg.
>> >
>> > > One more question, since its a in-memory datastore, what if my zk data
>> > > grows beyond available RAM? does it swap?
>> >
>> > No. ZooKeeper does not swap. You will get OutOfMemory exceptions if
>> store
>> > too much data. The ZooKeeper database is always limited by memory.
>> >
>> > -JZ
>> >
>> > > On Mar 15, 2018, at 5:57 PM, rammohan ganapavarapu <
>> > rammohanganap@gmail.com> wrote:
>> > >
>> > > Hi,
>> > >
>> > > How to find  actual size of zookeeper data since it store and operate
>> > from
>> > > in-memory? and snapshot may not give me actual size? I used
>> zkteeUtils to
>> > > dump the data is it the actual size ?
>> > >
>> > > One more question, since its a in-memory datastore, what if my zk data
>> > > grows beyond available RAM? does it swap?
>> > >
>> > > Thanks,
>> > > Ram
>> >
>> >
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message