Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (nike.apache.org: domain of ruslan.usifov@gmail.com
 designates 209.85.161.172 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <656E8470-3932-472A-9A6B-1E294391C0D9@thelastpickle.com>
References: 
 <CAHULbCk-Wu4Lo8dSQBFn4Z3fQAaZmpPd1HZvXHr-qE5vq2Qd1w@mail.gmail.com>
	<656E8470-3932-472A-9A6B-1E294391C0D9@thelastpickle.com>
Date: Mon, 4 Jun 2012 14:13:39 +0400
Message-ID: 
 <CAHULbCkHJUB-vRsbgEi-Xz2d_5MDXR-xTjhUib=ON9LtOxyenA@mail.gmail.com>
Subject: Re: row_cache_provider = 'SerializingCacheProvider'
From: ruslan usifov <ruslan.usifov@gmail.com>
To: user@cassandra.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

I have setup 5GB of JavaHeap wit follow tuning:

MAX_HEAP_SIZE=3D"5G"
HEAP_NEWSIZE=3D"800M"

JVM_OPTS=3D"$JVM_OPTS -XX:+UseParNewGC"
JVM_OPTS=3D"$JVM_OPTS -XX:+UseConcMarkSweepGC"
JVM_OPTS=3D"$JVM_OPTS -XX:+CMSParallelRemarkEnabled"
JVM_OPTS=3D"$JVM_OPTS -XX:SurvivorRatio=3D8"
JVM_OPTS=3D"$JVM_OPTS -XX:MaxTenuringThreshold=3D5"
JVM_OPTS=3D"$JVM_OPTS -XX:CMSInitiatingOccupancyFraction=3D65"
JVM_OPTS=3D"$JVM_OPTS -XX:+UseCMSInitiatingOccupancyOnly"
JVM_OPTS=3D"$JVM_OPTS -XX:CMSFullGCsBeforeCompaction=3D1"

Also I set up 2GB to memtables (memtable_total_space_in_mb: 2048)


My avg heap usage (nodetool -h localhost info):

3G


Based on "nodetool -h localhost cfhistograms" i calc avg row size

70KB

I setup row cache only for one CF with follow settings:

update column family building with rows_cached=3D10000 and
row_cache_provider=3D'SerializingCacheProvider';


When i setup row cache i got promotion failure in GC (with stop the
world pause about 30secs) with almost HEAP filled. I very confused
with this behavior.


PS: i use cassandra 1.0.10, with JNA 3.4.0 on ubuntu lucid (kernel 2.6.32-4=
1)


2012/6/4 aaron morton <aaron@thelastpickle.com>:
> Yes=A0SerializingCacheProvider is the off heap caching provider.
>
> Can you do some more digging into what is using the heap ?
>
> Cheers
> A
>
> -----------------
> Aaron Morton
> Freelance Developer
> @aaronmorton
> http://www.thelastpickle.com
>
> On 1/06/2012, at 9:52 PM, ruslan usifov wrote:
>
> Hello
>
> I begin use SerializingCacheProvider for rows cashing, and got
> extremely JAVA heap grows. But i think that this cache provider
> doesn't use JAVA heap
>
>