Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (athena.apache.org: domain of tran.hieutrung@gmail.com
 designates 209.85.160.44 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=JRAwPezg6zfZn35WU2AogkwwEhkvQOSnST3OfM/Bo4DWB7kNUPgBTtnadTGFQZXV/c
         jqa+55tckhlwsdIiJssGt4M48I9aGHdcocL9jkNWlwH8yiZDjIGjtFykQlF87BIWfBty
         EiHHeUJZKuTfa36RnzAzwkIz1bRqAkFMzA1Lw=
MIME-Version: 1.0
In-Reply-To: <3923633e-aee2-6586-b880-b6862ce5c4d1@me.com>
References: <AANLkTim0y596xU9BKJ+VZwUeYyVR_O_euRH=fuV8Sh+e@mail.gmail.com>
	<3923633e-aee2-6586-b880-b6862ce5c4d1@me.com>
Date: Mon, 22 Nov 2010 11:14:52 -0800
Message-ID: <AANLkTi=Md6ncMAyraN4NHpjiUpm6gO8jQhWf5rqRQgiy@mail.gmail.com>
Subject: Re: Newbie question on Cassandra mem usage
From: Trung Tran <tran.hieutrung@gmail.com>
To: user@cassandra.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hi,

Thanks for the guideline. I did not turn up any memory setting, the
nodes are configured with all default settings (except for disk-access
is using nmap). I have 3 nodes with 1 client using hector, 8 writing
threads. There are 3 CF, 1 standard and 2 super.

Thanks,
Trung.

On Mon, Nov 22, 2010 at 11:00 AM, Aaron Morton <aaron@thelastpickle.com> wr=
ote:
> The higher memory usage for the java process may be because of memory map=
ped
> file access, take a look at the disk_access_mode in cassandra.yaml
> WRT going OutOfMemory:
> - what are your Memtable thresholds in cassandra.yaml ?
> - how many Column Families do you have?
> - What are your row and key cache settings?
> - Have a read of JVM HeapSize section
> here=A0http://wiki.apache.org/cassandra/MemtableThresholds
> - Have a read
> of=A0http://wiki.apache.org/cassandra/FAQ#slows_down_after_lotso_inserts
> In short, if you've turned up any memory settings turn them down. Run you=
r
> test again and see if it completes. Then turn them up a little at a time.
> If you're still having trouble include some details of your cassandra.yam=
l
> file and the schema definition next time. As well as how many cassandra
> nodes you have, how many clients you are running against it and how fast
> they are writing.
> Aaron
>
> On 23 Nov, 2010,at 07:45 AM, Trung Tran <tran.hieutrung@gmail.com> wrote:
>
> Hi,
>
> I have a test cluster of 3 nodes, 14Gb of mem in each node,
> replication factor =3D 3. With default -Xms and Xmx, my nodes are set to
> have max-heap-size =3D 7Gb. After initial load with about 200M rows
> (write with hector default consistencylevel =3D quorum,) my nodes memory
> usage are up to 13.5Gb, show a bunches of GC notifications and
> eventually crashes with java.lang.OutOfMemoryError: Java heap space.
>
> Is there any setting that can help with this scenario?
>
> Thanks,
> Trung.
>