Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (nike.apache.org: domain of jbellis@gmail.com designates
 209.85.210.44 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=Py6SbFWxUNjuJRCuggXlfJ7/OW978jC0hNx5iKp4hDJ6Z13tDyipKNAojAv2kImmXp
         0MT9g/QxWF7JQa9eTYH2h+gSPCOz/LvEZPG220nkWyR6jDah1/0n1DcZOQyipe5rF0a2
         KFdFv3ae/vHaoY33oeBD3Zk9sKahzZHdRcNgM=
MIME-Version: 1.0
In-Reply-To: <AANLkTinZRVZtrZBSDZWeRhE+G7TkqTAH5ycrOzm-kWnE@mail.gmail.com>
References: <AANLkTinBueZ231wCwBBq4p_Cc5V0zWuGLvUnzcrO7XwK@mail.gmail.com>
	<AANLkTinZRVZtrZBSDZWeRhE+G7TkqTAH5ycrOzm-kWnE@mail.gmail.com>
Date: Tue, 8 Feb 2011 10:47:20 -0600
Message-ID: <AANLkTik-2A9iwR+wbKZFxET+W=k7Cd8r1Y5jnm8=E_+7@mail.gmail.com>
Subject: Re: Cassandra memory consumption
From: Jonathan Ellis <jbellis@gmail.com>
To: user <user@cassandra.apache.org>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

I missed the part where you explained where you're getting your numbers fro=
m.

On Tue, Feb 8, 2011 at 9:32 AM, Victor Kabdebon
<victor.kabdebon@gmail.com> wrote:
> It is really weird that I am the only one to have this issue.
> I restarted Cassandra today and already the memory compution is over the
> limit :
>
> root=A0=A0=A0=A0=A0 1739=A0 4.0 24.5 664968 494996 pts/4=A0=A0 SLl=A0 15:=
51=A0=A0 0:12
> /usr/bin/java -ea -Xms128M -Xmx256M -XX:+UseParNewGC -XX:+UseConcMarkSwee=
pGC
> -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=3D8 -XX:MaxTenuringThresh=
old=3D1
> -XX:CMSInitiatingOccupancyFraction=3D75 -XX:+UseCMSInitiatingOccupancyOnl=
y
> -XX:+HeapDumpOnOutOfMemoryError -Dcom.sun.management.jmxremote.port=3D808=
1
> -Dcom.sun.management.jmxremote.ssl=3Dfalse
> -Dcom.sun.management.jmxremote.authenticate=3Dfalse
> -Dstorage-config=3Dbin/../conf -cp
> bin/../conf:bin/../build/classes:bin/../lib/antlr-3.1.3.jar:bin/../lib/ap=
ache-cassandra-0.6.6.jar:bin/../lib/avro-1.2.0-dev.jar:bin/../lib/cassandra=
-javautils.jar:bin/../lib/clhm-production.jar:bin/../lib/commons-cli-1.1.ja=
r:bin/../lib/commons-codec-1.2.jar:bin/../lib/commons-collections-3.2.1.jar=
:bin/../lib/commons-io-1.4.jar:bin/../lib/commons-lang-2.4.jar:bin/../lib/c=
ommons-pool-1.5.4.jar:bin/../lib/google-collections-1.0.jar:bin/../lib/hado=
op-core-0.20.1.jar:bin/../lib/hector-0.6.0-14.jar:bin/../lib/high-scale-lib=
.jar:bin/../lib/ivy-2.1.0.jar:bin/../lib/jackson-core-asl-1.4.0.jar:bin/../=
lib/jackson-mapper-asl-1.4.0.jar:bin/../lib/jline-0.9.94.jar:bin/../lib/jna=
.jar:bin/../lib/json-simple-1.1.jar:bin/../lib/libthrift-r917130.jar:bin/..=
/lib/log4j-1.2.14.jar:bin/../lib/perf4j-0.9.12.jar:bin/../lib/slf4j-api-1.5=
.8.jar:bin/../lib/slf4j-log4j12-1.5.8.jar:bin/../lib/uuid-3.1.jar
> org.apache.cassandra.thrift.CassandraDaemon
>
> It is really an annoying problem if we cannot really foresee memory
> consumption.
>
> Best regards,
> Victor K
>
> 2011/2/8 Victor Kabdebon <victor.kabdebon@gmail.com>
>>
>> Dear all,
>>
>> Sorry to come back again to this point but I am really worried about
>> Cassandra memory consumption. I have a single machine that runs one
>> Cassandra server. There is almost no data on it but I see a crazy memory
>> consumption and it doesn't care at all about the instructions...
>> Note that I am not using mmap, but "Standard", I use also JNA (inside li=
b
>> folder), i am running on debian 5 64 bits, so a pretty normal configurat=
ion.
>> I also use Cassandra 0.6.8.
>>
>>
>> Here are the informations I gathered on Cassandra :
>>
>> 105=A0=A0=A0=A0=A0 16765=A0 0.1 34.1 1089424 687476 ?=A0=A0=A0=A0=A0 Sl=
=A0=A0 Feb02=A0 14:58
>> /usr/bin/java -ea -Xms128M -Xmx256M -XX:+UseParNewGC -XX:+UseConcMarkSwe=
epGC
>> -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=3D8 -XX:MaxTenuringThres=
hold=3D1
>> -XX:CMSInitiatingOccupancyFraction=3D75 -XX:+UseCMSInitiatingOccupancyOn=
ly
>> -XX:+HeapDumpOnOutOfMemoryError -Dcom.sun.management.jmxremote.port=3D80=
81
>> -Dcom.sun.management.jmxremote.ssl=3Dfalse
>> -Dcom.sun.management.jmxremote.authenticate=3Dfalse
>> -Dstorage-config=3Dbin/../conf -Dcassandra-foreground=3Dyes -cp
>> bin/../conf:bin/../build/classes:bin/../lib/antlr-3.1.3.jar:bin/../lib/a=
pache-cassandra-0.6.6.jar:bin/../lib/avro-1.2.0-dev.jar:bin/../lib/cassandr=
a-javautils.jar:bin/../lib/clhm-production.jar:bin/../lib/commons-cli-1.1.j=
ar:bin/../lib/commons-codec-1.2.jar:bin/../lib/commons-collections-3.2.1.ja=
r:bin/../lib/commons-io-1.4.jar:bin/../lib/commons-lang-2.4.jar:bin/../lib/=
commons-pool-1.5.4.jar:bin/../lib/google-collections-1.0.jar:bin/../lib/had=
oop-core-0.20.1.jar:bin/../lib/hector-0.6.0-14.jar:bin/../lib/high-scale-li=
b.jar:bin/../lib/ivy-2.1.0.jar:bin/../lib/jackson-core-asl-1.4.0.jar:bin/..=
/lib/jackson-mapper-asl-1.4.0.jar:bin/../lib/jline-0.9.94.jar:bin/../lib/jn=
a.jar:bin/../lib/json-simple-1.1.jar:bin/../lib/libthrift-r917130.jar:bin/.=
./lib/log4j-1.2.14.jar:bin/../lib/perf4j-0.9.12.jar:bin/../lib/slf4j-api-1.=
5.8.jar:bin/../lib/slf4j-log4j12-1.5.8.jar:bin/../lib/uuid-3.1.jar
>> org.apache.cassandra.thrift.CassandraDaemon
>>
>> result of nodetool info :
>>
>> 116024732779488843382476400091948985708
>> Load=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 : 1,94 MB
>> Generation No=A0=A0=A0 : 1296673772
>> Uptime (seconds) : 467550
>> Heap Memory (MB) : 120,26 / 253,94
>>
>>
>> I have about 21 column families, none of them have a lot of information =
(
>> as you see I have 2 Mb of text which is really small). Even if I set Xmx=
 at
>> 256 there is 687M of memory used. Where does this memory come from ? Bad
>> garbage collection ? Something that I ignore ?
>> Thank you for your help I really need to get rid of that problem.
>>
>> Best regards,
>> Victor Kabdebon
>
>


--=20
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of DataStax, the source for professional Cassandra support
http://www.datastax.com