Return-Path: Delivered-To: apmail-cassandra-dev-archive@www.apache.org Received: (qmail 18901 invoked from network); 19 Dec 2010 12:58:08 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 19 Dec 2010 12:58:08 -0000 Received: (qmail 44374 invoked by uid 500); 19 Dec 2010 12:58:05 -0000 Delivered-To: apmail-cassandra-dev-archive@cassandra.apache.org Received: (qmail 44280 invoked by uid 500); 19 Dec 2010 12:58:05 -0000 Mailing-List: contact dev-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list dev@cassandra.apache.org Received: (qmail 44264 invoked by uid 99); 19 Dec 2010 12:58:04 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 19 Dec 2010 12:58:04 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [209.85.213.172] (HELO mail-yx0-f172.google.com) (209.85.213.172) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 19 Dec 2010 12:57:58 +0000 Received: by yxt33 with SMTP id 33so1027136yxt.31 for ; Sun, 19 Dec 2010 04:57:33 -0800 (PST) MIME-Version: 1.0 Received: by 10.150.138.2 with SMTP id l2mr5247713ybd.261.1292763453411; Sun, 19 Dec 2010 04:57:33 -0800 (PST) Sender: scode@scode.org Received: by 10.150.220.9 with HTTP; Sun, 19 Dec 2010 04:57:33 -0800 (PST) X-Originating-IP: [213.114.156.79] In-Reply-To: References:

<3CB61C05-8FEE-4C88-B179-EBBD488E77A1@backupify.com>

Date: Sun, 19 Dec 2010 13:57:33 +0100 X-Google-Sender-Auth: EIxHfec3QiFRFSalao2RcTDN5bk Message-ID: Subject: Re: [SOLVED] Very high memory utilization (not caused by mmap on sstables) From: Peter Schuller To: user@cassandra.apache.org Cc: dev@cassandra.apache.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable > victor@****:~$ sudo ps aux | grep "cassandra" > cassandra =C2=A0=C2=A0=C2=A0 11034=C2=A0 0.2 22.9 1107772 462764 ?=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 Sl=C2=A0=C2=A0 Dec17=C2=A0=C2=A0 6:13 > /usr/bin/java -ea -Xms128M -Xmx512M -XX:+UseParNewGC -XX:+UseConcMarkSwee= pGC > -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=3D8 -XX:MaxTenuringThresh= old=3D1 > -XX:CMSInitiatingOccupancyFraction=3D75 -XX:+UseCMSInitiatingOccupancyOnl= y > -XX:+HeapDumpOnOutOfMemoryError -Dcom.sun.management.jmxremote.port=3D808= 1 > -Dcom.sun.management.jmxremote.ssl=3Dfalse > -Dcom.sun.management.jmxremote.authenticate=3Dfalse > -Dstorage-config=3Dbin/../conf -Dcassandra-foreground=3Dyes -cp > bin/../conf:bin/../build/classes:bin/../lib/antlr-3.1.3.jar:bin/../lib/ap= ache-cassandra-0.6.6.jar:bin/../lib/clhm-production.jar:bin/../lib/commons-= cli-1.1.jar:bin/../lib/commons-codec-1.2.jar:bin/../lib/commons-collections= -3.2.1.jar:bin/../lib/commons-lang-2.4.jar:bin/../lib/google-collections-1.= 0.jar:bin/../lib/hadoop-core-0.20.1.jar:bin/../lib/high-scale-lib.jar:bin/.= ./lib/ivy-2.1.0.jar:bin/../lib/jackson-core-asl-1.4.0.jar:bin/../lib/jackso= n-mapper-asl-1.4.0.jar:bin/../lib/jline-0.9.94.jar:bin/../lib/json-simple-1= .1.jar:bin/../lib/libthrift-r917130.jar:bin/../lib/log4j-1.2.14.jar:bin/../= lib/slf4j-api-1.5.8.jar:bin/../lib/slf4j-log4j12-1.5.8.jar > org.apache.cassandra.thrift.CassandraDaemon > > Cassandra uses 462764 Kb, roughly 460 Mb for 2 Mb of data... And it keeps > getting bigger. > It is important to know that I have just a few insert, quite a lot of rea= d > though. Also Cassandra seams to completly ignore the JVM limitations such= as > Xmx. > If I don't stop and launch Cassandra every 15 ou 20 days it simply crashe= s, > due to oom errors. The resident size is not unexpected given that your Xmx is 512 MB. The virtual may or may not be expected depending; for example thread stacks as previously discussed in this thread. If you're not seeing the *resident* set size go above the maximum heap size, you're unlikely to be seeing the same problem. WIth respect to OOM, see http://www.riptano.com/docs/0.6/operations/tuning - but without more information it's difficult to know what specifically it is that you're hitting. Are you seriously saying you're running for 15-20 days with only 2 mb of live data? --=20 / Peter Schuller