Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6E62D1072E for ; Thu, 20 Jun 2013 07:27:55 +0000 (UTC) Received: (qmail 19174 invoked by uid 500); 20 Jun 2013 07:27:53 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 19126 invoked by uid 500); 20 Jun 2013 07:27:50 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 19118 invoked by uid 99); 20 Jun 2013 07:27:50 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Jun 2013 07:27:50 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of samuelsson.joel@gmail.com designates 209.85.217.181 as permitted sender) Received: from [209.85.217.181] (HELO mail-lb0-f181.google.com) (209.85.217.181) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Jun 2013 07:27:45 +0000 Received: by mail-lb0-f181.google.com with SMTP id w10so5438875lbi.40 for ; Thu, 20 Jun 2013 00:27:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=M1OI4Hlz4HB4Ws48IcBpINJITRumIQcpQoayhUowH6o=; b=vrmv5TBCiFhWGs9LD4Ej5VRmvrPhn32srOcx8fY4D04V67k5qexnbzL8qOOwhd9vAS EA/V2HA7u48a+FKYVsSp9Gk1K5vun3byZGOibTrp/6v1B4ieWjnEaYFNJfVEvWu7sK1X id9Nh423hFbraxBdWpEkFuftGi5T3b8R1Z9aOdNUyDPIVtF32ZNr3HECQapO8LFTZKUX 2cwA6uhicB+pz57Sd+3gPwrn43WoUY1VLnVolp3/L5lXEcRen1f+jdjOrGdkbxRuB0Vr K463M/rtzVrqttpcuTisbsf6aIuk1bKjUqBtT18Jj/LgRI/7YdDmeXyUEizntBSUzZ4f 91eQ== MIME-Version: 1.0 X-Received: by 10.152.21.99 with SMTP id u3mr3097926lae.18.1371713243416; Thu, 20 Jun 2013 00:27:23 -0700 (PDT) Received: by 10.114.172.65 with HTTP; Thu, 20 Jun 2013 00:27:23 -0700 (PDT) In-Reply-To: References: <51B237BA.9060809@4friends.od.ua> <6D3C4DCA-8CD6-4D3E-915D-66CFF8323F13@gmail.com> <51C1061F.7020800@cloudian.com> Date: Thu, 20 Jun 2013 09:27:23 +0200 Message-ID: Subject: Re: Reduce Cassandra GC From: Joel Samuelsson To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=089e0149397a9b8f3a04df90e082 X-Virus-Checked: Checked by ClamAV on apache.org --089e0149397a9b8f3a04df90e082 Content-Type: text/plain; charset=ISO-8859-13 Content-Transfer-Encoding: quoted-printable 12.3 GB data per node (only one =F1ode). 16GB RAM. In virtual environment with the CPU specified as "8 cores", average CPU use is close to 0% (basically no load, around 12 requests / sec, mostly from OpsCenter). Average memory use is 4GB. Around 1GB heap used by Cassandra (out of 4GB). 2013/6/19 Mohit Anchlia > How much data do you have per node? > How much RAM per node? > How much CPU per node? > What is the avg CPU and memory usage? > > On Wed, Jun 19, 2013 at 12:16 AM, Joel Samuelsson < > samuelsson.joel@gmail.com> wrote: > >> My Cassandra ps info: >> >> root 26791 1 0 07:14 ? 00:00:00 /usr/bin/jsvc -user >> cassandra -home /opt/java/64/jre1.6.0_32/bin/../ -pidfile >> /var/run/cassandra.pid -errfile &1 -outfile /var/log/cassandra/output.lo= g >> -cp >> /usr/share/cassandra/lib/antlr-3.2.jar:/usr/share/cassandra/lib/avro-1.4= .0-fixes.jar:/usr/share/cassandra/lib/avro-1.4.0-sources-fixes.jar:/usr/sha= re/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-codec= -1.2.jar:/usr/share/cassandra/lib/commons-lang-2.6.jar:/usr/share/cassandra= /lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrentlinkedhashma= p-lru-1.3.jar:/usr/share/cassandra/lib/guava-13.0.1.jar:/usr/share/cassandr= a/lib/high-scale-lib-1.1.2.jar:/usr/share/cassandra/lib/jackson-core-asl-1.= 9.2.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.9.2.jar:/usr/share/ca= ssandra/lib/jamm-0.2.5.jar:/usr/share/cassandra/lib/jbcrypt-0.3m.jar:/usr/s= hare/cassandra/lib/jline-1.0.jar:/usr/share/cassandra/lib/jna.jar:/usr/shar= e/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/libthrift-0.7.= 0.jar:/usr/share/cassandra/lib/log4j-1.2.16.jar:/usr/share/cassandra/lib/lz= 4-1.1.0.jar:/usr/share/cassandra/lib/metrics-core-2.0.3.jar:/usr/share/cass= andra/lib/netty-3.5.9.Final.jar:/usr/share/cassandra/lib/servlet-api-2.5-20= 081211.jar:/usr/share/cassandra/lib/slf4j-api-1.7.2.jar:/usr/share/cassandr= a/lib/slf4j-log4j12-1.7.2.jar:/usr/share/cassandra/lib/snakeyaml-1.6.jar:/u= sr/share/cassandra/lib/snappy-java-1.0.4.1.jar:/usr/share/cassandra/lib/sna= ptree-0.1.jar:/usr/share/cassandra/apache-cassandra-1.2.5.jar:/usr/share/ca= ssandra/apache-cassandra-thrift-1.2.5.jar:/usr/share/cassandra/apache-cassa= ndra.jar:/usr/share/cassandra/stress.jar:/usr/share/java/jna.jar:/etc/cassa= ndra:/usr/share/java/commons-daemon.jar >> -Dlog4j.configuration=3Dlog4j-server.properties >> -Dlog4j.defaultInitOverride=3Dtrue >> -XX:HeapDumpPath=3D/var/lib/cassandra/java_1371626058.hprof >> -XX:ErrorFile=3D/var/lib/cassandra/hs_err_1371626058.log -ea >> -javaagent:/usr/share/cassandra/lib/jamm-0.2.5.jar -XX:+UseThreadPriorit= ies >> -XX:ThreadPriorityPolicy=3D42 -Xms4004M -Xmx4004M -Xmn800M >> -XX:+HeapDumpOnOutOfMemoryError -Xss180k -XX:+UseParNewGC >> -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio= =3D8 >> -XX:MaxTenuringThreshold=3D1 -XX:CMSInitiatingOccupancyFraction=3D75 >> -XX:+UseCMSInitiatingOccupancyOnly -XX:+UseTLAB >> -Djava.net.preferIPv4Stack=3Dtrue -Dcom.sun.management.jmxremote.port=3D= 7199 >> -Dcom.sun.management.jmxremote.ssl=3Dfalse >> -Dcom.sun.management.jmxremote.authenticate=3Dfalse >> org.apache.cassandra.service.CassandraDaemon >> 103 26792 26791 99 07:14 ? 854015-22:02:22 /usr/bin/jsvc >> -user cassandra -home /opt/java/64/jre1.6.0_32/bin/../ -pidfile >> /var/run/cassandra.pid -errfile &1 -outfile /var/log/cassandra/output.lo= g >> -cp >> /usr/share/cassandra/lib/antlr-3.2.jar:/usr/share/cassandra/lib/avro-1.4= .0-fixes.jar:/usr/share/cassandra/lib/avro-1.4.0-sources-fixes.jar:/usr/sha= re/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-codec= -1.2.jar:/usr/share/cassandra/lib/commons-lang-2.6.jar:/usr/share/cassandra= /lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrentlinkedhashma= p-lru-1.3.jar:/usr/share/cassandra/lib/guava-13.0.1.jar:/usr/share/cassandr= a/lib/high-scale-lib-1.1.2.jar:/usr/share/cassandra/lib/jackson-core-asl-1.= 9.2.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.9.2.jar:/usr/share/ca= ssandra/lib/jamm-0.2.5.jar:/usr/share/cassandra/lib/jbcrypt-0.3m.jar:/usr/s= hare/cassandra/lib/jline-1.0.jar:/usr/share/cassandra/lib/jna.jar:/usr/shar= e/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/libthrift-0.7.= 0.jar:/usr/share/cassandra/lib/log4j-1.2.16.jar:/usr/share/cassandra/lib/lz= 4-1.1.0.jar:/usr/share/cassandra/lib/metrics-core-2.0.3.jar:/usr/share/cass= andra/lib/netty-3.5.9.Final.jar:/usr/share/cassandra/lib/servlet-api-2.5-20= 081211.jar:/usr/share/cassandra/lib/slf4j-api-1.7.2.jar:/usr/share/cassandr= a/lib/slf4j-log4j12-1.7.2.jar:/usr/share/cassandra/lib/snakeyaml-1.6.jar:/u= sr/share/cassandra/lib/snappy-java-1.0.4.1.jar:/usr/share/cassandra/lib/sna= ptree-0.1.jar:/usr/share/cassandra/apache-cassandra-1.2.5.jar:/usr/share/ca= ssandra/apache-cassandra-thrift-1.2.5.jar:/usr/share/cassandra/apache-cassa= ndra.jar:/usr/share/cassandra/stress.jar:/usr/share/java/jna.jar:/etc/cassa= ndra:/usr/share/java/commons-daemon.jar >> -Dlog4j.configuration=3Dlog4j-server.properties >> -Dlog4j.defaultInitOverride=3Dtrue >> -XX:HeapDumpPath=3D/var/lib/cassandra/java_1371626058.hprof >> -XX:ErrorFile=3D/var/lib/cassandra/hs_err_1371626058.log -ea >> -javaagent:/usr/share/cassandra/lib/jamm-0.2.5.jar -XX:+UseThreadPriorit= ies >> -XX:ThreadPriorityPolicy=3D42 -Xms4004M -Xmx4004M -Xmn800M >> -XX:+HeapDumpOnOutOfMemoryError -Xss180k -XX:+UseParNewGC >> -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio= =3D8 >> -XX:MaxTenuringThreshold=3D1 -XX:CMSInitiatingOccupancyFraction=3D75 >> -XX:+UseCMSInitiatingOccupancyOnly -XX:+UseTLAB >> -Djava.net.preferIPv4Stack=3Dtrue -Dcom.sun.management.jmxremote.port=3D= 7199 >> -Dcom.sun.management.jmxremote.ssl=3Dfalse >> -Dcom.sun.management.jmxremote.authenticate=3Dfalse >> org.apache.cassandra.service.CassandraDaemon >> >> Is it normal to have two processes like this? >> >> > --089e0149397a9b8f3a04df90e082 Content-Type: text/html; charset=ISO-8859-13 Content-Transfer-Encoding: quoted-printable
12.3 GB data per node (only one =F1ode).
16GB RAM.
In virtual environment with the CPU specified as "8 cores",= average CPU use is close to 0% (basically no load, around 12 requests / se= c, mostly from OpsCenter).
Average memory use is 4GB. Around 1GB heap used by Cassandra (ou= t of 4GB).


2013/6/19 Mohit Anchlia <mohitanchlia@gmail.com>
How much data do you have per node?
How much RAM per node?
How much CPU per node?
What is the avg CPU and memory usage?

On Wed, Jun 19, 2013 at 12:16 AM, Joel Samuelsso= n <samuelsson.joel@gmail.com> wrote:
My Cassandra ps info:

root =A0 =A0 26791 =A0 =A0 1 =A00 07:14 ? =A0 =A0 =A0 =A000:00:00 /usr= /bin/jsvc -user cassandra -home /opt/java/64/jre1.6.0_32/bin/../ -pidfile /= var/run/cassandra.pid -errfile &1 -outfile /var/log/cassandra/output.lo= g -cp /usr/share/cassandra/lib/antlr-3.2.jar:/usr/share/cassandra/lib/avro-= 1.4.0-fixes.jar:/usr/share/cassandra/lib/avro-1.4.0-sources-fixes.jar:/usr/= share/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-co= dec-1.2.jar:/usr/share/cassandra/lib/commons-lang-2.6.jar:/usr/share/cassan= dra/lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrentlinkedhas= hmap-lru-1.3.jar:/usr/share/cassandra/lib/guava-13.0.1.jar:/usr/share/cassa= ndra/lib/high-scale-lib-1.1.2.jar:/usr/share/cassandra/lib/jackson-core-asl= -1.9.2.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.9.2.jar:/usr/share= /cassandra/lib/jamm-0.2.5.jar:/usr/share/cassandra/lib/jbcrypt-0.3m.jar:/us= r/share/cassandra/lib/jline-1.0.jar:/usr/share/cassandra/lib/jna.jar:/usr/s= hare/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/libthrift-0= .7.0.jar:/usr/share/cassandra/lib/log4j-1.2.16.jar:/usr/share/cassandra/lib= /lz4-1.1.0.jar:/usr/share/cassandra/lib/metrics-core-2.0.3.jar:/usr/share/c= assandra/lib/netty-3.5.9.Final.jar:/usr/share/cassandra/lib/servlet-api-2.5= -20081211.jar:/usr/share/cassandra/lib/slf4j-api-1.7.2.jar:/usr/share/cassa= ndra/lib/slf4j-log4j12-1.7.2.jar:/usr/share/cassandra/lib/snakeyaml-1.6.jar= :/usr/share/cassandra/lib/snappy-java-1.0.4.1.jar:/usr/share/cassandra/lib/= snaptree-0.1.jar:/usr/share/cassandra/apache-cassandra-1.2.5.jar:/usr/share= /cassandra/apache-cassandra-thrift-1.2.5.jar:/usr/share/cassandra/apache-ca= ssandra.jar:/usr/share/cassandra/stress.jar:/usr/share/java/jna.jar:/etc/ca= ssandra:/usr/share/java/commons-daemon.jar -Dlog4j.configuration=3Dlog4j-se= rver.properties -Dlog4j.defaultInitOverride=3Dtrue -XX:HeapDumpPath=3D/var/= lib/cassandra/java_1371626058.hprof -XX:ErrorFile=3D/var/lib/cassandra/hs_e= rr_1371626058.log -ea -javaagent:/usr/share/cassandra/lib/jamm-0.2.5.jar -X= X:+UseThreadPriorities -XX:ThreadPriorityPolicy=3D42 -Xms4004M -Xmx4004M -X= mn800M -XX:+HeapDumpOnOutOfMemoryError -Xss180k -XX:+UseParNewGC -XX:+UseCo= ncMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=3D8 -XX:MaxTe= nuringThreshold=3D1 -XX:CMSInitiatingOccupancyFraction=3D75 -XX:+UseCMSInit= iatingOccupancyOnly -XX:+UseTLAB -Djava.net.preferIPv4Stack=3Dtrue -Dcom.su= n.management.jmxremote.port=3D7199 -Dcom.sun.management.jmxremote.ssl=3Dfal= se -Dcom.sun.management.jmxremote.authenticate=3Dfalse org.apache.cassandra= .service.CassandraDaemon
103 =A0 =A0 =A026792 26791 99 07:14 ? =A0 =A0 =A0 =A0854015-22:02:22 /= usr/bin/jsvc -user cassandra -home /opt/java/64/jre1.6.0_32/bin/../ -pidfil= e /var/run/cassandra.pid -errfile &1 -outfile /var/log/cassandra/output= .log -cp /usr/share/cassandra/lib/antlr-3.2.jar:/usr/share/cassandra/lib/av= ro-1.4.0-fixes.jar:/usr/share/cassandra/lib/avro-1.4.0-sources-fixes.jar:/u= sr/share/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons= -codec-1.2.jar:/usr/share/cassandra/lib/commons-lang-2.6.jar:/usr/share/cas= sandra/lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrentlinked= hashmap-lru-1.3.jar:/usr/share/cassandra/lib/guava-13.0.1.jar:/usr/share/ca= ssandra/lib/high-scale-lib-1.1.2.jar:/usr/share/cassandra/lib/jackson-core-= asl-1.9.2.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.9.2.jar:/usr/sh= are/cassandra/lib/jamm-0.2.5.jar:/usr/share/cassandra/lib/jbcrypt-0.3m.jar:= /usr/share/cassandra/lib/jline-1.0.jar:/usr/share/cassandra/lib/jna.jar:/us= r/share/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/libthrif= t-0.7.0.jar:/usr/share/cassandra/lib/log4j-1.2.16.jar:/usr/share/cassandra/= lib/lz4-1.1.0.jar:/usr/share/cassandra/lib/metrics-core-2.0.3.jar:/usr/shar= e/cassandra/lib/netty-3.5.9.Final.jar:/usr/share/cassandra/lib/servlet-api-= 2.5-20081211.jar:/usr/share/cassandra/lib/slf4j-api-1.7.2.jar:/usr/share/ca= ssandra/lib/slf4j-log4j12-1.7.2.jar:/usr/share/cassandra/lib/snakeyaml-1.6.= jar:/usr/share/cassandra/lib/snappy-java-1.0.4.1.jar:/usr/share/cassandra/l= ib/snaptree-0.1.jar:/usr/share/cassandra/apache-cassandra-1.2.5.jar:/usr/sh= are/cassandra/apache-cassandra-thrift-1.2.5.jar:/usr/share/cassandra/apache= -cassandra.jar:/usr/share/cassandra/stress.jar:/usr/share/java/jna.jar:/etc= /cassandra:/usr/share/java/commons-daemon.jar -Dlog4j.configuration=3Dlog4j= -server.properties -Dlog4j.defaultInitOverride=3Dtrue -XX:HeapDumpPath=3D/v= ar/lib/cassandra/java_1371626058.hprof -XX:ErrorFile=3D/var/lib/cassandra/h= s_err_1371626058.log -ea -javaagent:/usr/share/cassandra/lib/jamm-0.2.5.jar= -XX:+UseThreadPriorities -XX:ThreadPriorityPolicy=3D42 -Xms4004M -Xmx4004M= -Xmn800M -XX:+HeapDumpOnOutOfMemoryError -Xss180k -XX:+UseParNewGC -XX:+Us= eConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=3D8 -XX:Ma= xTenuringThreshold=3D1 -XX:CMSInitiatingOccupancyFraction=3D75 -XX:+UseCMSI= nitiatingOccupancyOnly -XX:+UseTLAB -Djava.net.preferIPv4Stack=3Dtrue -Dcom= .sun.management.jmxremote.port=3D7199 -Dcom.sun.management.jmxremote.ssl=3D= false -Dcom.sun.management.jmxremote.authenticate=3Dfalse org.apache.cassan= dra.service.CassandraDaemon

Is it normal to have two processes like this?



--089e0149397a9b8f3a04df90e082--