incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeffrey Kesselman <jef...@gmail.com>
Subject Re: Much more native memory used by Cassandra then the configured JVM heap size
Date Tue, 12 Jun 2012 01:43:57 GMT
Btw.  I suggest you spin up JConsole as it will give you much more detai
kon what your VM is actually doing.



On Mon, Jun 11, 2012 at 9:14 PM, Jason Tang <ares.tang@gmail.com> wrote:

> Hi
>
> We have some problem with Cassandra memory usage, we configure the JVM
> HEAP 6G, but after runing Cassandra for several hours (insert, update,
> delete). The total memory used by Cassandra go up to 15G, which cause the
> OS low memory.
>  So I wonder if it is normal to have so many memory used by cassandra?
>
>         And how to limit the native memory used by Cassandra?
>
>
> ===========================
> Cassandra 1.0.3, 64 bit jdk.
>
> Memory ocupied by Cassandra 15G
>   PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
>  9567 casadm    20   0 28.3g  15g 9.1g S  269 65.1 385:57.65 java
>
> =============================
> -Xms6G -Xmx6G -Xmn1600M
>
>  # ps -ef | grep  9567
> casadm    9567     1 55 Jun11 ?        05:59:44 /opt/jdk1.6.0_29/bin/java
> -ea -javaagent:/opt/dve/cassandra/bin/../lib/jamm-0.2.5.jar
> -XX:+UseThreadPriorities -XX:ThreadPriorityPolicy=42 -Xms6G -Xmx6G
> -Xmn1600M -XX:+HeapDumpOnOutOfMemoryError -Xss128k -XX:+UseParNewGC
> -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8
> -XX:MaxTenuringThreshold=1 -XX:CMSInitiatingOccupancyFraction=75
> -XX:+UseCMSInitiatingOccupancyOnly -Djava.net.preferIPv4Stack=true
> -Dcom.sun.management.jmxremote.port=6080
> -Dcom.sun.management.jmxremote.ssl=false
> -Dcom.sun.management.jmxremote.authenticate=false
> -Daccess.properties=/opt/dve/cassandra/conf/access.properties
> -Dpasswd.properties=/opt/dve/cassandra/conf/passwd.properties
> -Dpasswd.mode=MD5 -Dlog4j.configuration=log4j-server.properties
> -Dlog4j.defaultInitOverride=true -cp
> /opt/dve/cassandra/bin/../conf:/opt/dve/cassandra/bin/../build/classes/main:/opt/dve/cassandra/bin/../build/classes/thrift:/opt/dve/cassandra/bin/../lib/Cassandra-Extensions-1.0.0.jar:/opt/dve/cassandra/bin/../lib/antlr-3.2.jar:/opt/dve/cassandra/bin/../lib/apache-cassandra-1.0.3.jar:/opt/dve/cassandra/bin/../lib/apache-cassandra-clientutil-1.0.3.jar:/opt/dve/cassandra/bin/../lib/apache-cassandra-thrift-1.0.3.jar:/opt/dve/cassandra/bin/../lib/avro-1.4.0-fixes.jar:/opt/dve/cassandra/bin/../lib/avro-1.4.0-sources-fixes.jar:/opt/dve/cassandra/bin/../lib/commons-cli-1.1.jar:/opt/dve/cassandra/bin/../lib/commons-codec-1.2.jar:/opt/dve/cassandra/bin/../lib/commons-lang-2.4.jar:/opt/dve/cassandra/bin/../lib/compress-lzf-0.8.4.jar:/opt/dve/cassandra/bin/../lib/concurrentlinkedhashmap-lru-1.2.jar:/opt/dve/cassandra/bin/../lib/guava-r08.jar:/opt/dve/cassandra/bin/../lib/high-scale-lib-1.1.2.jar:/opt/dve/cassandra/bin/../lib/jackson-core-asl-1.4.0.jar:/opt/dve/cassandra/bin/../lib/jackson-mapper-asl-1.4.0.jar:/opt/dve/cassandra/bin/../lib/jamm-0.2.5.jar:/opt/dve/cassandra/bin/../lib/jline-0.9.94.jar:/opt/dve/cassandra/bin/../lib/json-simple-1.1.jar:/opt/dve/cassandra/bin/../lib/libthrift-0.6.jar:/opt/dve/cassandra/bin/../lib/log4j-1.2.16.jar:/opt/dve/cassandra/bin/../lib/servlet-api-2.5-20081211.jar:/opt/dve/cassandra/bin/../lib/slf4j-api-1.6.1.jar:/opt/dve/cassandra/bin/../lib/slf4j-log4j12-1.6.1.jar:/opt/dve/cassandra/bin/../lib/snakeyaml-1.6.jar:/opt/dve/cassandra/bin/../lib/snappy-java-1.0.4.1.jar
> org.apache.cassandra.thrift.CassandraDaemon
>
> ==============================
> # nodetool -h 127.0.0.1 -p 6080 info
> Token            : 85070591730234615865843651857942052864
> Gossip active    : true
> Load             : 20.59 GB
> Generation No    : 1339423322
> Uptime (seconds) : 39626
> Heap Memory (MB) : 3418.42 / 5984.00
> Data Center      : datacenter1
> Rack             : rack1
> Exceptions       : 0
>
> =============================
> All row cache and key cache are disabled by default
>
>                 Key cache: disabled
>                 Row cache: disabled
>
>
> ==============================
>
> # pmap 9567
> 9567: java
> START               SIZE     RSS     PSS   DIRTY    SWAP PERM MAPPING
> 0000000040000000     36K     36K     36K      0K      0K r-xp
> /opt/jdk1.6.0_29/bin/java
> 0000000040108000      8K      8K      8K      8K      0K rwxp
> /opt/jdk1.6.0_29/bin/java
> 000000004010a000  18040K  17988K  17988K  17988K      0K rwxp [heap]
> 000000067ae00000 6326700K 6258664K 6258664K 6258664K      0K rwxp [anon]
> 00000007fd06b000  48724K      0K      0K      0K      0K rwxp [anon]
> 00007fbed1530000 1331104K      0K      0K      0K      0K r-xs
> /var/cassandra/data/drc/queue-hb-219-Data.db
> 00007fbf22918000 2097152K      0K      0K      0K      0K r-xs
> /var/cassandra/data/drc/queue-hb-219-Data.db
> 00007fbfa2918000 2097148K 1124464K 1124462K      0K      0K r-xs
> /var/cassandra/data/drc/queue-hb-219-Data.db
> 00007fc022917000 2097156K 2096496K 2096492K      0K      0K r-xs
> /var/cassandra/data/drc/queue-hb-219-Data.db
> 00007fc0a2918000 2097148K 2097148K 2097146K      0K      0K r-xs
> /var/cassandra/data/drc/queue-hb-219-Data.db
> 00007fc1a2917000 733584K   6444K   6444K      0K      0K r-xs
> /var/cassandra/data/drc/queue-hb-109-Data.db
> 00007fc1cf57b000 2097148K  20980K  20980K      0K      0K r-xs
> /var/cassandra/data/drc/queue-hb-109-Data.db
> 00007fc24f57a000 2097152K 456480K 456478K      0K      0K r-xs
> /var/cassandra/data/drc/queue-hb-109-Data.db
> 00007fc2cf57a000 2097156K 1168320K 1168318K      0K      0K r-xs
> /var/cassandra/data/drc/queue-hb-109-Data.db
> 00007fc34f57b000 2097148K 1177520K 1177520K      0K      0K r-xs
> /var/cassandra/data/drc/queue-hb-109-Data.db
> 00007fc405629000 618708K 338248K 338248K      0K      0K r-xs
> /var/cassandra/data/drc/queue-hb-230-Data.db
> 00007fc42b25e000 620388K 289024K 289024K      0K      0K r-xs
> /var/cassandra/data/drc/queue-hb-224-Data.db
> 00007fc451037000 619160K 342108K 342108K      0K      0K r-xs
> /var/cassandra/data/drc/queue-hb-216-Data.db
> 00007fc62b7df000 132696K      0K      0K      0K      0K r-xs
> /var/cassandra/data/drc/queue.idxInQueueTime-hb-175-Data.db
> 00007fc6de8e0000 132696K      0K      0K      0K      0K r-xs
> /var/cassandra/data/drc/queue.idxRecvTime-hb-175-Data.db
> 00007fc6f2bcc000  52492K      0K      0K      0K      0K r-xs
> /var/cassandra/data/drc/queue.idxPartitionId-hb-211-Data.db
> 00007fc6f64dc000  43784K  40840K  40840K      0K      0K r-xs
> /var/cassandra/data/drc/fpr_index-hb-91-Data.db
> 00007fc707ca6000  68968K  37724K  37724K      0K      0K r-xs
> /var/cassandra/data/drc/queue-hb-219-Index.db
> 00007fc70c000000   2468K   2436K   2436K   2436K      0K rwxp [anon]
> 00007fc70c269000  63068K      0K      0K      0K      0K ---p [anon]
> 00007fc710b9e000  52888K      0K      0K      0K      0K r-xs
> /var/cassandra/data/drc/queue.idxInQueueTime-hb-216-Data.db
> 00007fc713f44000  52952K      0K      0K      0K      0K r-xs
> /var/cassandra/data/drc/queue.idxFireTimeRange-hb-140-Data.db
> 00007fc7172fa000  52952K      0K      0K      0K      0K r-xs
> /var/cassandra/data/drc/queue.idxFireTime-hb-140-Data.db
> 00007fc71bd13000 162992K 162984K 162984K      0K      0K r-xs
> /var/cassandra/data/drc/fpr_index-hb-80-Data.db
> 00007fc725c3f000  52952K  28712K  28712K      0K      0K r-xs
> /var/cassandra/data/drc/queue.idxInQueueTimeRange-hb-140-Data.db
> 00007fc728ff5000  52952K      0K      0K      0K      0K r-xs
> /var/cassandra/data/drc/queue.idxRecvTimeRange-hb-140-Data.db
> 00007fc72d026000  52480K      0K      0K      0K      0K r-xs
> /var/cassandra/data/drc/queue.idxRecvTimeRange-hb-211-Data.db
> 00007fc730366000  52564K      0K      0K      0K      0K r-xs
> /var/cassandra/data/drc/queue.idxStatus-hb-196-Data.db
> 00007fc7336bb000  22348K      0K      0K      0K      0K r-xs
> /var/cassandra/data/drc/queue.idxInQueueTime-hb-175-Index.db
>
>
> BRs
> //Ares Tang
>



-- 
It's always darkest just before you are eaten by a grue.

Mime
View raw message