Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id C3DFF200BC1 for ; Wed, 16 Nov 2016 09:03:22 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id C264D160B08; Wed, 16 Nov 2016 08:03:22 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 9AB05160B03 for ; Wed, 16 Nov 2016 09:03:21 +0100 (CET) Received: (qmail 64067 invoked by uid 500); 16 Nov 2016 08:03:20 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 64057 invoked by uid 99); 16 Nov 2016 08:03:20 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 16 Nov 2016 08:03:20 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 94D891809D8 for ; Wed, 16 Nov 2016 08:03:18 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.079 X-Spam-Level: *** X-Spam-Status: No, score=3.079 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, KAM_LINEPADDING=1.2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id J2m0atCCIfXj for ; Wed, 16 Nov 2016 08:03:15 +0000 (UTC) Received: from mail-oi0-f51.google.com (mail-oi0-f51.google.com [209.85.218.51]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 7343F5FBD1 for ; Wed, 16 Nov 2016 08:03:15 +0000 (UTC) Received: by mail-oi0-f51.google.com with SMTP id b126so15023851oia.2 for ; Wed, 16 Nov 2016 00:03:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=DxRgGQnuxdoUEL5Xi1A0EFvvGj8gbbBaQz6sMCENGhY=; b=EpxBZ7DfYlcEjbY4unL+cO0Z1gL0vhIjRvqJjQ16fg8DwfXvoosDldflqKXQkHzEKf KufmjkTNvqtSbaQ+7GRtUmvLcOm2mrJQFYTzy6pi9j1p0BvarDZ5uPbVsll1hI4WWV75 lWZ2atDIhgxvrtnnunA0MGLVfropAdvNtQW5bgPaAYz76FJgPS7XeRDBAge2JNyj4mJ+ IR1LZaIInEwy0fnyg9TV/CLZp9A6JZWqrvjA9S89e7dBnn8zcZ0ljSnAdhEx4dQ7wXwy 0qvX8cEzT8hZcqBvwCSVd610iIOu+lAikD1qfGQIqzF/ma4jKZwPTAMsIpq07emZxmvy qlkg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=DxRgGQnuxdoUEL5Xi1A0EFvvGj8gbbBaQz6sMCENGhY=; b=LvFgNeRyjw90GzwN4PiNkNoIjl1tN9MJ207lhr0Tc/uubWmkyklJWA8Qx3lO8annMi +oMtUUObSSuN4FrUGYW3HA1RMayuw7v9nmxGDFydOMCwPiFKN1IwChNF6yC7YkzTZb4t LUNqJ/ZHGeQT9sFRh8f+XmKj3hrsFBcZJ7bV/+YOmwpMTBPR8O8V8l8KfVoHpoN5Me21 R383mH1/1Fwzb6ySY2H/83it34/caAgoaeg8F6wRTVi8NlUqoEUMz08eF6Mqkd8WrOsi yHtX78kmMrc5sry30qmpvPXFZg7RIZMiChSOTsb4TdsyEVsEdmPxjZ57EYR2H21IMU02 s/oA== X-Gm-Message-State: ABUngvfZ0N8l3UlbGm7RPCJv2sIoCcq7r00WR6mm/wSPKv5lhnE6jAbTNaxQ0l0+k/IAZRvHIu9yw/KhfthVEw== X-Received: by 10.202.224.134 with SMTP id x128mr1356188oig.117.1479283391672; Wed, 16 Nov 2016 00:03:11 -0800 (PST) MIME-Version: 1.0 Received: by 10.202.88.69 with HTTP; Wed, 16 Nov 2016 00:03:11 -0800 (PST) In-Reply-To: <7B1D5B07-4BBE-4209-8CEA-21CD72CCF664@crowdstrike.com> References: <7B1D5B07-4BBE-4209-8CEA-21CD72CCF664@crowdstrike.com> From: ankit tyagi Date: Wed, 16 Nov 2016 13:33:11 +0530 Message-ID: Subject: Re: Too High resident memory of cassandra 2.2.8 To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=001a113d30101539620541668128 archived-at: Wed, 16 Nov 2016 08:03:23 -0000 --001a113d30101539620541668128 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Jeff, I used below command to findout total off heap. bin/nodetool cfstats | grep 'Off heap memory used' | cut -d ":" -f2 | awk '{sum+=3D$1} END{print sum}' *1417134538* As per your suggestion, it is around 1GB only. we have around 50 tables and 2 column family but still it doesn't make sense to having so much resident memory. On Mon, Nov 14, 2016 at 7:15 PM, Jeff Jirsa wrote: > nodetool cfstats will show it per table. > > > > The bloom filter / compression data is typically (unless you have very > unusual settings in your schema) 1-3GB each per TB of data, so with 235= =E2=80=99ish > GB/server, it=E2=80=99s unlikely bloom filter or compression data. > > > > The memTable is AT LEAST 1MB per columnfamily/table, so if you know how > many tables you have, that may be an initial lower bound guess. > > > > > > > > *From: *ankit tyagi > *Reply-To: *"user@cassandra.apache.org" > *Date: *Sunday, November 13, 2016 at 11:33 PM > *To: *"user@cassandra.apache.org" > *Subject: *Re: Too High resident memory of cassandra 2.2.8 > > > > Hi Jeff, > > Below is the output of nodetool staus command. > > > > Status=3DUp/Down > > |/ State=3DNormal/Leaving/Joining/Moving > > -- Address Load Tokens Owns Host ID > Rack > > UN 192.168.68.156 *235.79 GB* 256 ? > e7b1a44d-0cd2-4b60-b322-4f989933fc51 rack1 > > UN 192.168.68.157 *234.65 GB* 256 ? > 70406f0b-3620-401e-beaa-15deb4b799ce rack1 > > UN 192.168.69.146 256 ? d32e1e4d-ec86-4c3f-9397-11f37ff= 7b4d3 > rack1 > > UN 192.168.69.147 *242.77 GB * 256 ? > 646d9416-a467-4526-9656-959aa98404d0 rack1 > > UN 192.168.69.148 *249.84 GB * 256 ? > 9b0ab632-75f4-4781-a987-a00b8246ae97 rack1 > > UN 192.168.69.149 *240.62 GB* 256 ? > 406c4d3e-0933-4cba-935f-bfba16e6d878 rack1 > > > > > > is there any command to find out the size of offheap memtable. > > > > On Mon, Nov 14, 2016 at 12:30 PM, Jeff Jirsa > wrote: > > Cassandra keeps certain data structures offheap, including bloom filters > (scales with data size), compression metadata (scales with data size), an= d > potentially memtables (scales with # of keyspaces/tables). > > > > How much data on your node? Onheap or offheap memtables? > > > > > > > > *From: *ankit tyagi > *Reply-To: *"user@cassandra.apache.org" > *Date: *Sunday, November 13, 2016 at 10:55 PM > *To: *"user@cassandra.apache.org" > *Subject: *Too High resident memory of cassandra 2.2.8 > > > > Hi, > > > > we are using cassandra 2.2.8 version in production. we are seeing residen= t > memory of cassndra process is very high 40G while heap size is only 8GB. > > > > root 23339 1 80 Nov11 ? 2-09:38:08 /opt/java8/bin/java > -ea -javaagent:bin/../lib/jamm-0.3.0.jar -XX:+CMSClassUnloadingEnabled > -XX:+UseThreadPriorities -XX:ThreadPriorityPolicy=3D42* -Xms8192M -Xmx819= 2M > -Xmn2048M* -XX:+HeapDumpOnOutOfMemoryError -Xss256k > -XX:StringTableSize=3D1000003 -XX:+UseParNewGC -XX:+UseConcMarkSweepGC > -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=3D8 > -XX:MaxTenuringThreshold=3D1 -XX:CMSInitiatingOccupancyFraction=3D75 -XX:= +UseCMSInitiatingOccupancyOnly > -XX:+UseTLAB -XX:+PerfDisableSharedMem -XX:CompileCommandFile=3Dbin/../co= nf/hotspot_compiler > -XX:CMSWaitDuration=3D10000 -XX:+CMSParallelInitialMarkEnabled > -XX:+CMSEdenChunksRecordAlways -XX:CMSWaitDuration=3D10000 > -XX:+UseCondCardMark -XX:+PrintGCDetails -XX:+PrintGCDateStamps > -XX:+PrintHeapAtGC -XX:+PrintTenuringDistribution -XX:+PrintGCApplication= StoppedTime > -XX:+PrintPromotionFailure -Xloggc:bin/../logs/gc.log > -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=3D10 -XX:GCLogFileSize= =3D10M > -Djava.net.preferIPv4Stack=3Dtrue -Dcassandra.jmx.local.port=3D7199 > -XX:+DisableExplicitGC -Djava.library.path=3Dbin/../lib/sigar-bin > -javaagent:/myntra/currentCassandra/lib/agent-1.2.jar=3D > statsd.myntra.com:8125 > > -Dlogback.configurationFile=3Dlogback.xml -Dcassandra.logdir=3Dbin/../log= s > -Dcassandra.storagedir=3Dbin/../data -cp bin/../conf:bin/../build/ > classes/main:bin/../build/classes/thrift:bin/../lib/ > agent-1.2.jar:bin/../lib/airline-0.6.jar:bin/../lib/ > antlr-runtime-3.5.2.jar:bin/../lib/apache-cassandra-2.2.8. > jar:bin/../lib/apache-cassandra-clientutil-2.2.8.jar:bin/../lib/apache- > cassandra-thrift-2.2.8.jar:bin/../lib/cassandra-driver- > core-2.2.0-rc2-SNAPSHOT-20150617-shaded.jar:bin/../ > lib/commons-cli-1.1.jar:bin/../lib/commons-codec-1.2.jar: > bin/../lib/commons-lang3-3.1.jar:bin/../lib/commons-math3- > 3.2.jar:bin/../lib/compress-lzf-0.8.4.jar:bin/../lib/ > concurrentlinkedhashmap-lru-1.4.jar:bin/../lib/crc32ex-0.1. > 1.jar:bin/../lib/disruptor-3.0.1.jar:bin/../lib/ecj-4.4.2. > jar:bin/../lib/guava-16.0.jar:bin/../lib/high-scale-lib-1.0. > 6.jar:bin/../lib/jackson-core-asl-1.9.2.jar:bin/../lib/ > jackson-mapper-asl-1.9.2.jar:bin/../lib/jamm-0.3.0.jar:bin/ > ../lib/java-statsd-client-3.1.0.jar:bin/../lib/javax.inject. > jar:bin/../lib/jbcrypt-0.3m.jar:bin/../lib/jcl-over-slf4j- > 1.7.7.jar:bin/../lib/jna-4.0.0.jar:bin/../lib/joda-time-2. > 4.jar:bin/../lib/json-simple-1.1.jar:bin/../lib/libthrift- > 0.9.2.jar:bin/../lib/log4j-over-slf4j-1.7.7.jar:bin/../ > lib/logback-classic-1.1.3.jar:bin/../lib/logback-core-1.1.3. > jar:bin/../lib/lz4-1.3.0.jar:bin/../lib/metrics-core-2.2.0. > jar:bin/../lib/metrics-core-3.1.0.jar:bin/../lib/metrics- > jvm-3.1.0.jar:bin/../lib/metrics-logback-3.1.0.jar:bin/ > ../lib/metrics-statsd-2.3.0.jar:bin/../lib/netty-all-4.0. > 23.Final.jar:bin/../lib/ohc-core-0.3.4.jar:bin/../lib/ohc- > core-j8-0.3.4.jar:bin/../lib/reporter-config3-3.0.0.jar: > bin/../lib/reporter-config-base-3.0.0.jar:bin/../lib/ > sigar-1.6.4.jar:bin/../lib/slf4j-api-1.7.7.jar:bin/../ > lib/snakeyaml-1.11.jar:bin/../lib/snappy-java-1.1.1.7.jar: > bin/../lib/ST4-4.0.8.jar:bin/../lib/stream-2.5.2.jar:bin/../ > lib/super-csv-2.1.0.jar:bin/../lib/thrift-server-0.3.7.jar:bin/../lib/jsr= 223/*/*.jar > org.apache.cassandra.service.CassandraDaemon > > > > > > below is the output of top command. > > > > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND > > 23339 root 20 0 295g * 39g 28g* S 107.5 63.5 3458:31 java > > > > > > *I couldn't understand why cassandra process is using so much resident > memory while heap size is only 8gb. Any insight??* > > > --001a113d30101539620541668128 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Jeff,

I used below command to findou= t total off heap.

bin/nodetool cfstats =C2=A0= | grep 'Off heap memory used' | cut -d ":" =C2=A0-f2 | aw= k '{sum+=3D$1} END{print sum}'
1417134538

As per your suggestion, it is around 1GB only. =C2= =A0we have around 50 tables and 2 column family but still it doesn't ma= ke sense to having so much =C2=A0resident memory.

=

O= n Mon, Nov 14, 2016 at 7:15 PM, Jeff Jirsa <jeff.jirsa@crowdstrik= e.com> wrote:

nodetool cfstats will show it per table.=

=C2=A0

The bloom filter / c= ompression data is typically (unless you have very unusual settings in your= schema) 1-3GB each per TB of data, so with 235=E2=80=99ish GB/server, it= =E2=80=99s unlikely bloom filter or compression data.<= /p>

=C2=A0

The memTable is AT LEAST 1MB per column= family/table, so if you know how many tables you have, that may be an initi= al lower bound guess.

=C2=A0<= /p>

=C2=A0

=C2=A0

= From: ankit tyag= i <ankit= tyagi.mnnit@gmail.com>
Reply-To: "user@cassandra.apache.org&q= uot; <use= r@cassandra.apache.org>
Date: Sunday, November 13, 2016 at= 11:33 PM
To: "user@cassandra.apache.org" <user@cassandra.apache.org= >
Subject: Re: Too High resident memory of cassandra 2.2.8<= /u>

=C2=A0

Hi Jeff,

Below is the o= utput of nodetool staus command.

=C2=A0

Status= =3DUp/Down

|/ State=3DNo= rmal/Leaving/Joining/Moving

-- =C2=A0Address =C2=A0 =C2=A0 =C2=A0 =C2=A0 Load =C2=A0 =C2=A0 = =C2=A0 Tokens =C2=A0 =C2=A0 =C2=A0 Owns =C2=A0 =C2=A0Host ID =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 Rack

U= N =C2=A0192.168.68.156 =C2=A0235.79 GB =C2=A0256 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0? =C2=A0 =C2=A0 =C2=A0 e7b1a44d-0cd2-4b60-b322-4f9899= 33fc51 =C2=A0rack1

UN = =C2=A0192.168.68.157 =C2=A0234.65 GB =C2=A0256 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0? =C2=A0 =C2=A0 =C2=A0 70406f0b-3620-401e-beaa-15deb4b799= ce =C2=A0rack1

UN =C2=A0= 192.168.69.146 =C2=A0 256 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0? =C2=A0 =C2=A0= =C2=A0 d32e1e4d-ec86-4c3f-9397-11f37ff7b4d3 =C2=A0rack1=

UN =C2=A0192.168.69.147 =C2=A0242.= 77 GB =C2=A0256 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0? =C2=A0 =C2=A0 =C2= =A0 646d9416-a467-4526-9656-959aa98404d0 =C2=A0rack1

=

UN =C2=A0192.168.69.148 =C2=A0249.84 G= B =C2=A0256 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0? =C2=A0 =C2=A0 =C2=A0 9b= 0ab632-75f4-4781-a987-a00b8246ae97 =C2=A0rack1

=

UN =C2=A0192.168.69.149 =C2=A0240.62 GB = =C2=A0256 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0? =C2=A0 =C2=A0 =C2=A0 406c4d3e= -0933-4cba-935f-bfba16e6d878 =C2=A0rack1

<= p class=3D"MsoNormal">=C2=A0

=C2=A0

is there any= command to find out the size of offheap memtable.=C2=A0

<= /div>

=C2=A0

On Mon, Nov 14, 2016 at 12:30 PM, Jeff Jirsa <jeff.jirsa@crowdstrik= e.com> wrote:

Cassandra keeps certain data structures offheap, = including bloom filters (scales with data size), compression metadata (scal= es with data size), and potentially memtables (scales with # of keyspaces/t= ables).

=C2=A0

How much d= ata on your node? Onheap or offheap memtables?

=C2= =A0

=C2=A0

=C2=A0<= u>

From: ankit tyagi <ankittyagi.mnnit@gmail.com>
Reply-To: = "user@c= assandra.apache.org" <user@cassandra.apache.org>
Date: Sun= day, November 13, 2016 at 10:55 PM
To: "user@cassandra.apache.org&qu= ot; <user= @cassandra.apache.org>
Subject: Too High resident memory o= f cassandra 2.2.8

=C2=A0

Hi,

=C2=A0<= /p>

we are using cassandra 2.2.8 version i= n production. we are seeing resident memory of cassndra process is very hig= h 40G while heap size is only 8GB.

=C2=A0

root = =C2=A0 =C2=A0 =C2=A023339 =C2=A0 =C2=A0 =C2=A01 80 Nov11 ? =C2=A0 =C2=A0 = =C2=A0 =C2=A02-09:38:08 /opt/java8/bin/java -ea -javaagent:bin/../lib/jamm-= 0.3.0.jar -XX:+CMSClassUnloadingEnabled -XX:+UseThreadPriorities -XX:T= hreadPriorityPolicy=3D42 -Xms8192M -Xmx8192M -Xmn2048M -XX:+Hea= pDumpOnOutOfMemoryError -Xss256k -XX:StringTableSize=3D1000003 -XX:+UseParN= ewGC -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRati= o=3D8 -XX:MaxTenuringThreshold=3D1 -XX:CMSInitiatingOccupancyFraction<= wbr>=3D75 -XX:+UseCMSInitiatingOccupancyOnly -XX:+UseTLAB -XX:+PerfDis= ableSharedMem -XX:CompileCommandFile=3Dbin/../conf/hotspot_compiler -X= X:CMSWaitDuration=3D10000 -XX:+CMSParallelInitialMarkEnabled -XX:+CMSE= denChunksRecordAlways -XX:CMSWaitDuration=3D10000 -XX:+UseCondCardMark -XX:= +PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintHeapAtGC -XX:+PrintTenurin= gDistribution -XX:+PrintGCApplicationStoppedTime -XX:+PrintPromotionFa= ilure -Xloggc:bin/../logs/gc.log -XX:+UseGCLogFileRotation -XX:NumberOfGCLo= gFiles=3D10 -XX:GCLogFileSize=3D10M -Djava.net.preferIPv4Stack=3Dtrue = -Dcassandra.jmx.local.port=3D7199 -XX:+DisableExplicitGC -Djava.librar= y.path=3Dbin/../lib/sigar-bin -javaagent:/myntra/currentCassandra= /lib/agent-1.2.jar=3Dstatsd.m= yntra.com:8125 -Dlogback.configurationFile=3Dlogback.xml -Dcassand= ra.logdir=3Dbin/../logs -Dcassandra.storagedir=3Dbin/../data -cp bin/.= ./conf:bin/../build/classes/main:bin/../build/classes/thrift:bin/= ../lib/agent-1.2.jar:bin/../lib/airline-0.6.jar:bin/../lib/a= ntlr-runtime-3.5.2.jar:bin/../lib/apache-cassandra-2.2.8.jar:bin/= ../lib/apache-cassandra-clientutil-2.2.8.jar:bin/../lib/apache-cassandra-thrift-2.2.8.jar:bin/../lib/cassandra-driver-core-2.= 2.0-rc2-SNAPSHOT-20150617-shaded.jar:bin/../lib/commons-cli-1.1.j= ar:bin/../lib/commons-codec-1.2.jar:bin/../lib/commons-lang3-3.1.= jar:bin/../lib/commons-math3-3.2.jar:bin/../lib/compress-lzf= -0.8.4.jar:bin/../lib/concurrentlinkedhashmap-lru-1.4.jar:bin/../= lib/crc32ex-0.1.1.jar:bin/../lib/disruptor-3.0.1.jar:bin/../lib/e= cj-4.4.2.jar:bin/../lib/guava-16.0.jar:bin/../lib/high-scale-lib-= 1.0.6.jar:bin/../lib/jackson-core-asl-1.9.2.jar:bin/../lib/j= ackson-mapper-asl-1.9.2.jar:bin/../lib/jamm-0.3.0.jar:bin/../lib/= java-statsd-client-3.1.0.jar:bin/../lib/javax.inject.jar:bin/../l= ib/jbcrypt-0.3m.jar:bin/../lib/jcl-over-slf4j-1.7.7.jar:bin/../li= b/jna-4.0.0.jar:bin/../lib/joda-time-2.4.jar:bin/../lib/json-simp= le-1.1.jar:bin/../lib/libthrift-0.9.2.jar:bin/../lib/log4j-o= ver-slf4j-1.7.7.jar:bin/../lib/logback-classic-1.1.3.jar:bin/../l= ib/logback-core-1.1.3.jar:bin/../lib/lz4-1.3.0.jar:bin/../lib/met= rics-core-2.2.0.jar:bin/../lib/metrics-core-3.1.0.jar:bin/../lib/= metrics-jvm-3.1.0.jar:bin/../lib/metrics-logback-3.1.0.jar:bin/../lib/metrics-statsd-2.3.0.jar:bin/../lib/netty-all-4.0.23.Fi= nal.jar:bin/../lib/ohc-core-0.3.4.jar:bin/../lib/ohc-core-j8-0.3.= 4.jar:bin/../lib/reporter-config3-3.0.0.jar:bin/../lib/reporter-c= onfig-base-3.0.0.jar:bin/../lib/sigar-1.6.4.jar:bin/../lib/s= lf4j-api-1.7.7.jar:bin/../lib/snakeyaml-1.11.jar:bin/../lib/snapp= y-java-1.1.1.7.jar:bin/../lib/ST4-4.0.8.jar:bin/../lib/stream-2.5= .2.jar:bin/../lib/super-csv-2.1.0.jar:bin/../lib/thrift-server-0.= 3.7.jar:bin/../lib/jsr223/*/*.jar org.apache.cassandra.service.Ca= ssandraDaemon

=C2=A0<= /u>

=C2=A0

below is the output of top command.<= /u>

=C2=A0=C2=A0<= /p>

PID USER =C2=A0 =C2=A0 =C2=A0PR =C2=A0= NI =C2=A0VIRT =C2=A0RES =C2=A0SHR S %CPU %MEM =C2=A0 =C2=A0TIME+ =C2=A0COMM= AND

=C2=A023339 root =C2= =A0 =C2=A0 =C2=A020 =C2=A0 0 =C2=A0295g =C2=A039g =C2=A028g S 107.5 = 63.5 =C2=A0 3458:31 java

=C2=A0

=C2=A0<= /u>

I couldn't understan= d why =C2=A0cassandra process is using so much resident memory while heap s= ize is only 8gb. Any insight??

= =C2=A0


--001a113d30101539620541668128--