Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A3C12E2BF for ; Fri, 22 Feb 2013 16:45:04 +0000 (UTC) Received: (qmail 68042 invoked by uid 500); 22 Feb 2013 16:45:02 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 68017 invoked by uid 500); 22 Feb 2013 16:45:01 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 68006 invoked by uid 99); 22 Feb 2013 16:45:01 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 22 Feb 2013 16:45:01 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [208.113.200.5] (HELO homiemail-a59.g.dreamhost.com) (208.113.200.5) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 22 Feb 2013 16:44:54 +0000 Received: from homiemail-a59.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a59.g.dreamhost.com (Postfix) with ESMTP id 39E4A56405C for ; Fri, 22 Feb 2013 08:44:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=thelastpickle.com; h=from :content-type:message-id:mime-version:subject:date:references:to :in-reply-to; s=thelastpickle.com; bh=iVkLDA+JOCHW40wRMPHgMBV0Qp 8=; b=U1G1GZSEB3kvJeKFLgUNfnbRzC70UrAV1wxz0EnwokbEUvTq8sGUZIPQb7 QEeiA3WH4+CbpoVp7oR8vP+EOZQd2kg7ufTdebBvaXy3/74wJjtcSxgwXEAs8ThQ En6OiTbSGZZ9OrTZpyZZYQffXkm2IH3K1ybItM8d/NURYfN0E= Received: from [172.16.1.8] (unknown [203.86.207.101]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: aaron@thelastpickle.com) by homiemail-a59.g.dreamhost.com (Postfix) with ESMTPSA id 03F6B564057 for ; Fri, 22 Feb 2013 08:44:31 -0800 (PST) From: aaron morton Content-Type: multipart/alternative; boundary="Apple-Mail=_EE91ADE0-636C-47F7-B7D8-8147AAD1F1DD" Message-Id: <9C5F82ED-0C80-4EF4-8BAB-D51C17FFEE43@thelastpickle.com> Mime-Version: 1.0 (Mac OS X Mail 6.2 \(1499\)) Subject: Re: "Heap is N.N full." Immediately on startup Date: Sat, 23 Feb 2013 05:44:32 +1300 References: To: user@cassandra.apache.org In-Reply-To: X-Mailer: Apple Mail (2.1499) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_EE91ADE0-636C-47F7-B7D8-8147AAD1F1DD Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii To get a good idea of how GC is performing turn on the GC logging in = cassandra-env.sh.=20 After a full cms GC event, see how big the tenured heap is. If it's not = reducing enough then GC will never get far enough ahead.=20 Cheers ----------------- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 22/02/2013, at 8:37 AM, Andras Szerdahelyi = wrote: > Thank you- indeed my index interval is 64 with a CF of 300M rows + = bloom filter false positive chance was default. > Raising the index interval to 512 didn't fix this alone, so I guess = I'll have to set the bloom filter to some reasonable value and scrub. >=20 > From: aaron morton > Reply-To: "user@cassandra.apache.org" > Date: Thursday 21 February 2013 17:58 > To: "user@cassandra.apache.org" > Subject: Re: "Heap is N.N full." Immediately on startup >=20 > My first guess would be the bloom filter and index sampling from = lots-o-rows=20 >=20 > Check the row count in cfstats > Check the bloom filter size in cfstats.=20 >=20 > Background on memory requirements = http://www.mail-archive.com/user@cassandra.apache.org/msg25762.html >=20 > Cheers >=20 > ----------------- > Aaron Morton > Freelance Cassandra Developer > New Zealand >=20 > @aaronmorton > http://www.thelastpickle.com >=20 > On 20/02/2013, at 11:27 PM, Andras Szerdahelyi = wrote: >=20 >> Hey list, >>=20 >> Any ideas ( before I take a heap dump ) what might be consuming my = 8GB JVM heap at startup in Cassandra 1.1.6 besides >> row cache : not persisted and is at 0 keys when this warning is = produced >> Memtables : no write traffic at startup, my app's column families are = durable_writes:false >> Pending tasks : no pending tasks, except for 928 compactions ( not = sure where those are coming from ) >> I drew these conclusions from the StatusLogger output below:=20 >>=20 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,198 GCInspector.java = (line 122) GC for ConcurrentMarkSweep: 14959 ms for 2 collections, = 7017934560 used; max is 8375238656 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,198 StatusLogger.java = (line 57) Pool Name Active Pending Blocked >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,199 StatusLogger.java = (line 72) ReadStage 0 0 0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,200 StatusLogger.java = (line 72) RequestResponseStage 0 0 0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,200 StatusLogger.java = (line 72) ReadRepairStage 0 0 0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,200 StatusLogger.java = (line 72) MutationStage 0 -1 0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,201 StatusLogger.java = (line 72) ReplicateOnWriteStage 0 0 0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,201 StatusLogger.java = (line 72) GossipStage 0 0 0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,201 StatusLogger.java = (line 72) AntiEntropyStage 0 0 0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,201 StatusLogger.java = (line 72) MigrationStage 0 0 0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,201 StatusLogger.java = (line 72) StreamStage 0 0 0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,202 StatusLogger.java = (line 72) MemtablePostFlusher 0 0 0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,202 StatusLogger.java = (line 72) FlushWriter 0 0 0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,202 StatusLogger.java = (line 72) MiscStage 0 0 0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,202 StatusLogger.java = (line 72) commitlog_archiver 0 0 0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,203 StatusLogger.java = (line 72) InternalResponseStage 0 0 0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,212 StatusLogger.java = (line 77) CompactionManager 0 928 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,212 StatusLogger.java = (line 89) MessagingService n/a 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,212 StatusLogger.java = (line 99) Cache Type Size Capacity = KeysToSave = Provider >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,212 StatusLogger.java = (line 100) KeyCache 25 25 = all = =20 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,213 StatusLogger.java = (line 106) RowCache 0 0 = all = org.apache.cassandra.cache.SerializingCacheProvider >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,213 StatusLogger.java = (line 113) ColumnFamily Memtable ops,data >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,213 StatusLogger.java = (line 116) MYAPP_1.CF 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,213 StatusLogger.java = (line 116) MYAPP_2.CF 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,213 StatusLogger.java = (line 116) HiveMetaStore.MetaStore 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,213 StatusLogger.java = (line 116) system.NodeIdInfo 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,213 StatusLogger.java = (line 116) system.IndexInfo 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,213 StatusLogger.java = (line 116) system.LocationInfo 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,214 StatusLogger.java = (line 116) system.Versions 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,214 StatusLogger.java = (line 116) system.schema_keyspaces 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,214 StatusLogger.java = (line 116) system.Migrations 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,214 StatusLogger.java = (line 116) system.schema_columnfamilies 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,214 StatusLogger.java = (line 116) system.schema_columns 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,214 StatusLogger.java = (line 116) system.HintsColumnFamily 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,214 StatusLogger.java = (line 116) system.Schema 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,214 StatusLogger.java = (line 116) cfs_archive.sblocks 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,214 StatusLogger.java = (line 116) cfs_archive.cleanup 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,215 StatusLogger.java = (line 116) cfs_archive.inode 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,215 StatusLogger.java = (line 116) cfs.cleanup 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,215 StatusLogger.java = (line 116) cfs.sblocks 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,215 StatusLogger.java = (line 116) cfs.inode 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,215 StatusLogger.java = (line 116) OpsCenter.events 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,215 StatusLogger.java = (line 116) OpsCenter.rollups300 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,215 StatusLogger.java = (line 116) OpsCenter.rollups86400 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,215 StatusLogger.java = (line 116) OpsCenter.pdps 345,54448 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,215 StatusLogger.java = (line 116) OpsCenter.events_timeline 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,216 StatusLogger.java = (line 116) OpsCenter.settings 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,216 StatusLogger.java = (line 116) OpsCenter.rollups7200 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,216 StatusLogger.java = (line 116) OpsCenter.rollups60 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,216 StatusLogger.java = (line 116) demo.users 0,0 >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,216 StatusLogger.java = (line 116) MYAPP_3.CF 0,0 >> WARN [ScheduledTasks:1] 2013-02-20 05:13:25,216 GCInspector.java = (line 145) Heap is 0.8379384574280004 full. You may need to reduce = memtable and/or cache sizes. Cassandra will now flush up to the two = largest memtables to free up memory. Adjust flush_largest_memtables_at = threshold in cassandra.yaml if you don't want Cassandra to do this = automatically >> WARN [ScheduledTasks:1] 2013-02-20 05:13:25,217 StorageService.java = (line 2855) Flushing CFS(Keyspace=3D'OpsCenter', ColumnFamily=3D'pdps') = to relieve memory pressure >> INFO [ScheduledTasks:1] 2013-02-20 05:13:25,217 = ColumnFamilyStore.java (line 659) Enqueuing flush of = Memtable-pdps@98567689(15238/54448 serialized/live bytes, 345 ops) >> INFO [FlushWriter:6] 2013-02-20 05:13:25,218 Memtable.java (line = 264) Writing Memtable-pdps@98567689(15238/54448 serialized/live bytes, = 345 ops) >> INFO [FlushWriter:6] 2013-02-20 05:13:25,241 Memtable.java (line = 305) Completed flushing = /var/lib/cassandra/data/OpsCenter/pdps/OpsCenter-pdps-hf-127-Data.db = (5394 bytes) for commitlog position = ReplayPosition(segmentId=3D1361354508149, : >>=20 >>=20 >>=20 >> Thanks! >> Andras >>=20 >=20 --Apple-Mail=_EE91ADE0-636C-47F7-B7D8-8147AAD1F1DD Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii To = get a good idea of how GC is performing turn on the GC logging in = cassandra-env.sh. 

After a full cms GC event, = see how big the tenured heap is. If it's not reducing enough then GC = will never get far enough = ahead. 

Cheers

http://www.thelastpickle.com

On 22/02/2013, at 8:37 AM, Andras Szerdahelyi <andras.szerdahelyi@igni= tionone.com> wrote:

Thank you- indeed my index interval is 64 with a CF of 300M rows + = bloom filter false positive chance was default.
Raising the index interval to 512 didn't fix this  alone, so I = guess I'll have to set the bloom filter to some reasonable value and = scrub.

From: aaron morton <aaron@thelastpickle.com> Reply-To: "user@cassandra.apache.org" = <user@cassandra.apache.org>= ;
Date: Thursday 21 February 2013 = 17:58
To: "user@cassandra.apache.org" = <user@cassandra.apache.org>= ;
Subject: Re: "Heap is N.N full." = Immediately on startup

My first guess would be the bloom filter and index sampling from = lots-o-rows 

Check the row count in cfstats
Check the bloom filter size in cfstats. 


Cheers

-----------------
Aaron Morton
Freelance Cassandra Developer
New Zealand

@aaronmorton

On 20/02/2013, at 11:27 PM, Andras Szerdahelyi <andras.szerdahelyi@igni= tionone.com> wrote:

Hey list,

Any ideas ( before I take a heap dump ) what might be consuming my = 8GB JVM heap at startup in Cassandra 1.1.6 besides
  • row cache : not persisted and is at 0 keys when this warning is = produced
  • Memtables : no write traffic at startup, my app's = column families are durable_writes:false
  • Pending tasks : no = pending tasks, except for 928 compactions ( not sure where those are = coming from )
I drew these conclusions from the StatusLogger output = below: 

INFO [ScheduledTasks:1] 2013-02-20 05:13:25,198 GCInspector.java = (line 122) GC for ConcurrentMarkSweep: 14959 ms for 2 collections, = 7017934560 used; max is 8375238656
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,198 = StatusLogger.java (line 57) Pool Name           =          Active   Pending   = Blocked
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,199 = StatusLogger.java (line 72) ReadStage           =               0       =   0         0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,200 = StatusLogger.java (line 72) RequestResponseStage       =        0         0     =     0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,200 = StatusLogger.java (line 72) ReadRepairStage         =           0         0 =         0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,200 = StatusLogger.java (line 72) MutationStage         =             0       =  -1         0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,201 = StatusLogger.java (line 72) ReplicateOnWriteStage       =       0         0     =     0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,201 = StatusLogger.java (line 72) GossipStage         =               0       =   0         0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,201 = StatusLogger.java (line 72) AntiEntropyStage         =          0         0   =       0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,201 = StatusLogger.java (line 72) MigrationStage         =            0         0 =         0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,201 = StatusLogger.java (line 72) StreamStage         =               0       =   0         0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,202 = StatusLogger.java (line 72) MemtablePostFlusher       =         0         0   =       0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,202 = StatusLogger.java (line 72) FlushWriter         =               0       =   0         0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,202 = StatusLogger.java (line 72) MiscStage           =               0       =   0         0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,202 = StatusLogger.java (line 72) commitlog_archiver       =          0         0   =       0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,203 = StatusLogger.java (line 72) InternalResponseStage       =       0         0     =     0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,212 = StatusLogger.java (line 77) CompactionManager       =           0       928
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,212 = StatusLogger.java (line 89) MessagingService         =        n/a       0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,212 = StatusLogger.java (line 99) Cache Type         =             Size       =           Capacity         =       KeysToSave           =                     =                     =       Provider
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,212 = StatusLogger.java (line 100) KeyCache           =               25       =                 25     =                  all   =                     =                     =                     =   
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,213 = StatusLogger.java (line 106) RowCache           =                0     =                    0 =                     =  all             =  org.apache.cassandra.cache.SerializingCacheProvider
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,213 = StatusLogger.java (line 113) ColumnFamily         =        Memtable ops,data
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,213 = StatusLogger.java (line 116) MYAPP_1.CF         =                0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,213 = StatusLogger.java (line 116) MYAPP_2.CF        =                  0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,213 = StatusLogger.java (line 116) HiveMetaStore.MetaStore     =               0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,213 = StatusLogger.java (line 116) system.NodeIdInfo       =                   0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,213 = StatusLogger.java (line 116) system.IndexInfo       =                   =  0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,213 = StatusLogger.java (line 116) system.LocationInfo       =                 0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,214 = StatusLogger.java (line 116) system.Versions         =                   0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,214 = StatusLogger.java (line 116) system.schema_keyspaces     =               0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,214 = StatusLogger.java (line 116) system.Migrations       =                   0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,214 = StatusLogger.java (line 116) system.schema_columnfamilies     =             0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,214 = StatusLogger.java (line 116) system.schema_columns       =               0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,214 = StatusLogger.java (line 116) system.HintsColumnFamily     =              0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,214 = StatusLogger.java (line 116) system.Schema         =                     = 0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,214 = StatusLogger.java (line 116) cfs_archive.sblocks       =                 0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,214 = StatusLogger.java (line 116) cfs_archive.cleanup       =                 0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,215 = StatusLogger.java (line 116) cfs_archive.inode       =                   0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,215 = StatusLogger.java (line 116) cfs.cleanup         =                     =   0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,215 = StatusLogger.java (line 116) cfs.sblocks         =                     =   0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,215 = StatusLogger.java (line 116) cfs.inode         =                     =     0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,215 = StatusLogger.java (line 116) OpsCenter.events       =                   =  0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,215 = StatusLogger.java (line 116) OpsCenter.rollups300       =                0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,215 = StatusLogger.java (line 116) OpsCenter.rollups86400       =              0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,215 = StatusLogger.java (line 116) OpsCenter.pdps         =              345,54448
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,215 = StatusLogger.java (line 116) OpsCenter.events_timeline     =             0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,216 = StatusLogger.java (line 116) OpsCenter.settings       =                  0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,216 = StatusLogger.java (line 116) OpsCenter.rollups7200       =               0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,216 = StatusLogger.java (line 116) OpsCenter.rollups60       =                 0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,216 = StatusLogger.java (line 116) demo.users         =                     =    0,0
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,216 = StatusLogger.java (line 116) MYAPP_3.CF        =                  0,0
 WARN [ScheduledTasks:1] 2013-02-20 05:13:25,216 = GCInspector.java (line 145) Heap is 0.8379384574280004 full.  You = may need to reduce memtable and/or cache sizes.  Cassandra will now = flush up to the two largest memtables to free up memory.  Adjust = flush_largest_memtables_at threshold in cassandra.yaml if you don't want Cassandra to do this = automatically
 WARN [ScheduledTasks:1] 2013-02-20 05:13:25,217 = StorageService.java (line 2855) Flushing CFS(Keyspace=3D'OpsCenter', = ColumnFamily=3D'pdps') to relieve memory pressure
 INFO [ScheduledTasks:1] 2013-02-20 05:13:25,217 = ColumnFamilyStore.java (line 659) Enqueuing flush of = Memtable-pdps@98567689(15238/54448 serialized/live bytes, 345 ops)
 INFO [FlushWriter:6] 2013-02-20 05:13:25,218 Memtable.java = (line 264) Writing Memtable-pdps@98567689(15238/54448 serialized/live = bytes, 345 ops)
 INFO [FlushWriter:6] 2013-02-20 05:13:25,241 Memtable.java = (line 305) Completed flushing = /var/lib/cassandra/data/OpsCenter/pdps/OpsCenter-pdps-hf-127-Data.db = (5394 bytes) for commitlog position = ReplayPosition(segmentId=3D1361354508149, :



Thanks!
Andras



= --Apple-Mail=_EE91ADE0-636C-47F7-B7D8-8147AAD1F1DD--