Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 23432 invoked from network); 23 Mar 2011 19:20:31 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 23 Mar 2011 19:20:31 -0000 Received: (qmail 59692 invoked by uid 500); 23 Mar 2011 18:18:29 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 59621 invoked by uid 500); 23 Mar 2011 18:18:29 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 59613 invoked by uid 99); 23 Mar 2011 18:18:28 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Mar 2011 18:18:28 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ruslan.usifov@gmail.com designates 209.85.212.171 as permitted sender) Received: from [209.85.212.171] (HELO mail-px0-f171.google.com) (209.85.212.171) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Mar 2011 18:18:22 +0000 Received: by pxi7 with SMTP id 7so1975614pxi.30 for ; Wed, 23 Mar 2011 11:18:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=ou7uMGI7xTRVZvcgoiSt1TP904i+ifAeyKqiurrSAY4=; b=YMKmOKEv39b0EKhgCcBzfhFyqshk0HbSXzBckEZdbrUlnbApo3FkB51jpugnDrSeIP McZ5lt8pj3/Xn7WiEVa2i/evx57h1Tm7c1YetniCd7+wbv26/2k/wEjPXwS0UiKhMVHE t1Grqd/2YFj8+ad/JFuK2KrinBDRkepvOi1qk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=tENxszFYwiJWEF6vWRrtp6XbdwtXXkvytjS2omj/f6RMiWzGzc8g6DqG6MjQOjUN2R 46BR61EvIYBDQ4R8Q4gCEtbXWhG0ANcgmIGUXnBwJeQy3xuqgxlOccNS8KJPnX9KIyeu 1clToGIAIZNQTF/isqRC64XKvTBhLdegpv/iY= MIME-Version: 1.0 Received: by 10.142.128.17 with SMTP id a17mr5140182wfd.110.1300904282441; Wed, 23 Mar 2011 11:18:02 -0700 (PDT) Received: by 10.142.127.21 with HTTP; Wed, 23 Mar 2011 11:18:02 -0700 (PDT) In-Reply-To: References: Date: Wed, 23 Mar 2011 21:18:02 +0300 Message-ID: Subject: Re: ParNew (promotion failed) From: ruslan usifov To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=000e0cd312e4a44726049f2a6112 --000e0cd312e4a44726049f2a6112 Content-Type: text/plain; charset=ISO-8859-1 2011/3/23 Narendra Sharma > I think it is due to fragmentation in old gen, due to which survivor area > cannot be moved to old gen. 300MB data size of memtable looks high for 3G > heap. I learned that in memory overhead of memtable can be as high as 10x of > memtable data size in memory. So either increase the heap or reduce the > memtable thresholds further so that old gen gets freed up faster. With > 16CFs, I would do both i.e. increase the heap to say 4GB and reduce memtable > thresholds further. > > > I think that you don't undestend me, 300MB is a summary thresholds on all 16 CF, so one memtable_threshold is about 18MB. Or all the same it is necessary to reduce memtable_threshold? --000e0cd312e4a44726049f2a6112 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable

2011/3/23 Narendra Sharma <narendra.sharma@gmail.= com>
I think it is due to fragmentation in old gen, due to which survivor area c= annot be moved to old gen. 300MB data size of memtable looks high for 3G he= ap. I learned that in memory overhead of memtable can be as high as 10x of = memtable data size in memory. So either increase the heap or reduce the mem= table thresholds further so that old gen gets freed up faster. With 16CFs, = I would do both i.e. increase the heap to say 4GB and reduce memtable thres= holds further.


I think that you don't undestend me, 3= 00MB is a summary thresholds on all 16 CF, so one memtable_threshold is abo= ut 18MB. Or all the same it is necessary to reduce memtable_threshold? --000e0cd312e4a44726049f2a6112--