Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 775CA9DF8 for ; Sat, 10 Mar 2012 21:50:50 +0000 (UTC) Received: (qmail 97708 invoked by uid 500); 10 Mar 2012 21:50:48 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 97684 invoked by uid 500); 10 Mar 2012 21:50:48 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 97657 invoked by uid 99); 10 Mar 2012 21:50:47 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 10 Mar 2012 21:50:47 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of scode@scode.org designates 74.125.82.172 as permitted sender) Received: from [74.125.82.172] (HELO mail-we0-f172.google.com) (74.125.82.172) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 10 Mar 2012 21:50:40 +0000 Received: by werb10 with SMTP id b10so2595735wer.31 for ; Sat, 10 Mar 2012 13:50:19 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:sender:x-originating-ip:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type :x-gm-message-state; bh=/umMObVVut5DzgYDYFSTcST+gnY8iQ6T8PMUhYqy9zc=; b=ockJNeD0BKfA/JfuPFuWdQkySuLGJoitjHkOJybXIGw5w/z/3sbNTeONjQyuAshdr7 GUOC19zR37eEu61ImrxdBVzpPAkWKQEg4Fy4lBDNLUJ2AZwffwBhT/Er6yOHXPUH5XEf 3ni1m3Z0f7aolIvXq9keR9Fl733yKJ1xtzyYWNRMAPKUejiO+tHG18hycUX2OtB8VpyJ WySi24r7OtAbmddsYeidrpRZ0ee2E4u6UBVeESaOnxw7Y06aa4/cGO+wRInR9TijJwz7 mYIhXrvlDvMDN/5S3GmZEbKSLQkPeFBTDhwlg29Sy7mIT/kuGGKnmlYDz/7mfVxDF8Od GTOg== MIME-Version: 1.0 Received: by 10.180.95.74 with SMTP id di10mr7609200wib.1.1331416219361; Sat, 10 Mar 2012 13:50:19 -0800 (PST) Sender: scode@scode.org Received: by 10.180.109.170 with HTTP; Sat, 10 Mar 2012 13:50:19 -0800 (PST) X-Originating-IP: [67.169.39.4] In-Reply-To: References: Date: Sat, 10 Mar 2012 13:50:19 -0800 X-Google-Sender-Auth: QucL_dOJEhCzxUh7bHLBCXhV-Ik Message-ID: Subject: Re: LeveledCompaction and/or SnappyCompressor causing memory pressure during repair From: Peter Schuller To: user@cassandra.apache.org Content-Type: text/plain; charset=UTF-8 X-Gm-Message-State: ALoCoQn0FBXoZLpAukGFfjORIRw9+VJ3fRE6ty5GtP+m8qUfHaKsIS8C1t0DfXZJgqQGouyBqP81 X-Virus-Checked: Checked by ClamAV on apache.org > However, when I run a repair my CMS usage graph no longer shows sudden drops > but rather gradual slopes and only manages to clear around 300MB each GC. > This seems to occur on 2 other nodes in my cluster around the same time, I > assume this is because they're the replicas (we use 3 replicas). Parnew > collections look about the same on my graphs with or without repair running > so no trouble there so far as I can tell. I don't know why leveled/snappy would affect it, but disregarding that, I would have been suggesting that you are seeing additional heap usage because of long-running repairs retaining sstables and delaying their unload/removal (index sampling/bloom filters filling your heap). If it really only happens for leveled/snappy however, I don't know what that might be caused by. -- / Peter Schuller (@scode, http://worldmodscode.wordpress.com)