Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (athena.apache.org: domain of chris.burroughs@gmail.com
 designates 209.85.220.172 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:user-agent:mime-version:to:cc:subject
         :references:in-reply-to:content-type:content-transfer-encoding;
        b=gbfuOgPir7lp7SzbQAGfFaNzVnWmbHN6ID98y0qgFCnrvxiyraHbK6r6it5hVsmpPT
         4GQBKpsMT8Zu7cSl3TqvTRarMhn+L4nSt12FbQzZ2JAfMbnSKOJTlwpsTadwHvIMasb3
         WqWQ/ScxgEUv3w/TYigtcTndcIQ9QgYkl/t+4=
Message-ID: <4DC29CDF.4080400@gmail.com>
Date: Thu, 05 May 2011 08:49:35 -0400
From: Chris Burroughs <chris.burroughs@gmail.com>
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US;
 rv:1.9.2.15) Gecko/20110409 Lightning/1.0b3pre Thunderbird/3.1.9
MIME-Version: 1.0
To: user@cassandra.apache.org
CC: Hannes Schmidt <hannes@eyealike.com>
Subject: Re: Native heap leaks?
References: <BANLkTi=7aJrsqdenjDZ-S04zcuHPp==GoQ@mail.gmail.com>
	<loom.20110505T083328-985@post.gmane.org>
 <BANLkTikwbLLaFs1HsdZ_KVxSkoakkPpikw@mail.gmail.com>
In-Reply-To: <BANLkTikwbLLaFs1HsdZ_KVxSkoakkPpikw@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit

On 2011-05-05 06:30, Hannes Schmidt wrote:
> This was my first thought, too. We switched to mmap_index_only and
> didn't see any change in behavior. Looking at the smaps file attached
> to my original post, one can see that the mmapped index files take up
> only a minuscule part of RSS.

I have not looked into smaps before. But it actually seems odd that that
mmaped Index files are taking up so *little memory*.  Are they only a
few kb on disk?  Is this a snapshot taken shortly after the process
started or before the OOM killer is presumably about to come along.  How
long does it take to go from 1.1 G to 2.1 G resident?  Either way, it
would be worthwhile to set one node to standard io to make sure it's
really not mmap causing the problem.

Anyway, assuming it's not mmap, here are the other similar threads on
the topic.  Unfortunately none of them claim an obvious solution:

http://www.mail-archive.com/user@cassandra.apache.org/msg09279.html
http://www.mail-archive.com/user@cassandra.apache.org/msg08063.html
http://www.mail-archive.com/user@cassandra.apache.org/msg12036.html
http://mail.openjdk.java.net/pipermail/hotspot-dev/2011-April/004091.html