incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ryan King <r...@twitter.com>
Subject Re: reduced cached mem; resident set size growth
Date Mon, 21 Mar 2011 03:00:13 GMT
The test was inconclusive because we decomissioned that cluster before
it'd be running long enough to exhibit the problem.

-ryan

On Wed, Mar 16, 2011 at 7:27 PM, Zhu Han <schumi.han@gmail.com> wrote:
>
>
> On Thu, Feb 3, 2011 at 1:49 AM, Ryan King <ryan@twitter.com> wrote:
>>
>> On Wed, Feb 2, 2011 at 6:22 AM, Chris Burroughs
>> <chris.burroughs@gmail.com> wrote:
>> > On 01/28/2011 09:19 PM, Chris Burroughs wrote:
>> >> Thanks Oleg and Zhu.  I swear that wasn't a new hotspot version when I
>> >> checked, but that's obviously not the case.  I'll update one node to
>> >> the
>> >> latest as soon as I can and report back.
>> >
>> >
>> > RSS over 48 hours with java 6 update 23:
>> >
>> > http://img716.imageshack.us/img716/5202/u2348hours.png
>> >
>> > I'll continue monitoring but RSS still appears to grow without bounds.
>> > Zhu reported a similar problem with Ubuntu 10.04.  While possible, it
>> > would seem seam extraordinary unlikely that there is a glibc or kernel
>> > bug affecting us both.
>>
>> We're seeing a similar problem with one of our clusters (but over a
>> longer time scale). Its possible that its not a leak, but just
>> fragmentation. Unless you've told it otherwise, the jvm uses glibc's
>> malloc implementation for off-heap allocations. We're currently
>> running a test with jemalloc on one node to see if the problem goes
>> away.
>
> Ryan, does jemalloc solve the RSS growth problem in your test?
>
>> -ryan
>
>

Mime
View raw message