Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (athena.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.com;
  h=X-YMail-OSG:Received:X-Mailer:Message-ID:Date:From:Reply-To:Subject:To:MIME-Version:Content-Type;
  b=VoghH+7EvadZwa2zICsqxESDQnjWQnv2xNUTtF2YcCY/pSZstbgnvl2rDmeNeMReQEUIzGpvtkivxZLuhIQWFFDagM4PrJCtaQFrKzM9g+lhC412hhWWci2xojP1FYy4p9kdlKBejCEy8ifqEw83FmFFoBRO62hy4Fs4601ndvI=;
Message-ID: <1360953362.23729.GenericBBA@web160902.mail.bf1.yahoo.com>
Date: Fri, 15 Feb 2013 10:36:02 -0800 (PST)
From: Wei Zhu <wz1975@yahoo.com>
Reply-To: Wei Zhu <wz1975@yahoo.com>
Subject: Re: heap usage
To: user@cassandra.apache.org
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii

We have 250G data and running at 8GB heap and one of the node is OOM during repair. 

I checked bloomfilter, only 200M. Not sure how the memory is used, maybe take a memory dump and exam that. 

----- Original Message -----
From: "Edward Capriolo" <edlinuxguru@gmail.com>
To: user@cassandra.apache.org
Sent: Friday, February 15, 2013 8:16:23 AM
Subject: Re: heap usage

It is not going to be true for long that LCS does not require bloom filters.

https://issues.apache.org/jira/browse/CASSANDRA-5029

Apparently, without bloom filters there are issues.

On Fri, Feb 15, 2013 at 7:29 AM, Blake Manders <blake@crosspixel.net> wrote:
>
> You probably want to look at your bloom filters.  Be forewarned though,
> they're difficult to change; changes to bloom filter settings only apply to
> new SSTables, so they might not be noticeable until a few compactions have
> taken place.
>
> If that is your issue, and your usage model fits it, a good alternative to
> the slow propagation of higher miss rates is to switch to LCS (which doesn't
> use bloom filters), which won't require you to make the jump to 1.2.
>
>
> On Fri, Feb 15, 2013 at 4:06 AM, Reik Schatz <reik.schatz@gmail.com> wrote:
>>
>> Hi,
>>
>> recently we are hitting some OOM: Java heap space, so I was investigating
>> how the heap is used in Cassandra 1.2+
>>
>> We use the calculated 4G heap. Our cluster is 6 nodes, around 750 GB data
>> and a replication factor of 3. Row cache is disabled. All key cache and
>> memtable settings are left at default.
>>
>> Is the primary key index kept in heap memory? We have a bunch of keyspaces
>> and column families.
>>
>> Thanks,
>> Rik
>
>
>
>
> --
>
> Blake Manders | CTO
>
> Cross Pixel, Inc. | 494 8th Ave, Penthouse | NYC 10001
>
> Website: crosspixel.net
> Twitter: twitter.com/CrossPix