Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 71739 invoked from network); 17 Feb 2011 20:36:33 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 17 Feb 2011 20:36:33 -0000 Received: (qmail 13232 invoked by uid 500); 17 Feb 2011 20:36:31 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 13192 invoked by uid 500); 17 Feb 2011 20:36:31 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 13184 invoked by uid 99); 17 Feb 2011 20:36:30 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 Feb 2011 20:36:30 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of victor.kabdebon@gmail.com designates 209.85.161.44 as permitted sender) Received: from [209.85.161.44] (HELO mail-fx0-f44.google.com) (209.85.161.44) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 Feb 2011 20:36:24 +0000 Received: by fxm9 with SMTP id 9so3169074fxm.31 for ; Thu, 17 Feb 2011 12:36:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=sDQ3BQuXcTp5xSEG6OlAkrvq14jPwUARhRArEHUvEQM=; b=GStFvXzhvsHGUzbmv6lvkvq1Z1E9CFgvQR9p0vE2V38OgJ65EIIGEGRZn6MVQy72sS CpexJHXo/uxplsLSuYLrf6rb2imqhFtrVvG6ozE/8TLANSOipRfhvHk7sjb7LPq5YV2Z 1wUW1IrbLkppW+pvoKmKpt98GDD07hYeCZIKQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; b=WLbQXNiduf/rE22MJ1RkhUiWwmAD3C5628L7MX8dtN4DT7KeHKnqhS8fwciIGSt/Wb LIg2fwAu6uA5BvjymYUigPQuVC/2LQJOmhOHX2LolJHcpGit4OsalszIqWEAtYTSKdHS /E4N3mPgfd7CEmXvQUt6QzzlJZ2/OxTbOkYOU= Received: by 10.223.86.16 with SMTP id q16mr2931984fal.58.1297974959860; Thu, 17 Feb 2011 12:35:59 -0800 (PST) MIME-Version: 1.0 Received: by 10.223.107.197 with HTTP; Thu, 17 Feb 2011 12:34:46 -0800 (PST) In-Reply-To: References: From: Victor Kabdebon Date: Thu, 17 Feb 2011 15:34:46 -0500 Message-ID: Subject: Re: memory consuption To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=20cf3054a6e968ed44049c805855 X-Virus-Checked: Checked by ClamAV on apache.org --20cf3054a6e968ed44049c805855 Content-Type: text/plain; charset=ISO-8859-1 Sorry I forgot to say that this is the partial result of : ps aux | grep cassandra Best regards 2011/2/17 Victor Kabdebon > Oh right but Cassandra doesn't really respect that, I thought there was > another option to set that. > > Just for your information, I set xms and xmx very low with a small amount > of data. I am waiting to be able to connect jconsole, I don't know why it is > not reachable at the moment. Here is my result : > > > 105 26115 0.2 27.3 1125328 755316 ? Sl Feb09 23:58 > /usr/bin/java -ea -Xms64M -Xmx128M > > > 2011/2/17 Aaron Morton > >> bin/cassandra.in.sh >> set Xms and Xmx in the JVM_OPTS >> >> Aaron >> >> >> On 18 Feb, 2011,at 09:10 AM, Victor Kabdebon >> wrote: >> >> Is it possible to change the maximum JVM heap memory use in 0.6.X ? >> >> 2011/2/17 Aaron Morton >> >>> What are you using for disk_access_mode ? >>> Have you tried reducing the JVM head size? >>> Have you added the Jna.jar file to lib/ ? This will allow Cassandra to >>> lock the JVM memory. >>> >>> >>> Aaron >>> >>> >>> >>> On 17/02/2011, at 9:20 PM, ruslan usifov >>> wrote: >>> >>> >>> >>> >>> >>> 2011/2/16 Aaron Morton < >>> aaron@thelastpickle.com> >>> >>>> JVM heap memory is controlled by the settings in conf/Cassandra-env.sh >>>> >>>> Memory mapped files will use additional virtual memory, is controlled in >>>> conf/Cassandra.yaml disk_access_mode >>>> >>>> >>> And??? JVM memory heap in cassandra 0.7 is by default half of memory is >>> system in my case 4GB, here is a part of cassandra-env.sh: >>> >>> calculate_heap_size() >>> { >>> case "`uname`" in >>> Linux) >>> system_memory_in_mb=`free -m | awk '/Mem:/ {print $2}'` >>> MAX_HEAP_SIZE=$((system_memory_in_mb / 2))M >>> return 0 >>> ;; >>> FreeBSD) >>> system_memory_in_bytes=`sysctl hw.physmem | awk '{print $2}'` >>> MAX_HEAP_SIZE=$((system_memory_in_bytes / 1024 / 1024 / 2))M >>> return 0 >>> ;; >>> *) >>> MAX_HEAP_SIZE=1024M >>> return 1 >>> ;; >>> esac >>> } >>> >>> >>> >>> I set all this options by default. All my nodes have 8GB of memory. And i >>> affraid that after some time all my nodes goes to hard swap, and only reboot >>> help them :-((( >>> >>> PS: as i understand that down sometime of cassandra is normal? >>> >>> >> > --20cf3054a6e968ed44049c805855 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Sorry I forgot to say that this is the partial result of :=A0
ps aux | = grep cassandra

Best regards

2011/2/17 Victor Kabdebon <victor.kabdebon@gmail.com>
Oh right but Cassandra doesn't really r= espect that, I thought there was another option to set that.

Just for your information, I set xms and xmx very low with a small amo= unt of data. I am waiting to be able to connect jconsole, I don't know = why it is not reachable at the moment. Here is my result :


105 =A0 =A0 =A026115 =A00.2 27.3 1125328 755316 ? = =A0 =A0 =A0Sl =A0 Feb09 =A023:58 /usr/bin/java -ea -Xms64M -Xmx128M


2011/2/17= Aaron Morton <aaron@thelastpickle.com>
set Xms and Xmx in = the JVM_OPTS

Aaron


On 18 Feb, 2011,at 09:10 AM, Victor Kabdebon <victor.kabdebon@gmail.com> wrote:

<= div>Is it possible to change the maximum JVM heap memory use in 0.6.X ?
=
2011/2/17 Aaron Morton <= ;aaron@thelast= pickle.com>
What are you using for disk_access= _mode ?
Have you tried reducing the JVM head size?
Have you added the Jna.jar file to lib/ ? This will allow Cassandra to= lock the JVM memory.


Aaron



On 17/02/2011, at 9:20 PM, ruslan usifov <ruslan.usifov@gmail= .com> wrote:





2011/2/16 Aaron Morton= <a= aron@thelastpickle.com>
JVM heap memory is controlled by the settings in conf/Cassandra-env.sh

Memory mapped files will use additional virtual memory, is controlled in co= nf/Cassandra.yaml disk_access_mode


And??? JVM memory= heap in cassandra 0.7 is by default half of memory is system in my case 4G= B, here is a part of cassandra-env.sh:

calculate_heap_size()
{ =A0=A0=A0 case "`uname`" in
=A0=A0=A0=A0=A0=A0=A0 Linux)
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 system_memory_in_mb=3D`free -m | awk '= ;/Mem:/ {print $2}'`
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 MAX_HEAP_SIZE= =3D$((system_memory_in_mb / 2))M
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 retur= n 0
=A0=A0=A0=A0=A0=A0=A0 ;;
=A0=A0=A0=A0=A0=A0=A0 FreeBSD)
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 system_= memory_in_bytes=3D`sysctl hw.physmem | awk '{print $2}'`
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0 MAX_HEAP_SIZE=3D$((system_memory_in_bytes / 102= 4 / 1024 / 2))M
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 return 0
=A0=A0=A0= =A0=A0=A0=A0 ;;
=A0=A0=A0=A0=A0=A0=A0 *)
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 MAX_HEAP_SIZE=3D1024M
=A0=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0 return 1
=A0=A0=A0=A0=A0=A0=A0 ;;
=A0=A0=A0 esac}



I set all this options by default. All my nodes have 8GB= of memory. And i affraid that after some time all my nodes goes to hard sw= ap, and only reboot help them :-(((

PS: as i understand that down sometime of cassandra is normal?



--20cf3054a6e968ed44049c805855--