Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 33885 invoked from network); 4 Apr 2011 22:24:54 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 4 Apr 2011 22:24:54 -0000 Received: (qmail 12296 invoked by uid 500); 4 Apr 2011 22:24:52 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 12263 invoked by uid 500); 4 Apr 2011 22:24:52 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 12253 invoked by uid 99); 4 Apr 2011 22:24:52 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Apr 2011 22:24:52 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of openvictor@gmail.com designates 209.85.210.172 as permitted sender) Received: from [209.85.210.172] (HELO mail-iy0-f172.google.com) (209.85.210.172) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Apr 2011 22:24:47 +0000 Received: by iye19 with SMTP id 19so7517049iye.31 for ; Mon, 04 Apr 2011 15:24:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=t7zafQZPnUmHRZnyPPgODRBjZI74NWRhD0pLZBmlpSs=; b=oIn0PpjeGLjngbHltVqq6nqvxPKBMZ2SeE1PNtcy/kyIPkHr10nicNE9T9YAFnGvXO fFzClPVar+fxt2xeRes14+J1q3R32a/SEDezVdxhl21GpE+6JHENfKFJDlFdRPvx45QN LxgEMZOr/8QJqFgyTDf7JSN/ECtcE8/58oLlA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=N3jbuwJLhs7eF94DhC7WlGon2RfhAHqnwNUtlUg2OyXW0Huz98FPrwYHbW/FXjvJ7B PTLMcvyPngPf2NZUkNZxfU+FFEW+LaSKSC1ZJv9ZgAfg5e/P0pAYSVzhnecl+oMwrmVI Zijm02nbsVFceS3lzIcttYQWembQMUdCeb+Rw= MIME-Version: 1.0 Received: by 10.43.54.9 with SMTP id vs9mr11777576icb.5.1301955865881; Mon, 04 Apr 2011 15:24:25 -0700 (PDT) Received: by 10.43.63.142 with HTTP; Mon, 4 Apr 2011 15:24:25 -0700 (PDT) In-Reply-To: References: <34142DA8-23A8-435D-BF0B-1BFFDB6261CB@thelastpickle.com> Date: Mon, 4 Apr 2011 18:24:25 -0400 Message-ID: Subject: Re: Abnormal memory consumption From: openvictor Open To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=bcaec517ad14e62cc604a01f3865 --bcaec517ad14e62cc604a01f3865 Content-Type: text/plain; charset=ISO-8859-1 Okay, I see. But isn't there a big issue for scaling here ? Imagine that I am the developper of a certain very successful website : At year 1 I need 20 CF. I might need to have 8Gb of RAM. Year 2 I need 50 CF because I added functionalities to my wonderful webiste will I need 20 Gb of RAM ? And if at year three I had 300 Column families, will I need 120 Gb of ram / node ? Or did I miss something about memory consuption ? Thank you very much, Victor 2011/4/4 Peter Schuller > > And about the production 7Gb or RAM is sufficient ? Or 11 Gb is the > minimum > > ? > > Thank you for your inputs for the JVM I'll try to tune that > > Production mem reqs are mostly dependent on memtable thresholds: > > http://www.datastax.com/docs/0.7/operations/tuning > > If you enable key caching or row caching, you will have to adjust > accordingly as well. > > -- > / Peter Schuller > --bcaec517ad14e62cc604a01f3865 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Okay, I see. But isn't there a big issue for scaling here ?
Imagine= that I am the developper of a certain very successful website : At year 1 = I need 20 CF. I might need to have 8Gb of RAM. Year 2 I need 50 CF because = I added functionalities to my wonderful webiste will I need 20 Gb of RAM ? = And if at year three I had 300 Column families, will I need 120 Gb of ram /= node ? Or did I miss something about memory consuption ?

Thank you very much,

Victor

20= 11/4/4 Peter Schuller <peter.schuller@infidyne.com>
> And about the production 7Gb or RAM is sufficient ? = Or 11 Gb is the minimum
> ?
> Thank you for your inputs for the JVM I'll try to tune that

Production mem reqs are mostly dependent on memtable thresholds:

=A0 http://www.datastax.com/docs/0.7/operations/tuning

If you enable key caching or row caching, you will have to adjust
accordingly as well.

--
/ Peter Schuller

--bcaec517ad14e62cc604a01f3865--