Return-Path: Delivered-To: apmail-incubator-cassandra-user-archive@minotaur.apache.org Received: (qmail 34224 invoked from network); 8 Mar 2010 12:52:26 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 8 Mar 2010 12:52:26 -0000 Received: (qmail 15363 invoked by uid 500); 8 Mar 2010 12:52:02 -0000 Delivered-To: apmail-incubator-cassandra-user-archive@incubator.apache.org Received: (qmail 15338 invoked by uid 500); 8 Mar 2010 12:52:02 -0000 Mailing-List: contact cassandra-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: cassandra-user@incubator.apache.org Delivered-To: mailing list cassandra-user@incubator.apache.org Received: (qmail 15330 invoked by uid 99); 8 Mar 2010 12:52:02 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Mar 2010 12:52:02 +0000 X-ASF-Spam-Status: No, hits=2.1 required=10.0 tests=BUG6152_INVALID_DATE_TZ_ABSURD,FREEMAIL_FROM,INVALID_DATE_TZ_ABSURD,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of anibalrojas@gmail.com designates 74.125.82.47 as permitted sender) Received: from [74.125.82.47] (HELO mail-ww0-f47.google.com) (74.125.82.47) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Mar 2010 12:52:01 +0000 Received: by wwb31 with SMTP id 31so2342611wwb.6 for ; Mon, 08 Mar 2010 04:51:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:from:date:message-id :subject:to:content-type:content-transfer-encoding; bh=u18LpZ9paRn21mTYRlQT6TS5XFgwP1J6DdXjgfBorlU=; b=VFF2ePB3BjoN1m1/98n1QaldR3YniTJ9nlokzADWWguO7Q/qwNqWQOfq/cQPD4wfZp /+RBZW1HXzuocSL9bfEQZADH0E7KO9OPuVy9aeNhV1imwPzmLfvsMlg/Yo3UpRfl1y3D w0LYW0SOQNbYOoB7jeK00dxdxLEV8MrMB0wqI= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:from:date:message-id:subject:to:content-type :content-transfer-encoding; b=nYbjLiJ9qMMnBciz1oTNYEdqMDmxiaAAU+bUEBz160XtSWW+OjeL4DeFKshssnKP2C 7eCmTMwJdE4R7NspCwsgheEeOSSYlrAynOimoOXRshYCgI+avjYMkOoPSeBiWtwk4q5g eFG3vM0tr+oaeLrktdMe7N/1DtZtSQ7dOKZEM= MIME-Version: 1.0 Received: by 10.216.89.213 with SMTP id c63mr2704828wef.211.1268052700150; Mon, 08 Mar 2010 04:51:40 -0800 (PST) From: =?ISO-8859-1?Q?An=EDbal_Rojas?= Date: Tue, 9 Mar 2010 08:21:20 +1930 Message-ID: Subject: Use Case scenario: Keeping a window of data + online analytics To: cassandra-user@incubator.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hello, Have been testing alternatives for MySQL / Postgres based app with the following characteristics: - A high rate of inserts. Heavy bursts are expected. - A high rate of deletes to remove old data. We keep a window, as old data is not relevant. - Online analytics based on _aging_ and other variables, right now mostly calculated client side, this means a lot of data transfer. - Cloud based deployment ala Amazon. EBS slow disks. I have been reading the Wiki, blogs, and mailing list discussions related to provisioning and performance and I would like to know your opinion in relation to: - Can we keep this "data window" approach, or will a high rate of delete pose a problem? - Also regarding the "data window", what about replication? - Will slow disk performance affect read speed? - We need read speed, I understand writes won't be a problem, but there will be a lot of reads, some of them with large sets of values. - What role plays RAM in Cassandra under this scenario? Of course we are looking at Cassandra as a possible solution and/or part of the solution, against / or combined with a in memory DB. Thanks in advance for sharing your experience, and opinions. -- An=EDbal Rojas Ruby on Rails Web Developer http://www.google.com/profiles/anibalrojas