Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 93954 invoked from network); 17 Sep 2010 15:45:29 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 17 Sep 2010 15:45:29 -0000 Received: (qmail 40143 invoked by uid 500); 17 Sep 2010 15:45:28 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 39947 invoked by uid 500); 17 Sep 2010 15:45:25 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 39939 invoked by uid 99); 17 Sep 2010 15:45:24 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Sep 2010 15:45:24 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of rcoli@digg.com designates 209.85.214.44 as permitted sender) Received: from [209.85.214.44] (HELO mail-bw0-f44.google.com) (209.85.214.44) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Sep 2010 15:45:17 +0000 Received: by bwz9 with SMTP id 9so3722743bwz.31 for ; Fri, 17 Sep 2010 08:44:55 -0700 (PDT) Received: by 10.223.106.8 with SMTP id v8mr2132974fao.42.1284738295477; Fri, 17 Sep 2010 08:44:55 -0700 (PDT) Received: from rcolis-MacBook-Pro.local (c-98-210-205-15.hsd1.ca.comcast.net [98.210.205.15]) by mx.google.com with ESMTPS id b11sm1737518faq.6.2010.09.17.08.44.53 (version=SSLv3 cipher=RC4-MD5); Fri, 17 Sep 2010 08:44:54 -0700 (PDT) Message-ID: <4C938CF3.2060907@digg.com> Date: Fri, 17 Sep 2010 08:44:51 -0700 From: Robert Coli User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.8) Gecko/20100802 Thunderbird/3.1.2 MIME-Version: 1.0 To: user@cassandra.apache.org Subject: Re: Dazed and confused with Cassandra on EC2 ... References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit On 9/17/10 7:41 AM, Jedd Rashbrooke wrote: > Happy times. This was when the cluster > was modestly sized - 20-50GB. It's now about 200GB, and > performance has dropped by an order of magnitude - perhaps > 5-6 hours to do the same amount of work, using the same > codebase and the same input data. You don't mention which version of the deb package you're using, but : https://issues.apache.org/jira/browse/CASSANDRA-1214 Is a performance hit which occurs as a result of the growth in data size, and could be your issue. Have you checked for swapping behavior like the above while your system is unhappy? =Rob