Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B51E26385 for ; Sat, 9 Jul 2011 01:51:59 +0000 (UTC) Received: (qmail 10534 invoked by uid 500); 9 Jul 2011 01:51:57 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 10400 invoked by uid 500); 9 Jul 2011 01:51:57 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 10389 invoked by uid 99); 9 Jul 2011 01:51:56 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 09 Jul 2011 01:51:56 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jbellis@gmail.com designates 74.125.82.172 as permitted sender) Received: from [74.125.82.172] (HELO mail-wy0-f172.google.com) (74.125.82.172) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 09 Jul 2011 01:51:51 +0000 Received: by wyj26 with SMTP id 26so1900799wyj.31 for ; Fri, 08 Jul 2011 18:51:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:content-transfer-encoding; bh=oUmyYcrP5oVPeVbOjla26KEBj+tl9jew+zZm7rjhMys=; b=czcm5aWOlNLq1qvEX1ZKZ+/sSPOCfcu5qQCXZWiupHddJllz+gz3mKoaj/ctgsu5UR /7SI6Td+IDfcjqEQ9otqjLDkZ0RUk2rdAMLVysc7BplEtgGtuK6BAkyh4Q69JcO5YoRf FnLbmPsnZ2URQfwEcPPSNQM271vAUR/LxXajc= Received: by 10.216.8.204 with SMTP id 54mr890043wer.92.1310176289095; Fri, 08 Jul 2011 18:51:29 -0700 (PDT) MIME-Version: 1.0 Received: by 10.216.38.85 with HTTP; Fri, 8 Jul 2011 18:51:09 -0700 (PDT) In-Reply-To: <4E178AFD.7060604@bnl.gov> References: <4E178AFD.7060604@bnl.gov> From: Jonathan Ellis Date: Fri, 8 Jul 2011 20:51:09 -0500 Message-ID: Subject: Re: Performance deterioration while building secondary index To: user@cassandra.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org My guess: index build isn't respecting the background i/o throttle. On Fri, Jul 8, 2011 at 5:55 PM, Maxim Potekhin wrote: > I have roughly 150 million rows in my database, which will grow as I > continue testing. I'm building an index on a particular column, via > cassandra-cli, something of the sort: > update column family jobs with column_metadata =3D [{column_name : 'DATE'= , > =A0 validation_class : AsciiType, index_type : 0, index_name : 'date'}] > > At this point, the cluster just becomes unresponsive -- just doing "list"= on > a CF takes a while. Random query test I used to run rather quickly, becom= es > terribly slow (hasn't returned since I started typing this). > > Is that normal? I can' imagine this happening in a production situation, > when I decided to add an index for some valid reasons. Really scratching = my > head now. TIA. > > The version is 0.8.1 > > Thanks! > --=20 Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com