Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 41725 invoked from network); 30 Nov 2010 18:13:51 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 30 Nov 2010 18:13:51 -0000 Received: (qmail 83339 invoked by uid 500); 30 Nov 2010 18:13:49 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 83298 invoked by uid 500); 30 Nov 2010 18:13:48 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 83289 invoked by uid 99); 30 Nov 2010 18:13:48 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 30 Nov 2010 18:13:48 +0000 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of edlinuxguru@gmail.com designates 209.85.161.44 as permitted sender) Received: from [209.85.161.44] (HELO mail-fx0-f44.google.com) (209.85.161.44) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 30 Nov 2010 18:13:43 +0000 Received: by fxm9 with SMTP id 9so4856873fxm.31 for ; Tue, 30 Nov 2010 10:13:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:content-type; bh=2yvUFOQgUMJ+Qftm3MyDb4XM3hg4lOerqgBsefJTqIY=; b=nRnrSlLY1zm1GPLIasd1sWnMo3BFHtbfAQzgIJDi8x9aJ/g8tAygsU9G9wv5JP2vaz c1fTl5xSXghkC9h2X3bBTr1FWdToR9k9GT5dOWEDyPFolnlLa0BIpsr0Kt2Gk0OrfQG+ wZPvvS15lHS+J78iAEU0bJTvxuHpRMWFGexwI= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=AdMOfYlTsSALQ6k1At5szoSvokcMs93hO9ScY6wjtuPb0I1MIp0N9zOdY9L9aaMANY ZVMyPPx8ZTFgaGBOBRq3cx1ANuOR/v734sjBMBKmNEqK7W6f54oME8CLANVhIkOVwh0s 2QuJxK2GYFobGvA8uODbXgN61UDb2C+89OvaE= MIME-Version: 1.0 Received: by 10.223.122.133 with SMTP id l5mr7203404far.52.1291140802639; Tue, 30 Nov 2010 10:13:22 -0800 (PST) Received: by 10.223.21.21 with HTTP; Tue, 30 Nov 2010 10:13:22 -0800 (PST) In-Reply-To: References: <4CEFE15D.8080505@33concept.com> Date: Tue, 30 Nov 2010 13:13:22 -0500 Message-ID: Subject: Re: get_count - cassandra 0.7.x predicate limit bug? From: Edward Capriolo To: user@cassandra.apache.org Content-Type: text/plain; charset=ISO-8859-1 On Tue, Nov 30, 2010 at 1:00 AM, Tyler Hobbs wrote: > What error are you getting? > > Remember, get_count() is still just about as much work for cassandra as > getting the whole row; the only advantage is it doesn't have to send the > whole row back to the client. > > If you're counting 3+ million columns frequently, it's time to take a look > at counters. > > - Tyler > > On Fri, Nov 26, 2010 at 10:33 AM, Marcin wrote: >> >> Hi guys, >> >> I have a key with 3million+ columns but when I am trying to run get_count >> on it its getting me error if setting limit more than 46000+ any ideas? >> >> In previous API there was no predicate at all so it was simply counting >> number of columns now its not so simple any more. >> >> Please let me know if that is a bug or I do something wrong. >> >> >> cheers, >> /Marcin > > +1 Tyler. The problem is you can increase the clients socket timeout as high as you like if socketTimeout < rpcTimeout you should see SocketTimeoutExceptions if socketTimeout >= rcpTimeout you start seeing Cassandra TimedOutExceptions. Raising the RPC Timeout is done on the server. In any case you may have to range_slice to get through a row this big and count. Also in my experience rows this large do not work well. They are particularly dangerous when combined with RowCache as bringing them into to memory and evicting them is both disk and memory intensive.