Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E1082469F for ; Wed, 11 May 2011 02:24:45 +0000 (UTC) Received: (qmail 47936 invoked by uid 500); 11 May 2011 02:24:43 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 47904 invoked by uid 500); 11 May 2011 02:24:43 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 47894 invoked by uid 99); 11 May 2011 02:24:43 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 May 2011 02:24:43 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [208.113.200.5] (HELO homiemail-a40.g.dreamhost.com) (208.113.200.5) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 May 2011 02:24:35 +0000 Received: from homiemail-a40.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a40.g.dreamhost.com (Postfix) with ESMTP id 4931374C064 for ; Tue, 10 May 2011 19:24:09 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; c=nofws; d=thelastpickle.com; h=content-type :mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; q=dns; s= thelastpickle.com; b=GL4BBPX5629J19DObvSZFZ4cBsScOpLvRdaffP38LUC yzL5UxNnLpkkruwbmZatH0DtlDbx7YCwKiGtuMzFlOSpebE3hLR+dOWqjHUxBUJm CzWCAKi1t78yF3M4lPM8bIoeJ5rk/vb+xT5x2mwykXolEqBBJ0aliYxJpnXauBEk = DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=thelastpickle.com; h= content-type:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; s= thelastpickle.com; bh=ja6jtTf5iG25NcWU4zVBokdgtf8=; b=Vl8qE7pJMi scamcmhx/MNrEEMo4C8uvmvISTvlA+O3Fh5+IYBeWFWuDshFv9tuabEj5aRJ9A9i ETXy1MEB42LfqFrmu08rgIp1yzJBLOLV3csuQ1deyV9p7RfUY6q/HDMFD24uPeNY ONLuoR7OTqKVu4aLpmttoJaTbrt9VVAPg= Received: from [10.0.1.151] (121-73-157-230.cable.telstraclear.net [121.73.157.230]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: aaron@thelastpickle.com) by homiemail-a40.g.dreamhost.com (Postfix) with ESMTPSA id E766674C058 for ; Tue, 10 May 2011 19:24:08 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Apple Message framework v1084) Subject: Re: Index interval tuning From: aaron morton In-Reply-To: <4DC9BE51.7080201@gmail.com> Date: Wed, 11 May 2011 14:24:05 +1200 Content-Transfer-Encoding: quoted-printable Message-Id: <5DE8EA16-B081-4949-BBE1-2C6AEE720003@thelastpickle.com> References: <1304956189.2567.5.camel@mierdi-laptop> <1304958030.2567.11.camel@mierdi-laptop> <4DC9BE51.7080201@gmail.com> To: user@cassandra.apache.org X-Mailer: Apple Mail (2.1084) X-Virus-Checked: Checked by ClamAV on apache.org What version and what were the values for = RecentBloomFilterFalsePositives and BloomFilterFalsePositives ? The bloom filter metrics are updated in SSTableReader.getPosition() the = only slightly odd thing I can see is that we do not count a key cache = hit a a true positive for the bloom filter. If there were a lot of key = cache hits and a few false positives the ratio would be wrong. I'll ask = around, does not seem to apply to Hectors case though.=20 Cheers ----------------- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 11 May 2011, at 10:38, Chris Burroughs wrote: > On 05/10/2011 02:12 PM, Peter Schuller wrote: >>> That reminds me, my false positive ration is stuck at 1.0, so I = guess >>> bloom filters aren't doing a lot for me. >>=20 >> That sounds unlikely unless you're hitting some edge case like = reading >> a particular row that happened to be a collision, and only that row. >> This is from JMX stats on the column family store? >>=20 >=20 > (=46rom jmx) I also see BloomFilterFalseRatio stuck at 1.0 on my > production nodes. The only values that RecentBloomFilterFalseRatio = had > over the past several minutes were 0.0 and 1.0. While I can't prove > that isn't accurate, it is very suspicions. >=20 > The code looked reasonable until I got to SSTableReader, which was too > complicated to just glance through.