Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7FB3C10927 for ; Mon, 17 Jun 2013 20:00:11 +0000 (UTC) Received: (qmail 53733 invoked by uid 500); 17 Jun 2013 20:00:09 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 53708 invoked by uid 500); 17 Jun 2013 20:00:09 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 53699 invoked by uid 99); 17 Jun 2013 20:00:09 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Jun 2013 20:00:09 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [98.138.120.220] (HELO nm41-vm4.bullet.mail.ne1.yahoo.com) (98.138.120.220) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Jun 2013 20:00:02 +0000 Received: from [98.138.90.48] by nm41.bullet.mail.ne1.yahoo.com with NNFMP; 17 Jun 2013 19:59:39 -0000 Received: from [98.138.89.163] by tm1.bullet.mail.ne1.yahoo.com with NNFMP; 17 Jun 2013 19:59:39 -0000 Received: from [127.0.0.1] by omp1019.mail.ne1.yahoo.com with NNFMP; 17 Jun 2013 19:59:39 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 862263.60691.bm@omp1019.mail.ne1.yahoo.com Received: (qmail 50220 invoked by uid 60001); 17 Jun 2013 19:59:39 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1371499179; bh=CVp2Q6MXoMm2iHZmT1XIjPGNoUUB+4sLP5qlmBtp6KM=; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=C/YxmkdLG2G+eMJGL+QSkeJ03IsklGtbXmVH9uTYHRPDGzHspe4G83MUzUszmujgUv/x41AFtpHzcRFBOG52AkrLD9c+57mHJZEnEZdSVhmIFgc1aEV53vnEJqAAX2HOVB72HbSedpAnypl+0TtFMaAQ6Nd185EIMjpQHTqtK7A= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=GleVaXOHK6Y74KsBnElaNLpuaHdMn3wuaAoVFtadYqXyMnmnHpKFxCwdN3nFoGIfNSrURIi+4JeQysD9SdioAF66KB17HQuRTcxYiWvNrDoPOVdi/k0wSL8fmOGb9EbBxWvrCQ+JXw0DvbMWjg13Nfy6vjNcC4tssUiTfNdHezs=; X-YMail-OSG: UALpLOQVM1m54eLlC9nODsY3RYWblbE0tqEMee49c9wP57k oHC66HpdVo3rpGVpm0vGuo8NyoYVQShydvT2y2gpzUbVyngR8zczkcmEwlSC m9XamCZeUeSTgm1eHA9u7d7eODrKjajtI625c7AMjBJKYRRjoXifrn534TAj DwnayHryOeDRnmrkFSrOYxuXUZvtGVfxsinaRgcvjnSQv0KNvM_qFEBlrV8Q bu.kaWuixH1A2oOy2pRhBd6WmDQmlF4vqloipXtzLotvHAhBXg101IbuSqhT 4Uv_Q1B4Hqrh7LZx9.UHeDs9eo1ZZnp_Fzhp5cXnyAKIkh6B9sY8Bvm6uGUm uuj7aiinj3yLryINKtuPuqhor.A6JJvOHqSAUDTCR5HldK.68mFGRx0Q8p4c gkFjbVskNOC7jPRkeEIBF66bTGnMzJOu84ZJn5BBmo79xeaXO9BR9F_6.7v1 MYcM6vbBKD6SFkJOQ3.wcUeiBiNmn5FGcE_38fCfrEp1SPs1JBsuWZjC8diP PrQvOx8L2_00olgx6VDLI363cbs2J1529meyJ.v7tQxAduPhIf.dNpZoM7JE BT7uWvM9.cB1JkuQ- Received: from [173.3.112.81] by web120406.mail.ne1.yahoo.com via HTTP; Mon, 17 Jun 2013 12:59:39 PDT X-Rocket-MIMEInfo: 002.001,CgoKCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fCiBGcm9tOiBSb2JlcnQgQ29saSA8cmNvbGlAZXZlbnRicml0ZS5jb20.ClRvOiB1c2VyQGNhc3NhbmRyYS5hcGFjaGUub3JnIApTZW50OiBNb25kYXksIEp1bmUgMTcsIDIwMTMgMzoyOCBQTQpTdWJqZWN0OiBSZTogaW5kZXhfaW50ZXJ2YWwKIAoKT24gTW9uLCBNYXkgMTMsIDIwMTMgYXQgOToxOSBQTSwgQnJ5YW4gVGFsYm90IDxidGFsYm90QGFlcmlhZ2FtZXMuY29tPiB3cm90ZToKPiBDYW4gdGhlIGluZGV4IHNhbXBsZSBzdG9yYWdlIGJlIHQBMAEBAQE- X-Mailer: YahooMailWebService/0.8.147.553 References: Message-ID: <1371499179.44547.YahooMailNeo@web120406.mail.ne1.yahoo.com> Date: Mon, 17 Jun 2013 12:59:39 -0700 (PDT) From: Thomas Bernhardt Reply-To: Thomas Bernhardt Subject: Re: index_interval To: "user@cassandra.apache.org" In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="1635569886-2042771328-1371499179=:44547" X-Virus-Checked: Checked by ClamAV on apache.org --1635569886-2042771328-1371499179=:44547 Content-Type: text/plain; charset=us-ascii ________________________________ From: Robert Coli To: user@cassandra.apache.org Sent: Monday, June 17, 2013 3:28 PM Subject: Re: index_interval On Mon, May 13, 2013 at 9:19 PM, Bryan Talbot wrote: > Can the index sample storage be treated more like key cache or row cache > where the total space used can be limited to something less than all > available system ram, and space is recycled using an LRU (or configurable) > algorithm? Treating it with LRU doesn't seem to make that much sense, but there's seemingly-trivial ways to prune an Index Sample [1] like delete-every-other-key. Brief conversation with driftx suggests a lack of enthusiasm for the scale of win potential from active pruning of the Index Sample, especially given the relative size of bloom filters compared to the Index Sample. However if you are interested in this as a potential improvement, feel free to file a JIRA! :D =Rob [1] New terminology "Partition Summary" per jbellis keynote @ summit2013 --1635569886-2042771328-1371499179=:44547 Content-Type: text/html; charset=us-ascii


From: Robert Coli <rcoli@eventbrite.com>
To: user@cassandra.apache.org
Sent: Monday, June 17, 2013 3:28 PM
Subject: Re: index_interval

On Mon, May 13, 2013 at 9:19 PM, Bryan Talbot <btalbot@aeriagames.com> wrote:
> Can the index sample storage be treated more like key cache or row cache
> where the total space used can be limited to something less than all
> available system ram, and space is recycled using an LRU (or configurable)
> algorithm?

Treating it with LRU doesn't seem to make that much sense, but there's
seemingly-trivial ways to prune an Index Sample [1] like
delete-every-other-key.

Brief conversation with driftx suggests a lack of enthusiasm for the
scale of win potential from active pruning of the Index Sample,
especially given the relative size of bloom filters compared to the
Index Sample.

However if you are interested in this as a potential improvement, feel
free to file a JIRA! :D

=Rob

[1] New terminology "Partition Summary" per jbellis keynote @ summit2013


--1635569886-2042771328-1371499179=:44547--