Return-Path: X-Original-To: apmail-cassandra-commits-archive@www.apache.org Delivered-To: apmail-cassandra-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C410F96F3 for ; Tue, 24 Jan 2012 22:05:03 +0000 (UTC) Received: (qmail 28525 invoked by uid 500); 24 Jan 2012 22:05:03 -0000 Delivered-To: apmail-cassandra-commits-archive@cassandra.apache.org Received: (qmail 28155 invoked by uid 500); 24 Jan 2012 22:05:02 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 28119 invoked by uid 99); 24 Jan 2012 22:05:01 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 24 Jan 2012 22:05:01 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 24 Jan 2012 22:05:00 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id B663F160B31 for ; Tue, 24 Jan 2012 22:04:40 +0000 (UTC) Date: Tue, 24 Jan 2012 22:04:40 +0000 (UTC) From: "Pavel Yaskevich (Commented) (JIRA)" To: commits@cassandra.apache.org Message-ID: <617136223.74296.1327442680760.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1972757074.61307.1327090359799.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (CASSANDRA-3762) AutoSaving KeyCache and System load time improvements. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CASSANDRA-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13192595#comment-13192595 ] Pavel Yaskevich commented on CASSANDRA-3762: -------------------------------------------- With this patch we trade whole sequential primary_index read for random I/O with SSTableReader.getPosition() only for amount saved keys. Can you extend key cache, let's make it 75% of the keys, and run your test again? I think the closer key cache size will get to actual number of keys the worse will performance get... > AutoSaving KeyCache and System load time improvements. > ------------------------------------------------------ > > Key: CASSANDRA-3762 > URL: https://issues.apache.org/jira/browse/CASSANDRA-3762 > Project: Cassandra > Issue Type: Improvement > Components: Core > Affects Versions: 1.2 > Reporter: Vijay > Assignee: Vijay > Priority: Minor > Fix For: 1.2 > > Attachments: 0001-SavedKeyCache-load-time-improvements.patch > > > CASSANDRA-2392 saves the index summary to the disk... but when we have saved cache we will still scan through the index to get the data out. > We might be able to separate this from SSTR.load and let it load the index summary, once all the SST's are loaded we might be able to check the bloomfilter and do a random IO on fewer Index's to populate the KeyCache. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira