Return-Path: Delivered-To: apmail-cassandra-commits-archive@www.apache.org Received: (qmail 55554 invoked from network); 17 Mar 2010 23:54:50 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 17 Mar 2010 23:54:50 -0000 Received: (qmail 2653 invoked by uid 500); 17 Mar 2010 23:54:50 -0000 Delivered-To: apmail-cassandra-commits-archive@cassandra.apache.org Received: (qmail 2621 invoked by uid 500); 17 Mar 2010 23:54:50 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 2613 invoked by uid 500); 17 Mar 2010 23:54:50 -0000 Delivered-To: apmail-incubator-cassandra-commits@incubator.apache.org Received: (qmail 2610 invoked by uid 99); 17 Mar 2010 23:54:50 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 Mar 2010 23:54:50 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 Mar 2010 23:54:48 +0000 Received: from brutus.apache.org (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 25B8F234C1F2 for ; Wed, 17 Mar 2010 23:54:27 +0000 (UTC) Message-ID: <926600377.329971268870067139.JavaMail.jira@brutus.apache.org> Date: Wed, 17 Mar 2010 23:54:27 +0000 (UTC) From: "Jonathan Ellis (JIRA)" To: cassandra-commits@incubator.apache.org Subject: [jira] Resolved: (CASSANDRA-299) make table directory creation lazy In-Reply-To: <1096733637.1247772494800.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/CASSANDRA-299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis resolved CASSANDRA-299. -------------------------------------- Resolution: Won't Fix Assignee: (was: Chris Goffinet) This isn't going to be a priority until someone starts runing with way more keyspaces than anyone is currently. Closing for now. > make table directory creation lazy > ---------------------------------- > > Key: CASSANDRA-299 > URL: https://issues.apache.org/jira/browse/CASSANDRA-299 > Project: Cassandra > Issue Type: Improvement > Components: Core > Reporter: Jonathan Ellis > Priority: Minor > Attachments: 0001-lazy-creation-of-Table-dirs.-only-open-tables-that-h.patch > > > checking that each subdir for each table is present on startup -- _every_ startup -- could be a real pita. > i think that to support 100k tables (not impossible, in a hosted-cassandra-as-a-service scenario) we're going to want to make table dir creation lazy. > then we would want to make scanning for sstables faster by only doing one listdir call per datadir, to see which table subdirs are present, and then checking only those for sstable files. this would involve some re-org of the onstart code. > (note that we don't want to prune directories if there are no sstables left in them, since we'd end up re-creating them at some point anyway; we just want to allow the lack of a table subdir to imply the same thing as an empty one.) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.