cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Ellis (JIRA)" <>
Subject [jira] Resolved: (CASSANDRA-299) make table directory creation lazy
Date Wed, 17 Mar 2010 23:54:27 GMT


Jonathan Ellis resolved CASSANDRA-299.

    Resolution: Won't Fix
      Assignee:     (was: Chris Goffinet)

This isn't going to be a priority until someone starts runing with way more keyspaces than
anyone is currently.  Closing for now.

> make table directory creation lazy
> ----------------------------------
>                 Key: CASSANDRA-299
>                 URL:
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Core
>            Reporter: Jonathan Ellis
>            Priority: Minor
>         Attachments: 0001-lazy-creation-of-Table-dirs.-only-open-tables-that-h.patch
> checking that each subdir for each table is present on startup -- _every_ startup --
could be a real pita.
> i think that to support 100k tables (not impossible, in a hosted-cassandra-as-a-service
scenario) we're going to want to make table dir creation lazy.
> then we would want to make scanning for sstables faster by only doing one listdir call
per datadir, to see which table subdirs are present, and then checking only those for sstable
files.  this would involve some re-org of the onstart code.
> (note that we don't want to prune directories if there are no sstables left in them,
since we'd end up re-creating them at some point anyway; we just want to allow the lack of
a table subdir to imply the same thing as an empty one.)

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message