cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stu Hood (JIRA)" <j...@apache.org>
Subject [jira] Issue Comment Edited: (CASSANDRA-674) New SSTable Format
Date Tue, 01 Feb 2011 09:19:29 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12989108#comment-12989108
] 

Stu Hood edited comment on CASSANDRA-674 at 2/1/11 9:17 AM:
------------------------------------------------------------

Attaching a snapshot of the work on this new design for the file format. There are a few important
blockers not implemented, as evidenced by failing tests, but I feel confident that serialization
and format themselves are solid.

Please carefully note the caveats listed under {{v2}} on the design doc: http://wiki.apache.org/cassandra/FileFormatDesignDoc#v2
In particular, we will barely see the benefits of compression with this implementation, because
only Spans are storing at most 1 row. Storing more than one row in a span will require an
index change, and I'd feel much better doing it once this is in trunk.

EDIT: Also, this necessarily applies atop CASSANDRA-2062.

      was (Author: stuhood):
    Attaching a snapshot of the work on this new design for the file format. There are a few
important blockers not implemented, as evidenced by failing tests, but I feel confident that
serialization and format themselves are solid.

Please carefully note the caveats listed under {{v2}} on the design doc: http://wiki.apache.org/cassandra/FileFormatDesignDoc#v2
In particular, we will barely see the benefits of compression with this implementation, because
only Spans are storing at most 1 row. Storing more than one row in a span will require an
index change, and I'd feel much better doing it once this is in trunk.
  
> New SSTable Format
> ------------------
>
>                 Key: CASSANDRA-674
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-674
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Core
>            Reporter: Stu Hood
>             Fix For: 0.8
>
>         Attachments: 674-v1.diff, 674-v2.tgz, perf-674-v1.txt, perf-trunk-2f3d2c0e4845faf62e33c191d152cb1b3fa62806.txt
>
>
> Various tickets exist due to limitations in the SSTable file format, including #16, #47
and #328. Attached is a proposed design/implementation of a new file format for SSTables that
addresses a few of these limitations.
> This v2 implementation is not ready for serious use: see comments for remaining issues.
It is roughly the format described here: http://wiki.apache.org/cassandra/FileFormatDesignDoc


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message