cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Benedict (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CASSANDRA-6809) Compressed Commit Log
Date Thu, 06 Mar 2014 19:54:43 GMT
Benedict created CASSANDRA-6809:
-----------------------------------

             Summary: Compressed Commit Log
                 Key: CASSANDRA-6809
                 URL: https://issues.apache.org/jira/browse/CASSANDRA-6809
             Project: Cassandra
          Issue Type: Improvement
            Reporter: Benedict
            Assignee: Benedict
            Priority: Minor
             Fix For: 3.0


It seems an unnecessary oversight that we don't compress the commit log. Doing so should improve
throughput, but some care will need to be taken to ensure we use as much of a segment as possible.
I propose decoupling the writing of the records from the segments. Basically write into a
(queue of) DirectByteBuffer, and have the sync thread compress, say, ~64K chunks every X MB
written to the CL (where X is ordinarily CLS size), and then pack as many of the compressed
chunks into a CLS as possible.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message