cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] Updated: (CASSANDRA-270) Reduce copies in data write path
Date Tue, 30 Jun 2009 21:08:47 GMT

     [ https://issues.apache.org/jira/browse/CASSANDRA-270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Todd Lipcon updated CASSANDRA-270:
----------------------------------

    Attachment: patches.tar

Patches uploaded in a tar:
commit 22867357d6073197781a6cdc47dead27447e6880
Author: Todd Lipcon <todd@amiestreet.com>
Date:   Fri Aug 1 15:35:13 2008 -0400

    Make RequestCountSampler flush using ChainedBufferOutput
    
    Memory usage no longer has 512MB spikes on flush!
    
    Test plan: made sure flushes still happen and that it's still 256MB.

commit cd3bf215571720049db69b02775820159ef026fa
Author: Todd Lipcon <todd@amiestreet.com>
Date:   Fri Aug 1 15:16:35 2008 -0400

    Add ChainedBufferOutput - this is a DataOutput that avoids copying when a block of bytes
is written

commit 7c9df9620389d5d68cf20d7e13a9b5956d5b4710
Author: Todd Lipcon <todd@amiestreet.com>
Date:   Fri Aug 1 14:55:27 2008 -0400

    Make ICompactSerializer take a DataOutput instead of DataOutputStream as its second parameter.
    
    This caused issues for the GMS messages which need to have access to DataOutputStream.size().
    I couldn't figure out a good way around this, so I chose a bad one -- there's a new
    ICompactStreamSerializer which takes the old style DataOutputStream.
    
    The purpose for this commit is so that we can write from serializers directly into SequenceFiles
    with no intermediate copy

commit 1c9d5b129ed768d10fc57ac4fbed135f70684be2
Author: Todd Lipcon <todd@amiestreet.com>
Date:   Fri Aug 1 13:33:20 2008 -0400

    Refactor writing of DataOutputBuffers into DataOutputs into an IWritable interface
    
    This is working towards getting rid of the remaining copy when flushing cardinality

commit 198b1037324d8e4d32604dbeaa0613308efc6734
Author: Todd Lipcon <todd@amiestreet.com>
Date:   Fri Aug 1 13:04:43 2008 -0400

    Only make shallow copies when performing cardinality flushes
    
    This should reduce cut half of height of the 512M memory spikes every 5 minutes


> Reduce copies in data write path
> --------------------------------
>
>                 Key: CASSANDRA-270
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-270
>             Project: Cassandra
>          Issue Type: Improvement
>            Reporter: Todd Lipcon
>         Attachments: patches.tar
>
>
> This is a series of patches against a very old version of Cassandra - they certainly
won't apply, but Jonathan asked me to upload the patches here to do the ASF grant.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message