cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Goffinet (JIRA)" <j...@apache.org>
Subject [jira] Commented: (CASSANDRA-436) OOM during major compaction on many (hundreds) of sstables
Date Wed, 16 Sep 2009 17:13:58 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12756111#action_12756111
] 

Chris Goffinet commented on CASSANDRA-436:
------------------------------------------

Tested on our cluster. Much better improvement! Before we were seeing 2-7GB of heap usage
now its under 700MB.

+1

> OOM during major compaction on many (hundreds) of sstables
> ----------------------------------------------------------
>
>                 Key: CASSANDRA-436
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-436
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>             Fix For: 0.5
>
>         Attachments: 0001-CASSANDRA-436-minor-fixes.txt, 0001-CASSANDRA-436-minor-fixes.txt,
0002-copy-FileStruct-to-SSTableScanner-and-remove-cruft.-M.txt, 0002-copy-FileStruct-to-SSTableScanner-and-remove-cruft.-M.txt,
0003-allow-ReducingIterator-to-reduce-from-one-type-to-a-di.txt, 0003-allow-ReducingIterator-to-reduce-from-one-type-to-a-di.txt,
0004-Replace-PriorityQueue-mess-with-a-CompactionIterator-t.txt, 0004-Replace-PriorityQueue-mess-with-a-CompactionIterator-t.txt
>
>
> compaction deserializes rows during compaction before they are needed, one per sstable.
 if we only deserialized on-demand the current algorithm would be fine on nearly arbitrarily
large numbers of sstables.  (this is only important b/c it is useful to disable compactions
during bulk load.)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message