cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Philip Thompson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-7019) Improve tombstone compactions
Date Tue, 26 Apr 2016 14:00:19 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-7019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15258124#comment-15258124
] 

Philip Thompson commented on CASSANDRA-7019:
--------------------------------------------

Failure from another run: These are all on c3.4xlarge nodes, which have 30GB of RAM, which
should be sufficient for the type of stress runs we're doing, no?

{code}
ERROR [CompactionExecutor:6] 2016-04-26 02:23:42,296 CassandraDaemon.java:195 - Exception
in thread Thread[CompactionExecutor:6,1,main]
java.lang.RuntimeException: Out of native memory occured, You can avoid it by increasing the
system ram space or by increasing bloom_filter_fp_chance.
	at org.apache.cassandra.utils.obs.OffHeapBitSet.<init>(OffHeapBitSet.java:49) ~[main/:na]
	at org.apache.cassandra.utils.FilterFactory.createFilter(FilterFactory.java:85) ~[main/:na]
	at org.apache.cassandra.utils.FilterFactory.getFilter(FilterFactory.java:78) ~[main/:na]
	at org.apache.cassandra.io.sstable.format.big.BigTableWriter$IndexWriter.<init>(BigTableWriter.java:382)
~[main/:na]
	at org.apache.cassandra.io.sstable.format.big.BigTableWriter.<init>(BigTableWriter.java:87)
~[main/:na]
	at org.apache.cassandra.io.sstable.format.big.BigFormat$WriterFactory.open(BigFormat.java:92)
~[main/:na]
	at org.apache.cassandra.io.sstable.format.SSTableWriter.create(SSTableWriter.java:101) ~[main/:na]
	at org.apache.cassandra.db.compaction.writers.MaxSSTableSizeWriter.switchCompactionLocation(MaxSSTableSizeWriter.java:96)
~[main/:na]
	at org.apache.cassandra.db.compaction.writers.MaxSSTableSizeWriter.realAppend(MaxSSTableSizeWriter.java:86)
~[main/:na]
	at org.apache.cassandra.db.compaction.writers.CompactionAwareWriter.append(CompactionAwareWriter.java:140)
~[main/:na]
	at org.apache.cassandra.db.compaction.CompactionTask.runMayThrow(CompactionTask.java:186)
~[main/:na]
	at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) ~[main/:na]
	at org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:82)
~[main/:na]
	at org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:60)
~[main/:na]
	at org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionCandidate.run(CompactionManager.java:265)
~[main/:na]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_40]
	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_40]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[na:1.8.0_40]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_40]
	at java.lang.Thread.run(Thread.java:745) [na:1.8.0_40]
{code}
{code}
ERROR [Reference-Reaper:1] 2016-04-26 02:23:42,835 Ref.java:203 - LEAK DETECTED: a reference
(org.apache.cassandra.utils.concurrent.Ref$State@5c307504) to class org.apache.cassandra.io.util.SafeMemory$MemoryTidy@1391956210:Memory@[7fa81dcab3e0..7fa81e639a60)
was not released before the reference was garbage collected
ERROR [Reference-Reaper:1] 2016-04-26 02:23:42,836 Ref.java:203 - LEAK DETECTED: a reference
(org.apache.cassandra.utils.concurrent.Ref$State@56c81e74) to class org.apache.cassandra.io.util.SafeMemory$MemoryTidy@332045001:Memory@[7f92e23ce010..7f92e835e110)
was not released before the reference was garbage collected
{code}
Attached as 7019-2-system.log

> Improve tombstone compactions
> -----------------------------
>
>                 Key: CASSANDRA-7019
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-7019
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Compaction
>            Reporter: Marcus Eriksson
>            Assignee: Branimir Lambov
>              Labels: compaction
>             Fix For: 3.x
>
>         Attachments: 7019-2-system.log, 7019-debug.log
>
>
> When there are no other compactions to do, we trigger a single-sstable compaction if
there is more than X% droppable tombstones in the sstable.
> In this ticket we should try to include overlapping sstables in those compactions to
be able to actually drop the tombstones. Might only be doable with LCS (with STCS we would
probably end up including all sstables)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message