cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Benedict (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-8851) Uncaught exception on thread Thread[SharedPool-Worker-16,5,main] after upgrade to 2.1.3
Date Wed, 18 Mar 2015 23:00:39 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14368086#comment-14368086
] 

Benedict commented on CASSANDRA-8851:
-------------------------------------

OK, so the problem does indeed seem to be down to sampling in some way. But not in the way
I expected. It seems that the effective index interval calculation is broken, and firstKeyBeyond
ignores this so works fine. [~thobbs]: couldn't we drop the effective index interval entirely?
We should scan forwards until we hit a record that sorts above us, no? I assume it's there
to cope with equality checks which do not compose the token, but perhaps we should simply
use the minimum effective interval, and after this switch to the slower inequality match path,
since it would not run the risk of this calculation being mistaken (or for now we could just
use the calculation as this mark, without removing it, so that it is only a more accurate
guide)?


> Uncaught exception on thread Thread[SharedPool-Worker-16,5,main] after upgrade to 2.1.3
> ---------------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-8851
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-8851
>             Project: Cassandra
>          Issue Type: Bug
>         Environment: ubuntu 
>            Reporter: Tobias Schlottke
>            Assignee: Benedict
>            Priority: Critical
>             Fix For: 2.1.4
>
>         Attachments: schema.txt, system.log.gz
>
>
> Hi there,
> after upgrading to 2.1.3 we've got the following error every few seconds:
> {code}
> WARN  [SharedPool-Worker-16] 2015-02-23 10:20:36,392 AbstractTracingAwareExecutorService.java:169
- Uncaught exception on thread Thread[SharedPool-Worker-16,5,main]: {}
> java.lang.AssertionError: null
> 	at org.apache.cassandra.io.util.Memory.size(Memory.java:307) ~[apache-cassandra-2.1.3.jar:2.1.3]
> 	at org.apache.cassandra.utils.obs.OffHeapBitSet.capacity(OffHeapBitSet.java:61) ~[apache-cassandra-2.1.3.jar:2.1.3]
> 	at org.apache.cassandra.utils.BloomFilter.indexes(BloomFilter.java:74) ~[apache-cassandra-2.1.3.jar:2.1.3]
> 	at org.apache.cassandra.utils.BloomFilter.isPresent(BloomFilter.java:98) ~[apache-cassandra-2.1.3.jar:2.1.3]
> 	at org.apache.cassandra.io.sstable.SSTableReader.getPosition(SSTableReader.java:1366)
~[apache-cassandra-2.1.3.jar:2.1.3]
> 	at org.apache.cassandra.io.sstable.SSTableReader.getPosition(SSTableReader.java:1350)
~[apache-cassandra-2.1.3.jar:2.1.3]
> 	at org.apache.cassandra.db.columniterator.SSTableSliceIterator.<init>(SSTableSliceIterator.java:41)
~[apache-cassandra-2.1.3.jar:2.1.3]
> 	at org.apache.cassandra.db.filter.SliceQueryFilter.getSSTableColumnIterator(SliceQueryFilter.java:185)
~[apache-cassandra-2.1.3.jar:2.1.3]
> 	at org.apache.cassandra.db.filter.QueryFilter.getSSTableColumnIterator(QueryFilter.java:62)
~[apache-cassandra-2.1.3.jar:2.1.3]
> 	at org.apache.cassandra.db.CollationController.collectAllData(CollationController.java:273)
~[apache-cassandra-2.1.3.jar:2.1.3]
> 	at org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationController.java:62)
~[apache-cassandra-2.1.3.jar:2.1.3]
> 	at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1915)
~[apache-cassandra-2.1.3.jar:2.1.3]
> 	at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1748)
~[apache-cassandra-2.1.3.jar:2.1.3]
> 	at org.apache.cassandra.db.Keyspace.getRow(Keyspace.java:342) ~[apache-cassandra-2.1.3.jar:2.1.3]
> 	at org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:57)
~[apache-cassandra-2.1.3.jar:2.1.3]
> 	at org.apache.cassandra.db.ReadVerbHandler.doVerb(ReadVerbHandler.java:47) ~[apache-cassandra-2.1.3.jar:2.1.3]
> 	at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:62) ~[apache-cassandra-2.1.3.jar:2.1.3]
> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) ~[na:1.7.0_45]
> 	at org.apache.cassandra.concurrent.AbstractTracingAwareExecutorService$FutureTask.run(AbstractTracingAwareExecutorService.java:164)
~[apache-cassandra-2.1.3.jar:2.1.3]
> 	at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105) [apache-cassandra-2.1.3.jar:2.1.3]
> 	at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
> {code}
> This seems to crash the compactions and pushes up server load and piles up compactions.
> Any idea / possible workaround?
> Best,
> Tobias



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message