cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "T Jake Luciani (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-4860) Estimated Row Cache Entry size incorrect (always 24?)
Date Tue, 07 May 2013 15:03:16 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-4860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13650936#comment-13650936
] 

T Jake Luciani commented on CASSANDRA-4860:
-------------------------------------------

I just rolled this patch and am hitting this exception:

{code}
) liveRatio is 7.8818923401518655 (just-counted was 7.8818923401518655).  calculation took
825ms for 78373 columns
ERROR [ReadStage:14] 2013-05-07 11:01:44,555 CassandraDaemon.java (line 175) Exception in
thread Thread[ReadStage:14,5,main]
java.lang.AssertionError: Serialized size cannot be more than 2GB/Integer.MAX_VALUE
	at org.apache.cassandra.cache.ConcurrentLinkedHashCache$1.weightOf(ConcurrentLinkedHashCache.java:58)
	at org.apache.cassandra.cache.ConcurrentLinkedHashCache$1.weightOf(ConcurrentLinkedHashCache.java:54)
	at com.googlecode.concurrentlinkedhashmap.ConcurrentLinkedHashMap$BoundedEntryWeigher.weightOf(ConcurrentLinkedHashMap.java:1447)
	at com.googlecode.concurrentlinkedhashmap.ConcurrentLinkedHashMap.put(ConcurrentLinkedHashMap.java:764)
	at com.googlecode.concurrentlinkedhashmap.ConcurrentLinkedHashMap.put(ConcurrentLinkedHashMap.java:743)
	at org.apache.cassandra.cache.ConcurrentLinkedHashCache.put(ConcurrentLinkedHashCache.java:101)
	at org.apache.cassandra.cache.ConcurrentLinkedHashCache.put(ConcurrentLinkedHashCache.java:27)
	at org.apache.cassandra.cache.InstrumentingCache.put(InstrumentingCache.java:44)
	at org.apache.cassandra.io.sstable.SSTableReader.cacheKey(SSTableReader.java:696)
	at org.apache.cassandra.io.sstable.SSTableReader.getPosition(SSTableReader.java:834)
	at org.apache.cassandra.io.sstable.SSTableReader.getPosition(SSTableReader.java:717)
	at org.apache.cassandra.db.columniterator.SSTableSliceIterator.<init>(SSTableSliceIterator.java:43)
	at org.apache.cassandra.db.filter.SliceQueryFilter.getSSTableColumnIterator(SliceQueryFilter.java:101)
	at org.apache.cassandra.db.filter.QueryFilter.getSSTableColumnIterator(QueryFilter.java:68)
	at org.apache.cassandra.db.CollationController.collectAllData(CollationController.java:274)
	at org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationController.java:65)
	at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1357)
	at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1214)
	at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1126)
	at org.apache.cassandra.db.Table.getRow(Table.java:347)
	at org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:70)
	at org.apache.cassandra.db.ReadVerbHandler.doVerb(ReadVerbHandler.java:44)
	at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:56)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
	at java.lang.Thread.run(Thread.java:662)
{code}
                
> Estimated Row Cache Entry size incorrect (always 24?)
> -----------------------------------------------------
>
>                 Key: CASSANDRA-4860
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4860
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 1.1.0, 1.2.3, 2.0
>            Reporter: Chris Burroughs
>            Assignee: Vijay
>             Fix For: 1.2.0 beta 3
>
>         Attachments: 0001-4860-v2.patch, 0001-4860-v3.patch, 0001-CASSANDRA-4860-for-11.patch,
0001-CASSANDRA-4860.patch, 4860-perf-test.zip, trunk-4860-revert.patch
>
>
> After running for several hours the RowCacheSize was suspicious low (ie 70 something
MB)  I used  CASSANDRA-4859 to measure the size and number of entries on a node:
> In [3]: 1560504./65021
> Out[3]: 24.0
> In [4]: 2149464./89561
> Out[4]: 24.0
> In [6]: 7216096./300785
> Out[6]: 23.990877204647838
> That's RowCacheSize/RowCacheNumEntires  .  Just to prove I don't have crazy small rows
the mean size of the row *keys* in the saved cache is 67 and Compacted row mean size: 355.
 No jamm errors in the log
> Config notes:
> row_cache_provider: ConcurrentLinkedHashCacheProvider
> row_cache_size_in_mb: 2048
> Version info:
>  * C*: 1.1.6
>  * centos 2.6.32-220.13.1.el6.x86_64
>  * java 6u31 Java HotSpot(TM) 64-Bit Server VM (build 20.6-b01, mixed mode)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message