cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tim Huske (JIRA)" <j...@apache.org>
Subject [jira] Commented: (CASSANDRA-866) AssertionError SSTableSliceIterator.java:126
Date Wed, 07 Apr 2010 23:21:36 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854720#action_12854720
] 

Tim Huske commented on CASSANDRA-866:
-------------------------------------

I think we are seeing this error as well.

ERROR [ROW-READ-STAGE:17] 2010-04-07 21:04:36,861 CassandraDaemon.java (line 78) Fatal exception
in thread Thread[ROW-READ-STAGE:17,5,main]
java.lang.AssertionError: DecoratedKey(112702293498592974518440554745446764341, 4452215176)
!= DecoratedKey(112702294131127473014102114707935791646, 11667886399) in /data2/data/Twitter/Statuses-4327-Data.db
	at org.apache.cassandra.db.filter.SSTableSliceIterator$ColumnGroupReader.<init>(SSTableSliceIterator.java:127)
	at org.apache.cassandra.db.filter.SSTableSliceIterator.<init>(SSTableSliceIterator.java:59)
	at org.apache.cassandra.db.filter.SliceQueryFilter.getSSTableColumnIterator(SliceQueryFilter.java:63)
	at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:830)
	at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:750)
	at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:719)
	at org.apache.cassandra.db.Table.getRow(Table.java:381)
	at org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:59)
	at org.apache.cassandra.db.ReadVerbHandler.doVerb(ReadVerbHandler.java:80)
	at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:40)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
	at java.lang.Thread.run(Thread.java:619)

We're using the RandomPartitioner, and a replication factor of 3, the relevant SSTable is
146GB, and the index file is 18GB.  This assertion only occurs on the primary node, whereas
the data is returned correctly from the other 2 when asked directly.  We had been running
with 0.6beta2 and a DiskAccessMode of "auto" which set the mode to mmap.  We've since upgraded
to 0.6rc1, and changed the DAM to "standard", but the error still occurs.

>From cassandra-cli, connected to the primary node:
cassandra> get Twitter.Statuses['11667886399']           
...RpcTimeout seconds later...
Exception Internal error processing get_slice

Connected to an unrelated node:
cassandra> get Twitter.Statuses['11667886399']
...RpcTimeout seconds later...
Exception null

We have a number of these errors, and for each one, the token for the key read off disk is
numerically very close to that of the requested key:
DecoratedKey(79954008423729056632733094063639634941, 8307722089) != DecoratedKey(79954009259417349514057411741701713236,
6153489921)
DecoratedKey(80379343112914474054622124950679452815, 3768834481) != DecoratedKey(80379344845214890401447094271897994174,
11653098762)
DecoratedKey(80779546346447228478584703771606621740, 8569013773) != DecoratedKey(80779548447419746111153057677392388488,
11764962920)
DecoratedKey(82844158105946904890171938436663575930, 4464394167) != DecoratedKey(82844159691805202566257389052615565753,
6874217428)
DecoratedKey(84289221786768678402050522652258180028, 6057213014) != DecoratedKey(84289224459791176731103465787486907832,
9899742458)
DecoratedKey(86300142475818241616994325294057703135, 5832470418) != DecoratedKey(86300142677962509841823563793986169119,
11448189666)
DecoratedKey(92092914035356318872651100377285498797, 3473992372) != DecoratedKey(92092915436251199165174090571909314827,
8851204821)
DecoratedKey(94745421400532682848559427993237380460, 9893103006) != DecoratedKey(94745431874154322071681265706426033545,
10438638106)

> AssertionError SSTableSliceIterator.java:126
> --------------------------------------------
>
>                 Key: CASSANDRA-866
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-866
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 0.6
>            Reporter: B. Todd Burruss
>             Fix For: 0.6.1
>
>
> also seeing these, using cassandra-0.6.0-beta2/
> 2010-03-09 07:37:57,683 ERROR [ROW-READ-STAGE:77] [CassandraDaemon.java:78] Fatal exception
in thread Thread[ROW-READ-STAGE:77,5,main]
> java.lang.AssertionError
>         at org.apache.cassandra.db.filter.SSTableSliceIterator$ColumnGroupReader.<init>(SSTableSliceIterator.java:126)
>         at org.apache.cassandra.db.filter.SSTableSliceIterator.<init>(SSTableSliceIterator.java:59)
>         at org.apache.cassandra.db.filter.SliceQueryFilter.getSSTableColumnIterator(SliceQueryFilter.java:63)
>         at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:851)
>         at org.apache.cassandra.db.ColumnFamilyStore.cacheRow(ColumnFamilyStore.java:748)
>         at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:773)
>         at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:740)
>         at org.apache.cassandra.db.Table.getRow(Table.java:381)
>         at org.apache.cassandra.db.SliceByNamesReadCommand.getRow(SliceByNamesReadCommand.java:56)
>         at org.apache.cassandra.db.ReadVerbHandler.doVerb(ReadVerbHandler.java:80)
>         at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:40)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>         at java.lang.Thread.run(Thread.java:619)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message