cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "mlowicki (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-10769) "received out of order wrt DecoratedKey" after scrub
Date Wed, 25 Nov 2015 09:18:10 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-10769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026472#comment-15026472
] 

mlowicki commented on CASSANDRA-10769:
--------------------------------------

Found this error on other node as well:
{code}
ERROR [ValidationExecutor:78] 2015-11-24 22:35:52,652 Validator.java:245 - Failed creating
a merkle tree for [repair #93837260-92fb-11e5-b036-75bb514ae072 on sync/entity2, (-6012485790753833422,-6009995015166063234]],
/10.210.3.221 (see log for details)
ERROR [ValidationExecutor:78] 2015-11-24 22:35:52,652 CassandraDaemon.java:227 - Exception
in thread Thread[ValidationExecutor:78,1,main]
java.lang.AssertionError: row DecoratedKey(-6012437544863914154, 00093237363237353730320000040000c3c700)
received out of order wrt DecoratedKey(-6009997709246787268, 00093237353833303430320000040000c3c700)
        at org.apache.cassandra.repair.Validator.add(Validator.java:127) ~[apache-cassandra-2.1.11.jar:2.1.11]
        at org.apache.cassandra.db.compaction.CompactionManager.doValidationCompaction(CompactionManager.java:1010)
~[apache-cassandra-2.1.11.jar:2.1.11]
        at org.apache.cassandra.db.compaction.CompactionManager.access$600(CompactionManager.java:94)
~[apache-cassandra-2.1.11.jar:2.1.11]
        at org.apache.cassandra.db.compaction.CompactionManager$9.call(CompactionManager.java:622)
~[apache-cassandra-2.1.11.jar:2.1.11]
        at java.util.concurrent.FutureTask.run(FutureTask.java:262) ~[na:1.7.0_80]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
~[na:1.7.0_80]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_80]
        at java.lang.Thread.run(Thread.java:745) [na:1.7.0_80]
{code}

> "received out of order wrt DecoratedKey" after scrub
> ----------------------------------------------------
>
>                 Key: CASSANDRA-10769
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-10769
>             Project: Cassandra
>          Issue Type: Bug
>         Environment: C* 2.1.11, Debian Wheezy
>            Reporter: mlowicki
>
> After running scrub and cleanup on all nodes in single data center I'm getting:
> {code}
> ERROR [ValidationExecutor:103] 2015-11-25 06:28:21,530 Validator.java:245 - Failed creating
a merkle tree for [repair #89fa2b70-933d-11e5-b036-75bb514ae072 on sync/entity_by_id2, (-5867793819051725444,-5865919628027816979]],
/10.210.3.221 (see log for details)
> ERROR [ValidationExecutor:103] 2015-11-25 06:28:21,531 CassandraDaemon.java:227 - Exception
in thread Thread[ValidationExecutor:103,1,main]
> java.lang.AssertionError: row DecoratedKey(-5867787467868737053, 00093237363331303631320000040000808800)
received out of order wrt DecoratedKey(-5865937851627253360, 00093331323031373733320000040000c3c700)
>         at org.apache.cassandra.repair.Validator.add(Validator.java:127) ~[apache-cassandra-2.1.11.jar:2.1.11]
>         at org.apache.cassandra.db.compaction.CompactionManager.doValidationCompaction(CompactionManager.java:1010)
~[apache-cassandra-2.1.11.jar:2.1.11]
>         at org.apache.cassandra.db.compaction.CompactionManager.access$600(CompactionManager.java:94)
~[apache-cassandra-2.1.11.jar:2.1.11]
>         at org.apache.cassandra.db.compaction.CompactionManager$9.call(CompactionManager.java:622)
~[apache-cassandra-2.1.11.jar:2.1.11]
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262) ~[na:1.7.0_80]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
~[na:1.7.0_80]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_80]
>         at java.lang.Thread.run(Thread.java:745) [na:1.7.0_80]
> {code}
> What I did is to run repair on other node:
> {code}
> time nodetool repair --in-local-dc
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message