cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias Keller (JIRA)" <j...@apache.org>
Subject [jira] Created: (CASSANDRA-2214) Bootstrap Token collision after nodetool loadbalance
Date Tue, 22 Feb 2011 11:06:38 GMT
Bootstrap Token collision after nodetool loadbalance
----------------------------------------------------

                 Key: CASSANDRA-2214
                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2214
             Project: Cassandra
          Issue Type: Bug
    Affects Versions: 0.7.2
            Reporter: Matthias Keller


I had two nodes for testing. They both owned around 50% of all data, my test CF has RF=2
Then I added a third node (bootstrapped it):
{noformat}
Address         Status State   Load            Owns    Token
                                                       101483442157567999664061592210059906302
10.0.0.2        Up     Normal  320.42 KB       50.00%  16412850427333383798217940352117853438
10.0.0.3        Up     Normal  341.53 KB       26.25%  61078635599166706937511052402724559481
10.0.0.1        Up     Normal  321.3 KB        23.75%  101483442157567999664061592210059906302
{noformat}

Then I wanted to re-balance node 2 (10.0.0.2), so I issued the  loadbalance  command on it.
It took quite a while but after leaving the ring and coming back, it seems to have assigned
the same token as node 3 (10.0.0.3); I get this on node3:
{quote}
ERROR 11:47:09,719 Fatal exception in thread Thread[HintedHandoff:1,1,main]
java.lang.RuntimeException: java.lang.NullPointerException
        at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.*NullPointerException*
        at org.apache.cassandra.db.HintedHandOffManager.waitForSchemaAgreement(HintedHandOffManager.java:250)
        at org.apache.cassandra.db.HintedHandOffManager.deliverHintsToEndpoint(HintedHandOffManager.java:267)
        at org.apache.cassandra.db.HintedHandOffManager.access$100(HintedHandOffManager.java:88)
        at org.apache.cassandra.db.HintedHandOffManager$2.runMayThrow(HintedHandOffManager.java:391)
        at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
        ... 3 more
{quote}

And a second later, this on node 1 (10.0.0.1):
{quote}
ERROR 11:47:10,719 Fatal exception in thread Thread[GossipStage:2,5,main]
java.lang.RuntimeException: Bootstrap Token collision between /10.0.0.3 and /10.0.0.2 (token
61078635599166706937511052402724559481
        at org.apache.cassandra.locator.TokenMetadata.addBootstrapToken(TokenMetadata.java:143)
        at org.apache.cassandra.service.StorageService.handleStateBootstrap(StorageService.java:696)
        at org.apache.cassandra.service.StorageService.onChange(StorageService.java:638)
        at org.apache.cassandra.service.StorageService.onJoin(StorageService.java:1114)
        at org.apache.cassandra.gms.Gossiper.handleMajorStateChange(Gossiper.java:639)
        at org.apache.cassandra.gms.Gossiper.handleNewJoin(Gossiper.java:614)
        at org.apache.cassandra.gms.Gossiper.applyStateLocally(Gossiper.java:686)
        at org.apache.cassandra.gms.GossipDigestAck2VerbHandler.doVerb(GossipDigestAck2VerbHandler.java:60)
        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:72)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:662)
{quote}

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message