incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From mcasandra <mohitanch...@gmail.com>
Subject Re: Error when bringing up 3rd node
Date Tue, 22 Feb 2011 02:04:01 GMT


mcasandra wrote:
> 
> I am still getting the following:
> 
> On node 1:
> ERROR 16:57:31,365 Fatal error: Bootstraping to existing token 0 is not
> allowed (decommission/removetoken the old node first).
> 
> On node 2:
> ERROR 16:57:42,300 Fatal error: Bootstraping to existing token
> 56713727820156410577229101238628035242 is not allowed
> (decommission/removetoken the old node first).
> Bad configuration; unable to start server
> 
> node 3: is up
> 
> node 1 has initial_token: 0 . I think earlier it wasn't set.
> 
> node 2 initial_token: 56713727820156410577229101238628035242. Earlier it
> had 0
> 
> node 3 initial_token: 113427455640312821154458202477256070484
> 
> What should I do now?
> 
> 
> 
> 

I am seeing very strange behaviour and makes me really uncomfortable.
Sometimes when I start the nodes I seee:

node 1:

ERROR 17:44:10,718 Error in ThreadPoolExecutor
java.lang.IllegalStateException: replication factor (2) exceeds number of
endpoints (1)
        at
org.apache.cassandra.locator.SimpleStrategy.calculateNaturalEndpoints(SimpleStrategy.java:60)
        at
org.apache.cassandra.locator.AbstractReplicationStrategy.getAddressRanges(AbstractReplicationStrategy.java:188)
        at
org.apache.cassandra.locator.AbstractReplicationStrategy.getAddressRanges(AbstractReplicationStrategy.java:215)
        at
org.apache.cassandra.service.StorageService.calculatePendingRanges(StorageService.java:792)
        at
org.apache.cassandra.service.StorageService.calculatePendingRanges(StorageService.java:773)
        at
org.apache.cassandra.service.StorageService.handleStateBootstrap(StorageService.java:587)
        at
org.apache.cassandra.service.StorageService.onChange(StorageService.java:548)
        at
org.apache.cassandra.gms.Gossiper.doNotifications(Gossiper.java:720)
        at
org.apache.cassandra.gms.Gossiper.applyApplicationStateLocally(Gossiper.java:685)
        at
org.apache.cassandra.gms.Gossiper.applyStateLocally(Gossiper.java:639)
        at
org.apache.cassandra.gms.GossipDigestAckVerbHandler.doVerb(GossipDigestAckVerbHandler.java:62)
        at
org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:63)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:662)
ERROR 17:44:10,720 Fatal exception in thread Thread[GossipStage:1,5,main]
java.lang.IllegalStateException: replication factor (2) exceeds number of
endpoints (1)
        at
org.apache.cassandra.locator.SimpleStrategy.calculateNaturalEndpoints(SimpleStrategy.java:60)
        at
org.apache.cassandra.locator.AbstractReplicationStrategy.getAddressRanges(AbstractReplicationStrategy.java:188)
        at
org.apache.cassandra.locator.AbstractReplicationStrategy.getAddressRanges(AbstractReplicationStrategy.java:215)
        at
org.apache.cassandra.service.StorageService.calculatePendingRanges(StorageService.java:792)
        at
org.apache.cassandra.service.StorageService.calculatePendingRanges(StorageService.java:773)
        at
org.apache.cassandra.service.StorageService.handleStateBootstrap(StorageService.java:587)
        at
org.apache.cassandra.service.StorageService.onChange(StorageService.java:548)
        at
org.apache.cassandra.gms.Gossiper.doNotifications(Gossiper.java:720)
        at
org.apache.cassandra.gms.Gossiper.applyApplicationStateLocally(Gossiper.java:685)
        at
org.apache.cassandra.gms.Gossiper.applyStateLocally(Gossiper.java:639)
        at
org.apache.cassandra.gms.GossipDigestAckVerbHandler.doVerb(GossipDigestAckVerbHandler.java:62)
        at
org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:63)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:662)

node 2: 


ERROR 17:43:57,429 Fatal exception in thread Thread[MiscStage:1,5,main]
java.lang.AssertionError
        at
org.apache.cassandra.locator.TokenMetadata.getToken(TokenMetadata.java:210)
        at
org.apache.cassandra.service.StorageService.getPrimaryRangeForEndpoint(StorageService.java:1289)
        at
org.apache.cassandra.service.StorageService.getLocalPrimaryRange(StorageService.java:160)
        at
org.apache.cassandra.service.StorageService.getBootstrapToken(StorageService.java:1443)
        at
org.apache.cassandra.dht.BootStrapper$BootstrapTokenVerbHandler.doVerb(BootStrapper.java:256)
        at
org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:63)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:662)
 INFO 17:44:10,505 Joining: getting bootstrap token

-- 
If I stop cassandra and start again the error messages disappear. But if I
start the nodes again I sometimes get this error again. In between all this
no data is changing.


I am unable to understand this behaviour and what I need to do if these
things happen in production.
-- 
View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Error-when-bringing-up-3rd-node-tp6041409p6050903.html
Sent from the cassandra-user@incubator.apache.org mailing list archive at Nabble.com.

Mime
View raw message