cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vladimir Kuptsov (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (CASSANDRA-6565) New node refuses to join the ring.
Date Wed, 14 Jan 2015 15:09:35 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14277020#comment-14277020
] 

Vladimir Kuptsov edited comment on CASSANDRA-6565 at 1/14/15 3:08 PM:
----------------------------------------------------------------------

I have the same issue on 2.0.11 for 2-DC's cluster with 5 nodes in each.

It happens during the empty 5th node join

 WARN [StreamReceiveTask:2] 2015-01-14 18:58:54,725 StreamResultFuture.java (line 215) [Stream
#4d5f7450-9bfd-11e4-8a10-bd59ad623a02] Stream failed
ERROR [main] 2015-01-14 18:58:54,726 CassandraDaemon.java (line 513) Exception encountered
during startup
java.lang.RuntimeException: Error during boostrap: Stream failed
        at org.apache.cassandra.dht.BootStrapper.bootstrap(BootStrapper.java:86)
        at org.apache.cassandra.service.StorageService.bootstrap(StorageService.java:998)
        at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:801)
        at org.apache.cassandra.service.StorageService.initServer(StorageService.java:614)
        at org.apache.cassandra.service.StorageService.initServer(StorageService.java:503)
        at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:378)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:496)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:585)
Caused by: org.apache.cassandra.streaming.StreamException: Stream failed
        at org.apache.cassandra.streaming.management.StreamEventJMXNotifier.onFailure(StreamEventJMXNotifier.java:85)
        at com.google.common.util.concurrent.Futures$4.run(Futures.java:1160)
        at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297)
        at com.google.common.util.concurrent.ExecutionList.executeListener(ExecutionList.java:156)
        at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:145)
        at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:202)
        at org.apache.cassandra.streaming.StreamResultFuture.maybeComplete(StreamResultFuture.java:216)
        at org.apache.cassandra.streaming.StreamResultFuture.handleSessionComplete(StreamResultFuture.java:191)
        at org.apache.cassandra.streaming.StreamSession.closeSession(StreamSession.java:377)
        at org.apache.cassandra.streaming.StreamSession.maybeCompleted(StreamSession.java:662)
        at org.apache.cassandra.streaming.StreamSession.taskCompleted(StreamSession.java:613)
        at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:137)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)



was (Author: vkuptcov):
I have the same issue on 2.0.11
 WARN [StreamReceiveTask:2] 2015-01-14 18:58:54,725 StreamResultFuture.java (line 215) [Stream
#4d5f7450-9bfd-11e4-8a10-bd59ad623a02] Stream failed
ERROR [main] 2015-01-14 18:58:54,726 CassandraDaemon.java (line 513) Exception encountered
during startup
java.lang.RuntimeException: Error during boostrap: Stream failed
        at org.apache.cassandra.dht.BootStrapper.bootstrap(BootStrapper.java:86)
        at org.apache.cassandra.service.StorageService.bootstrap(StorageService.java:998)
        at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:801)
        at org.apache.cassandra.service.StorageService.initServer(StorageService.java:614)
        at org.apache.cassandra.service.StorageService.initServer(StorageService.java:503)
        at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:378)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:496)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:585)
Caused by: org.apache.cassandra.streaming.StreamException: Stream failed
        at org.apache.cassandra.streaming.management.StreamEventJMXNotifier.onFailure(StreamEventJMXNotifier.java:85)
        at com.google.common.util.concurrent.Futures$4.run(Futures.java:1160)
        at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297)
        at com.google.common.util.concurrent.ExecutionList.executeListener(ExecutionList.java:156)
        at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:145)
        at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:202)
        at org.apache.cassandra.streaming.StreamResultFuture.maybeComplete(StreamResultFuture.java:216)
        at org.apache.cassandra.streaming.StreamResultFuture.handleSessionComplete(StreamResultFuture.java:191)
        at org.apache.cassandra.streaming.StreamSession.closeSession(StreamSession.java:377)
        at org.apache.cassandra.streaming.StreamSession.maybeCompleted(StreamSession.java:662)
        at org.apache.cassandra.streaming.StreamSession.taskCompleted(StreamSession.java:613)
        at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:137)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)


> New node refuses to join the ring.
> ----------------------------------
>
>                 Key: CASSANDRA-6565
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-6565
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Shao-Chuan Wang
>
> We have 30 nodes in one DC, 25 nodes in another. We are running 2.0.1.
> Two nodes are joining the ring, but one of them failed
> ARN [STREAM-IN-/10.4.197.53] 2014-01-09 19:41:40,418 StreamResultFuture.java (line 209)
[Stream #e515d6e0-795d-11e3-b74a-b72892248056] Stream failed
> ERROR [main] 2014-01-09 19:41:40,418 CassandraDaemon.java (line 459) Exception encountered
during startup
> java.lang.RuntimeException: Error during boostrap: Stream failed
>         at org.apache.cassandra.dht.BootStrapper.bootstrap(BootStrapper.java:86)
>         at org.apache.cassandra.service.StorageService.bootstrap(StorageService.java:901)
>         at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:670)
>         at org.apache.cassandra.service.StorageService.initServer(StorageService.java:529)
>         at org.apache.cassandra.service.StorageService.initServer(StorageService.java:428)
>         at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:343)
>         at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:442)
>         at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:485)
> Caused by: org.apache.cassandra.streaming.StreamException: Stream failed
>         at org.apache.cassandra.streaming.StreamResultFuture.maybeComplete(StreamResultFuture.java:210)
>         at org.apache.cassandra.streaming.StreamResultFuture.handleSessionComplete(StreamResultFuture.java:185)
>         at org.apache.cassandra.streaming.StreamSession.closeSession(StreamSession.java:321)
>         at org.apache.cassandra.streaming.StreamSession.complete(StreamSession.java:501)
       at org.apache.cassandra.streaming.StreamSession.messageReceived(Stre
> amSession.java:376)        at org.apache.cassandra.streaming.ConnectionHandler$IncomingMessageHandler.run(ConnectionHandler.java:293)
>         at java.lang.Thread.run(Thread.java:744)
> ERROR [StorageServiceShutdownHook] 2014-01-09 19:41:40,428 CassandraDaemon.java (line
185) Exception in thread Thread[StorageServiceShutdownHook,5,main]
> java.lang.NullPointerException
>         at org.apache.cassandra.service.StorageService.stopRPCServer(StorageService.java:312)
>         at org.apache.cassandra.service.StorageService.shutdownClientServers(StorageService.java:361)
>         at org.apache.cassandra.service.StorageService.access$000(StorageService.java:96)
>         at org.apache.cassandra.service.StorageService$1.runMayThrow(StorageService.java:494)
>         at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
>         at java.lang.Thread.run(Thread.java:744)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message