Return-Path: X-Original-To: apmail-cassandra-commits-archive@www.apache.org Delivered-To: apmail-cassandra-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 45A091066B for ; Wed, 20 May 2015 17:27:00 +0000 (UTC) Received: (qmail 90559 invoked by uid 500); 20 May 2015 17:27:00 -0000 Delivered-To: apmail-cassandra-commits-archive@cassandra.apache.org Received: (qmail 90523 invoked by uid 500); 20 May 2015 17:26:59 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 90512 invoked by uid 99); 20 May 2015 17:26:59 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 20 May 2015 17:26:59 +0000 Date: Wed, 20 May 2015 17:26:59 +0000 (UTC) From: "Omid Aladini (JIRA)" To: commits@cassandra.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (CASSANDRA-9440) Bootstrap fails without any hint of prior stream failure MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CASSANDRA-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552702#comment-14552702 ] Omid Aladini commented on CASSANDRA-9440: ----------------------------------------- It might be relevant that the cluster was running with the default streaming_socket_timeout_in_ms = 0, but if that's the cause of the failure, shouldn't the bootstrap just get stuck? > Bootstrap fails without any hint of prior stream failure > -------------------------------------------------------- > > Key: CASSANDRA-9440 > URL: https://issues.apache.org/jira/browse/CASSANDRA-9440 > Project: Cassandra > Issue Type: Bug > Environment: Cassandra 2.0.14 > 2 DCs on EC2 > Reporter: Omid Aladini > > I'm working on a cluster running Cassandra 2.0.14 and the bootstrap fails but there is no prior hint of failed streams: > {code} > WARN [StreamReceiveTask:177] 2015-05-20 04:20:55,251 StreamResultFuture.java (line 215) [Stream #0b42c640-fe03-11e4-8a6f-dd5dc9b30af4] Stream failed > ERROR [main] 2015-05-20 04:20:55,252 CassandraDaemon.java (line 584) Exception encountered during startup > java.lang.RuntimeException: Error during boostrap: Stream failed > at org.apache.cassandra.dht.BootStrapper.bootstrap(BootStrapper.java:86) > at org.apache.cassandra.service.StorageService.bootstrap(StorageService.java:1005) > at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:808) > at org.apache.cassandra.service.StorageService.initServer(StorageService.java:621) > at org.apache.cassandra.service.StorageService.initServer(StorageService.java:510) > at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:437) > at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:567) > at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:656) > Caused by: org.apache.cassandra.streaming.StreamException: Stream failed > at org.apache.cassandra.streaming.management.StreamEventJMXNotifier.onFailure(StreamEventJMXNotifier.java:85) > at com.google.common.util.concurrent.Futures$4.run(Futures.java:1160) > at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297) > at com.google.common.util.concurrent.ExecutionList.executeListener(ExecutionList.java:156) > at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:145) > at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:202) > at org.apache.cassandra.streaming.StreamResultFuture.maybeComplete(StreamResultFuture.java:216) > at org.apache.cassandra.streaming.StreamResultFuture.handleSessionComplete(StreamResultFuture.java:191) > at org.apache.cassandra.streaming.StreamSession.closeSession(StreamSession.java:377) > at org.apache.cassandra.streaming.StreamSession.maybeCompleted(StreamSession.java:662) > at org.apache.cassandra.streaming.StreamSession.taskCompleted(StreamSession.java:613) > at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:143) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) > INFO [StorageServiceShutdownHook] 2015-05-20 04:20:55,286 Gossiper.java (line 1330) Announcing shutdown > {code} > There are no WARN or ERROR prior to this in the log files of the bootstrapping node or other nodes in the cluster. Only relevant log lines are "Session with 11.22.33.44/11.22.33.44 is complete" > Is it possible that individual stream sessions fail silently? -- This message was sent by Atlassian JIRA (v6.3.4#6332)