Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9617EEF31 for ; Wed, 27 Feb 2013 06:26:14 +0000 (UTC) Received: (qmail 79098 invoked by uid 500); 27 Feb 2013 06:26:11 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 78936 invoked by uid 500); 27 Feb 2013 06:26:11 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 78906 invoked by uid 99); 27 Feb 2013 06:26:10 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 27 Feb 2013 06:26:10 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS,T_FRT_BELOW2 X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ben@relational.io designates 74.125.82.175 as permitted sender) Received: from [74.125.82.175] (HELO mail-we0-f175.google.com) (74.125.82.175) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 27 Feb 2013 06:26:05 +0000 Received: by mail-we0-f175.google.com with SMTP id x8so156210wey.20 for ; Tue, 26 Feb 2013 22:25:44 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-received:sender:x-originating-ip:in-reply-to :references:date:x-google-sender-auth:message-id:subject:from:to :content-type:x-gm-message-state; bh=pj5jxtGFxooK8AHurTijwJJ5svfXmg5F8KuQdIcwOpU=; b=Gymn6KPyLLzwTSDM7sepFHKzsJhpkDc5/IlmHiCCpnfeSC/IHflTFhDdV2MFbGvjoW W0YJidvuI+wz3YHk/AiaEC0ck8LYVbq4C4w4b2GF3uIs0JwuxrXsFBf4YIBZWgHzXvfL lY+7nDussSPlo0h4j2X7aPVBWzTz0aPonudUs+/+DjAO4LoNJ13yDFxYcxzyvif+Vd/n ZAqRAcue2KDblFD8SQS/LHPRnDu5/LkBkUc48AstYS3z2YRN3FoxKNIR/K2w/c57JoLm SZegTfHL6SBJzxxsr5I8pVVzlsSv2ghUN7CCXW1vF9uqvKQaNQfbwyF7uiCmulpC6A5h F9Vw== MIME-Version: 1.0 X-Received: by 10.180.102.164 with SMTP id fp4mr1593667wib.1.1361946343721; Tue, 26 Feb 2013 22:25:43 -0800 (PST) Sender: ben@relational.io Received: by 10.227.195.209 with HTTP; Tue, 26 Feb 2013 22:25:43 -0800 (PST) X-Originating-IP: [122.150.96.14] In-Reply-To: References: Date: Wed, 27 Feb 2013 17:25:43 +1100 X-Google-Sender-Auth: fgYCum7ChmQqZa00Ga9D6DNJrGo Message-ID: Subject: Re: no other nodes seen on priam cluster From: Ben Bromhead To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=f46d04462e64056b3f04d6aed81c X-Gm-Message-State: ALoCoQlFGQ2PDE3rvXAzk3/Xn9KbhVJsoJSNhSxZaXT/ssls12Uyko+qfvUZpj+8hgI2tUKV0Ams X-Virus-Checked: Checked by ClamAV on apache.org --f46d04462e64056b3f04d6aed81c Content-Type: text/plain; charset=ISO-8859-1 Hi Marcelo A few questions: Have your added the priam java agent to cassandras JVM argurments (e.g. -javaagent:$CASS_HOME/lib/priam-cass-extensions-1.1.15.jar) and does the web container running priam have permissions to write to the cassandra config directory? Also what do the priam logs say? If you want to get up and running quickly with cassandra, AWS and priam quickly check out www.instaclustr.comyou. We deploy Cassandra under your AWS account and you have full root access to the nodes if you want to explore and play around + there is a free tier which is great for experimenting and trying Cassandra out. Cheers Ben On Wed, Feb 27, 2013 at 6:09 AM, Marcelo Elias Del Valle wrote: > Hello, > > I am using cassandra 1.2.1 and I am trying to set up a Priam cluster > on AWS with two nodes. However, I can't get both nodes up and running > because of a weird error (at least to me). > When I start both nodes, they are both able to connect to each other > and do some communication. However, after some seconds, I just see > "Java.lang.RuntimeException: No other nodes seen! ", so they disconnect and > die. I tried to test all ports (7000, 9160 and 7199) between both nodes > and there is no firewall. On the second node, before the above exception, I > get a broken pipe, as shown bellow. > Any hint? > > DEBUG 18:54:31,776 attempting to connect to /10.224.238.170 > DEBUG 18:54:32,402 Reseting version for /10.224.238.170 > DEBUG 18:54:32,778 Connection version 6 from /10.224.238.170 > DEBUG 18:54:32,779 Upgrading incoming connection to be compressed > DEBUG 18:54:32,779 Max version for /10.224.238.170 is 6 > DEBUG 18:54:32,779 Setting version 6 for /10.224.238.170 > DEBUG 18:54:32,780 set version for /10.224.238.170 to 6 > DEBUG 18:54:33,455 Disseminating load info ... > DEBUG 18:54:59,082 Reseting version for /10.224.238.170 > DEBUG 18:55:00,405 error writing to /10.224.238.170 > java.io.IOException: Broken pipe > at sun.nio.ch.FileDispatcher.write0(Native Method) > at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:29) > at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:72) > at sun.nio.ch.IOUtil.write(IOUtil.java:43) > at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:334) > at java.nio.channels.Channels.writeFullyImpl(Channels.java:59) > at java.nio.channels.Channels.writeFully(Channels.java:81) > at java.nio.channels.Channels.access$000(Channels.java:47) > at java.nio.channels.Channels$1.write(Channels.java:155) > at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65) > at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123) > at org.xerial.snappy.SnappyOutputStream.flush(SnappyOutputStream.java:272) > at java.io.DataOutputStream.flush(DataOutputStream.java:106) > at > org.apache.cassandra.net.OutboundTcpConnection.writeConnected(OutboundTcpConnection.java:189) > at > org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:143) > DEBUG 18:55:01,405 attempting to connect to /10.224.238.170 > DEBUG 18:55:01,461 Started replayAllFailedBatches > DEBUG 18:55:01,462 forceFlush requested but everything is clean in batchlog > DEBUG 18:55:01,463 Finished replayAllFailedBatches > INFO 18:55:01,472 JOINING: schema complete, ready to bootstrap > DEBUG 18:55:01,473 ... got ring + schema info > INFO 18:55:01,473 JOINING: getting bootstrap token > ERROR 18:55:01,475 Exception encountered during startup > java.lang.RuntimeException: No other nodes seen! Unable to bootstrap.If > you intended to start a single-node cluster, you should make sure your > broadcast_address (or listen_address) is listed as a seed. Otherwise, you > need to determine why the seed being contacted has no knowledge of the rest > of the cluster. Usually, this can be solved by giving all nodes the same > seed list. > > > and on the first node: > > DEBUG 18:54:30,833 Disseminating load info ... > DEBUG 18:54:31,532 Connection version 6 from /10.242.139.159 > DEBUG 18:54:31,533 Upgrading incoming connection to be compressed > DEBUG 18:54:31,534 Max version for /10.242.139.159 is 6 > DEBUG 18:54:31,534 Setting version 6 for /10.242.139.159 > DEBUG 18:54:31,534 set version for /10.242.139.159 to 6 > DEBUG 18:54:31,542 Reseting version for /10.242.139.159 > DEBUG 18:54:31,791 Connection version 6 from /10.242.139.159 > DEBUG 18:54:31,792 Upgrading incoming connection to be compressed > DEBUG 18:54:31,792 Max version for /10.242.139.159 is 6 > DEBUG 18:54:31,792 Setting version 6 for /10.242.139.159 > DEBUG 18:54:31,793 set version for /10.242.139.159 to 6 > INFO 18:54:32,414 Node /10.242.139.159 is now part of the cluster > DEBUG 18:54:32,415 Resetting pool for /10.242.139.159 > DEBUG 18:54:32,415 removing expire time for endpoint : /10.242.139.159 > INFO 18:54:32,415 InetAddress /10.242.139.159 is now UP > DEBUG 18:54:32,789 attempting to connect to > ec2-75-101-233-115.compute-1.amazonaws.com/10.242.139.159 > DEBUG 18:54:58,840 Started replayAllFailedBatches > DEBUG 18:54:58,842 forceFlush requested but everything is clean in batchlog > DEBUG 18:54:58,842 Finished replayAllFailedBatches > INFO 18:54:58,852 JOINING: schema complete, ready to bootstrap > DEBUG 18:54:58,853 ... got ring + schema info > INFO 18:54:58,853 JOINING: getting bootstrap token > java.lang.RuntimeException: No other nodes seen! Unable to bootstrap.If > you intended to start a single-node cluster, you should make sure your > broadcast_address (or listen_address) is listed as a seed. Otherwise, you > need to determine why the seed being contacted has no knowledge of the rest > of the cluster. Usually, this can be solved by giving all nodes the same > seed list. > at > org.apache.cassandra.dht.BootStrapper.getBootstrapSource(BootStrapper.java:154) > at > org.apache.cassandra.dht.BootStrapper.getBalancedToken(BootStrapper.java:135) > at > org.apache.cassandra.dht.BootStrapper.getBootstrapTokens(BootStrapper.java:115) > at > org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:620) > at > org.apache.cassandra.service.StorageService.initServer(StorageService.java:508) > at > org.apache.cassandra.service.StorageService.initServer(StorageService.java:406) > at > org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:282) > at > org.apache.cassandra.service.CassandraDaemon.init(CassandraDaemon.java:315) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.apache.commons.daemon.support.DaemonLoader.load(DaemonLoader.java:212) > Cannot load daemon > Service exit with a return value of 3 > > > > > > Best regards, > -- > Marcelo Elias Del Valle > http://mvalle.com - @mvallebr > --f46d04462e64056b3f04d6aed81c Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi Marcelo

A few questions:

Have your added the priam java age= nt to cassandras JVM argurments (e.g.=A0-jav= aagent:$CASS_HOME/lib/priam-cass-extensions-1.1.15.jar)=A0 and does the web container running priam = have permissions to write to the cassandra config directory? Also what do t= he priam logs say?

If you want to get up and running quic= kly with cassandra, AWS and priam quickly check out www.instaclustr.com you.=A0
We deploy Cassandra under your = AWS account and you have full root access to the nodes if you want to explo= re and play around + there is a free tier which is great for experimenting = and trying Cassandra out.

Cheers

Ben

On Wed, Feb 27, 2013 at 6:09 AM, Marcel= o Elias Del Valle <mvallebr@gmail.com> wrote:
Hello,=A0

=A0 =A0 =A0I am using cassand= ra 1.2.1 and I am trying to set up a Priam cluster on AWS with two nodes. H= owever, I can't get both nodes up and running because of a weird error = (at least to me).=A0
=A0 =A0 =A0When I start both nodes, they are both able to connect to e= ach other and do some communication. However, after some seconds, I just se= e "Java.lang.RuntimeException: No other nodes seen! ", so they di= sconnect and die. I tried to test all ports (7000, 9160 and =A07199) betwee= n both nodes and there is no firewall. On the second node, before the above= exception, I get a broken pipe, as shown bellow.
=A0 =A0 =A0 Any hint?=A0

DEBUG 18:54:31,= 776 attempting to connect to /10.224.238.170
DEBUG 18:54:32,402 Reseting version for= /10.224.238.170
DEBUG 18:54:32,778 Connection version 6 from /10.224.238.170
DEBUG 18:54:32,779= Upgrading incoming connection to be compressed
DEBUG 18:54:32,77= 9 Max version for /10.2= 24.238.170 is 6
DEBUG 18:54:32,779 Setting version 6 for /10.224.238.170
DEBUG 18:54:32,780 set= version for /10.224.23= 8.170 to 6
DEBUG 18:54:33,455 Disseminating load info ...
DEBUG 18:54:59,082 Reseting version for /10.224.238.170
DEBUG 18:55:00,405 erro= r writing to /10.224.23= 8.170
java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatc= her.write0(Native Method)
<= /span>at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:29)
at sun.nio.ch.IOUtil.writ= eFromNativeBuffer(IOUtil.java:72)
at sun.nio.ch.IOUtil.write(IOUtil.java:43)
at sun.nio.ch.SocketChannelImp= l.write(SocketChannelImpl.java:334)
at java.nio.channels.Channels.writeFullyImpl(Channels.java:= 59)
at java.nio.channels.Chan= nels.writeFully(Channels.java:81)
at java.nio.channels.Channels.access$000(Channels.java:47)
at java.nio.channels.Chan= nels$1.write(Channels.java:155)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStrea= m.java:65)
at java.io.BufferedOutput= Stream.flush(BufferedOutputStream.java:123)
at org.xerial.snappy.SnappyOutputStream.flush(Snapp= yOutputStream.java:272)
at java.io.DataOutputStre= am.flush(DataOutputStream.java:106)
at org.apache.cassandra.net.OutboundTcpConnection.writeConn= ected(OutboundTcpConnection.java:189)
at org.apache.cassandra.n= et.OutboundTcpConnection.run(OutboundTcpConnection.java:143)
DEBU= G 18:55:01,405 attempting to connect to /10.224.238.170
DEBUG 18:55:01,461 Started replayAllFailedBatches
DEBUG 18:5= 5:01,462 forceFlush requested but everything is clean in batchlog
DEBUG 18:55:01,463 Finished replayAllFailedBatches
=A0INFO 18:55= :01,472 JOINING: schema complete, ready to bootstrap
DEBUG 18:55:01,473 ... got ring + schema info
=A0INFO 18:55:= 01,473 JOINING: getting bootstrap token
ERROR 18:55:01,475 Except= ion encountered during startup
java.lang.RuntimeException: No oth= er nodes seen! =A0Unable to bootstrap.If you intended to start a single-nod= e cluster, you should make sure your broadcast_address (or listen_address) = is listed as a seed. =A0Otherwise, you need to determine why the seed being= contacted has no knowledge of the rest of the cluster. =A0Usually, this ca= n be solved by giving all nodes the same seed list.


and on the first node:

DEBUG 18:54:30,833 Disseminating load info ...
DEBUG= 18:54:31,532 Connection version 6 from /10.242.139.159
DEBUG 18:54:31,533 Upgrading incoming connection to be compressed
DEBUG 18:54:31,534 Max version for /10.242.139.159 is 6
DEBUG 18:54:31,534 Set= ting version 6 for /10.= 242.139.159
DEBUG 18:54:31,534 set version for /10.242.139.159 to 6
DEBUG 18:54:31,542 Rese= ting version for /10.24= 2.139.159
DEBUG 18:54:31,791 Connection version 6 from /10.242.139.159
DEBUG 18:54:31,792 Upgrading incoming connection to be compressed
DEBUG 18:54:31,792 Max version for /10.242.139.159 is 6
DEBUG 18:54:31,792 Set= ting version 6 for /10.= 242.139.159
DEBUG 18:54:31,793 set version for /10.242.139.159 to 6
=A0INFO 18:54:32,414 No= de /10.242.139.159 = is now part of the cluster
DEBUG 18:54:32,415 Resetting pool for /10.242.139.159
DEBUG 18:54:32,415 removing expire time for endpoint : /10.242.139.159
=A0INFO = 18:54:32,415 InetAddress /10.242.139.159 is now UP
DEBUG 18:54:32,789 attempting to connect to ec2-75-101-= 233-115.compute-1.amazonaws.com/10.242.139.159
DEBUG 18:54:58= ,840 Started replayAllFailedBatches
DEBUG 18:54:58,842 forceFlush requested but everything is clean in bat= chlog
DEBUG 18:54:58,842 Finished replayAllFailedBatches
=A0INFO 18:54:58,852 JOINING: schema complete, ready to bootstrap
DEBUG 18:54:58,853 ... got ring + schema info
=A0INFO 18:54:= 58,853 JOINING: getting bootstrap token
java.lang.RuntimeExceptio= n: No other nodes seen! =A0Unable to bootstrap.If you intended to start a s= ingle-node cluster, you should make sure your broadcast_address (or listen_= address) is listed as a seed. =A0Otherwise, you need to determine why the s= eed being contacted has no knowledge of the rest of the cluster. =A0Usually= , this can be solved by giving all nodes the same seed list.
at org.apache.cassandra.d= ht.BootStrapper.getBootstrapSource(BootStrapper.java:154)
at org.apache.cassandra.dht.BootStrap= per.getBalancedToken(BootStrapper.java:135)
at org.apache.cassandra.d= ht.BootStrapper.getBootstrapTokens(BootStrapper.java:115)
at org.apache.cassandra.service.Stora= geService.joinTokenRing(StorageService.java:620)
at org.apache.cassandra.s= ervice.StorageService.initServer(StorageService.java:508)
at org.apache.cassandra.service.Stora= geService.initServer(StorageService.java:406)
at org.apache.cassandra.s= ervice.CassandraDaemon.setup(CassandraDaemon.java:282)
at org.apache.cassandra.service.Cassandr= aDaemon.init(CassandraDaemon.java:315)
at sun.reflect.NativeMeth= odAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMeth= odAccessorImpl.java:39)
at sun.reflect.Delegating= MethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
<= span style=3D"white-space:pre-wrap"> at java.lang.reflect.Method.inv= oke(Method.java:597)
at org.apache.commons.dae= mon.support.DaemonLoader.load(DaemonLoader.java:212)
Cannot load = daemon
Service exit with a return value of 3





Best regards,
-- =
Marcelo Elias Del Valle
http://mvalle.com=A0- @mvallebr

--f46d04462e64056b3f04d6aed81c--