Return-Path: X-Original-To: apmail-cassandra-commits-archive@www.apache.org Delivered-To: apmail-cassandra-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5FD25C095 for ; Fri, 14 Nov 2014 07:59:34 +0000 (UTC) Received: (qmail 36362 invoked by uid 500); 14 Nov 2014 07:59:34 -0000 Delivered-To: apmail-cassandra-commits-archive@cassandra.apache.org Received: (qmail 36324 invoked by uid 500); 14 Nov 2014 07:59:34 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 36312 invoked by uid 99); 14 Nov 2014 07:59:34 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Nov 2014 07:59:34 +0000 Date: Fri, 14 Nov 2014 07:59:34 +0000 (UTC) From: =?utf-8?Q?Rafa=C5=82_Furma=C5=84ski_=28JIRA=29?= To: commits@cassandra.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Comment Edited] (CASSANDRA-8306) exception in nodetool enablebinary MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CASSANDRA-8306?page=3Dcom.atlas= sian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D= 14211983#comment-14211983 ]=20 Rafa=C5=82 Furma=C5=84ski edited comment on CASSANDRA-8306 at 11/14/14 7:59= AM: ---------------------------------------------------------------------- [~mshuler] No, I don't have any errors related to Gossip in system.log. I s= uccessfully added one node to the cluster after resolving CASSANDRA-8296, s= o I'm pretty sure that this is not related. was (Author: rfurmanski): [~mshuler] No, I don't have any errors related to Gossip in system.log. I s= uccessfully added one node to the cluster after resolving CASSANDRA-8292, s= o I'm pretty sure that this is not related. > exception in nodetool enablebinary > ---------------------------------- > > Key: CASSANDRA-8306 > URL: https://issues.apache.org/jira/browse/CASSANDRA-8306 > Project: Cassandra > Issue Type: Bug > Reporter: Rafa=C5=82 Furma=C5=84ski > > I was trying to add new node (db4) to existing cluster - with no luck. I = can't see any errors in system.log. nodetool status shows, that node is joi= ning into cluster (for many hours). Attaching error and cluster info: > {code} > root@db4:~# nodetool enablebinary > error: Error starting native transport: null > -- StackTrace -- > java.lang.RuntimeException: Error starting native transport: null > =09at org.apache.cassandra.service.StorageService.startNativeTransport(St= orageService.java:350) > =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImp= l.java:57) > =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcc= essorImpl.java:43) > =09at java.lang.reflect.Method.invoke(Method.java:606) > =09at sun.reflect.misc.Trampoline.invoke(MethodUtil.java:75) > =09at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source) > =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcc= essorImpl.java:43) > =09at java.lang.reflect.Method.invoke(Method.java:606) > =09at sun.reflect.misc.MethodUtil.invoke(MethodUtil.java:279) > =09at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(Standard= MBeanIntrospector.java:112) > =09at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(Standard= MBeanIntrospector.java:46) > =09at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector= .java:237) > =09at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:138) > =09at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:252) > =09at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(Defaul= tMBeanServerInterceptor.java:819) > =09at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:8= 01) > =09at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnec= tionImpl.java:1487) > =09at javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnect= ionImpl.java:97) > =09at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.r= un(RMIConnectionImpl.java:1328) > =09at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation= (RMIConnectionImpl.java:1420) > =09at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionI= mpl.java:848) > =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImp= l.java:57) > =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcc= essorImpl.java:43) > =09at java.lang.reflect.Method.invoke(Method.java:606) > =09at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:322) > =09at sun.rmi.transport.Transport$1.run(Transport.java:177) > =09at sun.rmi.transport.Transport$1.run(Transport.java:174) > =09at java.security.AccessController.doPrivileged(Native Method) > =09at sun.rmi.transport.Transport.serviceCall(Transport.java:173) > =09at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java= :556) > =09at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransp= ort.java:811) > =09at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTranspo= rt.java:670) > =09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecuto= r.java:1145) > =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecut= or.java:615) > =09at java.lang.Thread.run(Thread.java:745) > {code} > {code} > root@db4:~# nodetool describecluster > Cluster Information: > =09Name: Production Cluster > =09Snitch: org.apache.cassandra.locator.DynamicEndpointSnitch > =09Partitioner: org.apache.cassandra.dht.Murmur3Partitioner > =09Schema versions: > =09=09b7e98bb9-717f-3f59-bac4-84bc19544e90: [10.195.15.163, 10.195.15.162= , 10.195.15.167, 10.195.15.166] > {code} > {code} > root@db4:~# nodetool status > Datacenter: Ashburn > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > Status=3DUp/Down > |/ State=3DNormal/Leaving/Joining/Moving > -- Address Load Tokens Owns Host ID = Rack > UN 10.195.15.163 12.05 GB 256 ? 0a9f478c-80b5-4c15-8b2e-e27= df6684c69 RAC1 > UN 10.195.15.162 12.8 GB 256 ? c18d2218-ef84-4165-9c3a-05f= 592f512e9 RAC1 > UJ 10.195.15.167 18.61 GB 256 ? 0d3999d9-1e33-4407-bbbd-10c= f0a93b3ba RAC1 > UN 10.195.15.166 13.67 GB 256 ? df8df3b7-da17-48de-8cf6-1c7= 18dc2fde8 RAC1 > {code} > I can't even connect to cassandra using cqlsh: > {code} > root@db4:~# cqlsh 10.195.15.167 > Connection error: ('Unable to connect to any servers', {'10.195.15.167': = error(111, "Tried connecting to [('10.195.15.167', 9042)]. Last error: Conn= ection refused")}) > {code} > In OpsCenter I can see that node has status: Active - Joining and Gossip = is active. Any ideas what could be wrong with this node? -- This message was sent by Atlassian JIRA (v6.3.4#6332)