Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 74745 invoked from network); 15 Jul 2010 04:43:52 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 15 Jul 2010 04:43:52 -0000 Received: (qmail 33001 invoked by uid 500); 15 Jul 2010 04:43:51 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 32838 invoked by uid 500); 15 Jul 2010 04:43:48 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 32813 invoked by uid 99); 15 Jul 2010 04:43:47 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 15 Jul 2010 04:43:47 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,MIME_QP_LONG_LINE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [208.113.200.5] (HELO blingymail-a1.g.dreamhost.com) (208.113.200.5) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 15 Jul 2010 04:43:40 +0000 Received: from localhost (webms.mac.com [17.148.16.116]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by blingymail-a1.g.dreamhost.com (Postfix) with ESMTP id 008AB5CE4D for ; Wed, 14 Jul 2010 21:43:17 -0700 (PDT) To: user@cassandra.apache.org From: Aaron Morton Subject: Re: Seed and nodetool X-Mailer: MobileMe Mail (1C262606) Message-id: Content-Type: multipart/alternative; boundary=Apple-Webmail-42--4e2fce85-a73c-c5dd-a100-f78384be2ca3 MIME-Version: 1.0 In-Reply-To: Date: Wed, 14 Jul 2010 21:43:17 -0700 (PDT) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Webmail-42--4e2fce85-a73c-c5dd-a100-f78384be2ca3 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8; format=flowed Can you do an insert with CL ALL?=0A=EF=BB=BF=0AAre there any ERRORs in th= e log file? Try turning the logging up the TRACE and see whats happening.=0A= =0ACheck B and see A by ssh'ing into B and using node tool from there to c= onnect to A.=0A=0ADo you have any switches / firewalls between the nodes ?= Could this be happening http://www.mail-archive.com/user@cassandra.apache= org/msg03813.html=0A=0AGood luck=0AAaron=0A=0AOn 15 Jul, 2010,at 03:55 PM= , Claire Chang wrote:=0A=0A> BTW,=0A>=0A> A is= 192.168.11.29=0A> B is 192.168.11.28=0A> C is 192.168.11.27=0A>=0A> from = the result of nodetool ring, does it mean that B thinks A, C are down and = C thinks B is down?=0A>=0A> I tried to restart B and for a bring moment, I= didn't get this problem (all the nodes are all from nodetool) but after a= while, this problem came back.=0A>=0A> What could be the issue?=0A>=0A> t= hanks,=0A> Claire=0A>=0A> On Jul 14, 2010, at 7:22 PM, Claire Chang wrote:= =0A>=0A> > I have 3 nodes A, B, C with RF=3D3. When I configure the cluste= r and before start taking any read/write request, I first start A, put A i= tself as seed (following in the instructions on wiki), and then start B (p= ut A as the seed) and then start C (also put A as the seed).=0A> >=0A> > B= and C seem joining the ring correctly and the cluster is working properly= but if I run nodetool=0A> >=0A> > claire@A:$ nodetool -h A -p 9090 ring=0A= > > Address Status Load Range Ring=0A> > 170141183460469231731687303715884= 105726=0A> > 192.168.11.29 Up 2.29 GB 567137278201564105772291012386280352= 42 |<--|=0A> > 192.168.11.28 Up 2.18 GB 1134274556403128211544582024772560= 70484 | |=0A> > 192.168.11.27 Up 2.29 GB 170141183460469231731687303715884= 105726 |-->|=0A> > claire@A:$ nodetool -h B -p 9090 ring=0A> > Address Sta= tus Load Range Ring=0A> > 170141183460469231731687303715884105726=0A> > 19= 2.168.11.29 Down 2.28 GB 56713727820156410577229101238628035242 |<--|=0A> = > 192.168.11.28 Up 2.18 GB 113427455640312821154458202477256070484 | |=0A>= > 192.168.11.27 Down 2.28 GB 170141183460469231731687303715884105726 |-->= |=0A> > claire@A:$ nodetool -h C -p 9090 ring=0A> > Address Status Load Ra= nge Ring=0A> > 170141183460469231731687303715884105726=0A> > 192.168.11.29= Up 2.29 GB 56713727820156410577229101238628035242 |<--|=0A> > 192.168.11.= 28 Down 2.18 GB 113427455640312821154458202477256070484 | |=0A> > 192.168.= 11.27 Up 2.29 GB 170141183460469231731687303715884105726 |-->|=0A> >=0A> >= =0A> > Any reason why nodetool thinks that some servers are down if pointi= ng to B or C? If my cluster setup correct?=0A> >=0A> > thanks,=0A> > Clair= e=0A> >=0A>=0A --Apple-Webmail-42--4e2fce85-a73c-c5dd-a100-f78384be2ca3 Content-Type: multipart/related; type="text/html"; boundary=Apple-Webmail-86--4e2fce85-a73c-c5dd-a100-f78384be2ca3 --Apple-Webmail-86--4e2fce85-a73c-c5dd-a100-f78384be2ca3 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=ISO-8859-1;
Can you do an insert with CL ALL?

Are there any ERRORs in the = log file? Try turning the logging up the =0ATRACE and see whats happening.=

Check B and see A by ssh'ing into=0A B and using node tool from t= here to connect to A.

Do you have =0Aany switches / firewalls betw= een the nodes ? Could this be happening =0Ahttp://www.mail-archive.com/use= r@cassandra.apache.org/msg03813.html

Good=0A luck
Aaron

On 15 Jul, 2010,at 03:55 PM, Claire Chang <claire@merchantcir= cle.com> wrote:

BTW,
=0A
=0AA is 192.168.11.29
=0AB is 192.168.11.28=0AC is 192.168.11.27
=0A
=0Afrom the result of nodetool ring, doe= s it mean that B thinks A, C are down and C thinks B is down?
=0A
=0A= I tried to restart B and for a bring moment, I didn't get this problem (al= l the nodes are all from nodetool) but after a while, this problem came ba= ck.
=0A
=0AWhat could be the issue?
=0A
=0Athanks,
=0AClair= e
=0A
=0AOn Jul 14, 2010, at 7:22 PM, Claire Chang wrote:
=0A
= =0A> I have 3 nodes A, B, C with RF=3D3. When I configure the cluster a= nd before start taking any read/write request, I first start A, put A itse= lf as seed (following in the instructions on wiki), and then start B (put = A as the seed) and then start C (also put A as the seed).
=0A>
=0A= > B and C seem joining the ring correctly and the cluster is working pr= operly but if I run nodetool
=0A>
=0A> claire@A:$ nodetool -h= A -p 9090 ring
=0A> Address Status Load Range = Ring
=0A> = 170141183460469231731687303715884105726
=0A> 192.= 168.11.29 Up 2.29 GB 56713727820156410577229101238628035242 = |<--|
=0A> 192.168.11.28 Up 2.18 GB 11342745564= 0312821154458202477256070484 | |
=0A> 192.168.11.27 Up = 2.29 GB 170141183460469231731687303715884105726 |-->|
=0A&g= t; claire@A:$ nodetool -h B -p 9090 ring
=0A> Address Status = Load Range Ring
=0A>= ; 1701411834604692317316873037158841= 05726
=0A> 192.168.11.29 Down 2.28 GB 56713727820156= 410577229101238628035242 |<--|
=0A> 192.168.11.28 Up = 2.18 GB 113427455640312821154458202477256070484 | |
=0A> = 192.168.11.27 Down 2.28 GB 17014118346046923173168730371588410= 5726 |-->|
=0A> claire@A:$ nodetool -h C -p 9090 ring
=0A&g= t; Address Status Load Range = Ring
=0A> 170141183= 460469231731687303715884105726
=0A> 192.168.11.29 Up 2.2= 9 GB 56713727820156410577229101238628035242 |<--|
=0A> = 192.168.11.28 Down 2.18 GB 11342745564031282115445820247725607= 0484 | |
=0A> 192.168.11.27 Up 2.29 GB 1701411834= 60469231731687303715884105726 |-->|
=0A>
=0A>
=0A&g= t; Any reason why nodetool thinks that some servers are down if pointing t= o B or C? If my cluster setup correct?
=0A>
=0A> thanks,
=0A= > Claire
=0A>
=0A
=0A
--Apple-Webmail-86--4e2fce85-a73c-c5dd-a100-f78384be2ca3-- --Apple-Webmail-42--4e2fce85-a73c-c5dd-a100-f78384be2ca3--