Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 73750 invoked from network); 12 Apr 2011 16:58:52 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 12 Apr 2011 16:58:52 -0000 Received: (qmail 97017 invoked by uid 500); 12 Apr 2011 16:58:50 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 96996 invoked by uid 500); 12 Apr 2011 16:58:50 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 96988 invoked by uid 99); 12 Apr 2011 16:58:50 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 Apr 2011 16:58:50 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of baskar.duraikannu.db@gmail.com designates 209.85.220.172 as permitted sender) Received: from [209.85.220.172] (HELO mail-vx0-f172.google.com) (209.85.220.172) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 Apr 2011 16:58:42 +0000 Received: by vxg33 with SMTP id 33so6247211vxg.31 for ; Tue, 12 Apr 2011 09:58:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:message-id:from:to:subject:date:mime-version :content-type:x-priority:x-msmail-priority:importance:x-mailer :x-mimeole; bh=UInJJeqCHUOguy522b3i/c+H0Mj0ZH6R8ZMeRisUddo=; b=TMah569MAJhj4Mhtum4m/CFJRYRh5/tPkmzhoI4/lsD2su54u7dNhCpsu5Mn2gFLHt SdiptIlP2djGFsxJSce90ivBs7GUOI1K15MQpMo5IKKLV453GSjt37NO6J07gEN7WJoe SCTSx9Xof54SYOQu273ceg1+G8a7kaMHzhGTw= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:from:to:subject:date:mime-version:content-type :x-priority:x-msmail-priority:importance:x-mailer:x-mimeole; b=qQhq3LxdWi6tLNZXvsQ4h8eDmRnh/gNaqTwIOEk07L4lFsaXf5H4B3+P/UUzABCzC8 +Y8UNGWKp817O0iR2k7w1YzJnlvq9yZcImq1IA2qE7l/ZWb2Y6Jn4TVVUnKTueldvTk+ s3VENE75lsrObCLl8/SGEIef6iBSllJunvOPE= Received: by 10.52.71.141 with SMTP id v13mr1652905vdu.284.1302627501742; Tue, 12 Apr 2011 09:58:21 -0700 (PDT) Received: from usnynyc1lpt0050 ([66.246.173.34]) by mx.google.com with ESMTPS id b4sm1512757vcy.27.2011.04.12.09.58.18 (version=SSLv3 cipher=OTHER); Tue, 12 Apr 2011 09:58:21 -0700 (PDT) Message-ID: <5F71895862254D6B9AC22CAB61726E9F@usnynyc1lpt0050> From: "Baskar Duraikannu" To: Subject: Help on decommission Date: Tue, 12 Apr 2011 12:53:31 -0400 MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_NextPart_000_018D_01CBF910.A0707A70" X-Priority: 3 X-MSMail-Priority: Normal Importance: Normal X-Mailer: Microsoft Windows Live Mail 14.0.8117.416 X-MimeOLE: Produced By Microsoft MimeOLE V14.0.8117.416 This is a multi-part message in MIME format. ------=_NextPart_000_018D_01CBF910.A0707A70 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable I have setup a 4 node cluster for testing. When I setup the cluster, I = have setup initial tokens in such a way that each gets 25% of load and = then started the node with autobootstrap=3Dfalse.=20 After all nodes are up, I loaded data using the stress test tool with = replication factor of 3. As per of my testing, I am trying to remove = one of the node using "nodetool decomission" but the node seems to be = stuck in "leaving" status.=20 How do I check whether it is doing any work at all? Please help [root@localhost bin]# ./nodetool -h 10.140.22.25 ring Address Status State Load Owns Token = 127605887595351923798765477786913079296 10.140.22.66 Up Leaving 119.41 MB 25.00% 0 10.140.22.42 Up Normal 116.23 MB 25.00% = 42535295865117307932921825928971026432 10.140.22.28 Up Normal 119.93 MB 25.00% = 85070591730234615865843651857942052864 10.140.22.25 Up Normal 116.21 MB 25.00% = 127605887595351923798765477786913079296 [root@localhost bin]# ./nodetool -h 10.140.22.66 netstats Mode: Leaving: streaming data to other nodes Streaming to: /10.140.22.42 /var/lib/cassandra/data/Keyspace1/Standard1-f-1-Data.db/(0,120929157) progress=3D120929157/120929157 - 100% /var/lib/cassandra/data/Keyspace1/Standard1-f-2-Data.db/(0,3361291) progress=3D0/3361291 - 0% Not receiving any streams. Pool Name Active Pending Completed Commands n/a 0 17 Responses n/a 0 108109 [root@usnynyc1cass02 bin]# ./nodetool -h 10.140.22.42 netstats Mode: Normal Not sending any streams. Streaming from: /10.140.22.66 Keyspace1: = /var/lib/cassandra/data/Keyspace1/Standard1-f-2-Data.db/(0,3361291) progress=3D0/3361291 - 0% Pool Name Active Pending Completed Commands n/a 0 11 Responses n/a 0 107879 Regards, Baskar ------=_NextPart_000_018D_01CBF910.A0707A70 Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable
I have setup a 4 node cluster = for testing.=20 When I setup the cluster, I have setup initial tokens in such a way that = each=20 gets 25% of load and then started the node with autobootstrap=3Dfalse.=20
 
 
After all nodes are up, I loaded data = using the=20 stress test tool with replication factor of 3.  As per of my = testing, I am=20 trying to remove one of the node using "nodetool decomission" but the = node seems=20 to be stuck in "leaving" status.
 
How do I check whether it is doing = any work at=20 all? Please help
 
 
[root@localhost bin]# ./nodetool -h = 10.140.22.25=20 ring
Address         Status=20 State  =20 Load           =20 Owns   =20 Token
          &nbs= p;            = ;            =             &= nbsp;      =20 127605887595351923798765477786913079296
10.140.22.66   = =20 Up     Leaving 119.41 = MB      =20 25.00%  0
10.140.22.42    = Up    =20 Normal  116.23 MB       25.00% =20 42535295865117307932921825928971026432
10.140.22.28    = Up     Normal  119.93=20 MB       25.00% =20 85070591730234615865843651857942052864
10.140.22.25    = Up     Normal  116.21=20 MB       25.00% =20 127605887595351923798765477786913079296
[root@localhost bin]# ./nodetool -h = 10.140.22.66=20 netstats
Mode: Leaving: streaming data to other nodes
Streaming = to:=20 /10.140.22.42
  =20 /var/lib/cassandra/data/Keyspace1/Standard1-f-1-Data.db/(0,120929157)
=         =20 progress=3D120929157/120929157 - 100%
  =20 /var/lib/cassandra/data/Keyspace1/Standard1-f-2-Data.db/(0,3361291)
&n= bsp;       =20 progress=3D0/3361291 - 0%
Not receiving any streams.
Pool=20 Name           &nb= sp;       =20 Active   Pending     =20 Completed
Commands        &nbs= p;            = ;  =20 n/a        =20 0            = =20 17
Responses         &nbs= p;            = ;=20 n/a        =20 0         = 108109
[root@usnynyc1cass02 bin]# = ./nodetool -h=20 10.140.22.42 netstats
Mode: Normal
Not sending any = streams.
Streaming=20 from: /10.140.22.66
   Keyspace1:=20 /var/lib/cassandra/data/Keyspace1/Standard1-f-2-Data.db/(0,3361291)
&n= bsp;       =20 progress=3D0/3361291 - 0%
Pool=20 Name           &nb= sp;       =20 Active   Pending     =20 Completed
Commands        &nbs= p;            = ;  =20 n/a        =20 0            = =20 11
Responses         &nbs= p;            = ;=20 n/a        =20 0         = 107879
 
 
Regards,
Baskar
------=_NextPart_000_018D_01CBF910.A0707A70--