From user-return-25684-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org Sun Apr 22 02:13:08 2012 Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3D0829D02 for ; Sun, 22 Apr 2012 02:13:08 +0000 (UTC) Received: (qmail 62947 invoked by uid 500); 22 Apr 2012 02:13:05 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 62924 invoked by uid 500); 22 Apr 2012 02:13:05 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 62913 invoked by uid 99); 22 Apr 2012 02:13:05 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 22 Apr 2012 02:13:05 +0000 X-ASF-Spam-Status: No, hits=-0.1 required=5.0 tests=HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [164.107.115.49] (HELO cse.ohio-state.edu) (164.107.115.49) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 22 Apr 2012 02:12:56 +0000 Received: from [192.168.2.4] (cpe-75-187-44-110.columbus.res.rr.com [75.187.44.110]) (authenticated bits=0) by cse.ohio-state.edu (8.12.11.20060308/8.12.11) with ESMTP id q3M2CZXk024315 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Sat, 21 Apr 2012 22:12:35 -0400 (EDT) Message-ID: <4F93691E.9030203@cse.ohio-state.edu> Date: Sat, 21 Apr 2012 22:12:46 -0400 From: Aniket Chakrabarti User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:11.0) Gecko/20120327 Thunderbird/11.0.1 MIME-Version: 1.0 To: user@cassandra.apache.org Subject: Re: nodetool decommission hangs References: <4F931458.6020204@cse.ohio-state.edu> In-Reply-To: Content-Type: multipart/alternative; boundary="------------030104000001080703000308" This is a multi-part message in MIME format. --------------030104000001080703000308 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Actually its an empty cluster i.e. no data is present, I am just trying to get the decommission to work. The cluster just has keyspace and a column family with no keys in it. On 4/21/2012 10:05 PM, Ji Cheng wrote: > It needs to stream all its data to the other node, which may take a > long time. You can use nodetool netstats to see the progress of > streaming. > > Best, > Cheng > > On Sun, Apr 22, 2012 at 4:11 AM, Aniket Chakrabarti > > wrote: > > Hi, > > I am trying to use nodetool decommission to remove a node from the > cluster(it is just a 2 node cluster). It hangs with the following log: > ======================================== > INFO [RMI TCP Connection(4)-164.107.119.50] 2012-04-21 > 11:07:15,095 StorageService.java (line 668) LEAVING: sleeping > 30000 ms for pending range setup > INFO [RMI TCP Connection(4)-164.107.119.50] 2012-04-21 > 11:07:45,251 StorageService.java (line 668) LEAVING: streaming > data to other nodes > INFO [StreamStage:1] 2012-04-21 11:07:45,259 StreamOut.java (line > 114) Beginning transfer to /10.2.246.0 > INFO [StreamStage:1] 2012-04-21 11:07:45,262 StreamOut.java (line > 95) Flushing memtables for [CFS(Keyspace='keyspace1', > ColumnFamily='Standard1')]... > INFO [StreamStage:1] 2012-04-21 11:07:45,262 StreamOut.java (line > 160) Stream context metadata [], 0 sstables. > INFO [StreamStage:1] 2012-04-21 11:07:45,264 > StreamOutSession.java (line 203) Streaming to /10.2.246.0 > > ======================================== > > Any pointers will be very helpful. > > Thanks, > Aniket > > --------------030104000001080703000308 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit Actually its an empty cluster i.e. no data is present, I am just trying to get the decommission to work. The cluster just has keyspace and a column family with no keys in it.

On 4/21/2012 10:05 PM, Ji Cheng wrote:
It needs to stream all its data to the other node, which may take a long time. You can use nodetool netstats to see the progress of streaming. 

Best,
Cheng

On Sun, Apr 22, 2012 at 4:11 AM, Aniket Chakrabarti <chakraba@cse.ohio-state.edu> wrote:
Hi,

I am trying to use nodetool decommission to remove a node from the cluster(it is just a 2 node cluster). It hangs with the following log:
========================================
INFO [RMI TCP Connection(4)-164.107.119.50] 2012-04-21 11:07:15,095 StorageService.java (line 668) LEAVING: sleeping 30000 ms for pending range setup
 INFO [RMI TCP Connection(4)-164.107.119.50] 2012-04-21 11:07:45,251 StorageService.java (line 668) LEAVING: streaming data to other nodes
 INFO [StreamStage:1] 2012-04-21 11:07:45,259 StreamOut.java (line 114) Beginning transfer to /10.2.246.0
 INFO [StreamStage:1] 2012-04-21 11:07:45,262 StreamOut.java (line 95) Flushing memtables for [CFS(Keyspace='keyspace1', ColumnFamily='Standard1')]...
 INFO [StreamStage:1] 2012-04-21 11:07:45,262 StreamOut.java (line 160) Stream context metadata [], 0 sstables.
 INFO [StreamStage:1] 2012-04-21 11:07:45,264 StreamOutSession.java (line 203) Streaming to /10.2.246.0
========================================

Any pointers will be very helpful.

Thanks,
Aniket

--------------030104000001080703000308--