cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From aaron morton <aa...@thelastpickle.com>
Subject Re: nodetool decommission hangs
Date Mon, 23 Apr 2012 09:20:59 GMT
You can check the streaming progress with nodetool netstats. That will tell you what it thinks
it is moving. 

nodetool ring will also tell you what state the nodes are in. 

That said, this looks a little suspicious…
 
>>  INFO [StreamStage:1] 2012-04-21 11:07:45,262 StreamOut.java (line 160) Stream context
metadata [], 0 sstables.

If netstats is showing nothing could you please reply with some details of what was in the
schema, and if there was *any* data at all.

Cheers


-----------------
Aaron Morton
Freelance Developer
@aaronmorton
http://www.thelastpickle.com

On 22/04/2012, at 2:12 PM, Aniket Chakrabarti wrote:

> Actually its an empty cluster i.e. no data is present, I am just trying to get the decommission
to work. The cluster just has keyspace and a column family with no keys in it.
> 
> On 4/21/2012 10:05 PM, Ji Cheng wrote:
>> 
>> It needs to stream all its data to the other node, which may take a long time. You
can use nodetool netstats to see the progress of streaming. 
>> 
>> Best,
>> Cheng
>> 
>> On Sun, Apr 22, 2012 at 4:11 AM, Aniket Chakrabarti <chakraba@cse.ohio-state.edu>
wrote:
>> Hi,
>> 
>> I am trying to use nodetool decommission to remove a node from the cluster(it is
just a 2 node cluster). It hangs with the following log:
>> ========================================
>> INFO [RMI TCP Connection(4)-164.107.119.50] 2012-04-21 11:07:15,095 StorageService.java
(line 668) LEAVING: sleeping 30000 ms for pending range setup
>>  INFO [RMI TCP Connection(4)-164.107.119.50] 2012-04-21 11:07:45,251 StorageService.java
(line 668) LEAVING: streaming data to other nodes
>>  INFO [StreamStage:1] 2012-04-21 11:07:45,259 StreamOut.java (line 114) Beginning
transfer to /10.2.246.0
>>  INFO [StreamStage:1] 2012-04-21 11:07:45,262 StreamOut.java (line 95) Flushing memtables
for [CFS(Keyspace='keyspace1',             ColumnFamily='Standard1')]...
>>  INFO [StreamStage:1] 2012-04-21 11:07:45,262 StreamOut.java (line 160) Stream context
metadata [], 0 sstables.
>>  INFO [StreamStage:1] 2012-04-21 11:07:45,264 StreamOutSession.java (line 203) Streaming
to /10.2.246.0
>> ========================================
>> 
>> Any pointers will be very helpful.
>> 
>> Thanks,
>> Aniket
>> 


Mime
View raw message