incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nate McCall <n...@thelastpickle.com>
Subject Re: Failed decommission
Date Sun, 25 Aug 2013 21:15:21 GMT
This is what I was seeing code wise as well - but Mike's answer was spot
on. Glad you got this straightened out. (And huge thanks to Mike for coming
back to post a work-around here and on the ticket).


On Sun, Aug 25, 2013 at 11:42 AM, Janne Jalkanen
<Janne.Jalkanen@ecyrd.com>wrote:

>
> This would be RP (cluster upgraded from 0.6->0.8->1.0->1.1 ;-). Looks to
> me like decommission assumes Murmur and 64-bit tokens.
>
> /Janne
>
> On Aug 25, 2013, at 17:25 , Nate McCall <nate@thelastpickle.com> wrote:
>
> Are you using Murmur3 or the older Random partitioner on this cluster?
>
>
> On Sun, Aug 25, 2013 at 3:06 AM, Janne Jalkanen <Janne.Jalkanen@ecyrd.com>wrote:
>
>> This on cass 1.2.8
>>
>> Ring state before decommission
>>
>> --  Address         Load       Owns   Host ID
>>   Token                                    Rack
>> UN  10.0.0.1  38.82 GB   33.3%  21a98502-dc74-4ad0-9689-0880aa110409  1
>>                                      1a
>> UN  10.0.0.2   33.5 GB    33.3%  cba6b27a-4982-4f04-854d-cc73155d5f69
>>  56713727820156407428984779325531226110   1b
>> UN  10.0.0.3  37.41 GB   0.0%   6ba2c7d4-713e-4c14-8df8-f861fb211b0d
>>  56713727820156407428984779325531226111   1b
>> UN  10.0.0.4  35.7 GB    33.3%  bf3d4792-f3e0-4062-afe3-be292bc85ed7
>>  113427455640312814857969558651062452222  1c
>>
>> Trying to decommission the node
>>
>> ubuntu@10.0.0.3:~$ nodetool decommission
>> Exception in thread "main" java.lang.NumberFormatException: For input
>> string: "56713727820156407428984779325531226111"
>>         at
>> java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
>>         at java.lang.Long.parseLong(Long.java:444)
>>         at java.lang.Long.parseLong(Long.java:483)
>>         at
>> org.apache.cassandra.service.StorageService.extractExpireTime(StorageService.java:1660)
>>         at
>> org.apache.cassandra.service.StorageService.handleStateLeft(StorageService.java:1515)
>>         at
>> org.apache.cassandra.service.StorageService.onChange(StorageService.java:1234)
>>         at
>> org.apache.cassandra.gms.Gossiper.doNotifications(Gossiper.java:949)
>>         at
>> org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1116)
>>         at
>> org.apache.cassandra.service.StorageService.leaveRing(StorageService.java:2817)
>>         at
>> org.apache.cassandra.service.StorageService.unbootstrap(StorageService.java:2861)
>>         at
>> org.apache.cassandra.service.StorageService.decommission(StorageService.java:2808)
>>
>> Now I'm in a state where the machine is still "up" but "leaving" but I
>> can't seem to get it out of the ring.  For example:
>>
>> % nodetool removenode 6ba2c7d4-713e-4c14-8df8-f861fb211b0d
>> Exception in thread "main" java.lang.UnsupportedOperationException: Node /
>> 10.0.0.3 is alive and owns this ID. Use decommission command to remove
>> it from the ring
>>
>> Any ideas?
>>
>> /Janne
>
>
>
>

Mime
View raw message