cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pranay Agarwal <agarwalpran...@gmail.com>
Subject Re: Adding new node to Cassandra cluster is too slow
Date Fri, 20 Mar 2015 18:44:51 GMT
Also, typically how long does it take for a node to join? I have in total 1
TB of data in 15 nodes cassandra cluster.

On Fri, Mar 20, 2015 at 10:53 AM, Pranay Agarwal <agarwalpranaya@gmail.com>
wrote:

> Thank Rahul, you are right. Unless the node complete joins the ring, there
> is no data dependency on them.
>
>
> On Fri, Mar 20, 2015 at 4:46 AM, Rahul Neelakantan <rahul@rahul.be> wrote:
>
>> You won't lose data unless you have run nodetool cleanup on the existing
>> nodes.
>>
>> Rahul
>>
>> On Mar 19, 2015, at 9:16 PM, Pranay Agarwal <agarwalpranaya@gmail.com>
>> wrote:
>>
>> Also, the new nodes (3 of them, in *UJ state*) are showing some data
>> size (~10g). Is there any data loss chances with stopping the cassandra on
>> them?
>>
>> On Thu, Mar 19, 2015 at 6:02 PM, Pranay Agarwal <agarwalpranaya@gmail.com
>> > wrote:
>>
>>> Thanks Rob, You are right. I am using ReleaseVersion: 2.1.0
>>>
>>> What do you mean by point 3? Also, by doing one at a time, does it mean
>>> wait till nodetool status of the new node is UN from UJ?
>>>
>>> On Thu, Mar 19, 2015 at 5:44 PM, Robert Coli <rcoli@eventbrite.com>
>>> wrote:
>>>
>>>> On Thu, Mar 19, 2015 at 5:32 PM, Pranay Agarwal <
>>>> agarwalpranaya@gmail.com> wrote:
>>>>
>>>>> I have 14 nodes cassandra cluster, each node as around 50gb of data.
I
>>>>> added 3 new nodes to the cluster and I can see the status as *UJ *for
>>>>> the new nodes. They have been in that for almost a day now and their
data
>>>>> size seems to be same as well. There is almost no CPU or disk usage either
>>>>> on them.
>>>>>
>>>>
>>>> It is not supported to add multiple nodes to a cluster simultaneously
>>>> until 2.1.1 [1]. Usually what happens is one or more of the bootstraps
>>>> fails and hangs forever. This seems to be what has happened to you.
>>>>
>>>> To resolve :
>>>>
>>>> 1) stop each of the bootstrapping nodes
>>>> 2) wipe their data directories completey
>>>> 3) verify that they do not show up in gossip on the other nodes
>>>> 4) bootstrap them again, one at a time
>>>>
>>>> =Rob
>>>> [1] https://issues.apache.org/jira/browse/CASSANDRA-7069
>>>>
>>>>
>>>>
>>>
>>
>

Mime
View raw message