Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
MIME-Version: 1.0
Sender: burtonator2011@gmail.com
In-Reply-To: 
 <CAAZU44kWEuuQuAc+DPY+FZswrCvr43JS=TXZ=tc4v3oF6D_8UQ@mail.gmail.com>
References: 
 <CAAZU44kWEuuQuAc+DPY+FZswrCvr43JS=TXZ=tc4v3oF6D_8UQ@mail.gmail.com>
From: Kevin Burton <burton@spinn3r.com>
Date: Sun, 18 Oct 2015 15:44:51 -0700
Message-ID: 
 <CAAZU44kLhuTMeLz6jWs_1TK7GhVWgbxVHerGj1L=8RnaCoVV-A@mail.gmail.com>
Subject: Re: Would we have data corruption if we bootstrapped 10 nodes at
 once?
To: "user@cassandra.apache.org" <user@cassandra.apache.org>
Content-Type: multipart/alternative; boundary=001a11c01300fe8a0c052268c738

--001a11c01300fe8a0c052268c738
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

An shit.. I think we're seeing corruption.. missing records :-/

On Sat, Oct 17, 2015 at 10:45 AM, Kevin Burton <burton@spinn3r.com> wrote:

> We just migrated from a 30 node cluster to a 45 node cluster. (so 15 new
> nodes)
>
> By default we have auto_boostrap =3D false
>
> so we just push our config to the cluster, the cassandra daemons restart,
> and they're not cluster members and are the only nodes in the cluster.
>
> Anyway.  While I was about 1/2 way done adding the 15 nodes,  I had about
> 7 members of the cluster and 8 not yet joined.
>
> We are only doing 1 at a time because apparently bootstrapping more than =
1
> is unsafe.
>
> I did a rolling restart whereby I went through and restarted all the
> cassandra boxes.
>
> Somehow the new nodes auto boostrapped themselves EVEN though
> auto_bootstrap=3Dfalse.
>
> We don't have any errors.  Everything seems functional.  I'm just worried
> about data loss.
>
> Thoughts?
>
> Kevin
>
> --
>
> We=E2=80=99re hiring if you know of any awesome Java Devops or Linux Oper=
ations
> Engineers!
>
> Founder/CEO Spinn3r.com
> Location: *San Francisco, CA*
> blog: http://burtonator.wordpress.com
> =E2=80=A6 or check out my Google+ profile
> <https://plus.google.com/102718274791889610666/posts>
>
>


--=20

We=E2=80=99re hiring if you know of any awesome Java Devops or Linux Operat=
ions
Engineers!

Founder/CEO Spinn3r.com
Location: *San Francisco, CA*
blog: http://burtonator.wordpress.com
=E2=80=A6 or check out my Google+ profile
<https://plus.google.com/102718274791889610666/posts>

--001a11c01300fe8a0c052268c738
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">An shit.. I think we&#39;re seeing corruption.. missing re=
cords :-/</div><div class=3D"gmail_extra"><br><div class=3D"gmail_quote">On=
 Sat, Oct 17, 2015 at 10:45 AM, Kevin Burton <span dir=3D"ltr">&lt;<a href=
=3D"mailto:burton@spinn3r.com" target=3D"_blank">burton@spinn3r.com</a>&gt;=
</span> wrote:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .=
8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">We just m=
igrated from a 30 node cluster to a 45 node cluster. (so 15 new nodes)<div>=
<br></div><div>By default we have auto_boostrap =3D false</div><div><br></d=
iv><div>so we just push our config to the cluster, the cassandra daemons re=
start, and they&#39;re not cluster members and are the only nodes in the cl=
uster.</div><div><br></div><div>Anyway.=C2=A0 While I was about 1/2 way don=
e adding the 15 nodes, =C2=A0I had about 7 members of the cluster and 8 not=
 yet joined.</div><div><br></div><div>We are only doing 1 at a time because=
 apparently bootstrapping more than 1 is unsafe. =C2=A0</div><div><br></div=
><div>I did a rolling restart whereby I went through and restarted all the =
cassandra boxes. =C2=A0</div><div><br></div><div>Somehow the new nodes auto=
 boostrapped themselves EVEN though auto_bootstrap=3Dfalse.</div><div><br><=
/div><div>We don&#39;t have any errors.=C2=A0 Everything seems functional.=
=C2=A0 I&#39;m just worried about data loss.</div><div><br></div><div>Thoug=
hts?</div><span class=3D"HOEnZb"><font color=3D"#888888"><div><br></div><di=
v>Kevin</div><div><div><br></div>-- <br><div><div dir=3D"ltr"><div><div dir=
=3D"ltr"><div><div dir=3D"ltr"><div><div><p style=3D"margin-top:0px;margin-=
right:0px;margin-bottom:12pt;margin-left:0px"></p><div><span style=3D"font-=
size:small">We=E2=80=99re hiring if you know of any awesome Java Devops or =
Linux Operations Engineers!</span><br></div><div><br></div><div>Founder/CEO=
=C2=A0<a href=3D"http://Spinn3r.com" target=3D"_blank">Spinn3r.com</a><br><=
/div><div>Location:=C2=A0<b>San Francisco, CA</b><br></div><div><font color=
=3D"#2c2c2c" face=3D"Helvetica, Arial, sans-serif"><span style=3D"line-heig=
ht:19px">blog:<b>=C2=A0</b></span></font><a href=3D"http://burtonator.wordp=
ress.com" target=3D"_blank">http://burtonator.wordpress.com</a></div><div>=
=E2=80=A6 or check out my <a href=3D"https://plus.google.com/10271827479188=
9610666/posts" target=3D"_blank">Google+ profile</a></div><div><img><br></d=
iv><div></div><p></p></div></div></div></div></div></div></div></div>
</div></font></span></div>
</blockquote></div><br><br clear=3D"all"><div><br></div>-- <br><div class=
=3D"gmail_signature"><div dir=3D"ltr"><div><div dir=3D"ltr"><div><div dir=
=3D"ltr"><div><div><p style=3D"margin-top:0px;margin-right:0px;margin-botto=
m:12pt;margin-left:0px"></p><div><span style=3D"font-size:small">We=E2=80=
=99re hiring if you know of any awesome Java Devops or Linux Operations Eng=
ineers!</span><br></div><div><br></div><div>Founder/CEO=C2=A0<a href=3D"htt=
p://Spinn3r.com" target=3D"_blank">Spinn3r.com</a><br></div><div>Location:=
=C2=A0<b>San Francisco, CA</b><br></div><div><font color=3D"#2c2c2c" face=
=3D"Helvetica, Arial, sans-serif"><span style=3D"line-height:19px">blog:<b>=
=C2=A0</b></span></font><a href=3D"http://burtonator.wordpress.com" target=
=3D"_blank">http://burtonator.wordpress.com</a></div><div>=E2=80=A6 or chec=
k out my <a href=3D"https://plus.google.com/102718274791889610666/posts" ta=
rget=3D"_blank">Google+ profile</a></div><div><img><br></div><div></div><p>=
</p></div></div></div></div></div></div></div></div>
</div>

--001a11c01300fe8a0c052268c738--