Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
From: Anubhav Kale <Anubhav.Kale@microsoft.com.INVALID>
To: "user@cassandra.apache.org" <user@cassandra.apache.org>,
	"dev@cassandra.apache.org" <dev@cassandra.apache.org>
CC: Sean Usher <seusher@microsoft.com>
Subject: Cassandra 2.1.13: Using JOIN_RING=False
Thread-Topic: Cassandra 2.1.13: Using JOIN_RING=False
Thread-Index: AdLJBttSEBWVIayESzC+R+DA+u1qiA==
Date: Tue, 9 May 2017 21:01:58 +0000
Message-ID: <CO2PR00MB0198056B8ED6351DD9C8181E8BEF0@CO2PR00MB0198.namprd00.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-US
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: multipart/alternative;
	boundary="_000_CO2PR00MB0198056B8ED6351DD9C8181E8BEF0CO2PR00MB0198namp_"
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-originalarrivaltime: 09 May 2017 21:01:58.7955
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 72f988bf-86f1-41af-91ab-2d7cd011db47
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CO2PR00MB0102
archived-at: Tue, 09 May 2017 21:02:15 -0000

--_000_CO2PR00MB0198056B8ED6351DD9C8181E8BEF0CO2PR00MB0198namp_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Hello,

With some inspiration from the Cassandra Summit talk from last year, we are=
 trying to setup a cluster with coordinator-only nodes. We setup join_ring=
=3Dfalse in env.sh, disabled auth in YAML and the nodes are able to start j=
ust fine. However, we're running into a few problems

1] The nodes marked with join_ring=3Dfalse continue to store data. Why ?
2] We tried Python driver's whitelistedpolicy. But we notice message like b=
elow, so we are not able to send queries to all nodes marked as coordinator=
s. We also changed the Scala driver to support whitelisting, but see the sa=
me thing. What are we missing ?
3] Is there any way to concretely tell that only coordinator nodes are gett=
ing requests from clients ? We don't have OpsCenter.

Thanks !

2017-05-09 20:45:25,060 [DEBUG] cassandra.cluster: [control connection] Rem=
oving host not found in peers metadata: <Host: 10.80.10.128>
2017-05-09 20:45:25,060 [INFO] cassandra.cluster: Cassandra host 10.80.10.1=
28 removed
2017-05-09 20:45:25,060 [DEBUG] cassandra.cluster: Removing host 10.80.10.1=
28
2017-05-09 20:45:25,060 [DEBUG] cassandra.cluster: [control connection] Rem=
oving host not found in peers metadata: <Host: 10.80.10.127>
2017-05-09 20:45:25,060 [INFO] cassandra.cluster: Cassandra host 10.80.10.1=
27 removed
2017-05-09 20:45:25,060 [DEBUG] cassandra.cluster: Removing host 10.80.10.1=
27
2017-05-09 20:45:25,060 [DEBUG] cassandra.cluster: [control connection] Rem=
oving host not found in peers metadata: <Host: 10.80.10.129>
2017-05-09 20:45:25,060 [INFO] cassandra.cluster: Cassandra host 10.80.10.1=
29 removed
2017-05-09 20:45:25,060 [DEBUG] cassandra.cluster: Removing host 10.80.10.1=
29
2017-05-09 20:45:25,060 [DEBUG] cassandra.cluster: [control connection] Fin=
ished fetching ring info
2017-05-09 20:45:25,060 [DEBUG] cassandra.cluster: [control connection] Reb=
uilding token map due to topology changes
2017-05-09 20:45:25,081 [DEBUG] cassandra.metadata: user functions table no=
t found
2017-05-09 20:45:25,081 [DEBUG] cassandra.metadata: user aggregates table n=
ot found
2017-05-09 20:45:25,098 [DEBUG] cassandra.cluster: Control connection creat=
ed
2017-05-09 20:45:25,099 [DEBUG] cassandra.pool: Initializing connection for=
 host 10.80.10.125
2017-05-09 20:45:25,099 [DEBUG] cassandra.pool: Initializing connection for=
 host 10.80.10.126


--_000_CO2PR00MB0198056B8ED6351DD9C8181E8BEF0CO2PR00MB0198namp_
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr=
osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:=
//www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"=
>
<meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
	{font-family:"Cambria Math";
	panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0in;
	margin-bottom:.0001pt;
	font-size:11.0pt;
	font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:#0563C1;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:#954F72;
	text-decoration:underline;}
span.EmailStyle17
	{mso-style-type:personal-compose;
	font-family:"Calibri",sans-serif;
	color:windowtext;}
.MsoChpDefault
	{mso-style-type:export-only;}
@page WordSection1
	{size:8.5in 11.0in;
	margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
	{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang=3D"EN-US" link=3D"#0563C1" vlink=3D"#954F72">
<div class=3D"WordSection1">
<p class=3D"MsoNormal">Hello,<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p>
<p class=3D"MsoNormal">With some inspiration from the Cassandra Summit talk=
 from last year, we are trying to setup a cluster with coordinator-only nod=
es. We setup join_ring=3Dfalse in env.sh, disabled auth in YAML and the nod=
es are able to start just fine. However,
 we&#8217;re running into a few problems<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p>
<p class=3D"MsoNormal">1] The nodes marked with join_ring=3Dfalse continue =
to store data. Why ?<o:p></o:p></p>
<p class=3D"MsoNormal">2] We tried Python driver&#8217;s whitelistedpolicy.=
 But we notice message like
<span style=3D"background:yellow;mso-highlight:yellow">below</span>, so we =
are not able to send queries to all nodes marked as coordinators. We also c=
hanged the Scala driver to support whitelisting, but see the same thing. Wh=
at are we missing ?<o:p></o:p></p>
<p class=3D"MsoNormal">3] Is there any way to concretely tell that only coo=
rdinator nodes are getting requests from clients ? We don&#8217;t have OpsC=
enter.<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p>
<p class=3D"MsoNormal">Thanks !<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p>
<p class=3D"MsoNormal">2017-05-09 20:45:25,060 [DEBUG] cassandra.cluster: [=
control connection] Removing host not found in peers metadata: &lt;Host: 10=
.80.10.128&gt;<o:p></o:p></p>
<p class=3D"MsoNormal"><span style=3D"background:yellow;mso-highlight:yello=
w">2017-05-09 20:45:25,060 [INFO] cassandra.cluster: Cassandra host 10.80.1=
0.128 removed<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"background:yellow;mso-highlight:yello=
w">2017-05-09 20:45:25,060 [DEBUG] cassandra.cluster: Removing host 10.80.1=
0.128<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"background:yellow;mso-highlight:yello=
w">2017-05-09 20:45:25,060 [DEBUG] cassandra.cluster: [control connection] =
Removing host not found in peers metadata: &lt;Host: 10.80.10.127&gt;<o:p><=
/o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"background:yellow;mso-highlight:yello=
w">2017-05-09 20:45:25,060 [INFO] cassandra.cluster: Cassandra host 10.80.1=
0.127 removed<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"background:yellow;mso-highlight:yello=
w">2017-05-09 20:45:25,060 [DEBUG] cassandra.cluster: Removing host 10.80.1=
0.127</span><o:p></o:p></p>
<p class=3D"MsoNormal">2017-05-09 20:45:25,060 [DEBUG] cassandra.cluster: [=
control connection] Removing host not found in peers metadata: &lt;Host: 10=
.80.10.129&gt;<o:p></o:p></p>
<p class=3D"MsoNormal">2017-05-09 20:45:25,060 [INFO] cassandra.cluster: Ca=
ssandra host 10.80.10.129 removed<o:p></o:p></p>
<p class=3D"MsoNormal">2017-05-09 20:45:25,060 [DEBUG] cassandra.cluster: R=
emoving host 10.80.10.129<o:p></o:p></p>
<p class=3D"MsoNormal">2017-05-09 20:45:25,060 [DEBUG] cassandra.cluster: [=
control connection] Finished fetching ring info<o:p></o:p></p>
<p class=3D"MsoNormal">2017-05-09 20:45:25,060 [DEBUG] cassandra.cluster: [=
control connection] Rebuilding token map due to topology changes<o:p></o:p>=
</p>
<p class=3D"MsoNormal">2017-05-09 20:45:25,081 [DEBUG] cassandra.metadata: =
user functions table not found<o:p></o:p></p>
<p class=3D"MsoNormal">2017-05-09 20:45:25,081 [DEBUG] cassandra.metadata: =
user aggregates table not found<o:p></o:p></p>
<p class=3D"MsoNormal">2017-05-09 20:45:25,098 [DEBUG] cassandra.cluster: C=
ontrol connection created<o:p></o:p></p>
<p class=3D"MsoNormal">2017-05-09 20:45:25,099 [DEBUG] cassandra.pool: Init=
ializing connection for host 10.80.10.125<o:p></o:p></p>
<p class=3D"MsoNormal">2017-05-09 20:45:25,099 [DEBUG] cassandra.pool: Init=
ializing connection for host 10.80.10.126
<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p>
</div>
</body>
</html>

--_000_CO2PR00MB0198056B8ED6351DD9C8181E8BEF0CO2PR00MB0198namp_--