Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: unknown (athena.apache.org: error in processing during lookup of
 evgeniy.ryabitskiy@wikimart.ru)
MIME-Version: 1.0
Date: Mon, 5 Sep 2011 19:04:04 +0400
Message-ID: 
 <CAG+AvmtkZytatXVKrAVdof0NEiOSE+txP20JJQGT7JhfzQFMWA@mail.gmail.com>
Subject: UnavailableException while storing with EACH_QUORUM and RF=3
From: Evgeniy Ryabitskiy <evgeniy.ryabitskiy@wikimart.ru>
To: user@cassandra.apache.org
Content-Type: multipart/alternative; boundary=0016e6dd9787acd86304ac3305c1

--0016e6dd9787acd86304ac3305c1
Content-Type: text/plain; charset=ISO-8859-1

Hi,

I'am trying to store record with EACH_QUORUM consistency and RF=3. While
same thing with RF=2 is working.
Could some one tell me why EACH_QUORUM is working with RF=2 but not with RF
>=3

I have 7 nodes cluster. All nodes are UP.

Here is simple CLI script:

create keyspace kspace3
with placement_strategy =
'org.apache.cassandra.locator.NetworkTopologyStrategy'
and strategy_options = [{datacenter1:3}];

use kspace3;
create column family User with comparator = UTF8Type;

consistencylevel as LOCAL_QUORUM;
set User[1]['name'] = 'Smith';
consistencylevel as EACH_QUORUM;
set User[2]['name'] = 'Smith';
list User;


In result is only one record, EACH_QUORUM is failed:

[default@unknown] create keyspace kspace3
...    with placement_strategy =
'org.apache.cassandra.locator.NetworkTopologyStrategy'
...    and strategy_options = [{datacenter1:3}];
dd350870-d7ce-11e0-0000-5025568f27ff
Waiting for schema agreement...
... schemas agree across the cluster
[default@unknown]
[default@unknown] use kspace3;
Authenticated to keyspace: kspace3
[default@kspace3] create column family User with comparator = UTF8Type;
dd45f860-d7ce-11e0-0000-5025568f27ff
Waiting for schema agreement...
... schemas agree across the cluster
[default@kspace3]
[default@kspace3] consistencylevel as LOCAL_QUORUM;
Consistency level is set to 'LOCAL_QUORUM'.
[default@kspace3] set User[1]['name'] = 'Smith';
Value inserted.
[default@kspace3] consistencylevel as EACH_QUORUM;
Consistency level is set to 'EACH_QUORUM'.
[default@kspace3] set User[2]['name'] = 'Smith';
null
[default@kspace3] list User;
Using default limit of 100
-------------------
RowKey: 01
=> (column=name, value=536d697468, timestamp=1315234443834000)

1 Row Returned.


While same thing with RF=2 is working:

[default@kspace3] create keyspace kspace2
...    with placement_strategy =
'org.apache.cassandra.locator.NetworkTopologyStrategy'
...    and strategy_options = [{datacenter1:2}];
Keyspace already exists.
[default@kspace3]
[default@kspace3] use kspace2;
Authenticated to keyspace: kspace2
[default@kspace2] create column family User with comparator = UTF8Type;
User already exists in keyspace kspace2
[default@kspace2]
[default@kspace2] set User[1]['name'] = 'Smith';
Value inserted.
[default@kspace2] consistencylevel as EACH_QUORUM;
Consistency level is set to 'EACH_QUORUM'.
[default@kspace2] set User[2]['name'] = 'Smith';
Value inserted.
[default@kspace2] list User;
Using default limit of 100
-------------------
RowKey: 01
=> (column=name, value=536d697468, timestamp=1315234997189000)
-------------------
RowKey: 02
=> (column=name, value=536d697468, timestamp=1315234997198000)

2 Rows Returned.

--0016e6dd9787acd86304ac3305c1
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hi,<br><br>I&#39;am trying to store record with EACH_QUORUM consistency and=
 RF=3D3. While same thing with RF=3D2 is working.<br>Could some one tell me=
 why EACH_QUORUM is working with RF=3D2 but not with RF &gt;=3D3<br><br>I h=
ave 7 nodes cluster. All nodes are UP.<br>
<br>Here is simple CLI script:<br><br>create keyspace kspace3<br>with place=
ment_strategy =3D &#39;org.apache.cassandra.locator.NetworkTopologyStrategy=
&#39;<br>and strategy_options =3D [{datacenter1:3}];<br><br>use kspace3;<br=
>
create column family User with comparator =3D UTF8Type;<br><br>consistencyl=
evel as LOCAL_QUORUM;<br>set User[1][&#39;name&#39;] =3D &#39;Smith&#39;;<b=
r>consistencylevel as EACH_QUORUM;<br>set User[2][&#39;name&#39;] =3D &#39;=
Smith&#39;;<br>
list User;<br><br><br>In result is only one record, EACH_QUORUM is failed:<=
br><br>[default@unknown] create keyspace kspace3<br>...=A0=A0=A0 with place=
ment_strategy =3D &#39;org.apache.cassandra.locator.NetworkTopologyStrategy=
&#39;<br>
...=A0=A0=A0 and strategy_options =3D [{datacenter1:3}];<br>dd350870-d7ce-1=
1e0-0000-5025568f27ff<br>Waiting for schema agreement...<br>... schemas agr=
ee across the cluster<br>[default@unknown] <br>[default@unknown] use kspace=
3;<br>
Authenticated to keyspace: kspace3<br>[default@kspace3] create column famil=
y User with comparator =3D UTF8Type;<br>dd45f860-d7ce-11e0-0000-5025568f27f=
f<br>Waiting for schema agreement...<br>... schemas agree across the cluste=
r<br>
[default@kspace3] <br>[default@kspace3] consistencylevel as LOCAL_QUORUM;<b=
r>Consistency level is set to &#39;LOCAL_QUORUM&#39;.<br>[default@kspace3] =
set User[1][&#39;name&#39;] =3D &#39;Smith&#39;;<br>Value inserted.<br>[def=
ault@kspace3] consistencylevel as EACH_QUORUM;<br>
Consistency level is set to &#39;EACH_QUORUM&#39;.<br>[default@kspace3] set=
 User[2][&#39;name&#39;] =3D &#39;Smith&#39;;<br>null<br>[default@kspace3] =
list User;<br>Using default limit of 100<br>-------------------<br>RowKey: =
01<br>
=3D&gt; (column=3Dname, value=3D536d697468, timestamp=3D1315234443834000)<b=
r><br>1 Row Returned.<br><br><br>While same thing with RF=3D2 is working:<b=
r><br>[default@kspace3] create keyspace kspace2<br>...=A0=A0=A0 with placem=
ent_strategy =3D &#39;org.apache.cassandra.locator.NetworkTopologyStrategy&=
#39;<br>
...=A0=A0=A0 and strategy_options =3D [{datacenter1:2}];<br>Keyspace alread=
y exists.<br>[default@kspace3] <br>[default@kspace3] use kspace2;<br>Authen=
ticated to keyspace: kspace2<br>[default@kspace2] create column family User=
 with comparator =3D UTF8Type;<br>
User already exists in keyspace kspace2<br>[default@kspace2] <br>[default@k=
space2] set User[1][&#39;name&#39;] =3D &#39;Smith&#39;;<br>Value inserted.=
<br>[default@kspace2] consistencylevel as EACH_QUORUM;<br>Consistency level=
 is set to &#39;EACH_QUORUM&#39;.<br>
[default@kspace2] set User[2][&#39;name&#39;] =3D &#39;Smith&#39;;<br>Value=
 inserted.<br>[default@kspace2] list User;<br>Using default limit of 100<br=
>-------------------<br>RowKey: 01<br>=3D&gt; (column=3Dname, value=3D536d6=
97468, timestamp=3D1315234997189000)<br>
-------------------<br>RowKey: 02<br>=3D&gt; (column=3Dname, value=3D536d69=
7468, timestamp=3D1315234997198000)<br><br>2 Rows Returned.<br><br><br><br>=
<br><br>

--0016e6dd9787acd86304ac3305c1--