Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (nike.apache.org: domain of mike@mailchannels.com
 designates 74.125.82.172 as permitted sender)
MIME-Version: 1.0
From: Mike Smith <mike@mailchannels.com>
Date: Tue, 1 Nov 2011 17:06:36 -0700
Message-ID: 
 <CAKFOuZFPsRAv=eBN_zSGGnMgyU6HvnZS7o4WeUwn0p7=b_DQ8g@mail.gmail.com>
Subject: Problem SliceByNamesReadCommand on super column family after flush
 operation
To: user@cassandra.apache.org
Content-Type: multipart/alternative; boundary=0016e65a09e41141d504b0b540bd

--0016e65a09e41141d504b0b540bd
Content-Type: text/plain; charset=ISO-8859-1

Hi,

I'm having a problem with doing a multiget_slice on a super column family
after its first flush. Updates to the column values work properly, but
trying to retrieve the updated values using a multiget_slice operation fail
to get the updated values. Instead they return the values from before the
flush. I've seen this problem in Cassandra v1.0.0 and v1.0.1. The problem
is not present in Cassandra v0.7.6.

Steps to reproduce:

   1. Create one or more super column entries
   2. Verify the sub column values can be updated and that you can retrieve
   the new values
   3. Use nodetool to flush the column family or restart cassandra
   4. Update the sub column values
   5. Verify they have been updated using cassandra-cli
   6. Verify you *DO NOT* get the updated values when doing a
   multiget_slice; instead you get the old values from before the flush

You can get the most recent value by doing a flush followed by a major
compaction. However, future updates are not retrieved properly either.

With debug turned on, it looks like the multiget_slice query uses the
following command/consistency level:
SliceByNamesReadCommand(table='test_cassandra', key=666f6f,
columnParent='QueryPath(columnFamilyName='test', superColumnName='null',
columnName='null')', columns=[foo,])/QUORUM.

Cassandra-cli uses the following command/consistency level for a get_slice:
SliceFromReadCommand(table='test_cassandra', key='666f6f',
column_parent='QueryPath(columnFamilyName='test', superColumnName='null',
columnName='null')', start='', finish='', reversed=false,
count=1000000)/QUORUM

Notice the test program gets 'bar2' for the column values and cassandra-cli
gets 'bar3' for the column values:

tcpdump from test program using hector-core:1.0-1

16:46:07.424562 IP iam.47158 > iam.9160: Flags [P.], seq 55:138, ack 30,
win 257, options [nop,nop,TS val 27474096 ecr 27474095], length 83
E....#@.@.PK.........6#.....].8......{.....
..8...8.........multiget_slice................foo..........test................foo.........
16:46:07.424575 IP iam.9160 > iam.47158: Flags [.], ack 138, win 256,
options [nop,nop,TS val 27474096 ecr 27474096], length 0
E..4..@.@.<.........#..6].8..........(.....
..8...8.
16:46:07.428771 IP iam.9160 > iam.47158: Flags [P.], seq 30:173, ack 138,
win 256, options [nop,nop,TS val 27474097 ecr 27474096], length 143
@.@.<&........#..6].8................
............foo...............foo...............foo1.......bar2
........6h........foo2.......bar2
........I.....


tcpdump of cassandra-cli:

16:30:55.945123 IP iam.47134 > iam.9160: Flags [P.], seq 370:479, ack 5310,
win 387, options [nop,nop,TS val 27246226 ecr 27241207], length 109
E.....@.@.9q..........#..n.X\
.............
................get_range_slices..............test.........................................................d.........
16:30:55.945152 IP iam.9160 > iam.47134: Flags [.], ack 479, win 256,
options [nop,nop,TS val 27246226 ecr 27246226], length 0
E..4..@.@.".........#...\
...n.......(.....
........
16:30:55.949245 IP iam.9160 > iam.47134: Flags [P.], seq 5310:5461, ack
479, win 256, options [nop,nop,TS val 27246227 ecr 27246226], length 151
E.....@.@."V........#...\
...n.............
....................get_range_slices...................foo..................foo...............foo1.......bar3
........&.........foo2.......bar3
........: .....

--0016e65a09e41141d504b0b540bd
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hi,<div><br></div><div>I&#39;m having a problem with doing a multiget_slice=
 on a super column family after its first flush. Updates to the column valu=
es work properly, but trying to retrieve the updated values using a multige=
t_slice operation fail to get the updated values. Instead they return the v=
alues from before the flush. I&#39;ve seen this problem in Cassandra v1.0.0=
 and v1.0.1. The problem is not present in Cassandra v0.7.6.</div>

<div><div><div><br></div><div>Steps to reproduce:</div><ol><li>Create one o=
r more super column entries</li><li>Verify the sub column values can be upd=
ated and that you can retrieve the new values</li><li>Use nodetool to flush=
 the column family or restart cassandra</li>

<li>Update the sub column values</li><li>Verify they have been updated usin=
g cassandra-cli</li><li>Verify you <b>DO NOT</b> get the updated values whe=
n doing a multiget_slice; instead you get the old values from before the fl=
ush</li>

</ol><div>You can get the most recent value by doing a flush followed by a =
major compaction. However, future updates are not retrieved properly either=
.=A0</div><div><br></div><div>With debug turned on, it looks like the multi=
get_slice query uses the following command/consistency level:</div>

<div>SliceByNamesReadCommand(table=3D&#39;test_cassandra&#39;, key=3D666f6f=
, columnParent=3D&#39;QueryPath(columnFamilyName=3D&#39;test&#39;, superCol=
umnName=3D&#39;null&#39;, columnName=3D&#39;null&#39;)&#39;, columns=3D[foo=
,])/QUORUM.</div>

</div><div><br></div><div>Cassandra-cli uses the following command/consiste=
ncy level for a get_slice:</div><div>SliceFromReadCommand(table=3D&#39;test=
_cassandra&#39;, key=3D&#39;666f6f&#39;, column_parent=3D&#39;QueryPath(col=
umnFamilyName=3D&#39;test&#39;, superColumnName=3D&#39;null&#39;, columnNam=
e=3D&#39;null&#39;)&#39;, start=3D&#39;&#39;, finish=3D&#39;&#39;, reversed=
=3Dfalse, count=3D1000000)/QUORUM</div>

<div><br></div><div>Notice the test program gets &#39;bar2&#39; for the col=
umn values and cassandra-cli gets &#39;bar3&#39; for the column values:</di=
v><div><br></div><div>tcpdump from test program using hector-core:1.0-1</di=
v>

<div><br></div><div><div>16:46:07.424562 IP iam.47158 &gt; iam.9160: Flags =
[P.], seq 55:138, ack 30, win 257, options [nop,nop,TS val 27474096 ecr 274=
74095], length 83</div><div>E....#@.@.PK.........6#.....].8......{.....</di=
v>

<div>..8...8.........multiget_slice................foo..........test.......=
.........foo.........</div><div>16:46:07.424575 IP iam.9160 &gt; iam.47158:=
 Flags [.], ack 138, win 256, options [nop,nop,TS val 27474096 ecr 27474096=
], length 0</div>

<div>E..4..@.@.&lt;.........#..6].8..........(.....</div><div>..8...8.</div=
><div>16:46:07.428771 IP iam.9160 &gt; iam.47158: Flags [P.], seq 30:173, a=
ck 138, win 256, options [nop,nop,TS val 27474097 ecr 27474096], length 143=
</div>

<div>@.@.&lt;&amp;........#..6].8................</div><div>............foo=
...............foo...............foo1.......bar2</div><div>........6h......=
..foo2.......bar2</div><div>........I.....</div></div><div><br></div><div>

<br></div><div>tcpdump of cassandra-cli:</div><div><br></div><div><div>16:3=
0:55.945123 IP iam.47134 &gt; iam.9160: Flags [P.], seq 370:479, ack 5310, =
win 387, options [nop,nop,TS val 27246226 ecr 27241207], length 109</div>

<div>E.....@.@.9q..........#..n.X\</div><div>.............</div><div>......=
..........get_range_slices..............test...............................=
..........................d.........</div><div>16:30:55.945152 IP iam.9160 =
&gt; iam.47134: Flags [.], ack 479, win 256, options [nop,nop,TS val 272462=
26 ecr 27246226], length 0</div>

<div>E..4..@.@.&quot;.........#...\</div><div>...n.......(.....</div><div>.=
.......</div><div>16:30:55.949245 IP iam.9160 &gt; iam.47134: Flags [P.], s=
eq 5310:5461, ack 479, win 256, options [nop,nop,TS val 27246227 ecr 272462=
26], length 151</div>

<div>E.....@.@.&quot;V........#...\</div><div>...n.............</div><div>.=
...................get_range_slices...................foo..................=
foo...............foo1.......bar3</div><div>........&amp;.........foo2.....=
..bar3</div>

<div>........: .....</div><div><br></div><div><br></div></div></div>

--0016e65a09e41141d504b0b540bd--