Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (nike.apache.org: domain of hodgson_sam@hotmail.com
 designates 157.55.2.37 as permitted sender)
Message-ID: <DUB116-W431A28094C1A9DD8D890CF99A10@phx.gbl>
Content-Type: multipart/alternative;
	boundary="_b20af193-c90f-429e-ab30-24c9efcd9728_"
From: Sam Hodgson <hodgson_sam@hotmail.com>
To: "user@cassandra.apache.org" <user@cassandra.apache.org>
Subject: RE: Added column does not sort as the last column at
Date: Tue, 14 May 2013 10:33:48 +0000
Importance: Normal
In-Reply-To: <DD6409FE-171D-4155-90DE-ECDE07FE3EF6@thelastpickle.com>
References: 
 <DUB116-W50A77967A0001297B33DCA99C60@phx.gbl>,<DD6409FE-171D-4155-90DE-ECDE07FE3EF6@thelastpickle.com>
MIME-Version: 1.0

--_b20af193-c90f-429e-ab30-24c9efcd9728_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

Thanks for this Aaron - I eventually found some data corruption in the keys=
 of the affected CF's which i think was causing the issue.

> Subject: Re: Added column does not sort as the last column at
> From: aaron@thelastpickle.com
> Date: Thu=2C 11 Apr 2013 22:08:17 +1200
> To: user@cassandra.apache.org
>=20
> To reduce possibilities=2C have you changed a super CF to a standard CF r=
ecently ?=20
>=20
> Can you isolate this to specific CF ?=20
>=20
> Have you changed the comparators / schema recently ?=20
>=20
> Cheers
>=20
> -----------------
> Aaron Morton
> Freelance Cassandra Consultant
> New Zealand
>=20
> @aaronmorton
> http://www.thelastpickle.com
>=20
> On 10/04/2013=2C at 1:26 AM=2C Sam Hodgson <hodgson_sam@hotmail.com> wrot=
e:
>=20
> > Hi All=2C
> >=20
> >=20
> >=20
> > I just upgraded from Cassandra 1.1.7 to 1.2.3 and im now seeing a lot o=
f the following error in my output.log=2C cant find much on the web about i=
t:
> >=20
> >=20
> >=20
> > ERROR 11:56:01=2C317 Exception in thread Thread[ReadStage:7236=2C5=2Cma=
in] java.lang.AssertionError: Added column does not sort as the last column=
 at org.apache.cassandra.db.ArrayBackedSortedColumns.addColumn(ArrayBackedS=
ortedColumns.java:131) at org.apache.cassandra.db.AbstractColumnContainer.a=
ddColumn(AbstractColumnContainer.java:109) at org.apache.cassandra.db.Abstr=
actColumnContainer.addColumn(AbstractColumnContainer.java:104) at org.apach=
e.cassandra.db.filter.SliceQueryFilter.collectReducedColumns(SliceQueryFilt=
er.java:171) at org.apache.cassandra.db.filter.QueryFilter.collateColumns(Q=
ueryFilter.java:136) at org.apache.cassandra.db.filter.QueryFilter.collateO=
nDiskAtom(QueryFilter.java:84) at org.apache.cassandra.db.CollationControll=
er.collectAllData(CollationController.java:294) at org.apache.cassandra.db.=
CollationController.getTopLevelColumns(CollationController.java:65) at org.=
apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.=
java:1363) at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(Col=
umnFamilyStore.java:1220) at org.apache.cassandra.db.ColumnFamilyStore.getC=
olumnFamily(ColumnFamilyStore.java:1132) at org.apache.cassandra.db.Table.g=
etRow(Table.java:348) at org.apache.cassandra.db.SliceFromReadCommand.getRo=
w(SliceFromReadCommand.java:70) at org.apache.cassandra.service.StorageProx=
y$LocalReadRunnable.runMayThrow(StorageProxy.java:1052) at org.apache.cassa=
ndra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:1578) at =
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.j=
ava:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolEx=
ecutor.java:908) at java.lang.Thread.run(Thread.java:662)
> >=20
> >=20
> >=20
> > I dont know Java and im struggling to identify exactly which query is c=
ausing this=2C is there a way to trace this back to a specific query?
> >=20
> >=20
> >=20
> > Any help appreciated.
> >=20
> >=20
> >=20
> > Sam
> >=20
>=20
 		 	   		  =

--_b20af193-c90f-429e-ab30-24c9efcd9728_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<html>
<head>
<style><!--
.hmmessage P
{
margin:0px=3B
padding:0px
}
body.hmmessage
{
font-size: 12pt=3B
font-family:Calibri
}
--></style></head>
<body class=3D'hmmessage'><div dir=3D'ltr'>Thanks for this Aaron - I eventu=
ally found some data corruption in the keys of the affected CF's which i th=
ink was causing the issue.<br><br><div>&gt=3B Subject: Re: Added column doe=
s not sort as the last column at<br>&gt=3B From: aaron@thelastpickle.com<br=
>&gt=3B Date: Thu=2C 11 Apr 2013 22:08:17 +1200<br>&gt=3B To: user@cassandr=
a.apache.org<br>&gt=3B <br>&gt=3B To reduce possibilities=2C have you chang=
ed a super CF to a standard CF recently ? <br>&gt=3B <br>&gt=3B Can you iso=
late this to specific CF ? <br>&gt=3B <br>&gt=3B Have you changed the compa=
rators / schema recently ? <br>&gt=3B <br>&gt=3B Cheers<br>&gt=3B <br>&gt=
=3B -----------------<br>&gt=3B Aaron Morton<br>&gt=3B Freelance Cassandra =
Consultant<br>&gt=3B New Zealand<br>&gt=3B <br>&gt=3B @aaronmorton<br>&gt=
=3B http://www.thelastpickle.com<br>&gt=3B <br>&gt=3B On 10/04/2013=2C at 1=
:26 AM=2C Sam Hodgson &lt=3Bhodgson_sam@hotmail.com&gt=3B wrote:<br>&gt=3B =
<br>&gt=3B &gt=3B Hi All=2C<br>&gt=3B &gt=3B <br>&gt=3B &gt=3B <br>&gt=3B &=
gt=3B <br>&gt=3B &gt=3B I just upgraded from Cassandra 1.1.7 to 1.2.3 and i=
m now seeing a lot of the following error in my output.log=2C cant find muc=
h on the web about it:<br>&gt=3B &gt=3B <br>&gt=3B &gt=3B <br>&gt=3B &gt=3B=
 <br>&gt=3B &gt=3B ERROR 11:56:01=2C317 Exception in thread Thread[ReadStag=
e:7236=2C5=2Cmain] java.lang.AssertionError: Added column does not sort as =
the last column at org.apache.cassandra.db.ArrayBackedSortedColumns.addColu=
mn(ArrayBackedSortedColumns.java:131) at org.apache.cassandra.db.AbstractCo=
lumnContainer.addColumn(AbstractColumnContainer.java:109) at org.apache.cas=
sandra.db.AbstractColumnContainer.addColumn(AbstractColumnContainer.java:10=
4) at org.apache.cassandra.db.filter.SliceQueryFilter.collectReducedColumns=
(SliceQueryFilter.java:171) at org.apache.cassandra.db.filter.QueryFilter.c=
ollateColumns(QueryFilter.java:136) at org.apache.cassandra.db.filter.Query=
Filter.collateOnDiskAtom(QueryFilter.java:84) at org.apache.cassandra.db.Co=
llationController.collectAllData(CollationController.java:294) at org.apach=
e.cassandra.db.CollationController.getTopLevelColumns(CollationController.j=
ava:65) at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(Col=
umnFamilyStore.java:1363) at org.apache.cassandra.db.ColumnFamilyStore.getC=
olumnFamily(ColumnFamilyStore.java:1220) at org.apache.cassandra.db.ColumnF=
amilyStore.getColumnFamily(ColumnFamilyStore.java:1132) at org.apache.cassa=
ndra.db.Table.getRow(Table.java:348) at org.apache.cassandra.db.SliceFromRe=
adCommand.getRow(SliceFromReadCommand.java:70) at org.apache.cassandra.serv=
ice.StorageProxy$LocalReadRunnable.runMayThrow(StorageProxy.java:1052) at o=
rg.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy=
.java:1578) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Threa=
dPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.r=
un(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662)<br=
>&gt=3B &gt=3B <br>&gt=3B &gt=3B <br>&gt=3B &gt=3B <br>&gt=3B &gt=3B I dont=
 know Java and im struggling to identify exactly which query is causing thi=
s=2C is there a way to trace this back to a specific query?<br>&gt=3B &gt=
=3B <br>&gt=3B &gt=3B <br>&gt=3B &gt=3B <br>&gt=3B &gt=3B Any help apprecia=
ted.<br>&gt=3B &gt=3B <br>&gt=3B &gt=3B <br>&gt=3B &gt=3B <br>&gt=3B &gt=3B=
 Sam<br>&gt=3B &gt=3B <br>&gt=3B <br></div> 		 	   		  </div></body>
</html>=

--_b20af193-c90f-429e-ab30-24c9efcd9728_--