Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 546557375 for ; Tue, 9 Aug 2011 15:34:41 +0000 (UTC) Received: (qmail 62680 invoked by uid 500); 9 Aug 2011 15:34:38 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 62592 invoked by uid 500); 9 Aug 2011 15:34:38 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 62584 invoked by uid 99); 9 Aug 2011 15:34:37 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Aug 2011 15:34:37 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [216.32.181.183] (HELO ch1outboundpool.messaging.microsoft.com) (216.32.181.183) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Aug 2011 15:34:29 +0000 Received: from mail146-ch1-R.bigfish.com (216.32.181.172) by CH1EHSOBE018.bigfish.com (10.43.70.68) with Microsoft SMTP Server id 14.1.225.22; Tue, 9 Aug 2011 15:34:07 +0000 Received: from mail146-ch1 (localhost.localdomain [127.0.0.1]) by mail146-ch1-R.bigfish.com (Postfix) with ESMTP id 19649CF82F4 for ; Tue, 9 Aug 2011 15:34:07 +0000 (UTC) X-SpamScore: -16 X-BigFish: VS-16(zzc89bh936eK62a3Kbf2Rc85dhzz1202hzz8275bh8275dhz2dh87h2a8h668h839h8aah61h) X-Spam-TCS-SCL: 0:0 X-Forefront-Antispam-Report: CIP:213.199.187.153;KIP:(null);UIP:(null);IPVD:NLI;SRV:BULK;H:IE2RD2HUB022.red002.local;RD:none;EFVD:NLI X-FB-DOMAIN-IP-MATCH: fail Received: from mail146-ch1 (localhost.localdomain [127.0.0.1]) by mail146-ch1 (MessageSwitch) id 1312904046591995_20324; Tue, 9 Aug 2011 15:34:06 +0000 (UTC) Received: from CH1EHSMHS017.bigfish.com (snatpool1.int.messaging.microsoft.com [10.43.68.242]) by mail146-ch1.bigfish.com (Postfix) with ESMTP id 8927478004C for ; Tue, 9 Aug 2011 15:34:06 +0000 (UTC) Received: from IE2RD2HUB022.red002.local (213.199.187.153) by CH1EHSMHS017.bigfish.com (10.43.70.17) with Microsoft SMTP Server (TLS) id 14.1.225.22; Tue, 9 Aug 2011 15:34:05 +0000 Received: from IE2RD2XVS531.red002.local ([10.43.203.70]) by IE2RD2HUB022.red002.local ([10.43.198.100]) with mapi; Tue, 9 Aug 2011 08:33:39 -0700 From: Roland Gude To: "user@cassandra.apache.org" Date: Tue, 9 Aug 2011 08:33:51 -0700 Subject: IndexSliceQuery issue - ReadStage piling up (looks like deadlock/infinite loop or similar) Thread-Topic: IndexSliceQuery issue - ReadStage piling up (looks like deadlock/infinite loop or similar) Thread-Index: AcxWqb2XCXVUyOBPSwq0p/l/M031/g== Message-ID: <7506C99D83A0A54F8127A4931F6CF0B006C63F456E@IE2RD2XVS531.red002.local> Accept-Language: de-DE, en-US Content-Language: de-DE X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: de-DE, en-US Content-Type: multipart/alternative; boundary="_000_7506C99D83A0A54F8127A4931F6CF0B006C63F456EIE2RD2XVS531r_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_7506C99D83A0A54F8127A4931F6CF0B006C63F456EIE2RD2XVS531r_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Hi, I experience issues when doing a indexslicequery with multiple expressions = if one of the expressions is about a non index column I did the equivalent of this example (but with my data) from http://www.datastax.com/dev/blog/whats-new-cassandra-07-secondary-indexes Secondary indexes automate this. Let's add some state data: [default@demo] set users[bsanderson][state] =3D 'UT'; [default@demo] set users[prothfuss][state] =3D 'WI'; [default@demo] set users[htayler][state] =3D 'UT'; Note that even though state is not indexed yet, we can include the new stat= e data in a query as long as another column in the query is indexed: [default@demo] get users where state =3D 'UT'; No indexed columns present in index clause with operator EQ [default@demo] get users where state =3D 'UT' and birth_date > 1970; No indexed columns present in index clause with operator EQ [default@demo]get users where birth_date =3D 1968 and state =3D 'UT'; ------------------- RowKey: htayler =3D> (column=3Dbirth_date, value=3D1968, timestamp=3D1291334765649000) =3D> (column=3Dfull_name, value=3DHoward Tayler, timestamp=3D12913347491600= 00) =3D> (column=3Dstate, value=3D5554, timestamp=3D1291334890708000) On On 0.7.8 (with CASSANDRA-2964 applied) This example will not return any data, but return "0 rows". I repeated the = query multiple times with different variations for the values which should = all have returned data, but eventually I ended up with the cluster having 8= 0000 reads pending on some of the nodes On 0.7.5 the query will result in a NullPointerException being thrown and "= null" returned in the cli ERROR [ReadStage:258] 2011-08-09 16:03:27,153 AbstractCassandraDaemon.java = (line 113) Fatal exception in thread Thread[ReadStage:258,5,main] java.lang.RuntimeException: java.lang.NullPointerException at org.apache.cassandra.service.IndexScanVerbHandler.doVerb(IndexSc= anVerbHandler.java:51) at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDelivery= Task.java:72) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoo= lExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:908) at java.lang.Thread.run(Thread.java:619) Caused by: java.lang.NullPointerException at org.apache.cassandra.db.ColumnFamily.addAll(ColumnFamily.java:13= 1) at org.apache.cassandra.db.ColumnFamilyStore.scan(ColumnFamilyStore= .java:1615) at org.apache.cassandra.service.IndexScanVerbHandler.doVerb(IndexSc= anVerbHandler.java:42) ... 4 more ERROR [ReadStage:258] 2011-08-09 16:03:27,153 AbstractCassandraDaemon.java = (line 113) Fatal exception in thread Thread[ReadStage:258,5,main] java.lang.RuntimeException: java.lang.NullPointerException at org.apache.cassandra.service.IndexScanVerbHandler.doVerb(IndexSc= anVerbHandler.java:51) at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDelivery= Task.java:72) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoo= lExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:908) at java.lang.Thread.run(Thread.java:619) Caused by: java.lang.NullPointerException at org.apache.cassandra.db.ColumnFamily.addAll(ColumnFamily.java:13= 1) at org.apache.cassandra.db.ColumnFamilyStore.scan(ColumnFamilyStore= .java:1615) at org.apache.cassandra.service.IndexScanVerbHandler.doVerb(IndexSc= anVerbHandler.java:42) ... 4 more Can anybody reproduce this? Greetings, Roland -- YOOCHOOSE GmbH Roland Gude Software Engineer Im Mediapark 8, 50670 K=F6ln +49 221 4544151 (Tel) +49 221 4544159 (Fax) +49 171 7894057 (Mobil) Email: roland.gude@yoochoose.com WWW: www.yoochoose.com YOOCHOOSE GmbH Gesch=E4ftsf=FChrer: Dr. Uwe Alkemper, Michael Friedmann Handelsregister: Amtsgericht K=F6ln HRB 65275 Ust-Ident-Nr: DE 264 773 520 Sitz der Gesellschaft: K=F6ln --_000_7506C99D83A0A54F8127A4931F6CF0B006C63F456EIE2RD2XVS531r_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable

Hi,

&nbs= p;

I experience iss= ues when doing a indexslicequery with multiple expressions if one of the ex= pressions is about a non index column

 

I did the equivalent of this example (but with my data) fr= om

= http://www.datastax.com/dev/blog/whats-new-cassandra-07-secondary-indexes

 

= Secondary indexes automate this. LetR= 17;s add some state data:

[default@demo] set users[bsanderson][state] =3D = 'UT';
[defaul= t@demo] set users[prothfuss][state] =3D 'WI';
[default@demo] set users[htayler][state] =3D 'UT';

Note that even though state is not indexed yet,= we can include the new state data in a query as long as another column in = the query is indexed:

= [default@demo] get users where state =3D 'UT';
No indexed columns= present in index clause with operator EQ
[default@demo] get users where st= ate =3D 'UT' and birth_date > 1970;
No indexed columns present in index clause with o= perator EQ
[def= ault@demo]get users where birth_date =3D 1968 and state =3D 'UT';
---------------= ----
RowKey: = htayler
=3D>= (column=3Dbirth_date, value=3D1968, timestamp=3D1291334765649000)
=3D> (column=3Dfull= _name, value=3DHoward Tayler, timestamp=3D1291334749160000)
=3D> (column=3Dstate, value= =3D5554, timestamp=3D1291334890708000)

<= o:p> 

On On 0.= 7.8 (with CASSANDRA-2964 applied)

This example will not return any data, but return ̶= 0;0 rows”. I repeated the query multiple times with different variati= ons for the values which should all have returned data, but eventually I en= ded up with the cluster having 80000 reads pending on some of the nodes

 =

On 0.7.5 the query will = result in a NullPointerException being thrown and “null” return= ed in the cli

=  

ERROR [= ReadStage:258] 2011-08-09 16:03:27,153 AbstractCassandraDaemon.java (line 1= 13) Fatal exception in thread Thread[ReadStage:258,5,main]

java.lang.RuntimeException: ja= va.lang.NullPointerException

=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.service.IndexS= canVerbHandler.doVerb(IndexScanVerbHandler.java:51)

=A0=A0=A0=A0=A0=A0=A0 at org.apache.c= assandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:72)

=A0=A0=A0=A0=A0=A0=A0 a= t java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor= .java:886)

=A0= =A0=A0=A0=A0=A0=A0 at java.util.concurrent.ThreadPoolExecutor$Worker.run(Th= readPoolExecutor.java:908)

=A0=A0=A0=A0=A0=A0=A0 at java.lang.Thread.run(Thread.java:619)=

Caused by: ja= va.lang.NullPointerException

=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.ColumnFamil= y.addAll(ColumnFamily.java:131)

<= span lang=3DEN-US>=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.ColumnFa= milyStore.scan(ColumnFamilyStore.java:1615)

=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassand= ra.service.IndexScanVerbHandler.doVerb(IndexScanVerbHandler.java:42)

=A0=A0=A0=A0=A0=A0= =A0 ... 4 more

ERROR [ReadStage:258] 2011-08-09 16:03:27,153 AbstractCassandraDaemon.java= (line 113) Fatal exception in thread Thread[ReadStage:258,5,main]

java.lang.RuntimeExcep= tion: java.lang.NullPointerException

=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.servic= e.IndexScanVerbHandler.doVerb(IndexScanVerbHandler.java:51)

=A0=A0=A0=A0=A0=A0=A0 at org.= apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:72)

=A0=A0=A0=A0=A0= =A0=A0 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPool= Executor.java:886)

=A0=A0=A0=A0=A0=A0=A0 at java.util.concurrent.ThreadPoolExecutor$Worke= r.run(ThreadPoolExecutor.java:908)

=A0=A0=A0=A0=A0=A0=A0 at java.lang.Thread.run(Thread.j= ava:619)

Cause= d by: java.lang.NullPointerException

=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.Col= umnFamily.addAll(ColumnFamily.java:131)

=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.= ColumnFamilyStore.scan(ColumnFamilyStore.java:1615)

=A0=A0=A0=A0=A0=A0=A0 at org.apache.c= assandra.service.IndexScanVerbHandler.doVerb(IndexScanVerbHandler.java:42)<= o:p>

=A0=A0=A0=A0= =A0=A0=A0 ... 4 more

 

 

=  

Can anybody = reproduce this?

 

Greet= ings,

Roland

 

--

YOOCHOOSE GmbH

 

= Roland Gude

Soft= ware Engineer

 

Im Mediapark 8, 50670 K= =F6ln

 

+49 221 4544151 (Tel)

+49 221 4544159 (Fax)

+49 171 7894057 (Mobil)

 

 = ;

Email: roland.gude@yoochoos= e.com

WWW: www.yoochoos= e.com

 

YOOCHOO= SE GmbH

Gesch=E4ftsf=FChrer: = Dr. Uwe Alkemper, Michael Friedmann

Handelsregister: Amtsgericht K=F6ln HRB 65275

<= p class=3DMsoNormal>Ust-Ident-Nr: DE 264 773 520

<= p class=3DMsoNormal>Sitz der Gesellschaft: K=F6ln

=

 

= --_000_7506C99D83A0A54F8127A4931F6CF0B006C63F456EIE2RD2XVS531r_--