From user-return-8274-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org Fri Aug 06 14:49:03 2010 Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 24266 invoked from network); 6 Aug 2010 14:49:02 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 6 Aug 2010 14:49:02 -0000 Received: (qmail 63959 invoked by uid 500); 6 Aug 2010 14:49:01 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 63770 invoked by uid 500); 6 Aug 2010 14:48:57 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 63762 invoked by uid 99); 6 Aug 2010 14:48:56 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Aug 2010 14:48:56 +0000 X-ASF-Spam-Status: No, hits=0.7 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [66.152.34.247] (HELO plymouthsystems.com) (66.152.34.247) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Aug 2010 14:48:49 +0000 X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----_=_NextPart_001_01CB3576.6D658161" Subject: RE: error using get_range_slice with random partitioner Date: Fri, 6 Aug 2010 10:45:20 -0400 Message-ID: X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: error using get_range_slice with random partitioner thread-index: Acs1WmWaE4R4HG9FQVSmafZxV6i+4wAG5jqZ References: <0DA8807C8FFE459E88F34B3C58255E53@PSIINC.local> From: "Adam Crain" To: X-Virus-Checked: Checked by ClamAV on apache.org This is a multi-part message in MIME format. ------_=_NextPart_001_01CB3576.6D658161 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Thomas, That was indeed the source of the problem. I naively assumed that the = token range would help me avoid retrieving duplicate rows. If you iterate over the keys, how do you avoid retrieving duplicate = keys? I tried this morning and I seem to get odd results. Maybe this is = just a consequence of the random partitioner. I really don't care about = the order of the iteration, but only each key once and that I see all = keys is important. -Adam -----Original Message----- From: th.heller@gmail.com on behalf of Thomas Heller Sent: Fri 8/6/2010 7:27 AM To: user@cassandra.apache.org Subject: Re: error using get_range_slice with random partitioner =20 Wild guess here, but are you using start_token/end_token here when you should be using start_key? Looks to me like you are trying end_token =3D ''. HTH, /thomas On Thursday, August 5, 2010, Adam Crain = wrote: > Hi, > > I'm on 0.6.4. Previous tickets in the JIRA in searching the web = indicated that iterating over the keys in keyspace is possible, even = with the random partitioner. This is mostly desirable in my case for = testing purposes only. > > I get the following error: > > [junit] Internal error processing get_range_slices > [junit] org.apache.thrift.TApplicationException: Internal error = processing get_range_slices > > and the following server traceback: > > java.lang.NumberFormatException: Zero length BigInteger > =A0=A0=A0=A0=A0=A0=A0 at = java.math.BigInteger.(BigInteger.java:295) > =A0=A0=A0=A0=A0=A0=A0 at = java.math.BigInteger.(BigInteger.java:467) > =A0=A0=A0=A0=A0=A0=A0 at = org.apache.cassandra.dht.RandomPartitioner$1.fromString(RandomPartitioner= .java:100) > =A0=A0=A0=A0=A0=A0=A0 at = org.apache.cassandra.thrift.CassandraServer.getRangeSlicesInternal(Cassan= draServer.java:575) > > I am using the scala cascal client, but am sure that get_range_slice = is being called with start and stop set to "". > > 1) Is batch iteration possible with random partioner? > > This isn't clear from the FAQ entry on the subject: > > http://wiki.apache.org/cassandra/FAQ#iter_world > > 2) The FAQ states that start argument should be "". What should the = end argument be? > > thanks! > Adam > > > > > > ------_=_NextPart_001_01CB3576.6D658161 Content-Type: application/ms-tnef; name="winmail.dat" Content-Transfer-Encoding: base64 eJ8+IhwOAQaQCAAEAAAAAAABAAEAAQeQBgAIAAAA5AQAAAAAAADoAAEIgAcAGAAAAElQTS5NaWNy b3NvZnQgTWFpbC5Ob3RlADEIAQ2ABAACAAAAAgACAAEEgAEAOAAAAFJFOiBlcnJvciB1c2luZyBn ZXRfcmFuZ2Vfc2xpY2Ugd2l0aCByYW5kb20gcGFydGl0aW9uZXIA6hQBBYADAA4AAADaBwgABgAK AC0AFAAFAD8BASCAAwAOAAAA2gcIAAYACgAwABoABQBIAQEJgAEAIQAAADQ2QTc2NTk5OEIwMzU0 NDk4MDQ0NkVDMEU0MjZCOUVCABMHAQOQBgB8DQAAOQAAAAMAJgAAAAAAAwA2AAAAAABAADkAiPSF /nU1ywEeAD0AAQAAAAUAAABSRTogAAAAAAIBRwABAAAAMQAAAGM9VVM7YT0gO3A9UFNJSU5DO2w9 UFNJLVNSVjAxLTEwMDgwNjE0NDgyNlotNDA2MwAAAAAeAEkAAQAAADgAAABSZTogZXJyb3IgdXNp bmcgZ2V0X3JhbmdlX3NsaWNlIHdpdGggcmFuZG9tIHBhcnRpdGlvbmVyAEAATgCAOx5lWjXLAR4A WgABAAAAFAAAAHRoLmhlbGxlckBnbWFpbC5jb20AAgFbAAEAAABFAAAAAAAAAIErH6S+oxAZnW4A 3QEPVAIAAAAAdGguaGVsbGVyQGdtYWlsLmNvbQBTTVRQAHRoLmhlbGxlckBnbWFpbC5jb20AAAAA AgFcAAEAAAAZAAAAU01UUDpUSC5IRUxMRVJAR01BSUwuQ09NAAAAAB4AXQABAAAADgAAAFRob21h cyBIZWxsZXIAAAACAV4AAQAAADwAAAAAAAAAgSsfpL6jEBmdbgDdAQ9UAgAAAABUaG9tYXMgSGVs bGVyAFNNVFAAaW5mb0B6aWxlbmNlLm5ldAACAV8AAQAAABYAAABTTVRQOklORk9AWklMRU5DRS5O RVQAAAAeAGYAAQAAAAUAAABTTVRQAAAAAB4AZwABAAAAFAAAAHRoLmhlbGxlckBnbWFpbC5jb20A HgBoAAEAAAAFAAAAU01UUAAAAAAeAGkAAQAAABEAAABpbmZvQHppbGVuY2UubmV0AAAAAB4AcAAB AAAANAAAAGVycm9yIHVzaW5nIGdldF9yYW5nZV9zbGljZSB3aXRoIHJhbmRvbSBwYXJ0aXRpb25l cgACAXEAAQAAABsAAAAByzVaZZoThHgcb0VBVKZp9nFXqL7jAAbmOpkAHgB0AAEAAAAaAAAAdXNl ckBjYXNzYW5kcmEuYXBhY2hlLm9yZwAAAB4AGgwBAAAACwAAAEFkYW0gQ3JhaW4AAB4AHQ4BAAAA NAAAAGVycm9yIHVzaW5nIGdldF9yYW5nZV9zbGljZSB3aXRoIHJhbmRvbSBwYXJ0aXRpb25lcgAC AQkQAQAAAAYGAAACBgAA9woAAExaRnUpJZZmAwAKAHJjcGcxMjXiMgNDdGV4BUEBAwH3TwqAAqQD 4wIAY2gKwHPwZXQwIAcTAoAP8wBQfwRWCFUHshHFDlEDARDHMvcGAAbDEcUzBEYQyRLbEdPbCO8J 9zsYvw4wNRHCDGDOYwBQCwkBZDM2EVALpsggVGgDcXMsCqIKhKsKgB2QYQVAdx3QIAuAAwEACYAg dGhlIHOlCGFjH+BvZh+zcANgAQJgZW0uIEkgbkELcHZlbHkgHdBzHnUHgB+iHuEfwnRva6kJ8CBy AHBnH+B3CGDGbB+gH9BscCAHgCIAWHZvaR+gGMB0CIF24QuAZyBkdQtQDeAe4KMf4ANgd3MuHgpJ IIC+eQhgH0AOsCOAJkFvIcD3BcAfwiNAeR3gJDAmgCXA3m8noyTPJdgpAj8hYSqS/x+iBAAkgAWw AwAloQBwH6DvIXARICEwIxEgI7AFQARwMypSIjBsdCagBdBheY5iIwEssizBanVzBUBMYSAFoACA ZXEKUG5fIEgjgSmgLgAKsXQn8Gl/AiAEkCFSGMAHQCHhKaBuvicFQCYgGMAiAAbgdSLEvwWwBIEg Zif0MrEpQGI0kf8CICHhM1AQ4CjyNrEgQS1yfyKTLbMiADNwKPMwAgdwcAsYYQBwdCa7LUFkYa5t Hgo6pTxyTwUQZwuA5wdABdAHkHNhI7A8cx4EakYDYTofsS4kQSEgcuxAZwDAAxAuBaAuAAIgdTZw ZRDwbCCAIHEdlCB+SD8THgQGYAIwPrA+cGmgIDgvNi8B0DERUFA3OjI3EWBNHmVvfz6wMFA/QSYg PXEfYCOALqZhCrAQ4GUuBbBnQbWYdWJqBZBCQVJlPrC/BJADYAXAMFAlki5RXyOD/F9zJgEjwSfw N0Ax70Gl2wrjCoBXAxAfoGcKUAQR/x/QGMA2ZDQiJ7JHdDBgMmHqXyMjLwnwZE2US7MfAO8f0AOg J7EeBHMdoCQCL5HnTOopASwATG8jMAQgLiG/JJEmACNAKcQ0MSqQeSWSQ04HHgQ9ICcnJrtIdFRI HfUvH8Adsh4KT1cDoB2QCHBzOyB5KUBB9nVLYDBhNSlAQvJYATshxxLAI4ALgCA8YTshP8BfWYI/ YAnSWsFFwHkFoXDdP8I+HwADYA6wOh4EW8CUSGkd9T5cRkknP/OgMC42LjQhUFAYwP8lgAhgUcEN 4CNALyAfQR+z8EpJUkFfwhEgCsAQ4OMlkh/Cd2ViH0ImEyJ1/zXVJaEoe1/CKQJFUTWxBCD7OcAE EGkhESlAJXAjUUjT/zGvMrUdkC/kBGAwYDOCB5DuaSOAIRFfwm0h8EShH+DvAhAooQeQYyNwCHBl QQeR/zbCJrVdWC5DH8ICEDNwJoBvU0NHIlw2XEZbMEADAHT+XSFgAjAEkT0hRxQg4SBA/2VhR68H kG7uRbFFNh/ABoExOiBUQXAl9DKxRXj/IEAFMDKxPrBv73D/cg1cRr839G1aRGEogyOAIEBiANB6 a25uaioQRSALYCOgLmZOIkAvkHJGBbAAwHR9dWlaBJApsCEgI6BI8UIfPOB2EiOwQaVbwFwnYf8B QIDPgVQiAAVAfMN98T7gmX+YLjwLgCfwPiiDWeN8wkNQOTUpgD+Gj4Jf44NvhH40NjeFr4v/h8VT c4lEqGRoOiBSZtNQ0TJoJDEuA1JTKpEjoO4oj0+FFEMQMIsvk6+NT7uOWXQ1Q0S2BmEogS4uUduR MSOwU3IzdhYoly6FI/w1N4WXbFhZQUd0H8MmIP8LYGninREwoCYAQiFMBS4A/yIwUuIe0kfeLMEv kCWSnRG/ISAfoEjTTUMtYzBgbyRwkxEhLhIiImveMSkhYH+gcR7gNzE112U3SM8ysz9/XP1oBTPT ISAKwQNSH7NG/EFRU3FTEUACH8NGVVz9QY8QdHA6Ly8D8GuqaUU5L0SnL6oRIyfy2l8j4HIkEFz9 MqRAHZD/qfRNQWqBIoShtUXAIkECMOcf8E/noxEgV7GjT+Qfwl9OAbI4L5CnfiKRblGwIX9cRjsY XVa4T7lfun8eVX0BvGAAAB4ANRABAAAAQAAAADxDRkNBMUIxMTdBNUFGMjRGOUI3MEQyQjJCNjVG MjZBMDAxMjFDOEBwc2ktc3J2MDEuUFNJSU5DLmxvY2FsPgAeADkQAQAAAHAAAAA8Q0ZDQTFCMTE3 QTVBRjI0RjlCNzBEMkIyQjY1RjI2QTAwMTIxQzFAcHNpLXNydjAxLlBTSUlOQy5sb2NhbD4gPDBE QTg4MDdDOEZGRTQ1OUU4OEYzNEIzQzU4MjU1RTUzQFBTSUlOQy5sb2NhbD4AHgBHEAEAAAAPAAAA bWVzc2FnZS9yZmM4MjIAAAsA8hABAAAAHwDzEAEAAAB8AAAAUgBFACUAMwBBACAAZQByAHIAbwBy ACAAdQBzAGkAbgBnACAAZwBlAHQAXwByAGEAbgBnAGUAXwBzAGwAaQBjAGUAIAB3AGkAdABoACAA cgBhAG4AZABvAG0AIABwAGEAcgB0AGkAdABpAG8AbgBlAHIALgBFAE0ATAAAAAsA9hAAAAAAQAAH MIj0hf51NcsBQAAIMB5tcW12NcsBAwDeP69vAAADAPE/CQQAAB4A+D8BAAAACwAAAEFkYW0gQ3Jh aW4AAAIB+T8BAAAAYAAAAAAAAADcp0DIwEIQGrS5CAArL+GCAQAAAAAAAAAvTz1QU0lJTkMvT1U9 RklSU1QgQURNSU5JU1RSQVRJVkUgR1JPVVAvQ049UkVDSVBJRU5UUy9DTj1BREFNLkNSQUlOAB4A +j8BAAAAFQAAAFN5c3RlbSBBZG1pbmlzdHJhdG9yAAAAAAIB+z8BAAAAHgAAAAAAAADcp0DIwEIQ GrS5CAArL+GCAQAAAAAAAAAuAAAAAwD9P+QEAAADABlAAAAAAAMAGkAAAAAAAwAdQAAAAAADAB5A AAAAAB4AMEABAAAACwAAAEFEQU0uQ1JBSU4AAB4AMUABAAAACwAAAEFEQU0uQ1JBSU4AAB4AMkAB AAAAFAAAAHRoLmhlbGxlckBnbWFpbC5jb20AHgAzQAEAAAARAAAAaW5mb0B6aWxlbmNlLm5ldAAA AAAeADhAAQAAAAsAAABBREFNLkNSQUlOAAAeADlAAQAAAAIAAAAuAAAAAwB2QP////8LACkAAAAA AAsAIwAAAAAAAwAGEB3FxGkDAAcQswYAAAMAEBAAAAAAAwAREAYAAAAeAAgQAQAAAGUAAABUSE9N QVMsVEhBVFdBU0lOREVFRFRIRVNPVVJDRU9GVEhFUFJPQkxFTUlOQUlWRUxZQVNTVU1FRFRIQVRU SEVUT0tFTlJBTkdFV09VTERIRUxQTUVBVk9JRFJFVFJJRVZJTkdEAAAAAAIBfwABAAAAQAAAADxD RkNBMUIxMTdBNUFGMjRGOUI3MEQyQjJCNjVGMjZBMDAxMjFDOEBwc2ktc3J2MDEuUFNJSU5DLmxv Y2FsPgBGwA== ------_=_NextPart_001_01CB3576.6D658161--