Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 45200 invoked from network); 6 Aug 2010 23:06:14 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 6 Aug 2010 23:06:14 -0000 Received: (qmail 99312 invoked by uid 500); 6 Aug 2010 23:06:13 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 99271 invoked by uid 500); 6 Aug 2010 23:06:12 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 99261 invoked by uid 99); 6 Aug 2010 23:06:12 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Aug 2010 23:06:12 +0000 X-ASF-Spam-Status: No, hits=0.7 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [66.152.34.247] (HELO plymouthsystems.com) (66.152.34.247) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Aug 2010 23:06:05 +0000 X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----_=_NextPart_001_01CB35BB.E53F8C70" Subject: RE: error using get_range_slice with random partitioner Date: Fri, 6 Aug 2010 19:05:43 -0400 Message-ID: X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: error using get_range_slice with random partitioner thread-index: Acs1uNlbMI0WkJUZTba9zE5O6gO4XwAAdrzx References: <0DA8807C8FFE459E88F34B3C58255E53@PSIINC.local><39CD52E67799437D9FEAB6EF2F716EF7@PSIINC.local><3198D9695A6F4E57A5492EFD66B0EA20@PSIINC.local><106D3BCC358D4642890104B9B0A70084@PSIINC.local> <3A17C5C400474E928DB0183A8C2F99BF@PSIINC.local> From: "Adam Crain" To: X-Virus-Checked: Checked by ClamAV on apache.org This is a multi-part message in MIME format. ------_=_NextPart_001_01CB35BB.E53F8C70 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable I took this approach... reject the first result of subsequent = get_range_slice requests. If you look back at output I posted (below) = you'll notice that not all of the 30 keys [key1...key30] get listed! The = iteration dies and can't proceed past key2. 1) 1st batch gets 10 unique keys. 2) 2nd batch only gets 9 unique keys with the 1st being a repeat 3) 3rd batch only get 2 unqiue keys "" That means the iteration didn't see 9 keys in the CF. Key7 and Key30 are = missing for example. [junit] Query w/ Range(,,10) result size: 10=20 [junit] key18=20 [junit] key23=20 [junit] key26=20 [junit] key27=20 [junit] key12=20 [junit] key28=20 [junit] key4=20 [junit] key3=20 [junit] key1=20 [junit] key24=20 [junit] Query w/ Range(key24,,10) result size: 10=20 [junit] key24=20 [junit] key5=20 [junit] key17=20 [junit] key29=20 [junit] key19=20 [junit] key8=20 [junit] key15=20 [junit] key22=20 [junit] key6=20 [junit] key25=20 [junit] Query w/ Range(key25,,10) result size: 3=20 [junit] key25=20 [junit] key14=20 [junit] key2=20 [junit] Query w/ Range(key2,,10), result size: 1=20 [junit] key2 -Adam -----Original Message----- From: scode@scode.org on behalf of Peter Schuller Sent: Fri 8/6/2010 6:43 PM To: user@cassandra.apache.org Subject: Re: error using get_range_slice with random partitioner =20 > I think this is actually the expected result, whenever you are using > range_slices with start_key/end_key you must increment the last key > you received and then use that in the next slice start_key. I also > tried to use token because of exactly that behaviour and the doc > talking about inclusive/exclusive. Another way to do it is to filter results to exclude columns received twice due to being on iteration end points. This is useful because it is not always possible to increment or decrement (depending on iteration order) a column name (for example, in the case of byte strings, because there is no defined maximum possible length so the lexicographically "previous" column name might be infinitely long). --=20 / Peter Schuller ------_=_NextPart_001_01CB35BB.E53F8C70 Content-Type: application/ms-tnef; name="winmail.dat" Content-Transfer-Encoding: base64 eJ8+IiwXAQaQCAAEAAAAAAABAAEAAQeQBgAIAAAA5AQAAAAAAADoAAEIgAcAGAAAAElQTS5NaWNy b3NvZnQgTWFpbC5Ob3RlADEIAQ2ABAACAAAAAgACAAEEgAEAOAAAAFJFOiBlcnJvciB1c2luZyBn ZXRfcmFuZ2Vfc2xpY2Ugd2l0aCByYW5kb20gcGFydGl0aW9uZXIA6hQBBYADAA4AAADaBwgABgAT AAUAKwAFADcBASCAAwAOAAAA2gcIAAYAEwAFACsABQA3AQEJgAEAIQAAADY5MzdFOUEzM0I3Nzcz NEM4MDZFMkY0MkFFQ0Y1M0UwADwHAQOQBgDYDgAAOQAAAAMAJgAAAAAAAwA2AAAAAABAADkAcIw/ 5bs1ywEeAD0AAQAAAAUAAABSRTogAAAAAAIBRwABAAAAMQAAAGM9VVM7YT0gO3A9UFNJSU5DO2w9 UFNJLVNSVjAxLTEwMDgwNjIzMDU0M1otNDE1OAAAAAAeAEkAAQAAADgAAABSZTogZXJyb3IgdXNp bmcgZ2V0X3JhbmdlX3NsaWNlIHdpdGggcmFuZG9tIHBhcnRpdGlvbmVyAEAATgAAMe/YuDXLAR4A WgABAAAAEAAAAHNjb2RlQHNjb2RlLm9yZwACAVsAAQAAAD0AAAAAAAAAgSsfpL6jEBmdbgDdAQ9U AgAAAABzY29kZUBzY29kZS5vcmcAU01UUABzY29kZUBzY29kZS5vcmcAAAAAAgFcAAEAAAAVAAAA U01UUDpTQ09ERUBTQ09ERS5PUkcAAAAAHgBdAAEAAAAPAAAAUGV0ZXIgU2NodWxsZXIAAAIBXgAB AAAASAAAAAAAAACBKx+kvqMQGZ1uAN0BD1QCAAAAAFBldGVyIFNjaHVsbGVyAFNNVFAAcGV0ZXIu c2NodWxsZXJAaW5maWR5bmUuY29tAAIBXwABAAAAIQAAAFNNVFA6UEVURVIuU0NIVUxMRVJASU5G SURZTkUuQ09NAAAAAB4AZgABAAAABQAAAFNNVFAAAAAAHgBnAAEAAAAQAAAAc2NvZGVAc2NvZGUu b3JnAB4AaAABAAAABQAAAFNNVFAAAAAAHgBpAAEAAAAcAAAAcGV0ZXIuc2NodWxsZXJAaW5maWR5 bmUuY29tAB4AcAABAAAANAAAAGVycm9yIHVzaW5nIGdldF9yYW5nZV9zbGljZSB3aXRoIHJhbmRv bSBwYXJ0aXRpb25lcgACAXEAAQAAABsAAAAByzW42VswjRaQlRlNtr3MTk7qA7hfAAB2vPEAHgB0 AAEAAAAaAAAAdXNlckBjYXNzYW5kcmEuYXBhY2hlLm9yZwAAAB4AGgwBAAAACwAAAEFkYW0gQ3Jh aW4AAB4AHQ4BAAAANAAAAGVycm9yIHVzaW5nIGdldF9yYW5nZV9zbGljZSB3aXRoIHJhbmRvbSBw YXJ0aXRpb25lcgACAQkQAQAAAFsFAABXBQAADgoAAExaRnVKztLGAwAKAHJjcGcxMjXiMgNDdGV4 BUEBAwH3/wqAAqQD5AcTAoAP8wBQBFY/CFUHshElDlEDAQIAY2jhCsBzZXQyBgAGwxEl9jMERhO3 MBIsETMI7wn3tjsYHw4wNREiDGBjAFAzCwkBZDM2FlALpiBJoCB0b29rHQBoBAAwIGFwcANgANBo LnUeMCAYIGoFkAVAHWBlOCBmaRQABUAYIHN1omwFQG9mIB+gYhQQJnEKUAIwIGcUIF9y4wBwINBf c2wN4B8AGCCrIHEfUHMeUEkgAHkIYLYgF7AdMWIA0B1AYR/RmHV0cCPAHOFwbx9QIQmAIChiZRew dymJIpInbAMgbm90IZJ/HWAjgSWhHaAlcR/xHuIzURZQa2V5BCBbJ4Ex9x4xJ4EnUF0gwiLQBAAk ceghIFQe8WkOsCEQJcBZAiAgZAiQHZFuJJBj/QBwJwVAHdEhoCSBCrAfUbkngTIuCqIKhAqAMSUQ djEfUSMwdBPQIMIEIDG9FlB1AwAgcSdzLGUyJRBOMirBLaQCIGx5LfQ5vS56IAPwHWAe0y1jZQuA ZmcdoB5hcGUjgCx0Mz0lEDMLIDANL8AucXFp+TF2IiIseimAI4EHgAYi+x7iKcpkKxIUEB8AMRAn g1MLgB7TQ0YeUEsnkDffKqM6gSdRCsAfAG0EATLipwIQBcAOwGFtC1BlLGtUW2ougXQooFEKUHIZ MKB3LwfwISIoLCyPLlAlEB+FAJB6ZTouQts9XCfiOEB/LEAzQb8sQP42Qv8sQDqwRE8OIEV/LED7 Qa8nkDRH/yhwSS8oAEpf/yxASR4+PUxzPy9AP0xfQRZ+NVGPKABFbywxMRBUDzH/VS8nkEfvJ/FS rywxRq8nkP9ELywxWN5Nv1xhTv9QAEpPf1xfQURRfywxXJ9dr17DLI9PTWKPLEAsei1BZDyQ62hb aiJPBRBnC4AHQAXQuQeQc2Eg0GojLHRGA2HXUAAE8ARxQGyDLgWwMwC3KjEkwBPgbCAAH/FQFCDd EoFTE9AfsDzAcix0BmAHAjBQAGwgaSA4LzZGLwHQLlE2OjRf8FAqTTbFb1AAdRQQckDvKvBrISrA IRAuHbAeAW0j7281IDAeklAAUk/xBJADYL8FwHHQMuIg3jHzIRFkA3C/K8EAICnAKiFvFmclPhzi 3R1wbh1FHYIesHUmoTCgfx7iDsAzYB6wJIEfhGYgd/se8HeQdhKBIqI7cnTzeDavIRkx1R9QdyFf J4EvCfD2ZH7iIpNtcdAFQAuABQD+ZQeAIKEe4gtgK/R4NiKi+xggIaBpe+AkkCqyHuEDoP9x0SYE OdV3kA7RIXR+lyJRaSaRc294NnQIgYMRb/+DdB0wg1EkwCrwg4If8Txx7x6wehMjgW2ydiogCHCC 5u8qUCtwhkcHQGsy4wbgI/HfgEEKQACQe+B/IHiMRSxrzkEloR7wBcB3YXohhzD/dtApsXlyhyEf IB/AEoEfhJ+Pg4zDAQAq4AbwdW0GMduCZix0dAPwIaFkLsGHIf8yxCoxKch/MSQxC4AiMTZs+3lU cdFmH7CH549EJmSOof8EICRBAJACYJNTgEgFsCx0+wWBgHUoAQAzYCrAk88FsH8EgSUQMyCRdCWQ PJAfACg9PDksLHQ51XIhiFNiee8OsH6BBRAhMHNmIIf2jlJ/KaGX8ipQARALgCSBAMB4/wdwkaAs dJjHPMAhMH5ihzD3gOMOwA3gbwnAHbAdcCrwnXoCIh3Qe9CJwXMinUv5O7BnaDOVJMA5waJxKcH3 MJEXsCEwKSxraiBnJT6gJ25fLKesTwp9rdAAHgA1EAEAAABAAAAAPENGQ0ExQjExN0E1QUYyNEY5 QjcwRDJCMkI2NUYyNkEwMDEyMUQzQHBzaS1zcnYwMS5QU0lJTkMubG9jYWw+AB4AORABAAAAZgIA ADxDRkNBMUIxMTdBNUFGMjRGOUI3MEQyQjJCNjVGMjZBMDAxMjFDMUBwc2ktc3J2MDEuUFNJSU5D LmxvY2FsPjwwREE4ODA3QzhGRkU0NTlFODhGMzRCM0M1ODI1NUU1M0BQU0lJTkMubG9jYWw+PENG Q0ExQjExN0E1QUYyNEY5QjcwRDJCMkI2NUYyNkEwMDEyMUM4QHBzaS1zcnYwMS5QU0lJTkMubG9j YWw+PDM5Q0Q1MkU2Nzc5OTQzN0Q5RkVBQjZFRjJGNzE2RUY3QFBTSUlOQy5sb2NhbD48Q0ZDQTFC MTE3QTVBRjI0RjlCNzBEMkIyQjY1RjI2QTAwMTIxQ0RAcHNpLXNydjAxLlBTSUlOQy5sb2NhbD48 MzE5OEQ5Njk1QTZGNEU1N0E1NDkyRUZENjZCMEVBMjBAUFNJSU5DLmxvY2FsPjxDRkNBMUIxMTdB NUFGMjRGOUI3MEQyQjJCNjVGMjZBMDAxMjFEMEBwc2ktc3J2MDEuUFNJSU5DLmxvY2FsPjwxMDZE M0JDQzM1OEQ0NjQyODkwMTA0QjlCMEE3MDA4NEBQU0lJTkMubG9jYWw+PENGQ0ExQjExN0E1QUYy NEY5QjcwRDJCMkI2NUYyNkEwMDEyMUQyQHBzaS1zcnYwMS5QU0lJTkMubG9jYWw+PEFBTkxrVGlr bmhjV2ZOLVoyUG05T0J1a2dxdGFGY3NreVJ4X1dmM1JYTzJvRkBtYWlsLmdtYWlsLmNvbT4gPDNB MTdDNUM0MDA0NzRFOTI4REIwMTgzQThDMkY5OUJGQFBTSUlOQy5sb2NhbD4AAAAeAEcQAQAAAA8A AABtZXNzYWdlL3JmYzgyMgAACwDyEAEAAAAfAPMQAQAAAHwAAABSAEUAJQAzAEEAIABlAHIAcgBv AHIAIAB1AHMAaQBuAGcAIABnAGUAdABfAHIAYQBuAGcAZQBfAHMAbABpAGMAZQAgAHcAaQB0AGgA IAByAGEAbgBkAG8AbQAgAHAAYQByAHQAaQB0AGkAbwBuAGUAcgAuAEUATQBMAAAACwD2EAAAAABA AAcwiGtNtLo1ywFAAAgwLXhL5bs1ywEDAN4/r28AAAMA8T8JBAAAHgD4PwEAAAALAAAAQWRhbSBD cmFpbgAAAgH5PwEAAABgAAAAAAAAANynQMjAQhAatLkIACsv4YIBAAAAAAAAAC9PPVBTSUlOQy9P VT1GSVJTVCBBRE1JTklTVFJBVElWRSBHUk9VUC9DTj1SRUNJUElFTlRTL0NOPUFEQU0uQ1JBSU4A HgD6PwEAAAAVAAAAU3lzdGVtIEFkbWluaXN0cmF0b3IAAAAAAgH7PwEAAAAeAAAAAAAAANynQMjA QhAatLkIACsv4YIBAAAAAAAAAC4AAAADAP0/5AQAAAMAGUAAAAAAAwAaQAAAAAADAB1AAAAAAAMA HkAAAAAAHgAwQAEAAAALAAAAQURBTS5DUkFJTgAAHgAxQAEAAAALAAAAQURBTS5DUkFJTgAAHgAy QAEAAAAQAAAAc2NvZGVAc2NvZGUub3JnAB4AM0ABAAAAHAAAAHBldGVyLnNjaHVsbGVyQGluZmlk eW5lLmNvbQAeADhAAQAAAAsAAABBREFNLkNSQUlOAAAeADlAAQAAAAIAAAAuAAAAAwB2QP////8L ACkAAAAAAAsAIwAAAAAAAwAGELart8EDAAcQAQYAAAMAEBAAAAAAAwAREAAAAAAeAAgQAQAAAGUA AABJVE9PS1RISVNBUFBST0FDSFJFSkVDVFRIRUZJUlNUUkVTVUxUT0ZTVUJTRVFVRU5UR0VUUkFO R0VTTElDRVJFUVVFU1RTSUZZT1VMT09LQkFDS0FUT1VUUFVUSVBPU1RFRChCAAAAAAIBfwABAAAA QAAAADxDRkNBMUIxMTdBNUFGMjRGOUI3MEQyQjJCNjVGMjZBMDAxMjFEM0Bwc2ktc3J2MDEuUFNJ SU5DLmxvY2FsPgCdFA== ------_=_NextPart_001_01CB35BB.E53F8C70--