Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 39EB2E940 for ; Mon, 18 Mar 2013 22:03:24 +0000 (UTC) Received: (qmail 23827 invoked by uid 500); 18 Mar 2013 22:03:20 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 23791 invoked by uid 500); 18 Mar 2013 22:03:20 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 23735 invoked by uid 99); 18 Mar 2013 22:03:20 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 18 Mar 2013 22:03:20 +0000 X-ASF-Spam-Status: No, hits=0.7 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.192.174] (HELO mail-pd0-f174.google.com) (209.85.192.174) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 18 Mar 2013 22:03:14 +0000 Received: by mail-pd0-f174.google.com with SMTP id 10so947685pdi.5 for ; Mon, 18 Mar 2013 15:02:53 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=x-received:from:mime-version:content-type:subject:date:in-reply-to :to:references:message-id:x-mailer:x-gm-message-state; bh=gGnX8fYgjJKrQPoq2sIrNVwra5GwZjEbndzL/wfG1Tc=; b=I79Ue6G8UUu2J3YupyKPLyturzNgAbKxcOOXX698cz6Y5xDnrGkQ8q3ktd+ZTiqYMH loNN5fn3udiUhWGT5Nb5bUpgKTq+S2ZOd31cAMNu4c71S1/yE/rlWwZlCvxDf9FJDYSF vKcozV2LuHiAJIKFAhmCKF5xHS+xr+/faf1pzA5IRsE5RFh8dMnaMBUq2nB1rNaSonY4 j1boOBATGcQa1SxP49+f4xfbLfy5ADmCWN8/5X+fs4+BljeEwyOIcnkoqUaId19oOI2Q ey/1Fz1/EpL5Dgyc2JJlx0pNktXC4Pd8SOdW3cBinhAuMUqSXBziToODIUJBlA8lXgsu 0gyg== X-Received: by 10.68.129.135 with SMTP id nw7mr35352194pbb.58.1363644173262; Mon, 18 Mar 2013 15:02:53 -0700 (PDT) Received: from btinling.home (50-46-132-91.evrt.wa.frontiernet.net. [50.46.132.91]) by mx.google.com with ESMTPS id 1sm21520670pba.32.2013.03.18.15.02.50 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 18 Mar 2013 15:02:51 -0700 (PDT) From: Brett Tinling Mime-Version: 1.0 (Apple Message framework v1283) Content-Type: multipart/signed; boundary="Apple-Mail=_88B42F59-8B9D-4FC2-96BA-3886163A2A42"; protocol="application/pkcs7-signature"; micalg=sha1 Subject: Re: secondary index problem Date: Mon, 18 Mar 2013 15:02:49 -0700 In-Reply-To: <21F63D46-175E-4378-A230-B1672C320B6D@thelastpickle.com> To: user@cassandra.apache.org References: <1413F397-F190-4F84-B445-824654B28E90@ecyrd.com> <21F63D46-175E-4378-A230-B1672C320B6D@thelastpickle.com> Message-Id: X-Mailer: Apple Mail (2.1283) X-Gm-Message-State: ALoCoQm703JOTwbdCEHoALUpLtDvxKI+4k0Y48T4fYcqC/NnRZ8fLVBPuQul8SqABPCrAPuuGPbH X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_88B42F59-8B9D-4FC2-96BA-3886163A2A42 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Aaron, No recipe yet. It pops up randomly and, i think due to the nature of = our app, goes away. Seems like when we have updates that are large (10k rows in one mutate) = the problem is more likely to occur. I'll try to workout a repro... -Brett On Mar 18, 2013, at 10:18 AM, aaron morton wrote: > Brett,=20 > Do you have some steps to reproduce the problem ? If so please = create a ticket on jira.=20 >=20 > Cheers >=20 > ----------------- > Aaron Morton > Freelance Cassandra Consultant > New Zealand >=20 > @aaronmorton > http://www.thelastpickle.com >=20 > On 16/03/2013, at 11:40 AM, Janne Jalkanen = wrote: >=20 >>=20 >> This could be either of the following bugs (which might be the same = thing). I get it too every time I recycle a node on 1.1.10. >>=20 >> https://issues.apache.org/jira/browse/CASSANDRA-4973 >> or >> https://issues.apache.org/jira/browse/CASSANDRA-4785 >>=20 >> /Janne >>=20 >> On Mar 15, 2013, at 23:24 , Brett Tinling = wrote: >>=20 >>> We have a CF with an indexed column 'type', but we get incomplete = results when we query that CF for all rows matching 'type'. We can find = the missing rows if we query by key. >>>=20 >>> * we are seeing this on a small, single node, 1.2.2 instance with = few rows. >>> * we use thrift execute_cql_query, no CL is specified >>> * none of repair, restart, compact, scrub helped >>>=20 >>> Finally, nodetool rebuild_index fixed it. =20 >>>=20 >>> Is index rebuild something we need to do periodically? How often? = Is there a way to know when it needs to be done? Do we have to run = rebuild on all nodes? >>>=20 >>> We have not noticed this until 1.2 >>>=20 >>> Regards, >>> - Brett >>>=20 >>>=20 >>>=20 >>>=20 >>>=20 >>>=20 >>=20 >=20 --Apple-Mail=_88B42F59-8B9D-4FC2-96BA-3886163A2A42 Content-Disposition: attachment; filename=smime.p7s Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIDyzCCA8cw ggKvoAMCAQICAQEwCwYJKoZIhvcNAQELMHsxFjAUBgNVBAMMDUJyZXR0IFRpbmxpbmcxHDAaBgNV BAoME0xhY3VuYSBTeXN0ZW1zIEluYy4xCzAJBgNVBAgMAldBMQswCQYDVQQGEwJVUzEpMCcGCSqG SIb3DQEJARYaYnRpbmxpbmdAbGFjdW5hc3lzdGVtcy5jb20wHhcNMTIwNDE4MDA0NzM4WhcNMjIw NDE2MDA0NzM4WjB7MRYwFAYDVQQDDA1CcmV0dCBUaW5saW5nMRwwGgYDVQQKDBNMYWN1bmEgU3lz dGVtcyBJbmMuMQswCQYDVQQIDAJXQTELMAkGA1UEBhMCVVMxKTAnBgkqhkiG9w0BCQEWGmJ0aW5s aW5nQGxhY3VuYXN5c3RlbXMuY29tMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAzGmK Zb2mneqHxPGmT21mrYRItMtFCPavjlQABrSJnlPr9s7vJODGLk5+ajblRMinjnWDlrme+4IQFP4c lsXw7W4NuJEdVpeomwjIgn2NjriA/2pD4YUP2mY9GmVTuFBj9OK+oMuzT07JIpoEg0Lv0L3M7e5X yIKQ79zLRM6QJxNYuTkixa8Evc+Rb3vpE8zJgElQ7SFGhTT5CALVRhOvsBBr9ocW4Mt5z/R+y56a yicDm+mPZnVpkB0p1VXfJs2xUyiPdgPchntVS4c95AdO+BAvtrSd8jaXIjmlNgjvq4lz8rA/4MK+ +zy+CEY+D8EQ+Q52Eukx7/bJwqF4WadivwIDAQABo1gwVjAPBgNVHQ8BAf8EBQMDB/+AMBwGA1Ud JQEB/wQSMBAGCCsGAQUFBwMEBgRVHSUAMCUGA1UdEQQeMByBGmJ0aW5saW5nQGxhY3VuYXN5c3Rl bXMuY29tMA0GCSqGSIb3DQEBCwUAA4IBAQAL9KAB7TJz3dN8UN251BoPpWUkmCaFY7H2y+X6xTWt ORIIUtIpyubotOukoOeysxKcPBP8PUHFPmehQkI6tvxFLiDEOhq+xw4fF0s/9KqMkMTN2g4EQCCf 66QkAALJ7aiz2sKRbwkgJ6pm3I1xH3BHGVCQfUyQ9zThsEZ49AFZ8OwUe/+fxkkiUqNhAqgS9iKI NNb5h2OXOwbqf2KyOIexuh+3TxlZcghpFBSw/ofY7qWI7buHNbFJCstnll94FWkE9lehQMLzDjAD +BcB+SZyI6hjd5Qz+T/XNiP7RLFZpsvfrv2cBIAJm7A2SX1UM4njK+n/FFoUs0ddGQAPYT6NMYID MzCCAy8CAQEwgYAwezEWMBQGA1UEAwwNQnJldHQgVGlubGluZzEcMBoGA1UECgwTTGFjdW5hIFN5 c3RlbXMgSW5jLjELMAkGA1UECAwCV0ExCzAJBgNVBAYTAlVTMSkwJwYJKoZIhvcNAQkBFhpidGlu bGluZ0BsYWN1bmFzeXN0ZW1zLmNvbQIBATAJBgUrDgMCGgUAoIIBhzAYBgkqhkiG9w0BCQMxCwYJ KoZIhvcNAQcBMBwGCSqGSIb3DQEJBTEPFw0xMzAzMTgyMjAyNTBaMCMGCSqGSIb3DQEJBDEWBBTY 1w7prAO1f6yy7lGxQt1amG038DCBkQYJKwYBBAGCNxAEMYGDMIGAMHsxFjAUBgNVBAMMDUJyZXR0 IFRpbmxpbmcxHDAaBgNVBAoME0xhY3VuYSBTeXN0ZW1zIEluYy4xCzAJBgNVBAgMAldBMQswCQYD VQQGEwJVUzEpMCcGCSqGSIb3DQEJARYaYnRpbmxpbmdAbGFjdW5hc3lzdGVtcy5jb20CAQEwgZMG CyqGSIb3DQEJEAILMYGDoIGAMHsxFjAUBgNVBAMMDUJyZXR0IFRpbmxpbmcxHDAaBgNVBAoME0xh Y3VuYSBTeXN0ZW1zIEluYy4xCzAJBgNVBAgMAldBMQswCQYDVQQGEwJVUzEpMCcGCSqGSIb3DQEJ ARYaYnRpbmxpbmdAbGFjdW5hc3lzdGVtcy5jb20CAQEwDQYJKoZIhvcNAQEBBQAEggEAruAxgc4D ChJ/bD7wrXiowF0vXMvQkwWAji5yt1HZCea7ZyltxoagQJGSPvWOrnMZ2Jxget3Aev0u5F20P6/R /ahYuX4v2F6JZZ3sQ3z+siWmPpHrYn/r//U3/b5SeAxX4Avd+hDKzMWYCmoNsYhTLSgq3S5ykzvr eP6GIG9HzQS3HJKK2PxSQFrTn8vmooiDNmwVsUzjw/E5wvJMBspb1m9hCQzWvgBCO1I2y0rxAkPa 89s7PMTQI4WmzbOdBugPX0zBkFbGtRivc3oxsUVgbfe8xzDr4/E4QtfQ2AMzzIFGWacSBrAifErm 0IrAFx+KTFZnZPkkK+RCaPKMayhEZgAAAAAAAA== --Apple-Mail=_88B42F59-8B9D-4FC2-96BA-3886163A2A42--