Return-Path: Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: (qmail 64966 invoked from network); 18 Jun 2009 22:08:44 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 18 Jun 2009 22:08:44 -0000 Received: (qmail 60516 invoked by uid 500); 18 Jun 2009 22:08:55 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 60447 invoked by uid 500); 18 Jun 2009 22:08:54 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 60427 invoked by uid 99); 18 Jun 2009 22:08:53 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Jun 2009 22:08:53 +0000 X-ASF-Spam-Status: No, hits=1.5 required=10.0 tests=SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [69.41.234.56] (HELO shell.lasthome.net) (69.41.234.56) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Jun 2009 22:08:42 +0000 Received: from [192.168.0.189] (fw.baysidebusinessplaza.com [208.83.107.2]) by shell.lasthome.net (Postfix) with ESMTP id 4D13415F304 for ; Thu, 18 Jun 2009 22:08:20 +0000 (UTC) Message-Id: <5FBCB21A-1F46-421F-A9A3-373AAA1FB8C2@nondifferentiable.com> From: Jim Puls To: user@couchdb.apache.org In-Reply-To: Content-Type: multipart/signed; boundary=Apple-Mail-7-767727574; micalg=sha1; protocol="application/pkcs7-signature" Mime-Version: 1.0 (Apple Message framework v935.3) Subject: Re: Why is CouchDB frequently re-indexing my views from scratch? Date: Thu, 18 Jun 2009 15:08:19 -0700 References: <821F740F-D464-4E58-8389-E5E1DE04B61C@nondifferentiable.com> <658687EA-616F-48E1-98D7-ED6C739354C7@apache.org> <8ffb00ae0906181142o7c69a56ci51b916f0f361afbf@mail.gmail.com> <58390CE1-B26F-41BD-B9C4-F9B96924ECBB@apache.org> <94DF0F05-5B90-464B-A7BB-0A10EBAF577D@nondifferentiable.com> <0D99DCB7-C0EA-4403-AB7D-0E7D6CB8E88C@apache.org> <152AFD03-DDAB-47C2-B88C-93DE6F82B28D@nondifferentiable.com> <191ED30F-2B78-438A-8A44-9C5DC7CD8B11@nondifferentiable.com> X-Mailer: Apple Mail (2.935.3) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail-7-767727574 Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit I couldn't figure out how to file a bug (seriously!) but here's how I'm testing it. I have a short Ruby file "test_reindexing.rb": require 'rubygems' require 'couchrest' class SomeModel < CouchRest::ExtendedDocument use_database CouchRest.database!('http://localhost:5984/testing') def self.load 20000.times do |i| some_model = new some_model.type = 'foo' some_model.save end end property :type view_by :bar, :map => %q{ function (event) { if (event.type === 'quux' && event.bar) { emit(event.bar, null); } } } end where I can first populate the database: ruby -r test_reindexing -e SomeModel.load and then I can have it query a view and see the indexing every time: ruby -r test_reindexing -e SomeModel.by_bar To verify that there are no changes other than the revision number and ordering of the views, I take the the MD5 hash of the sorted list of characters in the view record: ruby -r test_reindexing -e SomeModel.by_bar && curl http://localhost:5984/testing/_design/SomeModel 2>/dev/null | ruby -ne '$_.sub! /"_rev":"[^"]+",/, "";puts $_.split(//).sort.join("")' | openssl md5 -> jp On Jun 18, 2009, at 2:20 PM, Damien Katz wrote: > Hmm, that's a bug in CouchDB IMO. Can you write a bug with a failing > test for that? > > -Damien > > On Jun 18, 2009, at 5:07 PM, Jim Puls wrote: > >> On Jun 18, 2009, at 1:10 PM, Damien Katz wrote: >> >>> Also, do the order of the views change? >> >> Indeed, I see when I do a raw HTTP GET of the design document that >> CouchRest is changing the order of the views. Futon, of course - >> actually my browser parsing the JSON data - was nice enough to >> alphabetize them for me, completely obscuring the problem. >> >> -> jp >> --Apple-Mail-7-767727574 Content-Disposition: attachment; filename=smime.p7s Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIGQjCCAvsw ggJkoAMCAQICEGMt0bO9I33fQAsT8craPPQwDQYJKoZIhvcNAQEFBQAwYjELMAkGA1UEBhMCWkEx JTAjBgNVBAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMTI1RoYXd0ZSBQ ZXJzb25hbCBGcmVlbWFpbCBJc3N1aW5nIENBMB4XDTA5MDMwMzE5MzM1MVoXDTEwMDMwMzE5MzM1 MVowWjENMAsGA1UEBBMEUHVsczEMMAoGA1UEKhMDSmltMREwDwYDVQQDEwhKaW0gUHVsczEoMCYG CSqGSIb3DQEJARYZamltQG5vbmRpZmZlcmVudGlhYmxlLmNvbTCCASIwDQYJKoZIhvcNAQEBBQAD ggEPADCCAQoCggEBALo+cVQkmaMx5lJD2/pm7Fd3Jf7NlRh7JVp1MeeuCNjzSKLzzTQJzaJB5eYZ ts2m4EM0Y/htwjT6RQkffemvYyrzsm6Ee2V+p8X4LOH7r4+jPbhrasLwcQLjqQS6CMGMiJiOqZOc R+O/RFYQN9kmIvl6iuBGPIJwAyNi3vLyP0MS6LalRE3BUNLNZ5VGJ53xs2DRkv/eLZdpMCvsopki g9jyEnPCB8zdOP+B6rHMT6bBK2CfZveRcnb4NrRtW6Wbhm2cUdVMe3h9/2SPr7AcQCyvUyocOIgk R7H51+gFmXuZuaV4nAze+zxG5YeZbHjPNRms1fA//7KfEq2VfXvQ0WECAwEAAaM2MDQwJAYDVR0R BB0wG4EZamltQG5vbmRpZmZlcmVudGlhYmxlLmNvbTAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEB BQUAA4GBAMSC3gwxMrH1AjhPVoan+k5XNiaZbhRtGR3LG+bFT0uNEyEP0aJ5nMUcWIH21ymi1DjV RL2CUBolhc3bBYEetWcY54Kqz0pHU7FjBMAWjQFLrv+QRHwgntFkpq2SVGcnGgViqm43b97hc3uf TPMx1ktXMrc7Pe/yXb23drG0SCbcMIIDPzCCAqigAwIBAgIBDTANBgkqhkiG9w0BAQUFADCB0TEL MAkGA1UEBhMCWkExFTATBgNVBAgTDFdlc3Rlcm4gQ2FwZTESMBAGA1UEBxMJQ2FwZSBUb3duMRow GAYDVQQKExFUaGF3dGUgQ29uc3VsdGluZzEoMCYGA1UECxMfQ2VydGlmaWNhdGlvbiBTZXJ2aWNl cyBEaXZpc2lvbjEkMCIGA1UEAxMbVGhhd3RlIFBlcnNvbmFsIEZyZWVtYWlsIENBMSswKQYJKoZI hvcNAQkBFhxwZXJzb25hbC1mcmVlbWFpbEB0aGF3dGUuY29tMB4XDTAzMDcxNzAwMDAwMFoXDTEz MDcxNjIzNTk1OVowYjELMAkGA1UEBhMCWkExJTAjBgNVBAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQ dHkpIEx0ZC4xLDAqBgNVBAMTI1RoYXd0ZSBQZXJzb25hbCBGcmVlbWFpbCBJc3N1aW5nIENBMIGf MA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQDEpjxVc1X7TrnKmVoeaMB1BHCd3+n/ox7svc31W/Ia dr1/DDph8r9RzgHU5VAKMNcCY1osiRVwjt3J8CuFWqo/cVbLrzwLB+fxH5E2JCoTzyvV84J3PQO+ K/67GD4Hv0CAAmTXp6a7n2XRxSpUhQ9IBH+nttE8YQRAHmQZcmC3+wIDAQABo4GUMIGRMBIGA1Ud EwEB/wQIMAYBAf8CAQAwQwYDVR0fBDwwOjA4oDagNIYyaHR0cDovL2NybC50aGF3dGUuY29tL1Ro YXd0ZVBlcnNvbmFsRnJlZW1haWxDQS5jcmwwCwYDVR0PBAQDAgEGMCkGA1UdEQQiMCCkHjAcMRow GAYDVQQDExFQcml2YXRlTGFiZWwyLTEzODANBgkqhkiG9w0BAQUFAAOBgQBIjNFQg+oLLswNo2as Zw9/r6y+whehQ5aUnX9MIbj4Nh+qLZ82L8D0HFAgk3A8/a3hYWLD2ToZfoSxmRsAxRoLgnSeJVCU YsfbJ3FXJY3dqZw5jowgT2Vfldr394fWxghOrvbqNOUQGls1TXfjViF4gtwhGTXeJLHTHUb/XV9l TzGCAxAwggMMAgEBMHYwYjELMAkGA1UEBhMCWkExJTAjBgNVBAoTHFRoYXd0ZSBDb25zdWx0aW5n IChQdHkpIEx0ZC4xLDAqBgNVBAMTI1RoYXd0ZSBQZXJzb25hbCBGcmVlbWFpbCBJc3N1aW5nIENB AhBjLdGzvSN930ALE/HK2jz0MAkGBSsOAwIaBQCgggFvMBgGCSqGSIb3DQEJAzELBgkqhkiG9w0B BwEwHAYJKoZIhvcNAQkFMQ8XDTA5MDYxODIyMDgyMFowIwYJKoZIhvcNAQkEMRYEFJuKwZnoRKbT eAjtd8f3Z9QlS9/KMIGFBgkrBgEEAYI3EAQxeDB2MGIxCzAJBgNVBAYTAlpBMSUwIwYDVQQKExxU aGF3dGUgQ29uc3VsdGluZyAoUHR5KSBMdGQuMSwwKgYDVQQDEyNUaGF3dGUgUGVyc29uYWwgRnJl ZW1haWwgSXNzdWluZyBDQQIQYy3Rs70jfd9ACxPxyto89DCBhwYLKoZIhvcNAQkQAgsxeKB2MGIx CzAJBgNVBAYTAlpBMSUwIwYDVQQKExxUaGF3dGUgQ29uc3VsdGluZyAoUHR5KSBMdGQuMSwwKgYD VQQDEyNUaGF3dGUgUGVyc29uYWwgRnJlZW1haWwgSXNzdWluZyBDQQIQYy3Rs70jfd9ACxPxyto8 9DANBgkqhkiG9w0BAQEFAASCAQAeUGTCjP2Y07Fj+rVq32w+HayRo8x72CbJZlY+xMdAGTJGXIAb 5G6twqe4Sn6nXp9+0K7a3rdQXKItAN0hFJ3s6hl8nEllN/dmEwQJqeY8yh+htYarxJAfFMnjbJWj utQKOfIEQiaoLhB111o/kgZSMdnXLyepvaqUyAw3okStdtru1r4Jm5RA4z3+5PR80Uh20nNiErUE Bs6gUAc4dauerpMVI+LxgQkUu8qW5vNBAWe4CtphYNAUgDztdJSLtmjaxcx6AVW0Oirjx81XHGoV P6Ew8I6T8AtL4h+XKflv47SC9jzD1Mmb1gV6IKBJfwaFtucbOEWPS/7KcTFQ8mo9AAAAAAAA --Apple-Mail-7-767727574--