Return-Path: Delivered-To: apmail-incubator-couchdb-user-archive@locus.apache.org Received: (qmail 20912 invoked from network); 12 Jun 2008 00:52:04 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 12 Jun 2008 00:52:04 -0000 Received: (qmail 87118 invoked by uid 500); 12 Jun 2008 00:52:06 -0000 Delivered-To: apmail-incubator-couchdb-user-archive@incubator.apache.org Received: (qmail 87092 invoked by uid 500); 12 Jun 2008 00:52:06 -0000 Mailing-List: contact couchdb-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: couchdb-user@incubator.apache.org Delivered-To: mailing list couchdb-user@incubator.apache.org Received: (qmail 87080 invoked by uid 99); 12 Jun 2008 00:52:06 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Jun 2008 17:52:06 -0700 X-ASF-Spam-Status: No, hits=2.4 required=10.0 tests=FS_REPLICA,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [209.85.198.240] (HELO rv-out-0708.google.com) (209.85.198.240) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 Jun 2008 00:51:16 +0000 Received: by rv-out-0708.google.com with SMTP id k29so3666306rvb.0 for ; Wed, 11 Jun 2008 17:51:33 -0700 (PDT) Received: by 10.141.141.3 with SMTP id t3mr431269rvn.213.1213231893188; Wed, 11 Jun 2008 17:51:33 -0700 (PDT) Received: from Sita.home.wirestorm.net ( [210.1.193.129]) by mx.google.com with ESMTPS id f42sm689386rvb.5.2008.06.11.17.51.28 (version=TLSv1/SSLv3 cipher=RC4-MD5); Wed, 11 Jun 2008 17:51:32 -0700 (PDT) Message-Id: <87D5FA5A-35B9-4FD3-BC4A-017175D018A2@wirestorm.net> From: Ray Hilton To: couchdb-user@incubator.apache.org Content-Type: multipart/signed; boundary=Apple-Mail-77-848967217; micalg=sha1; protocol="application/pkcs7-signature" Mime-Version: 1.0 (Apple Message framework v924) Subject: Partial replication? Date: Thu, 12 Jun 2008 10:51:24 +1000 X-Mailer: Apple Mail (2.924) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail-77-848967217 Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit CouchDB sounds like the holy grail for Large storage... but what happens if you hit the disk limit of a single machine? Is there a way to host parts of the index on different machines (in a redundant and fault tolerant manner)? I was thinking of writing my own that would partition by date and then inspect the query to see which indices to include, and send a MapReduce task to whichever machines had a copy of the relevant indices. Is this something that may be possible with CouchDB? Ray --Apple-Mail-77-848967217 Content-Disposition: attachment; filename=smime.p7s Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIGIzCCAtww ggJFoAMCAQICEAg3KB6oiZkzSaPukS0ujWUwDQYJKoZIhvcNAQEFBQAwYjELMAkGA1UEBhMCWkEx JTAjBgNVBAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMTI1RoYXd0ZSBQ ZXJzb25hbCBGcmVlbWFpbCBJc3N1aW5nIENBMB4XDTA4MDMxMzAwMjA1OFoXDTA5MDMxMzAwMjA1 OFowQzEfMB0GA1UEAxMWVGhhd3RlIEZyZWVtYWlsIE1lbWJlcjEgMB4GCSqGSIb3DQEJARYRcmF5 QHdpcmVzdG9ybS5uZXQwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDf0J4rryCnjLoM M09r9NPLWjPYKgvUD9T0LNzgcwuMociaSDzhT4/ZXyhlJpUkdXwDzwDi3oCeCU0dRWJEZzMruzev jAyU25v70+hQ5/yHKPbGJXEb0tlQ0Km3ooFVWf1KM/T/8Pw9pWJVLSuOGZm/cvw24wZ+hl7ZC27R 7fEhuJGpz9PoCwdNe3pcOOZ6mjGQdQp6yKb8+NnNiBMfuxy/fbYhvLe3nhyKvzXfXih7keQxkcFn jgVznk6+DWzjPbYeRhi0atmfxzgPWMWsGoSf9/VqDYwC9Z3btc2sFjJaZT5nDsUZJHvVDWUheY0w 8C/nSjxS4c5DDzIceURwWoNXAgMBAAGjLjAsMBwGA1UdEQQVMBOBEXJheUB3aXJlc3Rvcm0ubmV0 MAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQEFBQADgYEAlep7VDQCdicETGyQdkndDVgkgI8TGPrK zSfmztjqxdB/v6J5VtLAJz7DE8Rwcb39julNanQi8D18Gq6Q3fsTypyzMWbBLNvj3zI9LZOEp9jE dN6XuDIJNoA49M+zg54GsAlQvljcT11tnoX/PykMCUxHNLOScNd75QRZmsYjVd8wggM/MIICqKAD AgECAgENMA0GCSqGSIb3DQEBBQUAMIHRMQswCQYDVQQGEwJaQTEVMBMGA1UECBMMV2VzdGVybiBD YXBlMRIwEAYDVQQHEwlDYXBlIFRvd24xGjAYBgNVBAoTEVRoYXd0ZSBDb25zdWx0aW5nMSgwJgYD VQQLEx9DZXJ0aWZpY2F0aW9uIFNlcnZpY2VzIERpdmlzaW9uMSQwIgYDVQQDExtUaGF3dGUgUGVy c29uYWwgRnJlZW1haWwgQ0ExKzApBgkqhkiG9w0BCQEWHHBlcnNvbmFsLWZyZWVtYWlsQHRoYXd0 ZS5jb20wHhcNMDMwNzE3MDAwMDAwWhcNMTMwNzE2MjM1OTU5WjBiMQswCQYDVQQGEwJaQTElMCMG A1UEChMcVGhhd3RlIENvbnN1bHRpbmcgKFB0eSkgTHRkLjEsMCoGA1UEAxMjVGhhd3RlIFBlcnNv bmFsIEZyZWVtYWlsIElzc3VpbmcgQ0EwgZ8wDQYJKoZIhvcNAQEBBQADgY0AMIGJAoGBAMSmPFVz VftOucqZWh5owHUEcJ3f6f+jHuy9zfVb8hp2vX8MOmHyv1HOAdTlUAow1wJjWiyJFXCO3cnwK4Va qj9xVsuvPAsH5/EfkTYkKhPPK9Xzgnc9A74r/rsYPge/QIACZNenprufZdHFKlSFD0gEf6e20Txh BEAeZBlyYLf7AgMBAAGjgZQwgZEwEgYDVR0TAQH/BAgwBgEB/wIBADBDBgNVHR8EPDA6MDigNqA0 hjJodHRwOi8vY3JsLnRoYXd0ZS5jb20vVGhhd3RlUGVyc29uYWxGcmVlbWFpbENBLmNybDALBgNV HQ8EBAMCAQYwKQYDVR0RBCIwIKQeMBwxGjAYBgNVBAMTEVByaXZhdGVMYWJlbDItMTM4MA0GCSqG SIb3DQEBBQUAA4GBAEiM0VCD6gsuzA2jZqxnD3+vrL7CF6FDlpSdf0whuPg2H6otnzYvwPQcUCCT cDz9reFhYsPZOhl+hLGZGwDFGguCdJ4lUJRix9sncVcljd2pnDmOjCBPZV+V2vf3h9bGCE6u9uo0 5RAaWzVNd+NWIXiC3CEZNd4ksdMdRv9dX2VPMYIDEDCCAwwCAQEwdjBiMQswCQYDVQQGEwJaQTEl MCMGA1UEChMcVGhhd3RlIENvbnN1bHRpbmcgKFB0eSkgTHRkLjEsMCoGA1UEAxMjVGhhd3RlIFBl cnNvbmFsIEZyZWVtYWlsIElzc3VpbmcgQ0ECEAg3KB6oiZkzSaPukS0ujWUwCQYFKw4DAhoFAKCC AW8wGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMDgwNjEyMDA1MTI1 WjAjBgkqhkiG9w0BCQQxFgQUFXRTD4Piu9Zw3nUmj3YBcRCaCaowgYUGCSsGAQQBgjcQBDF4MHYw YjELMAkGA1UEBhMCWkExJTAjBgNVBAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAq BgNVBAMTI1RoYXd0ZSBQZXJzb25hbCBGcmVlbWFpbCBJc3N1aW5nIENBAhAINygeqImZM0mj7pEt Lo1lMIGHBgsqhkiG9w0BCRACCzF4oHYwYjELMAkGA1UEBhMCWkExJTAjBgNVBAoTHFRoYXd0ZSBD b25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMTI1RoYXd0ZSBQZXJzb25hbCBGcmVlbWFpbCBJ c3N1aW5nIENBAhAINygeqImZM0mj7pEtLo1lMA0GCSqGSIb3DQEBAQUABIIBAGi+UripnuurPzKT wRcGylI7SneGS884GqQ5iwfrDgLFLeEotAlpI7R27G5DOap2dCPc1f3CHGu2u+FCt7wrhYM+haHl bjnJ8fJPLRCK3oLktELwYoWIMXo8aIJrhrjU5I0cLB8l3nuOFOkny1MFMgJ2Uj8kTfhQ0viIHRp3 EC2kFWd1iKR2Q0WVLSZZZttlyF7m0OVyODR1kXyOTdXdX0FUd6/VdDeKMrX+xU9RoTTOZXb7hqz1 UlU9psCF773Ofa7x9prFYY1rNFbP+QNpdOdZHtbUHuQEP/1tWIpxlFE5dwPY5t9jrwAcm5e9PfQ0 ybPi+hwNFnZjZUisBz77/cYAAAAAAAA= --Apple-Mail-77-848967217--