Return-Path: Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: (qmail 57231 invoked from network); 20 Apr 2010 18:30:35 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 20 Apr 2010 18:30:35 -0000 Received: (qmail 12419 invoked by uid 500); 20 Apr 2010 18:30:34 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 12384 invoked by uid 500); 20 Apr 2010 18:30:34 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 12376 invoked by uid 99); 20 Apr 2010 18:30:34 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 20 Apr 2010 18:30:34 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=10.0 tests=AWL,SPF_HELO_PASS,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of mfidelman@meetinghouse.net designates 207.154.13.48 as permitted sender) Received: from [207.154.13.48] (HELO server1.neighborhoods.net) (207.154.13.48) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 20 Apr 2010 18:30:26 +0000 Received: from localhost (localhost.localdomain [127.0.0.1]) by server1.neighborhoods.net (Postfix) with ESMTP id B188C38C414 for ; Tue, 20 Apr 2010 14:30:05 -0400 (EDT) X-Virus-Scanned: by amavisd-new-2.6.2 (20081215) (Debian) at neighborhoods.net Received: from server1.neighborhoods.net ([127.0.0.1]) by localhost (server1.neighborhoods.net [127.0.0.1]) (amavisd-new, port 10024) with LMTP id ZKJ96Q3RY+uJ for ; Tue, 20 Apr 2010 14:30:04 -0400 (EDT) Received: from new-host.home (pool-173-76-225-163.bstnma.fios.verizon.net [173.76.225.163]) by server1.neighborhoods.net (Postfix) with ESMTPSA id 99ED238C408 for ; Tue, 20 Apr 2010 14:30:04 -0400 (EDT) Message-ID: <4BCDF2AC.4040705@meetinghouse.net> Date: Tue, 20 Apr 2010 14:30:04 -0400 From: Miles Fidelman User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.1.9) Gecko/20100317 SeaMonkey/2.0.4 MIME-Version: 1.0 To: user@couchdb.apache.org Subject: Re: experience with very large numbers of nodes? References: <4BCDE1A8.5030608@meetinghouse.net> <4BCDE4B8.1030706@canonical.com> In-Reply-To: <4BCDE4B8.1030706@canonical.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Eric Casteleijn wrote: > On 04/20/2010 01:17 PM, Miles Fidelman wrote: >> Hi Folks, >> >> Does anybody have any experience with very large Couch deployments - on >> the order of 100s to 1000s of nodes? > > For Ubuntu One, we have a very large number of nodes: one on every > machine of every user of the service, and then a central node on our > server (or set of nodes, but each user will only see one) that it > replicates from and to, and we believe this can be made to scale quite > well, although we are still in the tuning phase. Sounds like a good datapoint. Thanks! > > Each user has their own set of databases though, so there is way less > replication needed and chance of conflicts, than if you were to have > one global database that thousands of nodes all replicate between > eachother. We're in a situation where we're supporting small-to-mid-sized groups, each with their own set of documents (think workgroups in a large corporation). A particular database would be replicated across anywhere from 10 to 100 machines - individual laptops and desktops, plus workgroup servers. I'm thinking that each user would synchronize with a local workgroup server, and the workgroup servers would synchronize with each other. Miles -- In theory, there is no difference between theory and practice. In practice, there is. .... Yogi Berra