Return-Path: Delivered-To: apmail-couchdb-dev-archive@www.apache.org Received: (qmail 69727 invoked from network); 27 Feb 2009 00:26:48 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 27 Feb 2009 00:26:48 -0000 Received: (qmail 21515 invoked by uid 500); 27 Feb 2009 00:26:47 -0000 Delivered-To: apmail-couchdb-dev-archive@couchdb.apache.org Received: (qmail 21474 invoked by uid 500); 27 Feb 2009 00:26:47 -0000 Mailing-List: contact dev-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@couchdb.apache.org Delivered-To: mailing list dev@couchdb.apache.org Received: (qmail 21463 invoked by uid 99); 27 Feb 2009 00:26:47 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 26 Feb 2009 16:26:47 -0800 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of paul.joseph.davis@gmail.com designates 209.85.132.242 as permitted sender) Received: from [209.85.132.242] (HELO an-out-0708.google.com) (209.85.132.242) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 27 Feb 2009 00:26:37 +0000 Received: by an-out-0708.google.com with SMTP id c37so529454anc.5 for ; Thu, 26 Feb 2009 16:26:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=4uJYgfzC1pxZoFQcPljhaliM9I6B4spOQUZNmNx9Dao=; b=iZhSQqmVM7GYRSI72APKTgSXaVbEd52evrxOKresuhmu0mrS9W9G1ciU3JGiUKq8cr AOv102BjAUcccAIqao2iJCWOhnDFy6VM+BKF/O3shrP+Pmky7W9X4/su9vBUct0gxlmp lZwD+Llc3VgmLlfqE0Sg8AyXZVAfmqVV+3erE= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=AJIV/do2X9amnfMIuu9VP8wu7owNVxgTDgQJQjaJEA9wgY+Ej27JyFiHXrHh6MiF7n 7UMW96F5yQvn6XHCLOraZ8hPc4/Hb9kKBdCEDANNyjaxJPngsw3ChZ7e/f2aU6LZ6w9k KVOnslvzwwcKzzIk9at9bwwEzxB5Gk/6dgNyE= MIME-Version: 1.0 Received: by 10.100.14.2 with SMTP id 2mr2056841ann.79.1235694376324; Thu, 26 Feb 2009 16:26:16 -0800 (PST) In-Reply-To: References: <56a83cd00902260948x15ce887u4916cedd54959c6@mail.gmail.com> <7898CB93-1504-40B6-8EB8-C4C816189EB8@apache.org> <73AF9D27-6895-4E0D-96E0-335C02B94892@gmail.com> Date: Thu, 26 Feb 2009 19:26:16 -0500 Message-ID: Subject: Re: CouchDB and clustering From: Paul Davis To: dev@couchdb.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org On Thu, Feb 26, 2009 at 7:06 PM, Chris Anderson wrote: > On Thu, Feb 26, 2009 at 3:56 PM, Ben Browning wrote: >> I think I've captured, at least at a high-level, the general consensus >> on partitioning here: >> >> http://wiki.apache.org/couchdb/Partitioning_proposal >> > > This looks great to me, thanks for capturing it here! The actual > hashing of docids and merging of view queries will probably not be the > hard part. I expect the hard part to be configuration and management > of nodes across machines, as well as communication between nodes. > > There has been some work to make CouchDB more OTP-like (having trouble > finding links...) and I think doing that first could make the rest of > this job much easier. > > Thinking we should move this conversation to dev@ to ensure we get the > right people's attention. ('scuse the cross-post.) > > Chris > > -- > Chris Anderson > http://jchris.mfdz.com > I'm starting to believe that becoming more OTP compliant is going to be the most (immediately) important aspect of supporting CouchDB nodes that span physical hosts. By getting the core bits of functionality separated into OTP modules/apps/units/appropriate-term replacing bits of CouchDB functionality becomes *alot* easier. I think a good place for figuring out how to make the different bits work would be to sit down and figure out a modular split for CouchDB and then make those our OTP bits. Then with a configurable setup, having a plugin that replaces the entire storage system (with say, a distributed btree implementation) would be as easy as changing an INI setting. HTH, Paul Davis