Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: pass (nike.apache.org: domain of jchris@gmail.com designates
 209.85.212.171 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:sender:in-reply-to:references:date
         :x-google-sender-auth:message-id:subject:from:to:content-type
         :content-transfer-encoding;
        b=Mch3VRYYPffDBXAiu0vawzH3UkM+vfWIachZHSTfzEiUHkp/ROG+j1HXzXXJQabtP2
         Uu7EtbqTpB7CcKekm9J9js8MZBgzhQWZvCwVECMKCeI01A4kDr+fJOIkfiWizQIByqDp
         OOiHl16cTV0l+hIdCdXHrcyAs8jcO5wWn+wbU=
MIME-Version: 1.0
Sender: jchris@gmail.com
In-Reply-To: <47F1032E-FA42-4A56-B1B7-B8C2FE8E5A9A@bzero.se>
References: <47F1032E-FA42-4A56-B1B7-B8C2FE8E5A9A@bzero.se>
Date: Sat, 5 Sep 2009 11:34:56 -0700
Message-ID: <e282921e0909051134h5c120873pfdd3dccb1c019b82@mail.gmail.com>
Subject: Re: comfy couch?
From: Chris Anderson <jchris@apache.org>
To: user@couchdb.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

On Wed, Sep 2, 2009 at 11:33 PM, Martin Hedenfalk<martin@bzero.se> wrote:
> Hello couchdb users,
>
> We're currently evaluating couchdb for a project and would very much
> appreciate
> any thoughts and insights regarding the suitability of couchdb for this.
>
> We want to use CouchDB on several nodes (say around 12 nodes initially, b=
ut
> may
> grow over time). Each node runs our application that handles external
> requests
> by updating the local couchdb database. There is no loadbalancer.
> Continuous replication between all nodes make sure all databases are
> (eventually) consistent. The same document can be updated via different
> nodes,
> so conflicts are expected to happen.
>
> Any node can fail and should be synchronized when it is back online.
>
> We anticipate the system to handle around 1000 transactions per second.
> While
> load is not necessarily distributed evenly between all nodes, let's say
> around
> 100 tps per node.

Everything you've said above, sounds like a sane deployment.

100 - 1000 tps per node should be possible on normal hardware.

Remember that since you aren't partitioning (all nodes eventually see
all updates) you won't get the pattern where each node gets only a
portion of the write load. All writes are eventually performed
everywhere. The multi-master configuration you describe will still
absorb load spikes. Replication is a more efficient writer than most
clients, so you should be able to load the cluster harder than a
single node.

>
> What delay can we expect before a document is replicated to any of the ot=
her
> nodes? The couchdb book mentions a "complex algorithm determining the ide=
al
> moment to replicate". My initial tests (although with only two nodes the
> same
> network segment) indicates replication happens nearly instantly when
> inserting
> some hundred documents per second.
>
> Would a full mesh of continuous replication between many nodes pose a
> problem?
> So far I've only tested replication between two nodes. I'll add more node=
s
> to
> the testbed as I get my hands on more machines.
>
> Is there any difference between push and pull mode replication?

Pull replication is a little more efficient than push, due to http
pipelining etc.

>
> There was however one troublesome issue with replication. There were 116
> documents missing in one database. Restarting both couches and trying any
> combination of replication didn't help. One node was always running on 10=
0%
> CPU
> and the other machine was completely idle. Once I continued with the test
> insertions and setting up continuous replication again it resolved itself=
.
> Have
> anyone experienced the same thing?

I'm not sure what could cause this - if you are able to make it
reproducible, we can make sure it goes away.

Chris

>
> I'm running CouchDB 0.10.0a810462 (I checked out the 0.10.x branch) on
> FreeBSD
> Erlang R13B01 (erts-5.7.2) [source] [64-bit] [smp:4:4] [rq:4]
> [async-threads:0] [hipe] [kernel-poll:false]
>
> thanks
> =A0 =A0 =A0 =A0-martin
>
>
>


--=20
Chris Anderson
http://jchrisa.net
http://couch.io