Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: pass (athena.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.com;
  h=X-YMail-OSG:Received:X-Mailer:Message-ID:Date:From:Reply-To:Subject:To:MIME-Version:Content-Type;
  b=tPMPICCTbdpIufgbkgE7arFVcOXZ+/9X7fNaVpOkN8YEgrZByG0doD2J7KSyt1JJaUvDreyvq6/wSRXlMdeDnONQ1Wl2mWWKn2AZwBC5bESh44xjhO07SCswOlzjsW2OGIMlIIUj1eT0q6P90A3L1j5xRfBSunk/CdcLfpEvhMg=;
Message-ID: <1341538667.23741.YahooMailNeo@web39406.mail.mud.yahoo.com>
Date: Thu, 5 Jul 2012 18:37:47 -0700 (PDT)
From: Andreas Kemkes <a5sk4s@yahoo.com>
Reply-To: Andreas Kemkes <a5sk4s@yahoo.com>
Subject: How many filtered replications is too many?
To: "user@couchdb.apache.org" <user@couchdb.apache.org>
MIME-Version: 1.0
Content-Type: multipart/alternative;
 boundary="411857043-1560820755-1341538667=:23741"

--411857043-1560820755-1341538667=:23741
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable

I'm trying to split up a monolithic database into smaller ones using filter=
ed continuous replications in couchdb 1.2.=0A=0AI need about 200 of these r=
eplications (on a single server) and would like to parallelize as much as p=
ossible. =A0Yet, when I do, the cpu load gets very high and the system seem=
s to be crawling, replication seems to be slow, and I'm seeing timeout and =
other errors.=0A=0AHow can I best determine what the bottleneck is?=0A=0AAr=
e there suggestions on how to configure couchdb to handle it better (I've i=
ncreased max_dbs_open to 200)?=0A=0AHow do I best achieve good throughput?=
=0A=0AThis will be a one-time task, so any large measurement / monitoring e=
ffort is probably overkill.=0A=0AAny suggestions are much appreciated (incl=
uding suggestions for different approaches).=0A=0AThanks,=0A=0AAndreas
--411857043-1560820755-1341538667=:23741--