Mailing-List: contact couchdb-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: couchdb-user@incubator.apache.org
Received-SPF: pass (athena.apache.org: domain of paul.joseph.davis@gmail.com
 designates 74.125.92.147 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:to:subject:in-reply-to:mime-version
         :content-type:content-transfer-encoding:content-disposition
         :references;
        b=ey34Rp1vkgYt9DDDfpmRq1m5rtRgNH/jDH4FyXOoO2hO1BWlq7/YFd9DBGxf6Fv6AW
         c+SMGwxJbQ797oyOCABFsk0oHa/ZEi5NYmLh1dRLmgLo8HYDonfjW5zBq0MZU/fuAVdn
         rOycsd9LWPUPk7JEqQVAVYAcNK90MNyYt5x+8=
Message-ID: <e2111bbb0811022119y5e2103f6mc8543aa5050e3695@mail.gmail.com>
Date: Mon, 3 Nov 2008 00:19:11 -0500
From: "Paul Davis" <paul.joseph.davis@gmail.com>
To: couchdb-user@incubator.apache.org
Subject: Re: Largest CouchDB dbs?
In-Reply-To: <8C1EE3D1-D62F-4C6A-A859-196297E09C3D@apache.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline
References: <8C1EE3D1-D62F-4C6A-A859-196297E09C3D@apache.org>

Also on second reading of the email, make sure to leverage loading
documents via _bulk_docs. When I load huge numbers of documents I tend
to try and load a couple thousand at a time. If an update fails I fall
back to a binary search to find the offending record. There's an open
request for identifying the offending records.

View updates are admittedly slower than we'd like. There's planned
work on making this sort of thing parallelized to automagically fill
out multi-node clusters. Last I remember this is a 'probably 1.0'
feature though.

On Sun, Nov 2, 2008 at 5:23 PM, Ask Bj=F8rn Hansen <ask@apache.org> wrote:
> What are the largest known production DBs in CouchDB?
>
> I'm loading ~3M documents into a database that'll be probably around 10GB
> and then grow from there.  So not very much data, but inserting and updat=
ing
> views is much slower than I expected (or thought they were in tests on
> earlier versions, is that possible?)
>
>
>
>  - ask
>