Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: pass (athena.apache.org: domain of dave@muse.net.nz designates
 209.85.212.52 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAGxYWpZtDM_AZqKjRgC9ypyvk_HbvTHSs7KmrENBt2GBxwZAqg@mail.gmail.com>
References: 
 <CAGxYWpZtDM_AZqKjRgC9ypyvk_HbvTHSs7KmrENBt2GBxwZAqg@mail.gmail.com>
Date: Tue, 5 Jun 2012 09:50:21 +0200
Message-ID: 
 <CAHZBNKaZ845U3_0xT8nQMpZm=dFCY+SoaYZZWK6cVuarr8KQEw@mail.gmail.com>
Subject: Re: limit on number of docs updated via _bulk_docs?
From: Dave Cottlehuber <dave@muse.net.nz>
To: user@couchdb.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

On 5 June 2012 05:07, Tim Tisdall <tisdall@gmail.com> wrote:
> Hopefully someone can give me an idea on this problem because I think
> I've about exhausted ideas.
>
> I'm doing a series of document updates fairly rapidly. =A0I was doing
> the updates via PUT and was having no problems except for the DB file
> size growing way too fast. =A0I changed things to update the database in
> batches using _bulk_docs. =A0Now I seem to have a problem with
> connections timing out to couchdb after about 11000 doc updates. =A0I've
> tried different size batches from 5 to 500 docs but each time the
> program dies with a connection time out after about the same number of
> doc updates.
>
> I thought it may be a problem with my code (it's in PHP, and that's
> usually the problem ;) ), however I tried something that I think
> negates that possibility. =A0I have the script running and stop it after
> about 5000 updates, then manually restart the script again right away.
> =A0The second time the script dies after about 6000 updates. =A0So, still
> around 11000 updates over 2 different processes.
>
> Any thoughts, guesses, things to try, or things to test?
>
> -Tim

I'd start off with putting the couch into [log] level =3D debug and see wha=
t comes
out. Feel free to put a section up on friendpaste.com or similar for commen=
t.

A+
Dave