Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: pass (athena.apache.org: domain of kxepal@gmail.com designates
 209.85.212.52 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAJzZBASjfdUVgmY14zCq9MC0+cf24yUzvfGhRAxoMOtw7TchMg@mail.gmail.com>
References: 
 <CAJzZBASjfdUVgmY14zCq9MC0+cf24yUzvfGhRAxoMOtw7TchMg@mail.gmail.com>
Date: Thu, 11 Aug 2011 22:02:32 +0400
Message-ID: 
 <CAHdjip+rEwn5cSakb6-3=W3OZZZVNR2fRo5PQj=qscVak6y9Aw@mail.gmail.com>
Subject: Re: CouchDB performance
From: Alexander Shorin <kxepal@gmail.com>
To: user@couchdb.apache.org
Content-Type: text/plain; charset=UTF-8

Hi, John!

Regarding couchdb-python there is opened issue about insert performance:
http://code.google.com/p/couchdb-python/issues/detail?id=193
Suddenly, nothing serious could be done there, but you may take a look
at PyCurl solution and solution using raw sockets instead of httplib
module.

------------------
,,,^..^,,,


On Thu, Aug 11, 2011 at 9:54 PM, John Cheng <johnlicheng@gmail.com> wrote:
> I published some Python scripts to help me evaluate the performance of
> CouchDB (https://github.com/jlcheng/couchdb-test). I was hoping the folks
> here can help me understand what I am seeing.
>
> The raw spreadsheet of my findings:
> https://spreadsheets0.google.com/spreadsheet/pub?hl=en_US&hl=en_US&key=0AtagEcs-wlFDdGVfMGItdUIxQXcyTmZxdVdOMUw4TWc&output=html
>
> First, I've found that the Document Update Handler API performed worse than
> using Python to get, modify, then update the document when the application
> code is running on the same machine as CouchDB. This is surprising to me. It
> leads me to believe that when the network is not a bottleneck, it might be
> better to avoid update handers.
>
> Second, the insert performance is not as good as I'd hoped - at least for
> large documents (100 kB+). The update performance is even worse. When using
> the "benchbulk.sh" script with a DOCSIZE of 100 kB and a BULKSIZE of 15, I
> am seeing about 12 inserts per second. Using my Python script, I was seeing
> 81 inserts/second and 30 updates/seconds for 100 kB documents. This is on a
> single 7200 rpm SATA drive. A write performance of 3 MB per second seems
> low.
>
> In brief, there are two things I can learn more about: Is is expected for
> the Document Update API to be slower? Two, does this kind of write and
> update performance look right?
>
> This is a Ubunut 10.01 system with
>
> 4GB RAM
> 900GB 7200 rpm SATA drive
> CouchDB 1.0.2 compiled using https://github.com/couchone/build-couchdb
>
> And the stock CouchDB 0.10.0 from Ubuntu has similar performance as well.
>