Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: pass (nike.apache.org: domain of jchris@gmail.com designates
 209.85.212.171 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:sender:in-reply-to:references:date
         :x-google-sender-auth:message-id:subject:from:to:content-type;
        b=Fh8w/Vd8MZnSzYiviyUyXXQoKfPYVZGkOg+R8Okm1rRwQRQuZOyyeyx7uIJ4qnK5Pp
         KM1DfUzrbbSHE15SfcFrnSkIOL7ScHZmnKoQcwkwAJ8rwvHK+2Sc7BRXiLu6xuIdFPfc
         cooW3MnPjxy3HygInfpX3MM4GPyH26hqYSo90=
MIME-Version: 1.0
Sender: jchris@gmail.com
In-Reply-To: <8b1c89270909190513r1494523ew6a9cb363269c3f04@mail.gmail.com>
References: <8b1c89270909190513r1494523ew6a9cb363269c3f04@mail.gmail.com>
Date: Sat, 19 Sep 2009 09:57:08 -0700
Message-ID: <e282921e0909190957n9007a6cjb66525355835b543@mail.gmail.com>
Subject: Re: Query server perfromance issues ..
From: Chris Anderson <jchris@apache.org>
To: user@couchdb.apache.org, dghosh@acm.org
Content-Type: text/plain; charset=ISO-8859-1

On Sat, Sep 19, 2009 at 5:13 AM, Debasish Ghosh
<ghosh.debasish@gmail.com> wrote:
> Hi -
> As I have mentioned previously I have been working on a Scala driver for
> CouchDB, which also includes a Query Server. I was working with an April
> snapshot of 2009/04/23. This worked fine for all the views and validations
> that I have written.Things were running fine and I could write map/reduce
> and validation functions in Scala.
> Recently I tried to upgrade to trunk. Suddenly the views and validations
> became very very slow. After some fact finding, I tried to poke into *
> couch_query_servers.erl*, since that seemed to be the obvious area to look
> into. I may be worng though, but it was a blind guess.
> I noticed that previously I was working with *revision 749852* of the file,
> which delivered the goods for me. Then when I faced problems with the trunk,
> I started doing a git reset to earlier versions of this file. Now I find
> that it looks like the performance problem starts from *revision 780165* of
> this file. Have a look at
> http://svn.apache.org/viewvc/couchdb/trunk/src/couchdb/couch_query_servers.erl?r1=780165&r2=749852&diff_format=hfor
> the difference. Looks like there have been some major changes. I am
> just
> wondering if this change has anything to do with the performance issue.
>

A quick scan of that diff suggests that the only real behavior change
that should effect you is the ["reset"] call for recycled processes.
Maybe reset is expensive in your implementation?

BTW, have you tried running:

spec test/query_server_spec.rb -f specdoc --color

It should be simple to extend that test suite to test your scala
server. If there are patches we can make to make it easier to
integrate outside projects with the query server test suite, I'm happy
to help there as well.

> Any help, pointer will be appreciated.
>
> Thanks.
> - Debasish
>


-- 
Chris Anderson
http://jchrisa.net
http://couch.io