Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: pass (athena.apache.org: domain of paul.joseph.davis@gmail.com
 designates 209.85.220.180 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAONf+LTkX9U1Qkp4njVnOkm+pd_+zqTZBcrg7fy0cZwfrVr8Cg@mail.gmail.com>
References: 
 <CAONf+LTkX9U1Qkp4njVnOkm+pd_+zqTZBcrg7fy0cZwfrVr8Cg@mail.gmail.com>
From: Paul Davis <paul.joseph.davis@gmail.com>
Date: Thu, 11 Aug 2011 23:48:49 -0500
Message-ID: 
 <CAJ_m3YDN_HT7DD+a25pGFY9n2yXq9_Uj_QVb+ycQuw-ksjL1Ww@mail.gmail.com>
Subject: Re: Bulk update performance with validation functions
To: user@couchdb.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

On Thu, Aug 11, 2011 at 4:18 PM, Max Ogden <max@maxogden.com> wrote:
> =A0I'm wondering if anyone has a solution for the huge bulk_docs performa=
nce
> hit incurred when using javascript validate_doc_update functions ~100k do=
cs
> (2.6MB of json) =A0 =A0log_level info without validation: 0m2.663s
> =A0log_level info and validation: 0m30.778s (yes, it went from 2 seconds =
to 30
> seconds when I added a validation function) =A0 =A0validation function:
> ddoc.validate_doc_update
> =3D function (newDoc, oldDoc, userCtx) { if (newDoc._deleted =3D=3D=3D tr=
ue &&
> userCtx.roles.indexOf('_admin') =3D=3D=3D -1) { throw "Only admin can del=
ete
> documents on this database."; } }; is it possible to write these function=
s
> in erlang? max
>

Its been awhile since I peeped the erlang code for this, but maybe?

Also, you tried this on trunk with the new JSON parser improvements?