Return-Path: Delivered-To: apmail-incubator-couchdb-user-archive@locus.apache.org Received: (qmail 69933 invoked from network); 3 Nov 2008 09:36:05 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 3 Nov 2008 09:36:05 -0000 Received: (qmail 34485 invoked by uid 500); 3 Nov 2008 09:36:10 -0000 Delivered-To: apmail-incubator-couchdb-user-archive@incubator.apache.org Received: (qmail 34453 invoked by uid 500); 3 Nov 2008 09:36:10 -0000 Mailing-List: contact couchdb-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: couchdb-user@incubator.apache.org Delivered-To: mailing list couchdb-user@incubator.apache.org Received: (qmail 34442 invoked by uid 99); 3 Nov 2008 09:36:10 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Nov 2008 01:36:10 -0800 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [83.97.50.139] (HELO jan.prima.de) (83.97.50.139) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Nov 2008 09:34:54 +0000 Received: from macnolia.lan (f053003031.adsl.alicedsl.de [::ffff:78.53.3.31]) (AUTH: LOGIN jan, TLS: TLSv1/SSLv3,128bits,AES128-SHA) by jan.prima.de with esmtp; Mon, 03 Nov 2008 09:35:33 +0000 Message-Id: <241FD008-0740-4393-9F4D-D2A7C14F764D@apache.org> From: Jan Lehnardt To: couchdb-user@incubator.apache.org In-Reply-To: <46302F0F-7FF1-475B-B341-E7699295D915@apache.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed; delsp=yes Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Apple Message framework v929.2) Subject: Re: Largest CouchDB dbs? Date: Mon, 3 Nov 2008 10:34:56 +0100 References: <8C1EE3D1-D62F-4C6A-A859-196297E09C3D@apache.org> <46302F0F-7FF1-475B-B341-E7699295D915@apache.org> X-Mailer: Apple Mail (2.929.2) X-Virus-Checked: Checked by ClamAV on apache.org On Nov 3, 2008, at 10:26, Ask Bj=F8rn Hansen wrote: > > On Nov 2, 2008, at 21:19, Paul Davis wrote: > >> View updates are admittedly slower than we'd like. There's planned >> work on making this sort of thing parallelized to automagically fill >> out multi-node clusters. Last I remember this is a 'probably 1.0' >> feature though. > > > I wonder if some of the slowness is from running it through JS? Perl =20= > has an extremely fast JSON parser (JSON::XS), would there be any =20 > potential optimization in using an alternate view language like that =20= > - or is most of the time spent elsewhere? Another part is the Erlang to JSON conversion that is known to be slow-=20= ish. I don't know which side of the conversion weighs more though. We are working with =20 the Erlang community and developers to get a C-based JSON encoder into Erlang. =20 Since building a view server is relatively straightforward, giving a Perl version a =20 shot is probably worth it. Which Erlang version are you running. R11B-x is known for causing view-=20= build slowness. R12B-3 and R12B-4 are good. > I don't expect more than a few tens of thousands of new documents a =20= > day though, so other than on index changes this isn't such a big deal. That sounds about correct. Cheers Jan --