Return-Path: X-Original-To: apmail-couchdb-user-archive@www.apache.org Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 81B1E119AF for ; Mon, 14 Jul 2014 22:52:22 +0000 (UTC) Received: (qmail 24189 invoked by uid 500); 14 Jul 2014 22:52:21 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 24129 invoked by uid 500); 14 Jul 2014 22:52:21 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 24117 invoked by uid 99); 14 Jul 2014 22:52:21 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 14 Jul 2014 22:52:21 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of siriele2x3@gmail.com designates 209.85.216.169 as permitted sender) Received: from [209.85.216.169] (HELO mail-qc0-f169.google.com) (209.85.216.169) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 14 Jul 2014 22:52:16 +0000 Received: by mail-qc0-f169.google.com with SMTP id m20so2309750qcx.28 for ; Mon, 14 Jul 2014 15:51:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=JRrSGZzyB7wvTtuibjP8vE5wbXVmQJ6t/xgLJtXKS2Y=; b=cr+J2MeHXz3IzJSqTuhZKXJXiwbx0UD7Jj2h2KCTlBs2o+etUkwaEpXlPFZg+d37hV h2PFUpg/sKPuGrDQiDP2g4N0IZt8i9zPLxl0QJicYs1Zg42D1txFWOqhGiYx9qDnkYuL /M1WcOwbBNNJJS6gan/pvc2SvFKlh6/dxhiwobqhPg3RIXyRPa0W364MjDTHM0LeuQDD U2ldN9pbOmhm3w43wASE59cxS/Z3//RePlgNm3Dd8S9RGzcXQA7iAzoIM6RoaxzbM4y8 pvIkz5nzk47e/arflqvNoTEE7olnQffE+6VwEohfirnG5x7sxSONoEguR+UG6O+9Mlvu fzfg== MIME-Version: 1.0 X-Received: by 10.224.137.135 with SMTP id w7mr27441567qat.52.1405378316334; Mon, 14 Jul 2014 15:51:56 -0700 (PDT) Received: by 10.96.158.42 with HTTP; Mon, 14 Jul 2014 15:51:56 -0700 (PDT) Received: by 10.96.158.42 with HTTP; Mon, 14 Jul 2014 15:51:56 -0700 (PDT) In-Reply-To: <72168055-CCE1-4587-87E5-6A3361D0713A@couchbase.com> References: <32B0E010-17CA-4F64-BAAB-2BFF5BF9EC13@apache.org> <36BAC57B-DF9B-4F28-AF94-6075C48A6A1C@couchbase.com> <72168055-CCE1-4587-87E5-6A3361D0713A@couchbase.com> Date: Mon, 14 Jul 2014 15:51:56 -0700 Message-ID: Subject: Re: Control view query performance From: Stanley Iriele To: user@couchdb.apache.org Content-Type: multipart/alternative; boundary=001a11c2eb34520abb04fe2f239b X-Virus-Checked: Checked by ClamAV on apache.org --001a11c2eb34520abb04fe2f239b Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Interesting....does the native view server have the same relationship with couchdb? And by that I mean is there a pool of processes that read db files from disk or is its relationship completely different?. Also...can..and should the number of spun up processes be configurable? By the way many thanks Robert/Jens this is spot on... exactly what I was looking for! ... Lastly a lot of you guy's thorough explanations about these sorts of this make for an excellent FAQ section in the docs to come On Jul 14, 2014 11:51 AM, "Jens Alfke" wrote: > > On Jul 14, 2014, at 11:29 AM, I wrote: > > > Really? I thought that the map function would be run in parallel on > several documents at once. Seems like an obvious way to speed up view > updates; after all, map/reduce as popularized by Google is intended to be= a > massively parallel algorithm=E2=80=A6) > > Sorry, I realize I=E2=80=99ve fallen prey to the =E2=80=9Cany problem I h= aven=E2=80=99t worked on > must be trivial=E2=80=9D attitude, a common pitfall of engineers. :-p > > I=E2=80=99m sure there are good reasons this hasn=E2=80=99t been implemen= ted yet, > including the fact that JSVMs are single-threaded so you=E2=80=99d have t= o spin up > several of them to be able to run map functions in parallel. > But it would be a good optimization at some point, considering the large > number of CPU cores that today=E2=80=99s server boxes have. > > =E2=80=94Jens --001a11c2eb34520abb04fe2f239b--