From user-return-5523-apmail-couchdb-user-archive=couchdb.apache.org@couchdb.apache.org Mon Jul 13 15:24:38 2009 Return-Path: Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: (qmail 39575 invoked from network); 13 Jul 2009 15:24:38 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 13 Jul 2009 15:24:38 -0000 Received: (qmail 6326 invoked by uid 500); 13 Jul 2009 15:24:46 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 6017 invoked by uid 500); 13 Jul 2009 15:24:45 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 5952 invoked by uid 99); 13 Jul 2009 15:24:45 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Jul 2009 15:24:45 +0000 X-ASF-Spam-Status: No, hits=1.5 required=10.0 tests=SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of truemped@googlemail.com designates 209.85.218.210 as permitted sender) Received: from [209.85.218.210] (HELO mail-bw0-f210.google.com) (209.85.218.210) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Jul 2009 15:24:34 +0000 Received: by bwz6 with SMTP id 6so443821bwz.11 for ; Mon, 13 Jul 2009 08:24:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:received:received:received:message-id:from:to :in-reply-to:content-type:content-transfer-encoding:mime-version :subject:date:references:x-mailer; bh=ZV4SXpO4L/W+m1OCjRd8LoVOK6xlRMKBDDtC9oNjscE=; b=dQM8+1Xan77k02F3at3q0tvsq0KhEmVWK4GK4D4AZ9xNiC2KWJtJPCnBz+nvBBylPc xoeBGdtvVHS3N8LDnOs/5tFjD+UbB79smk1Ern10H7pobCVcIWq3rCScNquMiJbTLzFL XiajlENC2f8jewa4lCQyBeEvA3Pe1AYP/rc2A= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=message-id:from:to:in-reply-to:content-type :content-transfer-encoding:mime-version:subject:date:references :x-mailer; b=uzkeWS1OK6IWTlQ5Hf+SCZP02mmGpsIm0Ji27rbF4Y4eXN4jtELLvnieT5+yrcIy9T uvUGgiotdSB+zdLp//RJx0t7jI0y6voe2B8l1wm1aI3e2YzbDzUZqu616WuKqv0HnjJJ rNkO7pI4zqiIHEp0LKz3084dJUfqhKAhXW3Vk= Received: by 10.204.97.204 with SMTP id m12mr5204459bkn.185.1247498219118; Mon, 13 Jul 2009 08:16:59 -0700 (PDT) Received: from hence22.org ([85.131.190.91]) by mx.google.com with ESMTPS id 22sm6386442bwz.38.2009.07.13.08.16.58 (version=TLSv1/SSLv3 cipher=RC4-MD5); Mon, 13 Jul 2009 08:16:58 -0700 (PDT) Received: from vandusen.neofonie.priv (crt-01-tr.neofonie.de [81.17.210.28]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by hence22.org (Postfix) with ESMTPSA id 63EAB3E479 for ; Mon, 13 Jul 2009 17:16:56 +0200 (CEST) Message-Id: <94AB0F01-22CC-4369-9E3A-3B0F6F050DB9@googlemail.com> From: =?ISO-8859-1?Q?Daniel_Tr=FCmper?= To: user@couchdb.apache.org In-Reply-To: <20090709081336.GB15577@uk.tiscali.com> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v935.3) Subject: Re: Updating views while inserting documents Date: Mon, 13 Jul 2009 17:16:56 +0200 References: <6D108219-1BAE-43EF-BEE2-6D0DE33257DB@googlemail.com> <20090709081336.GB15577@uk.tiscali.com> X-Mailer: Apple Mail (2.935.3) X-Virus-Checked: Checked by ClamAV on apache.org Finally I had the time to investigate a little on this issue. What I want to do is this: - Insert documents (via bulk_save) - after 1,000 documents have been added, call one of the views of my design document in order to get it indexed. What I am seeing though is: - storing the documents works just fine - "curl http://localhost:5984/_active_tasks" shows this: [{"type":"View Group Indexer","task":"docinsider_test _design/ docstore","status":"Processed 449 of 1000 changes (44%)","pid":"<0.8743.0>"}] - "curl http://localhost:5984/test" shows this: {"db_name":"test","doc_count":3001,"doc_del_count":0,"update_seq": 3001,"purge_seq":0,"compact_running":false,"disk_size": 5375964,"instance_start_time":"1247490668343164" The corresponding view file (test.view) is 468M. - calling the view takes hours! at the moment: _1_ document every 5 seconds! From the logs I cannot say that much except than it is spawning a new group server for the view group. Log level is at "debug" I am running on: CouchDB: 0.9.1 (from the svn branch) Erlang: 5.6.5 OTP: R12B5 Spidermokey: 1.8.1.16 OS: Ubuntu Jaunty (9.04) (everything 64bit). Any help much appreciated! Daniel