Return-Path: X-Original-To: apmail-couchdb-user-archive@www.apache.org Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 18DEB3136 for ; Sat, 30 Apr 2011 16:08:44 +0000 (UTC) Received: (qmail 94635 invoked by uid 500); 30 Apr 2011 16:08:42 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 94603 invoked by uid 500); 30 Apr 2011 16:08:42 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 94595 invoked by uid 99); 30 Apr 2011 16:08:42 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 30 Apr 2011 16:08:42 +0000 X-ASF-Spam-Status: No, hits=-2.3 required=5.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [128.18.84.114] (HELO mailgate-internal4.sri.com) (128.18.84.114) by apache.org (qpsmtpd/0.29) with SMTP; Sat, 30 Apr 2011 16:08:33 +0000 Received: from brightmail-internal2.sri.com (128.18.84.122) by mailgate-internal4.sri.com with SMTP; 30 Apr 2011 16:08:10 -0000 X-AuditID: 8012547a-b7ccaae000000cc8-de-4dbc33ea3ce1 Received: from mars.esd.sri.com (mars.esd.sri.com [128.18.26.200]) by brightmail-internal2.sri.com (Symantec Brightmail Gateway) with SMTP id 6F.57.03272.AE33CBD4; Sat, 30 Apr 2011 09:08:10 -0700 (PDT) MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; charset=us-ascii Received: from [192.168.1.6] (adsl-75-15-145-117.dsl.snlo01.sbcglobal.net [75.15.145.117]) by mars.esd.sri.com (Sun Java(tm) System Messaging Server 6.3-8.05 (built Sep 1 2009; 64bit)) with ESMTPSA id <0LKH00D783HEUH00@mars.esd.sri.com> for user@couchdb.apache.org; Sat, 30 Apr 2011 09:08:03 -0700 (PDT) Subject: Re: triggering all (necessary) view update References: <4DBB04C4.7070704@mage.hu> <4DBBFD2E.4080301@mage.hu> From: Jim Klo X-Mailer: iPhone Mail (8F190) In-reply-to: Message-id: Date: Sat, 30 Apr 2011 09:08:07 -0700 To: "user@couchdb.apache.org" X-Brightmail-Tracker: AAAAAA== X-Virus-Checked: Checked by ClamAV on apache.org I've been watching this thread, and thanks for bit of roadmap update - I'd love to see a better plugin architecture. Back to updating views, along the same lines of triggering updates, is there a way to make the view updates non-blocking? I can handle scripting the updates and eventual consistency - but I can't handle the 2 - 5 minutes of blocking it takes for each view to update after a few thousand docs are added. - Jim On Apr 30, 2011, at 7:32 AM, Robert Newson wrote: > Magie, > > I didn't read your post as offensive, don't worry. The problem is > mostly that compaction is an intensive process so scheduling it > automatically is tricky; the right schedule will vary by use case. I > can see the scheduler becoming very complicated in order to > accommodate as many cases as possible. > > I think it would be better done externally, even if that's in the form > of some kind of official couchdb plugin or addon. Once the next couple > of releases are behind us (1.0.3 and 1.1.0), we'll be reorganizing the > source tree to make things more manageable (and separated). That would > be a good time to consider a compaction scheduler add-on. > > B. > > On 30 April 2011 13:14, Mage wrote: >> On 04/29/2011 10:36 PM, Robert Newson wrote: >>> "I suppose that I can write a short script that finds all the views in a >>> database and asks one document from each, however it is not as elegant >>> as having a request which does the same." >>> >>> You only find it more elegant because you won't have to look at the code. :) >> I didn't mean to be offensive. >> >> I don't know erlang yet so I have no idea how much work would be >> required to implement this in CouchDB. There is a lot of things to >> rethink after the long years spent with sql. >> >> Anyway, I'will script this. >> >> Mage >> >> >>