Return-Path: Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: (qmail 84261 invoked from network); 28 Oct 2009 19:09:34 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 28 Oct 2009 19:09:34 -0000 Received: (qmail 8661 invoked by uid 500); 28 Oct 2009 19:09:33 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 8606 invoked by uid 500); 28 Oct 2009 19:09:32 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 8596 invoked by uid 99); 28 Oct 2009 19:09:32 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Oct 2009 19:09:32 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of seggy.umboh@gmail.com designates 209.85.223.179 as permitted sender) Received: from [209.85.223.179] (HELO mail-iw0-f179.google.com) (209.85.223.179) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Oct 2009 19:09:24 +0000 Received: by iwn9 with SMTP id 9so1030032iwn.30 for ; Wed, 28 Oct 2009 12:09:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type; bh=7JChJCtCHlUcrh173n3SmYDklRc9Ca6bVnnjycYez+k=; b=azL++epFMPjqeneLpTf5tNAJymnxB1OtKSrKOA7pmMELZbVrPc8rt6ULsrguDF+geT OYjmd+GMPKIbZTfeReDGzQ5LuT0ywrI8dhgyV5rq92XPenS1ERxq/9XaNWgXWQUf7M6M HvAAa3bTknNVTWABvcAP/bQFvZZnaeHPoZEew= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=D8WuV8amO34I/YM1OfS+4YpRzHEuoHrtnsXRJN4KdVQSdtY9K1LM3TsKIJyY7i0FIy z9r0I9/zikEJ9nq8Lpnpe620aXzDrRpwUYkZeWNmSOeXqSA/QJWUGejUGpB0P9wktKKc kN1wW66ApGIh3ZyTvtyf4yPCB8S/276ECTpq0= MIME-Version: 1.0 Received: by 10.231.124.227 with SMTP id v35mr2075951ibr.18.1256756943642; Wed, 28 Oct 2009 12:09:03 -0700 (PDT) In-Reply-To: References: <9ce8c9f70910271725x2a338fcdi45ce6d55bf58d545@mail.gmail.com> Date: Wed, 28 Oct 2009 12:09:03 -0700 Message-ID: Subject: Re: Best practice for view updates across large data sets From: Seggy Umboh To: user@couchdb.apache.org Content-Type: multipart/alternative; boundary=0016e6498a4231e130047703874a X-Virus-Checked: Checked by ClamAV on apache.org --0016e6498a4231e130047703874a Content-Type: text/plain; charset=UTF-8 That's interesting. Is the hash per design document, or per view? Does it mean that when I change one view in my _design/development, only that view is reindexed? On Tue, Oct 27, 2009 at 7:53 PM, Adam Kocoloski wrote: > On Oct 27, 2009, at 8:25 PM, Larry wrote: > > As I had expected Im starting to experience lengthy re-indexing times when >> changing/updating our views. We have just over 300K worth of documents >> currently and it will be growing. One of our views takes about 20 minutes >> or >> so to index when installed. This locks up key aspects of our application >> and >> we would like to find a way to keep the application continuously >> functional. >> I know that our views scripts can certainly be optimized and thats >> something >> were working on as our knowledge and experience with CouchDB grows. >> However >> given where we are now I was wondering if there is a "best practice" or >> any >> tips that users may have on updating views across large data sets. >> >> Thanks for the help! >> >> larry >> > > Hi Larry, one trick you may find useful in 0.10 is to take advantage of the > fact that the view index files are identified by the hash of their contents. > This means that you can have your _design/production document and your > _design/development document, and when you're satisfied with the dev version > of your app and you want to deploy it, you can just update > _design/production to be identical to _design/development -- your production > system will automatically use the prebuilt indexes from _design/development > with zero downtime. You can even use HTTP COPY to do this if you like. > Cheers, > > Adam > > --0016e6498a4231e130047703874a--