Mailing-List: contact couchdb-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: couchdb-user@incubator.apache.org
Received-SPF: pass (athena.apache.org: domain of guby.mail@gmail.com
 designates 74.125.46.153 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:from:to:in-reply-to:content-type:mime-version:subject:date:references:x-mailer;
        b=h91159ddgTyKKNoSRi9UHF4m1vvnB9PegJ9K6ZGSwhYhgUfbm32bcbZoyjlLCmVPKw54/jr6Z2omcf2okHE+cYdZDh2x0TJV/87JuFOoOo/fVnkk+XLHBfQBXIAbEFZTI47lljnU/KSGk8qDTC0lWVUEhPaP7+Q60//u9Ti7b5U=
Message-Id: <2C59BE6D-C831-4CD7-BBE0-F894CA96F617@gmail.com>
From: Guby <guby.mail@gmail.com>
To: couchdb-user@incubator.apache.org
In-Reply-To: <F1141FAC-F195-4743-8F08-236A4C959334@gmail.com>
Content-Type: multipart/alternative; boundary=Apple-Mail-3--731795187
Mime-Version: 1.0 (Apple Message framework v919.2)
Subject: Re: Updating views on save
Date: Tue, 29 Apr 2008 18:13:58 -0300
References: <FC4513C5-7896-4F65-9A8B-4CCB32F2372B@gmail.com>
 <94947A5A-28C0-4ED2-98F4-0C780A9970FA@apache.org>
 <43B3557F-C8DB-4580-A70E-8B5DCAF94C91@gmail.com>
 <ACCA1844-974E-43A1-B665-D66695D9EE27@gmail.com>
 <1DBCBFC4-6A33-4DAC-8981-7286773A623E@gmail.com>
 <4624B2E1-C462-4191-BFBC-417267659399@apache.org>
 <D8218852-48CC-40ED-86EC-EF18C6A0ED16@gmail.com>
 <F1141FAC-F195-4743-8F08-236A4C959334@gmail.com>

--Apple-Mail-3--731795187
Content-Type: text/plain;
	charset=US-ASCII;
	format=flowed;
	delsp=yes
Content-Transfer-Encoding: 7bit

Hm...
On my server I just noticed CouchDB had started 14 instances of the  
DbUpdateNotificationProcess!
Is this normal, and in case, why so many? And why do they all keep  
running when the CouchDB is somewhat idle and doesn't need them at all?

Best regards
Sebastian


On Apr 28, 2008, at 1:55 PM, Guby wrote:

> Added to wiki: http://wiki.apache.org/couchdb/ 
> RegeneratingViewsOnUpdate
> Edit as you see fit.
>
> S
>
>
> On Apr 28, 2008, at 1:14 PM, Guby wrote:
>
>> Sure!
>> That makes more sense than having it here in the mailinglist :)
>>
>> S
>>
>> On Apr 28, 2008, at 12:58 PM, Jan Lehnardt wrote:
>>
>>>
>>> On Apr 28, 2008, at 17:18, Guby wrote:
>>>> I am very happy with the way this discussion turned out!
>>>> Now I have written a tiny ruby script that updates the views for  
>>>> every tenth document update and at most once every second under  
>>>> heavy updates.
>>>> Here on my development machine it uses about 1.2 mb of ram, and I  
>>>> can live with that.
>>>>
>>>> I'll include it here in case somebody reads this discussion in  
>>>> the future and needs a similar script.
>>>
>>> Would you mind putting it on the Wiki? For the obvious benefits :)
>>>
>>> Good work there,
>>>
>>> Cheers
>>> Jan
>>> --
>>>
>>>
>>>>
>>>>
>>>> Thanks again for all the help and for a great database!
>>>>
>>>> Best regards
>>>> Sebastian
>>>>
>>>>
>>>> **********************************
>>>>
>>>> CONFIG: couch.ini:
>>>> add line:
>>>> DbUpdateNotificationProcess=/PATH/TO/view_updater.rb
>>>>
>>>> **********************************
>>>>
>>>> SCRIPT: view_updater.rb
>>>>
>>>> #!/usr/bin/ruby
>>>>
>>>> ###
>>>> # CONF
>>>> ###
>>>>
>>>> # The smallest amount of changed documents before the views are  
>>>> updated
>>>> MIN_NUM_OF_CHANGED_DOCS = 10
>>>>
>>>> # URL to the DB on the CouchDB server
>>>> # Only supports one database at the moment as that is what I need
>>>> # Should be easy to improve for several databases if needed
>>>> URL = "http://localhost:5984/kleio"
>>>>
>>>> # Set the minimum pause between calls to the database
>>>> PAUSE = 1 # seconds
>>>>
>>>> # One for each design document
>>>> VIEWS = ["feed/to_check",
>>>>      "feed_entries/list_for_user_by_feed",
>>>>      "subscription/number_of_subscriptions",
>>>>      "subscription_requests/request",
>>>>      "user/by_email",
>>>>      "couch_object_has_many_relations/related_documents"]
>>>>
>>>>
>>>>
>>>>
>>>> ###
>>>> # "MAIN LOOP"
>>>> ###
>>>>
>>>> run = true
>>>> number_of_changed_docs = 0
>>>>
>>>> threads = []
>>>>
>>>> # Updates the views
>>>> threads << Thread.new do
>>>>
>>>> while run do
>>>>
>>>> if number_of_changed_docs >= MIN_NUM_OF_CHANGED_DOCS
>>>>
>>>>   number_of_changed_docs = 0
>>>>
>>>>   VIEWS.each do |view|
>>>>     `curl #{URL}/_view/#{view}?count=0`
>>>>   end
>>>>
>>>> end
>>>>
>>>> sleep PAUSE
>>>>
>>>> end
>>>>
>>>> end
>>>>
>>>> # Receives the update notification from CouchDB
>>>> threads << Thread.new do
>>>>
>>>> while run do
>>>>
>>>> update_call = gets
>>>>
>>>> # When CouchDB exits the script gets called with
>>>> # a never ending series of nil
>>>> if update_call == nil
>>>>   run = false
>>>> else
>>>>   number_of_changed_docs += 1
>>>> end
>>>>
>>>> end
>>>>
>>>> end
>>>>
>>>> # Good bye
>>>> threads.each {|thr| thr.join}
>>>>
>>>>
>>>
>>
>


--Apple-Mail-3--731795187--