From couchdb-dev-return-234-apmail-incubator-couchdb-dev-archive=incubator.apache.org@incubator.apache.org Sun Apr 13 02:38:49 2008 Return-Path: Delivered-To: apmail-incubator-couchdb-dev-archive@locus.apache.org Received: (qmail 64081 invoked from network); 13 Apr 2008 02:38:49 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 13 Apr 2008 02:38:49 -0000 Received: (qmail 78745 invoked by uid 500); 13 Apr 2008 02:38:49 -0000 Delivered-To: apmail-incubator-couchdb-dev-archive@incubator.apache.org Received: (qmail 78713 invoked by uid 500); 13 Apr 2008 02:38:49 -0000 Mailing-List: contact couchdb-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: couchdb-dev@incubator.apache.org Delivered-To: mailing list couchdb-dev@incubator.apache.org Received: (qmail 78701 invoked by uid 99); 13 Apr 2008 02:38:49 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 12 Apr 2008 19:38:49 -0700 X-ASF-Spam-Status: No, hits=-1.0 required=10.0 tests=RCVD_IN_DNSWL_LOW,SPF_HELO_PASS,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of brian@briansmith.org designates 216.86.168.179 as permitted sender) Received: from [216.86.168.179] (HELO mxout-04.mxes.net) (216.86.168.179) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 13 Apr 2008 02:37:58 +0000 Received: from T60 (unknown [70.245.69.157]) (using TLSv1 with cipher RC4-MD5 (128/128 bits)) (No client certificate requested) by smtp.mxes.net (Postfix) with ESMTP id 2EE82D05A6 for ; Sat, 12 Apr 2008 22:38:17 -0400 (EDT) From: "Brian Smith" To: References: <20080411102355.GP29836@bytesexual.org> <3F0276A4-6C09-4BB6-8227-B17B6CDDAE18@apache.org> <20080411111110.GA22960@bytesexual.org> <4214AA37-4CA1-44D2-ADBB-0A69358B6797@apache.org> Subject: RE: Lazy Fulltext Search Date: Sat, 12 Apr 2008 19:38:12 -0700 Message-ID: <006601c89d0f$6f0d6c00$0302a8c0@T60> MIME-Version: 1.0 Content-Type: text/plain; charset="US-ASCII" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Office Outlook 11 In-Reply-To: <4214AA37-4CA1-44D2-ADBB-0A69358B6797@apache.org> Thread-Index: Acibxs3hfAKEKxPnQu2SErfETcv8AABR+gQg X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3198 X-Virus-Checked: Checked by ClamAV on apache.org Jan Lehnardt wrote: > Views are built JIT as well, with intermediate > results cached, so that only latest changes need to be indexed. I > propose the exactly same thing for fulltext searching. The > same trade- > offs apply and the same drawbacks as well. What I don't > understand now > is why you say it is good for views and bad for fulltext searching. > The only architectural change I propose is that the indexer is > triggered by the searcher on demand instead of CouchDB's update > notification mechanism. Re-computing indexes synchronously with updates is bad. But, Re-computing them synchronously with queries is also bad. Why not re-compute them immediately upon each update, but asynchronously, so that all the re-indexing will usually happen between updates and queries? In other words, re-compute (pre-compute) indexes using and and all idle resources. - Brian