Return-Path: 
 <couchdb-user-return-182-apmail-incubator-couchdb-user-archive=incubator.apache.org@incubator.apache.org>
Delivered-To: apmail-incubator-couchdb-user-archive@locus.apache.org
Received: (qmail 49208 invoked from network); 11 Apr 2008 10:24:27 -0000
Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2)
  by minotaur.apache.org with SMTP; 11 Apr 2008 10:24:27 -0000
Received: (qmail 25852 invoked by uid 500); 11 Apr 2008 10:24:27 -0000
Delivered-To: apmail-incubator-couchdb-user-archive@incubator.apache.org
Received: (qmail 25799 invoked by uid 500); 11 Apr 2008 10:24:27 -0000
Mailing-List: contact couchdb-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:couchdb-user-help@incubator.apache.org>
List-Unsubscribe: <mailto:couchdb-user-unsubscribe@incubator.apache.org>
List-Post: <mailto:couchdb-user@incubator.apache.org>
List-Id: <couchdb-user.incubator.apache.org>
Reply-To: couchdb-user@incubator.apache.org
Delivered-To: mailing list couchdb-user@incubator.apache.org
Received: (qmail 25780 invoked by uid 99); 11 Apr 2008 10:24:27 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Apr 2008 03:24:27 -0700
X-ASF-Spam-Status: No, hits=-0.0 required=10.0
	tests=SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: local policy)
Received: from [89.16.172.240] (HELO bytesexual.vm.bytemark.co.uk)
 (89.16.172.240)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Apr 2008 10:23:45 +0000
Received: from nslater by bytesexual.vm.bytemark.co.uk with local (Exim 4.69)
	(envelope-from <nslater@bytesexual.org>)
	id 1JkGQF-0005ac-MU; Fri, 11 Apr 2008 11:23:55 +0100
Date: Fri, 11 Apr 2008 11:23:55 +0100
From: Noah Slater <nslater@apache.org>
To: couchdb-dev@incubator.apache.org
Cc: couchdb-user@incubator.apache.org
Subject: Re: Lazy Fulltext Search
Message-ID: <20080411102355.GP29836@bytesexual.org>
Mail-Followup-To: couchdb-dev@incubator.apache.org,
	couchdb-user@incubator.apache.org
References: <D27A5EDE-DEC9-457F-8C85-E6653921B699@apache.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <D27A5EDE-DEC9-457F-8C85-E6653921B699@apache.org>
Organization: The Apache Software Foundation <http://www.apache.org/>
X-Noah: Awesome
User-Agent: Mutt/1.5.17+20080114 (2008-01-14)
X-SA-Exim-Connect-IP: <locally generated>
X-SA-Exim-Mail-From: nslater@bytesexual.org
X-SA-Exim-Scanned: No (on bytesexual.vm.bytemark.co.uk);
 SAEximRunCond expanded to false
X-Virus-Checked: Checked by ClamAV on apache.org

On Thu, Apr 10, 2008 at 11:32:21PM +0200, Jan Lehnardt wrote:
> My proposed architectural change would be to trigger the Indexer from
> the Searcher module when a request comes in, just like views work. This
> would delay the creation of fulltext indexes until they are
> actually needed.

I thought that the advantage of full text search systems is that you can perform
a lot of work up front in exchange for very fast queries later on. This proposal
would seem to make the trade-off in performance without the associated benefit.

> The possible drawback though is, that when building the fulltext index
> is rather slow, old-style pre-calculation might be more feasible. View
> deal with that by requiring frequent requests (possibly cron-ed).

My understanding is that the KEY element of CouchDB Wiews is that they are
generated in advance, and incrementally, before you use them.

What you're proposing for the full text indexing sounds like quite the opposite
to me, though I may be totally wrong.

-- 
Noah Slater - The Apache Software Foundation <http://www.apache.org/>