Mailing-List: contact couchdb-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: couchdb-user@incubator.apache.org
Received-SPF: pass (athena.apache.org: domain of jchris@gmail.com designates
 72.14.220.152 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:sender:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth;
        b=HWYfjKbu745hrXFPDc4dkhjfA5ewPt2wfWrFBuL4WVfXFuz67OSxhSPjB6UicXf8x2NSxSogDxnMpkjA7w0R6rC2vHhLL9tohC9bDmNvshqdPsMhiB1PTL/cCgyBSPQM7jspHvNB/TFx2yOxJ3XzhwBc89xZeOXXk9SibFSjT0A=
Message-ID: <e282921e0804110026m52d1642cs2f1a99a2df5ff28d@mail.gmail.com>
Date: Fri, 11 Apr 2008 00:26:36 -0700
From: "Chris Anderson" <jchris@mfdz.com>
Sender: jchris@gmail.com
To: couchdb-user@incubator.apache.org
Subject: Re: Clarifications or bugs
In-Reply-To: <44500.193.3.142.123.1207895485.squirrel@www.widetrail.dk>
MIME-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline
References: <200804092350.23492.sh@widetrail.dk>
	 <9C3977AC-3865-4DD4-9B45-F6F5A4402072@gmx.de>
	 <51868.193.3.142.123.1207808427.squirrel@www.widetrail.dk>
	 <47FE9F26.8090508@naderman.de>
	 <44500.193.3.142.123.1207895485.squirrel@www.widetrail.dk>

On Thu, Apr 10, 2008 at 11:31 PM, S=F8ren Hilmer <sh@widetrail.dk> wrote:
>  My problem is that couchdb only tells me which database has changed, wit=
h
>  that information I can get the documents changed, but now I need to run
>  the views to index on these documents (and preferably these documents
>  only) in order to get what I need to index. I believed I could filter on
>  the documentid (startkey_docid) but that is apparently only supported in
>  conjunction with startkey (which I do not know, as I haven't ran the vie=
w
>  on the document yet).

I'm afraid this is significantly different from the architecture as it
currently stands, but if the indexer were to be called with the output
of each emit() function from the view engine, it would clear up a lot
of these problems. Since the view engine is already external to
CouchDB and communicating over stdio, it seems like a decent
opportunity to attach other processes as well. CouchDB could be set to
send the result of each view (at least those that are configured to be
full-text searchable) along with its corresponding document to the
full-text indexer, at view-compute time. The full-text indexer would
be called once per emit, so it could easily handle cases where a given
document shows up in the same view multiple times.

To me this seems simpler than trying to pick up changes that could be
anywhere in the view sort order. The gotcha may come when the
view-engines are distributed across instances. Then the problem
becomes managing a distributed full-text indexing process...

Hopefully this is helpful.

Chris


--=20
Chris Anderson
http://jchris.mfdz.com