Mailing-List: contact dev-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@couchdb.apache.org
Received-SPF: pass (athena.apache.org: domain of robert.newson@gmail.com
 designates 209.85.216.180 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=FtUH10wfytgg/XcHWtre/ScdVsvJVCYqdpQMttn0nBphfkcyJ5hIb/NNg+2MXUe2Xv
         LT1JAz153C1ETPS/xHnVxV3CXa3WtWvBLRe08/qGYmrQkmRaI/wgFzn9Ci/IXyI/D4lA
         5Ej7ZtNsX1Lols6AE1ypqhk0lBtU17Xt12sA4=
MIME-Version: 1.0
In-Reply-To: <AANLkTimK-aqAGBtL8UiLg0jj-jNLwSsMyT0nJyXYQEAs@mail.gmail.com>
References: <AANLkTinuZG64L1c101hUf0kXux6Z47_KcEBcPoOMh4uG@mail.gmail.com>
	<AANLkTim=k9JJ11eNd=xfgpTX75zNA9dmqQ81wm87rTWo@mail.gmail.com>
	<96CEF573-64EE-44B2-AC41-2A5A312A141D@apache.org>
	<F35A86EE-AD33-4DC1-B270-1470C88D4076@apache.org>
	<AANLkTikqu_TVh7u=p56ww4acAf3c4UTUXrg7Y3XuESXu@mail.gmail.com>
	<AANLkTiko+ZG5dCgQ2vPopSGJJ6mouQtF=UYG5OdNLfQ=@mail.gmail.com>
	<4835209A-F0C3-493E-8ED9-E58FEC4B1C55@apache.org>
	<4C6B3C3B.8020607@gmail.com>
	<AANLkTimbWHsT48H23vbkdPqHDGfUbmPuC0kPqTPTObDo@mail.gmail.com>
	<AANLkTimj7iKXc_NjphJ29=DKQ8hO=7VaGOX3GX+-=gPy@mail.gmail.com>
	<AANLkTimK-aqAGBtL8UiLg0jj-jNLwSsMyT0nJyXYQEAs@mail.gmail.com>
Date: Sun, 22 Aug 2010 23:15:03 +0100
Message-ID: <AANLkTikeX9CnMO2FGXQkY1jkPGOcudi3ZxSzq8PXKWBq@mail.gmail.com>
Subject: Re: multiview on github
From: Robert Newson <robert.newson@gmail.com>
To: dev@couchdb.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

I'm concerned about the performance of this on non-trivial databases,
given the iteration of all items between startkey and endkey. I don't
have time to test it this week but I'd be interested to hear the time
it took to do a multiview on two views of, say, a million rows each
(especially as compared to the two normal view calls).

I was also intrigued to see the code handles fti too, a problem I have
spent some time thinking about without finding a satisfactorily
performant solution too. I note that, as written, it doesn't appear to
work because the fti call (I'm assuming couchdb-lucene) will only
return the top N matching hits, so at best you can filter those
against another view (perhaps that's useful?). The trick to merging a
view and an fti result together would be to get the results from both
in the same order and step through the rows, filtering as you go.
Sorting in Lucene has a large memory hit so I gave up on that
solution.

Finally, your patch appears to add two generated files (local_dev.ini
and etc/init.d/couchdb) to the branch which should be fixed (add your
settings to default.init.tpl.in instead).

I should end by saying that if the problems above can be solved then
this would be a very useful addition to CouchDB and one that is
frequently requested. It might also be a model for multi-machine
views.

B.

On Sun, Aug 22, 2010 at 10:45 PM, Norman Barker <norman.barker@gmail.com> w=
rote:
> I would like to take this multiview code and have it added to trunk if
> possible, what are the next steps?
>
> thanks,
>
> Norman
>
> On Wed, Aug 18, 2010 at 11:44 AM, Norman Barker <norman.barker@gmail.com>=
 wrote:
>> I have made
>>
>> http://github.com/normanb/couchdb
>>
>> which is a fork of the latest couchdb trunk with the multiview code
>> and tests added.
>>
>> If geocouch is available then it can still be used.
>>
>> There are a couple of questions about the multiview on the user /dev
>> list so I will be adding some more test cases during today.
>>
>> thanks,
>>
>> Norman
>>
>> On Tue, Aug 17, 2010 at 9:23 PM, Norman Barker <norman.barker@gmail.com>=
 wrote:
>>> this is possible, I forked geocouch since I use it, but I have already
>>> separated the geocouch dependencies from the trunk.
>>>
>>> I can do this tomorrow, certainly be interested in any feedback.
>>>
>>> thanks,
>>>
>>> Norman
>>>
>>>
>>>
>>> On Tue, Aug 17, 2010 at 7:49 PM, Volker Mische <volker.mische@gmail.com=
> wrote:
>>>> On 08/18/2010 03:26 AM, J Chris Anderson wrote:
>>>>>
>>>>> On Aug 16, 2010, at 4:38 PM, Norman Barker wrote:
>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> I have made the changes as recommended, adding a test case
>>>>>> multiview.js and also adding the userCtx to open the db.
>>>>>>
>>>>>> I have also forked geocouch and this is available here
>>>>>>
>>>>>
>>>>> this patch seems important (especially as people are already asking f=
or
>>>>> help using it on user@)
>>>>>
>>>>> to get it committed, it either must remove the dependency on GeoCouch=
, or
>>>>> become part of CouchDB when (and if) GeoCouch becomes part of CouchDB=
.
>>>>>
>>>>> Is it possible / useful to make a version that doesn't use GeoCouch? =
And
>>>>> then to make the GeoCouch capabilities part GeoCouch for now?
>>>>>
>>>>> Chris
>>>>>
>>>>
>>>> Hi Norman,
>>>>
>>>> if the patch is ready for trunk, I'd be happy to move the GeoCouch bit=
s to
>>>> GeoCouch itself (as GeoCouch isn't ready for trunk yet).
>>>>
>>>> Lately I haven't been that responsive when it comes to GeoCouch, but t=
hat
>>>> will change (in about a month) after holidays and FOSS4G.
>>>>
>>>> Cheers,
>>>> =A0Volker
>>>>
>>>
>>
>