Mailing-List: contact couchdb-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: couchdb-user@incubator.apache.org
Received-SPF: pass (athena.apache.org: domain of paul.joseph.davis@gmail.com
 designates 74.125.92.146 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:to:subject:in-reply-to:mime-version
         :content-type:content-transfer-encoding:content-disposition
         :references;
        b=geNOBEQW1fYtolIpHcue73DkJEC6nagPs3ztPMJFnan7nMIs2y2z64Vnt/1s00Jr9W
         +4NY5zyf3sKrJy0Abp9yYvkTxsR9vDOVjKUWXa/UY9PHqueIfJHmvcg4LLEFlzCmLsIN
         C+4vz+f3HH6sR9b7frR5I+cRw/FvardVUPr2I=
Message-ID: <e2111bbb0810200711l14539547y8f718a76fd85569c@mail.gmail.com>
Date: Mon, 20 Oct 2008 10:11:10 -0400
From: "Paul Davis" <paul.joseph.davis@gmail.com>
To: couchdb-user@incubator.apache.org
Subject: Re: couchDB gave up building views
In-Reply-To: <27d8d0930810200657u688aec9fge20d74c2ec1966d0@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=WINDOWS-1252
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline
References: <d7c4bbc0810200607k75d02412t1c4e138cdb489b8f@mail.gmail.com>
	 <5e0220e30810200617y3c304225l6715e69a6da534d2@mail.gmail.com>
	 <e2111bbb0810200622m4b18f4edqc90a39714f02636e@mail.gmail.com>
	 <d7c4bbc0810200647j2c620cbbpdbe8f64dcbac1ce6@mail.gmail.com>
	 <e2111bbb0810200651x242d2212u6887de5f9dd05edc@mail.gmail.com>
	 <27d8d0930810200657u688aec9fge20d74c2ec1966d0@mail.gmail.com>

On Mon, Oct 20, 2008 at 9:57 AM, Ayende Rahien <ayende@ayende.com> wrote:
> Is it possible to get a group of documents 20,000 long?
>

Assuming you mean, is it possible for 20,000 documents to be sent in
one chunk to a view server... Actually, as a matter of fact....
(checking code) it looks like a big no on that. couch_query_servers is
sending them across the wire one at a time. Though for a given design
doc, all map functions are executed on the doc in the same go.


> On Mon, Oct 20, 2008 at 3:51 PM, Paul Davis <paul.joseph.davis@gmail.com>=
wrote:
>
>> Yeah, that means your map function took too long to complete a map
>> operation. (5 seconds IIRC). If your map functions are taking that
>> long you should reexamine them. (That's per group of docs sent, not
>> the entire operation mind you)
>>
>> Paul
>>
>> On Mon, Oct 20, 2008 at 9:47 AM, Yuuki Takano <ytakano@jaist.ac.jp> wrot=
e:
>> > Thank you for your quick response.
>> >
>> > When I looking up views, the process "couchjs" is running and takes
>> > 90% of CPU resources.
>> > However, that process stop after receiving following response.
>> >
>> > {"error":"error","reason":"{{nocatch,{map_process_error,\"map function
>> > timed out\"}},
>> >  [{couch_query_servers,readline,2},
>> >  {couch_query_servers,read_json,1},
>> >  {couch_query_servers,prompt,2},
>> >  {couch_query_servers,'-rereduce\/3-fun-0-',3},
>> >  {lists,zipwith,3},\n  {couch_query_servers,rereduce,3},
>> >  {couch_view,'-init_group\/4-fun-0-',4},
>> >  {couch_btree,'-write_node\/3-lc$^0\/1-0-',3}]}"}
>> >
>> > So, I think couchDB gave up building views despite it had to continue.
>> >
>> >
>> > 2008/10/20 Paul Davis <paul.joseph.davis@gmail.com>:
>> >> Also, i think there's work on a patch to be able to query couch on th=
e
>> >> status of view generation. If not, sorry to get your hopes up.
>> >>
>> >> Paul
>> >>
>> >> On Mon, Oct 20, 2008 at 9:17 AM, Ed Finkler <funkatron@gmail.com>
>> wrote:
>> >>> What's probably timing out is your http request, not the view
>> >>> building. Views with a large number of docs can take a while to buil=
d
>> >>> initially, but the build process will continue even if your request
>> >>> times out. Typically I keep an eye on the cpu usage on the couchjs
>> >>> process(es) to see when it calms down =96 that usually means the bui=
ld
>> >>> is done.
>> >>>
>> >>> --
>> >>> Ed Finkler
>> >>> http://funkatron.com
>> >>> AIM: funka7ron
>> >>> ICQ: 3922133
>> >>> Skype: funka7ron
>> >>>
>> >>>
>> >>> On Mon, Oct 20, 2008 at 9:07 AM, Yuuki Takano <ytakano@jaist.ac.jp>
>> wrote:
>> >>>> Hi there,
>> >>>>
>> >>>> I inserted 20,000 documents into couchDB, and looked up views of it=
.
>> >>>> However , couchDB gave up building views because of timed out.
>> >>>>
>> >>>> The views were quite simple, such as
>> >>>>
>> >>>> function(doc) {
>> >>>>    if (doc.type =3D=3D 'vote') {
>> >>>>        emit([doc.service, doc.user, doc.item], doc);
>> >>>>    }
>> >>>> }
>> >>>>
>> >>>> It seems that couchDB does not support many documents at this versi=
on
>> (0.8.1).
>> >>>> Is that right?
>> >>>>
>> >>>> Regards,
>> >>>>
>> >>>> -- Yuuki Takano <ytakano@jaist.ac.jp>
>> >>>>
>> >>>
>> >>
>> >
>>
>