Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: unknown (athena.apache.org: error in processing during lookup of
 dcaylor@fh.org)
MIME-Version: 1.0
In-Reply-To: <AANLkTi=TW1Wn9E6nNm5-uvpuPc6iM_vi8ZeFLmwm=0NF@mail.gmail.com>
References: <AANLkTi=6BmBbPn2fSNdGPRGLWV7cWH6J7sT9_vwHsZJJ@mail.gmail.com>
	<AANLkTi=TW1Wn9E6nNm5-uvpuPc6iM_vi8ZeFLmwm=0NF@mail.gmail.com>
From: David Caylor <dcaylor@fh.org>
Date: Thu, 5 Aug 2010 13:25:53 -0700
Message-ID: <AANLkTik54fUOg7cY7aOM+X18ndh4ghLGPE2cTYL+1b1c@mail.gmail.com>
Subject: Re: View Building Grinds System to Halt
To: user@couchdb.apache.org
Content-Type: multipart/alternative; boundary=0016368336f88b4d8e048d195cc0

--0016368336f88b4d8e048d195cc0
Content-Type: text/plain; charset=UTF-8

Did you run ldconfig after you set the xulrunner settings?  I did that to
myself last time I updated a Ubuntu box where I'd installed couchdb from
source.  I updated the xulrunner.conf, but forgot to run ldconfig, and got
pretty much what you are describing.

David Caylor


On Wed, Aug 4, 2010 at 4:07 PM, Gordon Leland Hempton <ghempton@gmail.com>wrote:

> After looking at the logs, it looks pretty bad:
>
> [Wed, 04 Aug 2010 22:57:28 GMT] [info] [<0.12883.0>] 127.0.0.1 - - 'GET'
>
> /trademark/_design/Trademark/_view/by_filingDate?limit=10&stale=ok&descending=true&include_docs=true
> 200
>
> [Wed, 04 Aug 2010 22:57:52 GMT] [error] [emulator] Error in process
> <0.12957.0> with exit value: {badarg,[{erlang,binary_to_term,[<<1885695232
>
> bytes>>]},{couch_file,pread_term,2},{couch_db,make_doc,5},{couch_db,open_doc_int,3},{couch_view_updater,load_doc,5},{couch_view_updater,'-update/2-fun-2-',8},{couch_btree,stream_kv_node2,8...
>
> Anyone know where to start?
>
> I am running Ubuntu 10.04 server with couchdb 1.0 installed from source. I
> have made sure the xulrunner settings are correct.
>
> Thanks,
>
> On Wed, Aug 4, 2010 at 12:18 PM, Gordon Leland Hempton
> <ghempton@gmail.com>wrote:
>
> > I am working with a database of ~10 mil docs and 30GB size. I am trying
> to
> > build a view consisting of a single field as the key and a null document.
> >
> > After creating the view and trying to access it, the couchdb beam.smp
> > command eventually goes up to 12.3GB virtual memory and uses 3.7GB of
> > physical memory. Memory is clearly the bottleneck as the CPU usage is
> around
> > 5-15%. My system only has 4GB of memory so naturally all this paging is
> > slowing everything down to a crawl.
> >
> > After a few minutes this usage will go back down, but it will get to the
> > same levels every time I access the view (which is still building and has
> > been for 12 hours).
> >
> > Is this normal? How can I improve this?
> >
> > --
> > Gordon L. Hempton
> > http://componentlab.com
> > http://hempton.com
> >
>
>
>
> --
> Gordon L. Hempton
> http://componentlab.com
> http://hempton.com
>

--0016368336f88b4d8e048d195cc0--