Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: pass (athena.apache.org: domain of ghempton@gmail.com designates
 74.125.82.54 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:date:message-id:subject:from:to:content-type;
        b=vIajViPMMTffLHVzQAn8kq23h2H4UnbdnbeEs4UunZ9tnX5JLMcjBMMqx+sOaSEcRr
         +4CkgN7LH6gyjvbJ0+YuP9gs09oDczZxFDjK5oKQ/XMdKYMTurZu1/ejJZcd66+OL0xQ
         1ijvd53cP6GkO5hqWCB8NuZ4/4zAuvJ8/tSnc=
MIME-Version: 1.0
Date: Wed, 4 Aug 2010 12:18:46 -0700
Message-ID: <AANLkTi=6BmBbPn2fSNdGPRGLWV7cWH6J7sT9_vwHsZJJ@mail.gmail.com>
Subject: View Building Grinds System to Halt
From: Gordon Leland Hempton <ghempton@gmail.com>
To: user@couchdb.apache.org
Content-Type: multipart/alternative; boundary=000e0cdf6fea8462e1048d044de1

--000e0cdf6fea8462e1048d044de1
Content-Type: text/plain; charset=ISO-8859-1

I am working with a database of ~10 mil docs and 30GB size. I am trying to
build a view consisting of a single field as the key and a null document.

After creating the view and trying to access it, the couchdb beam.smp
command eventually goes up to 12.3GB virtual memory and uses 3.7GB of
physical memory. Memory is clearly the bottleneck as the CPU usage is around
5-15%. My system only has 4GB of memory so naturally all this paging is
slowing everything down to a crawl.

After a few minutes this usage will go back down, but it will get to the
same levels every time I access the view (which is still building and has
been for 12 hours).

Is this normal? How can I improve this?

-- 
Gordon L. Hempton
http://componentlab.com
http://hempton.com

--000e0cdf6fea8462e1048d044de1--