Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: pass (athena.apache.org: domain of paul.p.carey@gmail.com
 designates 72.14.220.159 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:to:subject:in-reply-to:mime-version
         :content-type:content-transfer-encoding:content-disposition
         :references;
        b=ndBuRpIOTZaiLhxsJqJk9CAXlXsZtvZOjZCAHyHd5MXjgnn8H/htpxXM62JVI6PHKa
         Yp9WYXBMKrN8idj9j+IpWD+7Dx+FGJrID3r0EVZY+NjKpLgw2N8CstqLiZhNmXkWwXZ8
         E1b6LkMHFEsdO6zSVVoDb+ZW3mO0ecyRqPa3E=
Message-ID: <13ae4dd50901140858x5e5c450uf14b67698756af3e@mail.gmail.com>
Date: Wed, 14 Jan 2009 16:58:59 +0000
From: "Paul Carey" <paul.p.carey@gmail.com>
To: user@couchdb.apache.org
Subject: Re: Progress of view generation
In-Reply-To: <1231947933.543.15.camel@chris-laptop>
MIME-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
References: <1231947933.543.15.camel@chris-laptop>

Hi Chris

> I have a database containing more than 11-million documents (87 GB).
>
> As can be expected, the view generation is taking quite a long time.
> The problem is, though, that I have no idea how long it could take; I'm
> not even sure whether it could be a matter of hours, days, weeks, ...

At a guess, hours, probably quite a few.

> So, I guess I am wondering if there's any way to gauge the progress of
> the generation of these views -- or at least to be sure the views are
> actually being generated and I'm not just watching the Futon
> spinny-thing go on endlessly.

There is indeed. Take a look at

/usr/local/var/lib/couchdb/.my_design_doc.couch/Myview.view

You should be able to see it growing while view generation is taking
place.  Given that you're emitting the doc as a value, and assuming
your map function as is you stated e.g. no filtering is being
performed, you can expect the size of the view file to be in the same
ballpark as the size of you database.

> That is, once the view has been generated once, can I be confident
> that further generations (assuming I've only added a small number of
> documents since the last generation) will be reasonably quick?

Yes.

Paul