Mailing-List: contact couchdb-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: couchdb-user@incubator.apache.org
Received-SPF: pass (athena.apache.org: domain of jchris@gmail.com designates
 74.125.46.155 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:sender:to:subject:in-reply-to:mime-version
         :content-type:content-transfer-encoding:content-disposition
         :references:x-google-sender-auth;
        b=mRJWD2CkGjvx8AMXpAjDMWqmHRAbON6OIlb6sgvFNZ3nUUa28nCaxEirRI/HQd04ki
         H/5c0415LfsEpWtESurGgU4DnuQmBFsBZf4FLGkU/UuGAfi3qCjq4QMuxQZ7IhLXmaZA
         gGGKOgJdRdtz71yU+aKvaatu2cO5EruInPaLk=
Message-ID: <e282921e0808031429y26fe34cfo4e623735c4cdf00d@mail.gmail.com>
Date: Sun, 3 Aug 2008 14:29:33 -0700
From: "Chris Anderson" <jchris@grabb.it>
Sender: jchris@gmail.com
To: couchdb-user@incubator.apache.org
Subject: Re: Is it possible to evaluate a view on a 20.000 documents database?
In-Reply-To: <12EA0EAA-08E4-4BF2-BF60-6D6F4BB428C9@gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
References: <4aa4f4d60807311410m6077d984x83cb3b5d4e8c6f17@mail.gmail.com>
	 <06C596D4-E5D1-4161-BFF1-D3A40FFB4627@gmail.com>
	 <e282921e0807311514s1e09ff40j3d526b7c12cf92d3@mail.gmail.com>
	 <4aa4f4d60807311538h5a9c9d02k2dc507a0b566f34@mail.gmail.com>
	 <20080801160848.GA12647@ginosko.ndrix.org>
	 <E4D9D7CF-79FD-4DBC-9E50-4B9ADAC5DB12@apache.org>
	 <4aa4f4d60808011006y7451ad7dnc4483f0c0d75f7e7@mail.gmail.com>
	 <e282921e0808011105x7abf70a4lf6619c015b574c31@mail.gmail.com>
	 <12EA0EAA-08E4-4BF2-BF60-6D6F4BB428C9@gmail.com>

On Fri, Aug 1, 2008 at 11:06 AM, Ed Finkler <funkatron@gmail.com> wrote:
>
> On Aug 1, 2008, at 2:05 PM, Chris Anderson wrote:
>
>> That's how I do it. I've got a bunch of Ruby scripts that do things
>> like replicate 1% of the database, clone a map index to documents in
>> another db, etc. Maybe a cleanup-for-release day is in order.
>
> Yes please! 8)

I cleaned up subset.rb and remap.rb for release - you can find them here:

http://github.com/jchris/couchrest/tree/master/utils

subset.rb takes a source and a target database, and randomly
replicates some percentage of the documents from the source to the
target.

remap.rb iterates over a map view yielding an array of values as
associated with each unique key. It creates a document in a separate
target db for each key.

-- 
Chris Anderson
http://jchris.mfdz.com