incubator-couchdb-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dave Cottlehuber <>
Subject Re: iterative map reduce
Date Wed, 14 Dec 2011 08:50:52 GMT
On 14 December 2011 05:46, Dominic Tarr <> wrote:
> hi,
> I need a iterative map reduce, prefurably, in couchdb.
> I want to be able to do a map reduce to generate unique items, then another
> map reduce to generate stats about those unique items.
> from what I know about couchdb at the moment, it seems like id have to do
> the first step at the document creation step, which is just ugly.
> has anyone else dealt with this problem?

Hi Dom,

Cloudant do this in BigCouch which they released as open source a
while back
there are a few other posts on chained MR around but I don't know of a
better Couch-style implementation. Their basic approach is to copy the
view output into a new db which you'd then re-MR as required. Rinse
and repeat until complete.

Depending on your data it might be possible to implement their
view->copy to db -> new view approach yourself in native couch. It
would be interesting to do this as a couch extension using that nifty
plugin interface that hasn't been developed yet!


View raw message