From user-return-4255-apmail-couchdb-user-archive=couchdb.apache.org@couchdb.apache.org Fri Apr 03 07:06:43 2009 Return-Path: Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: (qmail 80902 invoked from network); 3 Apr 2009 07:06:43 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 3 Apr 2009 07:06:43 -0000 Received: (qmail 54228 invoked by uid 500); 3 Apr 2009 07:06:42 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 54143 invoked by uid 500); 3 Apr 2009 07:06:41 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 54133 invoked by uid 99); 3 Apr 2009 07:06:41 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Apr 2009 07:06:41 +0000 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.198.233] (HELO rv-out-0506.google.com) (209.85.198.233) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Apr 2009 07:06:32 +0000 Received: by rv-out-0506.google.com with SMTP id k40so844496rvb.35 for ; Fri, 03 Apr 2009 00:06:09 -0700 (PDT) MIME-Version: 1.0 Received: by 10.141.107.13 with SMTP id j13mr399921rvm.251.1238742369691; Fri, 03 Apr 2009 00:06:09 -0700 (PDT) Date: Fri, 3 Apr 2009 18:06:09 +1100 Message-ID: <55047b710904030006o331108e8v6af71f032746d969@mail.gmail.com> Subject: Map / Reduce limits From: Nicholas Orr To: user@couchdb.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org On Fri, Apr 3, 2009 at 5:27 PM, Chris Anderson wrote: > > On Thu, Apr 2, 2009 at 7:50 PM, Nicholas Orr wrote: >> >> Also for anyone who happens upon this. [ http://is.gd/qsyw original mail thread at couchrest group] >> >> I've solved my original problem of being able to lookup the families >> by make. Map/Reduce is a tricky bugger after dealing with rdbms for so >> long, requires a logic shift :) >> >> http://gist.github.com/89572 > > If there are only a few families, it should be fine. Basically, it has > to fit in working set, which is governed by B-tree block size and > couchjs memory availability. > There are ~18,000 documents (grows by about 50 each month) the max number of families per make (123 makes) is about 50. Thoughts on those numbers? I haven't got the importer hooked up to import all the data into CouchDB as yet. When I do I'll be to test to see if couch is going to make things simple or not / handle the data. I like couch because 1 document can have all the data in one place related to a unit (car,boat,bike). Then with sinatra/couchrest a simple lookup service is just that, simple :) Thanks, Nick