Return-Path: Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: (qmail 89788 invoked from network); 7 Feb 2011 20:29:19 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 7 Feb 2011 20:29:19 -0000 Received: (qmail 298 invoked by uid 500); 7 Feb 2011 20:29:17 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 236 invoked by uid 500); 7 Feb 2011 20:29:16 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 228 invoked by uid 99); 7 Feb 2011 20:29:16 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Feb 2011 20:29:16 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of mwkohout@gmail.com designates 209.85.214.52 as permitted sender) Received: from [209.85.214.52] (HELO mail-bw0-f52.google.com) (209.85.214.52) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Feb 2011 20:29:10 +0000 Received: by bwz4 with SMTP id 4so5142129bwz.11 for ; Mon, 07 Feb 2011 12:28:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=ZSrc49D99GwaJ7ADA7aDgvHoHl/hpKLrtWIX+i3OAsc=; b=C6BVHS0N3TIXgcJPmLvmYGd0iAxRKFHp4V/EVeRetkq3/zRsxJyI8651E+1dGYEjtW t7HGbsykuXK4CN+7Kn/h12EMgUCBVYUo5M9iUA7gmeYsrHYk/pc0vNK6ZmfK2+Lros/S +zsFKlKD+yw4y9XBIv+9R6JeoFujmou5Tbf3E= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=RhagzY44Mwxu1s4IMx1Ee5tKpZ4x99uY6iWSOOiPsQNKOsk//4SiZ++0XfbnJ3/gu6 czBLZiFlhhoyM0c//zu8SmBbVEGx/Bna5/5dLMeI8wLRgrl1bh1aV2kXXG7UJ/xvXPVj V0pwVqxHHY8GtxmHLYYfPSrffFHr+P9C/lxOc= MIME-Version: 1.0 Received: by 10.204.123.7 with SMTP id n7mr16287191bkr.33.1297110529665; Mon, 07 Feb 2011 12:28:49 -0800 (PST) Received: by 10.204.113.147 with HTTP; Mon, 7 Feb 2011 12:28:49 -0800 (PST) In-Reply-To: References: Date: Mon, 7 Feb 2011 14:28:49 -0600 Message-ID: Subject: Re: new couch user: "denormalizing" using views? General application architecture suggestions? From: Michael Kohout To: user@couchdb.apache.org Content-Type: multipart/alternative; boundary=00504502d60c5aec6f049bb71490 X-Virus-Checked: Checked by ClamAV on apache.org --00504502d60c5aec6f049bb71490 Content-Type: text/plain; charset=ISO-8859-1 I'd rather not do it via batch because I'd like the system to be interactive (via a browser). And depending on all this processing to occur outside this subsystem seems less robust. And to touch on your point, this is a pretty big database and exporting like that would make some unhappy dbas. I'm not sure these are good reasons, but at least they are the ones I've thought of. But ultimately what I've taken from this conversation is that the _changes feed is basically the only way I can build the system I'd like. Unless there is some other way that makes sense. thanks Mike On Mon, Feb 7, 2011 at 11:29 AM, Dirkjan Ochtman wrote: > On Mon, Feb 7, 2011 at 18:14, Michael Kohout wrote: > > What does the couch community think of this? Is there some other pattern > > that might result in a simpler system? > > Simple system: use SQL JOINs to fetch all the data for each document > you want in CouchDB, then batch-load those into CouchDB (per few k > documents) as the rows come in from the RDBMS. > > I'm not sure why you'd want to do it some other way? This is the way > I've done it a few times, though admittedly on smaller databases. I > don't think your idea for doing joins in a view is particularly > feasible, though there are things you can do here. > > Cheers, > > Dirkjan > --00504502d60c5aec6f049bb71490--