Return-Path: X-Original-To: apmail-couchdb-dev-archive@www.apache.org Delivered-To: apmail-couchdb-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 555E99109 for ; Thu, 2 Aug 2012 08:13:10 +0000 (UTC) Received: (qmail 63655 invoked by uid 500); 2 Aug 2012 08:13:09 -0000 Delivered-To: apmail-couchdb-dev-archive@couchdb.apache.org Received: (qmail 63619 invoked by uid 500); 2 Aug 2012 08:13:09 -0000 Mailing-List: contact dev-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@couchdb.apache.org Delivered-To: mailing list dev@couchdb.apache.org Received: (qmail 63596 invoked by uid 99); 2 Aug 2012 08:13:08 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Aug 2012 08:13:08 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of bchesneau@gmail.com designates 74.125.83.52 as permitted sender) Received: from [74.125.83.52] (HELO mail-ee0-f52.google.com) (74.125.83.52) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Aug 2012 08:13:02 +0000 Received: by eekc41 with SMTP id c41so1866150eek.11 for ; Thu, 02 Aug 2012 01:12:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; bh=ubbGFNGEVoYm0NHekmujK+M3squMraoF2I8H14ztiDo=; b=mR6JdgekmWTEQUwJTqxQm1NT1SkiU2diegEqV2N59LpVcJtr7id38YxYfqfqrfOrSh nnUP03rexvzEA8jEY7aYi0rHm18SGJMzli7k6kp2huDt6QfnjIclqw0XNfAw6w3RLiAq GqiYDcJE14uE5eq4bGWma5XmZHUj/2AF1i9itIVMaxEhrQLYJ//bU7AmAosO9DtZd0ik aByXfhbDLCld4WQse3yKsYXso8o2P/wzbm7uBlUeuxlsKmhoBz0p8Wid7Hk0f8pVLVvu Q6pTwYzogqvIRIyMBPvaW2vKFmXlEGjDKNQkjoDBj6lMYzOVBOBZHhRL3h5j31y3weu3 mWeg== MIME-Version: 1.0 Received: by 10.14.214.197 with SMTP id c45mr25775500eep.37.1343895161403; Thu, 02 Aug 2012 01:12:41 -0700 (PDT) Received: by 10.14.37.77 with HTTP; Thu, 2 Aug 2012 01:12:41 -0700 (PDT) In-Reply-To: References: Date: Thu, 2 Aug 2012 10:12:41 +0200 Message-ID: Subject: Re: include_atttachments=true & include_docs=true From: Benoit Chesneau To: dev@couchdb.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org On Thu, Aug 2, 2012 at 9:59 AM, Alexander Shorin wrote: > On Wed, Aug 1, 2012 at 12:44 PM, Robert Newson wrote= : >> The attachment data would be streamed, not fully materialized into memor= y, so the difference is the size of an attachment chunk (which is under 8k = iirc). > > That's right for client and direct view request, but I'm asking about > _list processing on query server side. Streaming attachments to it via > stdin wouldn't solve that problem if attachments will be embed into > doc object. If not: I suppose then there would be new command set that > breaks compatibility and it's not clear how to fast read and process a > lot of chunks within fixed os_process time. > Ah. you're right lists processing would be a problem with the current implementation. But imo that is another problem that could be fixed later. Current implementation of the query servers can be improved a lot... - beno=EEt