Return-Path: Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: (qmail 82681 invoked from network); 22 Nov 2010 14:03:47 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 22 Nov 2010 14:03:47 -0000 Received: (qmail 1082 invoked by uid 500); 22 Nov 2010 14:04:16 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 1011 invoked by uid 500); 22 Nov 2010 14:04:15 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 1003 invoked by uid 99); 22 Nov 2010 14:04:15 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Nov 2010 14:04:15 +0000 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of bneijt@gmail.com designates 209.85.216.52 as permitted sender) Received: from [209.85.216.52] (HELO mail-qw0-f52.google.com) (209.85.216.52) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Nov 2010 14:04:10 +0000 Received: by qwb8 with SMTP id 8so67631qwb.11 for ; Mon, 22 Nov 2010 06:03:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=T8G35gph/7sCbrIISD6nbjxY0y27AM8vERqAlU5sRsM=; b=dCYCp7mGkxsQujS9Wi5iL/GsgAcg3nzreuRPrXBLz7QM7Ibz6tQfWdLDEn41sRI6I5 P3zSWyrK2Ac8MYEXCBxn9uQWJIA+axBUys/zGgnLJmRwptuBjLNgzdSqUexBnFako/eS /13Uw2sgYiumV0cRpnkMXHpzTObGr5ZeM6q2o= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=jPUjY1dKzj/UJNvhRKiusK95TReQl6lDiabqJf6EN7x1s7qKqITJrwAtkaQwlVBQik eSf1oNEEEhCbC2QVcFkAwtS3OItvz6LfV65XDTUcPZ6vPyGR/SSZXH/9UQqwn/gA8kkY xR1XGzmgFh7Sh+NOXC6OpNBBq2rXu8x1nzocg= MIME-Version: 1.0 Received: by 10.229.109.199 with SMTP id k7mr5102858qcp.239.1290434629418; Mon, 22 Nov 2010 06:03:49 -0800 (PST) Received: by 10.229.102.86 with HTTP; Mon, 22 Nov 2010 06:03:49 -0800 (PST) In-Reply-To: <20101116165649.6tbx1v0n40g4sosc@webmail.bath.ac.uk> References: <20101116130051.noatxco6osk0kcs8@webmail.bath.ac.uk> <20101116165649.6tbx1v0n40g4sosc@webmail.bath.ac.uk> Date: Mon, 22 Nov 2010 15:03:49 +0100 Message-ID: Subject: Re: Large attachments From: Bram Neijt To: user@couchdb.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable I can reproduce this problem: if I upload a 500 MB and start 10 concurrent curl commands, memory usage increase dramatically with the following environment: Description: Ubuntu 10.10 Release: 10.10 Codename: maverick {"couchdb":"Welcome","version":"1.0.1"} Bram On Tue, Nov 16, 2010 at 5:56 PM, wrote: > Well, I'm just doing a GET directly to the document_id + attachment: > http://localhost:5984/database/doc_id/attachment > > Clicking on the attachment in Futon would have the same effect. > > David > > Quoting Jan Lehnardt : > >> Hi David, >> >> On 16 Nov 2010, at 14:00, evxdo@bath.ac.uk wrote: >> >>> Hi everyone, >>> >>> I'm trying to work with some large attachments (around 1.5 GB). =A0When= I >>> go to download these (as a standalone attachment) the =A0CouchDB proces= s grows >>> in size by at least the size of the =A0attachment before the download s= tarts. >>> This implies that the =A0attachment is being loaded into memory entirel= y >>> before being sent =A0to the client. Has anyone else seen this behaviour= ? Is >>> this a bug, =A0or is there a configuration change I can make to resolve= this? >>> >>> I've tried disabling compression on attachments in case it's the >>> =A0compression that's causing the problem. >>> >>> I'm using 1.0.1. >> >> What does your request look like? >> >> The standalone attachment API does not buffer. >> >> Cheers >> Jan >> -- >> >> >> > > > >