Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: pass (nike.apache.org: domain of robert.newson@gmail.com
 designates 209.85.216.173 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=dTm0gpHmk6WPoA4eYft1Kw5OcqpRFFiPmifL9xfxRy08c/CbM59gofwlrIfaeHldPp
         d7DlyF2gu9SbEhql+PlSSLzgk2yt+IaJdor2bsuV3xFvdMGlD9R1zXGgf6I0QlvmkPIS
         UbfGGX9fk96tPj6nOhSqQS8bAQfNAJPU9kmE8=
MIME-Version: 1.0
In-Reply-To: <AANLkTimvrQuE83JWfFrgoj_rROVT+0gY36Rm4kso+6kd@mail.gmail.com>
References: <20101116130051.noatxco6osk0kcs8@webmail.bath.ac.uk>
	<CE80F508-9859-4C13-B0B7-73782F657B49@apache.org>
	<20101116165649.6tbx1v0n40g4sosc@webmail.bath.ac.uk>
	<AANLkTimvrQuE83JWfFrgoj_rROVT+0gY36Rm4kso+6kd@mail.gmail.com>
Date: Mon, 22 Nov 2010 14:11:37 +0000
Message-ID: <AANLkTi=sKmHi64=M0GXx_xTa=WJkJT5MqJ6r8Fh=1+Q_@mail.gmail.com>
Subject: Re: Large attachments
From: Robert Newson <robert.newson@gmail.com>
To: user@couchdb.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Curl buffers binary uploads, depending on the manner you perform the operat=
ion.

B.

On Mon, Nov 22, 2010 at 2:03 PM, Bram Neijt <bneijt@gmail.com> wrote:
> I can reproduce this problem: if I upload a 500 MB and start 10
> concurrent curl commands, memory usage increase dramatically with the
> following environment:
> Description: =A0 =A0Ubuntu 10.10
> Release: =A0 =A0 =A0 =A010.10
> Codename: =A0 =A0 =A0 maverick
> {"couchdb":"Welcome","version":"1.0.1"}
>
> Bram
>
> On Tue, Nov 16, 2010 at 5:56 PM, =A0<evxdo@bath.ac.uk> wrote:
>> Well, I'm just doing a GET directly to the document_id + attachment:
>> http://localhost:5984/database/doc_id/attachment
>>
>> Clicking on the attachment in Futon would have the same effect.
>>
>> David
>>
>> Quoting Jan Lehnardt <jan@apache.org>:
>>
>>> Hi David,
>>>
>>> On 16 Nov 2010, at 14:00, evxdo@bath.ac.uk wrote:
>>>
>>>> Hi everyone,
>>>>
>>>> I'm trying to work with some large attachments (around 1.5 GB). =A0Whe=
n I
>>>> go to download these (as a standalone attachment) the =A0CouchDB proce=
ss grows
>>>> in size by at least the size of the =A0attachment before the download =
starts.
>>>> This implies that the =A0attachment is being loaded into memory entire=
ly
>>>> before being sent =A0to the client. Has anyone else seen this behaviou=
r? Is
>>>> this a bug, =A0or is there a configuration change I can make to resolv=
e this?
>>>>
>>>> I've tried disabling compression on attachments in case it's the
>>>> =A0compression that's causing the problem.
>>>>
>>>> I'm using 1.0.1.
>>>
>>> What does your request look like?
>>>
>>> The standalone attachment API does not buffer.
>>>
>>> Cheers
>>> Jan
>>> --
>>>
>>>
>>>
>>
>>
>>
>>
>