Mailing-List: contact dev-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@couchdb.apache.org
Received-SPF: pass (athena.apache.org: domain of paul.joseph.davis@gmail.com
 designates 209.85.217.162 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=uSv4T7AF1y5hwTif7YPHE/1w9E9XaN4/atqKvwg8u7U8/aMdTtOT7WzJA+RnturtJw
         vXyycFx1BLRolcV7c8cJdvD4rezj6tK/iH1B8qSnnfFgq31gk/rjhzFPK2a3iDXyAW17
         mfIBHVVyyS+B4Ze5ODYAsMM4zz2jkfW4bOWgc=
MIME-Version: 1.0
In-Reply-To: <5aaed53f0902260542k1bbefecbt3bf4e732bc79589@mail.gmail.com>
References: <5aaed53f0902250507t47edbef3ra43a7e4761d6d5dc@mail.gmail.com>
	 <20090226080342.GA6356@uk.tiscali.com>
	 <42D5E435-4453-46B2-98B9-0AA3439C3FCB@apache.org>
	 <5aaed53f0902260542k1bbefecbt3bf4e732bc79589@mail.gmail.com>
Date: Thu, 26 Feb 2009 10:47:13 -0500
Message-ID: <e2111bbb0902260747m236a3dbdw1b058c623d0ec81c@mail.gmail.com>
Subject: Re: [RESULT]: Accept newline patch into CouchDB for 0.9 (Was: Re:
	VOTE: accept newline patch into CouchDB for 0.9)
From: Paul Davis <paul.joseph.davis@gmail.com>
To: dev@couchdb.apache.org, tech@dundeemt.com
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

On Thu, Feb 26, 2009 at 8:42 AM, Jeff Hinrichs - DM&T
<dundeemt@gmail.com> wrote:
> On Thu, Feb 26, 2009 at 3:56 AM, Jan Lehnardt <jan@apache.org> wrote:
>>
>> On 26 Feb 2009, at 09:03, Brian Candler wrote:
>>
>>> On Wed, Feb 25, 2009 at 07:07:11AM -0600, Jeff Hinrichs - DM&T wrote:
>>>>>
>>>>> CouchDB dodges this at present, since you can't download a document
>>>>> together
>>>>> with its attachments.
>>>>
>>>> what about ?attachments=3Dtrue =A0or am I misunderstanding you?
>>>
>>> This is new to me - such feature doesn't seem to be mentioned at
>>> http://wiki.apache.org/couchdb/HTTP_Document_API, where it says:
>>>
>>> "When retrieving documents, the attachment's actual data is not include=
d,
>>> only the metadata. The actual data has to be fetched separately, using =
a
>>> special URI."
>>>
>>> However I do see "attachments=3Dtrue" in couch_rep.erl. Is this somethi=
ng
>>> internal/private for replication?
>>
>> This is an omission in the documentation. I added it to the wiki now wit=
h
>> a note that you should not use it :) I think the plan forward is to add =
an
>> API
>> where documents and attachments can be transferred in a single HTTP
>> request using a multipart mime request. This will speed up replication,
> Not immediately apparent that this is true, only if mime encode/decode
> is faster than json encode/decode
>

The major speed up factors when doing this in multipart mime are:

1. Streaming bytes from and to disk for attachments.
2. No Base64 round trip
3. No base64 means less data transferred

Seems like I'm missing another one, but those are the biggies.

HTH,
Paul Davis

>> fix handling replication with large attachments and makes it possible to
>> create a document and a set of attachments without going through
>> intermediate revisions.
> I am doing this currently, the recent fix to mochiweb of the 1MB body
> regression allows one to upload document + attachments in a single
> revision -- you need to base64 the attachment and set the attributes,
> but it works. =A0My dump/load code does it quite nicely.
>>
>
> Regards,
>
> Jeff Hinrichs
>