Mailing-List: contact dev-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@couchdb.apache.org
Received-SPF: pass (nike.apache.org: domain of paul.joseph.davis@gmail.com
 designates 74.125.44.30 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=CP7G8xl6EwWV9mGcNS9+0lP+Et8t47ttGwFaIgl4IZUA3cQBm+hIrAsJbs3ROek1B0
         3ayZf0hLtxhu84+z54pKvyNTQwQCZefvntJAyS5FqRWPlq9QB2eD+erm2GaieAFxK35y
         OEoV+XXsI1OtqLeA5KByu8yvcYlLhdjAfG/dM=
MIME-Version: 1.0
In-Reply-To: <3C3DE9B8-6E82-49CE-98AE-3130A284DA31@apache.org>
References: <e2111bbb0905101849y546cd0c6y7af79e57f3faf8fb@mail.gmail.com>
	 <D824EF58-5B07-4154-8A63-8B6DFD0D85CF@apache.org>
	 <DC845851-E066-40E3-ACA4-467DCED1C9A3@gmail.com>
	 <e282921e0905111352v53e5680du3c474612f8b7eb8d@mail.gmail.com>
	 <DE17C40B-C48B-4842-9579-2A10B3EE76AA@apache.org>
	 <e2111bbb0905131301t7da2d791u44fba272ed3049b4@mail.gmail.com>
	 <3C3DE9B8-6E82-49CE-98AE-3130A284DA31@apache.org>
Date: Thu, 14 May 2009 12:14:04 -0400
Message-ID: <e2111bbb0905140914u128f8a1t4e706d53f529f8e6@mail.gmail.com>
Subject: Re: chunkify profiling (was Re: Patch to couch_btree:chunkify)
From: Paul Davis <paul.joseph.davis@gmail.com>
To: dev@couchdb.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

>
> You know BERT better than I do -- you said the size of a binary is stored=
 in
> its header, correct?
>

I'm not sure now. It may only get length information when being sent
across the wire.

>> I'll put this on the weekend agenda. Until I can show that its
>> consistently faster I'll hold off.
>>
>> For reference, when you say 2K docs in batches of 1K, did you mean 200K?
>
> No, I meant 2k (2 calls to _bulk_docs). =A0200k would have generated a
> multi-GB trace and I think fprof:profile() would have melted my MacBook
> processing it. =A0YMMV ;-)

I thought you knew the guys at Cern ;)

Thanks for writing this up and do please post code somewhere. This
weekend I'll take a bit of time to see if I can weasel anything better
out of the fprof stuff.

Paul Davis