Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: pass (nike.apache.org: domain of paul.joseph.davis@gmail.com
 designates 209.85.212.52 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:from:date:message-id:subject:to
         :cc:content-type:content-transfer-encoding;
        b=qiVJZnSPP1koE6SRF6uFm+rMWAHPFHjUHXF4HTuLd7orCuYGU3q1MRkqGVhrrbDOGb
         K/cLIJTg5hRgQgipj1ngdqMkC/cg4P3LxRcmh34AXanZhgpsY6FT2X7j4t51V++5oeOi
         fB4+DQGAiK+IdAGfBSk4Ir68l13envVVFSZqs=
MIME-Version: 1.0
In-Reply-To: <DF859CC6-B1BE-4D0E-B67B-E2C3E9A46295@apache.org>
References: <4D62AC7F.2040708@databill.com> <4D6C5CCC.207@databill.com>
 <AANLkTinS_9kUoy6Uq0cyEZrYJBPNpcstu8PmxBpnxJVr@mail.gmail.com>
 <4D6D40C9.7090203@databill.com>
 <AANLkTimqLv5LzdeLBdLSmU1GOD0DO7zgPyqmK8LLnpYk@mail.gmail.com>
 <DF859CC6-B1BE-4D0E-B67B-E2C3E9A46295@apache.org>
From: Paul Davis <paul.joseph.davis@gmail.com>
Date: Tue, 1 Mar 2011 14:54:06 -0500
Message-ID: <AANLkTimAsK_pc9JuzmboOq-vaSp-ZVv=Fdi_ErYv3Or0@mail.gmail.com>
Subject: Re: Replication: stalled?
To: user@couchdb.apache.org
Cc: Adam Kocoloski <kocolosk@apache.org>, Wayne Conrad <wayne@databill.com>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

On Tue, Mar 1, 2011 at 2:34 PM, Adam Kocoloski <kocolosk@apache.org> wrote:
> On Mar 1, 2011, at 2:26 PM, Filipe David Manana wrote:
>
>> On Tue, Mar 1, 2011 at 6:54 PM, Wayne Conrad <wayne@databill.com> wrote:
>>> On 03/01/11 03:15, Filipe David Manana wrote:
>>>>
>>>> You can also try the new replicator that landed recently into trunk
>>>> (from where 1.2 will be cut from), it adds more parallelism so you'll
>>>> likely see a better performance:
>>>>
>>>> http://s.apache.org/KsY
>>>>
>>>>
>>>> https://github.com/apache/couchdb/commit/34eb4175f8547546cd76fbeb00642=
1020cbf0d71
>>>
>>> Version 1.2.0ac052866-git replicates my ginormous documents with panach=
e.
>>> =A0My test-case-de-jeur is a document with 32,700 attachments, 4k each.
>>> =A0Inserting 100 attachments at a time, the document gets inserted into=
 the
>>> source database in 42 seconds. =A0The destination database is pulling t=
he
>>> changes so fast I can't measure the latency by refreshing futon: The mo=
ment
>>> I'm done adding the last attachment to the source database, it appears =
in
>>> the destination database. =A0Outstanding!
>>>
>>> I had only one small issue building it: on Debian, the package
>>> "erlang-eunit" is required to run "make check." =A0Is that worth mentio=
ning in
>>> the DEVELOPER file?
>
> I'm a bit surprised by this one, I thought we had figured out how to avoi=
d that. =A0Bob?
>
>>> Before I put it in production, "make check" reports some failures. =A0D=
o these
>>> matter?
>>
>> No they're related to the vhost and OS daemon features. The former was
>> fixed this morning I believe, while the later happens often but not
>> always. They're completely unrelated to the replicator, rest assured
>> :)
>
> Yes, the errors in 173 have happened in each of the last four CI builds (=
50-53) for R14B01:
>
> http://jenkins.cloudant.com/job/CouchDB-trunk-R14B01/
>
> I've discussed them with Paul and one of these days we'll get around to m=
aking that test less timing-sensitive.
>
> Thanks for the detailed report Wayne. =A0Cheers, Adam
>
>

Yeah, I tried rewriting this one in shell but got stuck on how to get
the script to close when stdin was closed. If anyone knows a bit of
shell foo that can do that, feel free to let me in on the secret.