Return-Path: Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: (qmail 96220 invoked from network); 1 Mar 2011 19:44:39 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 1 Mar 2011 19:44:39 -0000 Received: (qmail 35033 invoked by uid 500); 1 Mar 2011 19:44:37 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 34985 invoked by uid 500); 1 Mar 2011 19:44:37 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 34977 invoked by uid 99); 1 Mar 2011 19:44:37 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Mar 2011 19:44:37 +0000 X-ASF-Spam-Status: No, hits=2.9 required=5.0 tests=FREEMAIL_FROM,FS_REPLICA,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of robert.newson@gmail.com designates 209.85.214.52 as permitted sender) Received: from [209.85.214.52] (HELO mail-bw0-f52.google.com) (209.85.214.52) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Mar 2011 19:44:31 +0000 Received: by bwj24 with SMTP id 24so5564632bwj.11 for ; Tue, 01 Mar 2011 11:44:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type:content-transfer-encoding; bh=wMso7+lq1wrc8XPZSisMDE2Kr3LcNk6+9HL3CUvZhg8=; b=a+QPdYx9YUkiBk1M+ep4J3HW4iRfXKFy/NICHds4b11OderEt7nSzUyo80eEZRWCfU kQoMfNDR77ypaTQAXb7PZvwv5d/SfsvBoEXVpk5tQ2MKWo/7ZSflRvTKarV0qeJF+M1x M0j22cJGrXT3y0G7Gdatq4sYEtc7W4VFuf4xs= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=PMtXoa+VOhfAUln86GaAqY2cahUA/Eb+qjEF0V/YnAurOi9ijd4LxQF9AyOL0R8/fn CrP3cBR5x2bTxZgIFl2fh1SwCACw31aEjbCrcGoDvt/mG9kcu8xFKIqK6nTM3imSZ4R4 +/gNZaNgVFvLRTQguxafv6R0koXeoMXb0klF4= MIME-Version: 1.0 Received: by 10.204.61.199 with SMTP id u7mr6346987bkh.6.1299008651134; Tue, 01 Mar 2011 11:44:11 -0800 (PST) Received: by 10.204.14.193 with HTTP; Tue, 1 Mar 2011 11:44:11 -0800 (PST) In-Reply-To: References: <4D62AC7F.2040708@databill.com> <4D6C5CCC.207@databill.com> <4D6D40C9.7090203@databill.com> Date: Tue, 1 Mar 2011 19:44:11 +0000 Message-ID: Subject: Re: Replication: stalled? From: Robert Newson To: user@couchdb.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org I mentioned the undeclared dependency on eunit and the fact that Debian packaged it separately some months ago. In addition, I passed a patch to mochiweb (where the dependency comes from) to fix it, but failed to chase it up. B. On 1 March 2011 19:34, Adam Kocoloski wrote: > On Mar 1, 2011, at 2:26 PM, Filipe David Manana wrote: > >> On Tue, Mar 1, 2011 at 6:54 PM, Wayne Conrad wrote: >>> On 03/01/11 03:15, Filipe David Manana wrote: >>>> >>>> You can also try the new replicator that landed recently into trunk >>>> (from where 1.2 will be cut from), it adds more parallelism so you'll >>>> likely see a better performance: >>>> >>>> http://s.apache.org/KsY >>>> >>>> >>>> https://github.com/apache/couchdb/commit/34eb4175f8547546cd76fbeb00642= 1020cbf0d71 >>> >>> Version 1.2.0ac052866-git replicates my ginormous documents with panach= e. >>> =A0My test-case-de-jeur is a document with 32,700 attachments, 4k each. >>> =A0Inserting 100 attachments at a time, the document gets inserted into= the >>> source database in 42 seconds. =A0The destination database is pulling t= he >>> changes so fast I can't measure the latency by refreshing futon: The mo= ment >>> I'm done adding the last attachment to the source database, it appears = in >>> the destination database. =A0Outstanding! >>> >>> I had only one small issue building it: on Debian, the package >>> "erlang-eunit" is required to run "make check." =A0Is that worth mentio= ning in >>> the DEVELOPER file? > > I'm a bit surprised by this one, I thought we had figured out how to avoi= d that. =A0Bob? > >>> Before I put it in production, "make check" reports some failures. =A0D= o these >>> matter? >> >> No they're related to the vhost and OS daemon features. The former was >> fixed this morning I believe, while the later happens often but not >> always. They're completely unrelated to the replicator, rest assured >> :) > > Yes, the errors in 173 have happened in each of the last four CI builds (= 50-53) for R14B01: > > http://jenkins.cloudant.com/job/CouchDB-trunk-R14B01/ > > I've discussed them with Paul and one of these days we'll get around to m= aking that test less timing-sensitive. > > Thanks for the detailed report Wayne. =A0Cheers, Adam > >