From user-return-21335-apmail-couchdb-user-archive=couchdb.apache.org@couchdb.apache.org Thu Jun 21 19:40:45 2012 Return-Path: X-Original-To: apmail-couchdb-user-archive@www.apache.org Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9C707EC9 for ; Thu, 21 Jun 2012 19:40:45 +0000 (UTC) Received: (qmail 68738 invoked by uid 500); 21 Jun 2012 19:40:44 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 68687 invoked by uid 500); 21 Jun 2012 19:40:44 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 68677 invoked by uid 99); 21 Jun 2012 19:40:44 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 21 Jun 2012 19:40:44 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FSL_RCVD_USER,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of fdmanana@gmail.com designates 209.85.210.52 as permitted sender) Received: from [209.85.210.52] (HELO mail-pz0-f52.google.com) (209.85.210.52) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 21 Jun 2012 19:40:37 +0000 Received: by dano14 with SMTP id o14so1458022dan.11 for ; Thu, 21 Jun 2012 12:40:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type :content-transfer-encoding; bh=nDvZcWcymiQQEoN8UeXAcAh/QYGKP1rdsF5Aw2mY5NA=; b=jTE6lFz03L9bciysr5FWqU0of78T/pdhFQ7TCp3Bcw2S7UNN5mZkGaLpTeeY39apcP 19YfZlD32dftilb4UwKGzskXixOz2MQDGMYpH/CCzuzlf9lNNwhbyVjEDahHVPgR+L4y POibOLr00YT59QOJsrO5focgXmFPQhgqk8nM9u8obGrJCMcUCQOOAVgykbC9xBwWJU6U gW9nCwIXlYTqwD23FxnTvEBgoiAioi+h9X+dsmC22l6aZF0KGtq1CVArGcFQtflIKn6l vob1JWZe3Z9Gt9EHIRrv0ytyWLueQTQHW6xWMcEkkJ43h2e0WMufDxAiS5WDfjZpt0Tm 81cg== MIME-Version: 1.0 Received: by 10.68.232.201 with SMTP id tq9mr2158528pbc.70.1340307617038; Thu, 21 Jun 2012 12:40:17 -0700 (PDT) Sender: fdmanana@gmail.com Received: by 10.143.78.4 with HTTP; Thu, 21 Jun 2012 12:40:16 -0700 (PDT) In-Reply-To: <1340306882.46820.YahooMailNeo@web39401.mail.mud.yahoo.com> References: <1340152586.21235.YahooMailNeo@web39403.mail.mud.yahoo.com> <1340297453.92738.YahooMailNeo@web39405.mail.mud.yahoo.com> <04EAF841-633C-44F5-954B-32988F653892@apache.org> <1340306882.46820.YahooMailNeo@web39401.mail.mud.yahoo.com> Date: Thu, 21 Jun 2012 20:40:16 +0100 X-Google-Sender-Auth: oG7MCNlFVs6MmGuRbFEwuRDFxu0 Message-ID: Subject: Re: Replication and checkpoints - what to expect? From: Filipe David Manana To: user@couchdb.apache.org, Andreas Kemkes Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org On Thu, Jun 21, 2012 at 8:28 PM, Andreas Kemkes wrote: > The bump was by mistake, I wanted to add to it (i.e., stalling replicatio= n - see other reply). =C2=A0Thanks for answering. > > It should report 100% in my opinion if it has caught up with the current = source sequence, even though in the future there might be more. That is the case for continuous replications. When target has caught up with the source, it goes to 100%. When source gets new stuff, target will report a progress < 100% for some time, and then eventually back to 100%. > > The same should be true for filtered replications if there is no applicab= le document between the=C2=A0current source sequence and the last checkpoin= t. =C2=A0Otherwise you would be always wondering if it has been replicated = entirely. That's harder. With filtered replication, we only know about sequence numbers of changes that pass the filter. > > -- Andreas > > > ________________________________ > =C2=A0From: Robert Newson > To: user@couchdb.apache.org; Andreas Kemkes > Sent: Thursday, June 21, 2012 10:40 AM > Subject: Re: Replication and checkpoints - what to expect? > > > If you're running continuous replication, then the process isn't going to= reach 100% (since that would imply all future changes have been replicated= , which is clearly impossible). I suspect it's just a reporting anomaly. I = didn't reply earlier because I hadn't had time to verify the code but since= you bumped the thread, I thought I'd best say something. > > B. > > > On 21 Jun 2012, at 17:50, Andreas Kemkes wrote: > >> Reply to user@couchdb.apache.org >> >> >> ________________________________ >> From: Andreas Kemkes >> To: "user@couchdb.apache.org" >> Sent: Tuesday, June 19, 2012 5:36 PM >> Subject: Replication and checkpoints - what to expect? >> >> Upgrading to 1.2 on the target system allowed me to setup an unfiltered = continuous replication between a couchdb 1.1.1 instance and a couchdb 1.2 a= nd then use the latter as the source for several filtered continuous replic= ations to shard a monolithic couchdb database. >> >> The unfiltered replication was started from the futon replicator api, al= l the others from the command line using the ../_replicate call.=C2=A0 All = replications are pull. >> >> The all work nicely, except that the replication between couchdb 1.1.1 a= nd couchdb 1.2 seems to not write any checkpoints after a while: >> >> Checkpointed source sequence 911275, current source sequence 918089, pro= gress 99% >> >> Is this to be expected?=C2=A0 Would an upgrade to couchdb 1.2 on the sou= rce system correct the issue? >> >> >> I also think that the filtered replications, which don't involve couchdb= 1.1.1, only checkpoint to the latest sequence that involves a document tha= t passes the filter.=C2=A0 Even if new documents are added at the source an= d replicated to the target, a new checkpoint is not always written. >> >> Is this a known issue? >> >> How can I further narrow down the issue? >> >> Any documentation on the interplay of replication and checkpoints would = helpful as well.=C2=A0 Thanks for your help. >> >> -- Andreas --=20 Filipe David Manana, "Reasonable men adapt themselves to the world. =C2=A0Unreasonable men adapt the world to themselves. =C2=A0That's why all progress depends on unreasonable men."