From user-return-21545-apmail-couchdb-user-archive=couchdb.apache.org@couchdb.apache.org Fri Jul 13 00:15:43 2012 Return-Path: X-Original-To: apmail-couchdb-user-archive@www.apache.org Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E71CED4C2 for ; Fri, 13 Jul 2012 00:15:38 +0000 (UTC) Received: (qmail 56087 invoked by uid 500); 13 Jul 2012 00:15:37 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 56049 invoked by uid 500); 13 Jul 2012 00:15:37 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 56036 invoked by uid 99); 13 Jul 2012 00:15:37 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 13 Jul 2012 00:15:37 +0000 X-ASF-Spam-Status: No, hits=4.7 required=5.0 tests=FREEMAIL_FORGED_REPLYTO,FSL_FREEMAIL_1,FSL_FREEMAIL_2,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [98.139.213.154] (HELO nm9-vm0.bullet.mail.bf1.yahoo.com) (98.139.213.154) by apache.org (qpsmtpd/0.29) with SMTP; Fri, 13 Jul 2012 00:15:29 +0000 Received: from [98.139.212.151] by nm9.bullet.mail.bf1.yahoo.com with NNFMP; 13 Jul 2012 00:15:08 -0000 Received: from [98.139.212.196] by tm8.bullet.mail.bf1.yahoo.com with NNFMP; 13 Jul 2012 00:15:08 -0000 Received: from [127.0.0.1] by omp1005.mail.bf1.yahoo.com with NNFMP; 13 Jul 2012 00:15:08 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 239738.99398.bm@omp1005.mail.bf1.yahoo.com Received: (qmail 79348 invoked by uid 60001); 13 Jul 2012 00:15:07 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1342138507; bh=RJ9Yeigs72YOho55goJG2GRwgsra6G1xC8bUJq9Ga1w=; h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=oqS5o+e1DRyzO6daHNx2VZK9O2HTIB7ErnOxS27yuiv5NcHa/IyuhEXWKPWQWLwI9iTYjR+h4T86OKTkkldeHLTPEJwsjI92F6L8rJ13eZyY/BWXAcg/A7tzca/J7NmiXCejIOOvoGFQOrnSXzLfxG1x3UU1jauW5+M/njcWWQA= DomainKey-Signature:a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=yu2YhsIGUOGbzlyckLX0k2Av3cb7Vbn+7EhdzXzN4f64lnUS5esQ+SPekfzjWXxE3aqTPXpglc/emw/ClkFWelfcCLyJJEn1/lxWg6Ua/uXVMMP2ltkEvdj2EuwIdopxoNfLYKFcXcAyV55UAShw8jnVUFcSFiIkPWeUYVc5xIY=; X-YMail-OSG: NHasgYcVM1n95s0y3ophPeKPnj3II3l34lcRrzKbdBcY9wE Mb4wnts_z.F4Xb.d0yCZeZsMQgAR0e1XKQcu5z.qKvDBKkm.YOf9jCZXxNIX FqBEQ19Ar.yPtF77ma.0GNmanNmHs3NsnAwso0hqzoEVCDKTNlBHHVifRP3Z iaovGA3XHkNZ7K4ftRX5BOsjl5urZlvIbKH6PHnkt0yn22h8N0qzGqd5l8oJ METKS2nPAJSn9IshYRZ45zQJCMKgsNevkO4_HcLNYyZ2gLCwRgv6M8Ns4oTu CyKTgdS1j43zI2VNyU.odVjH7.pBJxmtIzJ47ZooaVLWIcDDVO.A8Ql5ZFJN o77k8BFhMesSUNPTFe.lUEwub2X.YSanYY0CVf5gbnVfiCuHws7pPVQTP8IC NnEJRcEtmt5Oifa2T87CHFrk_UQf7lKTS7Jv87FEAeVt7Q.wecSjftD.aJH2 DWOEJhwlpyyx332CHrw-- Received: from [98.119.13.225] by web39405.mail.mud.yahoo.com via HTTP; Thu, 12 Jul 2012 17:15:07 PDT X-Mailer: YahooMailWebService/0.8.120.356233 References: <1342050226.6885.YahooMailNeo@web39405.mail.mud.yahoo.com> Message-ID: <1342138507.57716.YahooMailNeo@web39405.mail.mud.yahoo.com> Date: Thu, 12 Jul 2012 17:15:07 -0700 (PDT) From: Andreas Kemkes Reply-To: Andreas Kemkes Subject: Re: Filtered replication topologies To: "user@couchdb.apache.org" In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="-154443274-88175345-1342138507=:57716" X-Virus-Checked: Checked by ClamAV on apache.org ---154443274-88175345-1342138507=:57716 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable Mathias:=0A=0AThat is excellent advise. =A0Still learning feature by featur= e.=0A=0AThanks,=0A=0AAndreas=0A=0A=0A________________________________=0A Fr= om: Mathias Leppich =0ATo: user@couchdb.apache.org; Andr= eas Kemkes =0ASent: Thursday, July 12, 2012 12:22 AM=0AS= ubject: Re: Filtered replication topologies=0A =0AHi Andreas,=0A=0AIf you r= eplicated to R1..n via an intermediate database they will not know the sour= ce DB.=0ABut if you KNOW that M's seq N has already made its way via I to t= he Rs, you can use that seq N as a start seq parameter for a new replicatio= n between M and the Rs.=0A=0Ae.g.=0Acurl -sg -X POST 'http://sourceHost:598= 4/_replicate' -H 'Content-Type:application/json' -d '{=0A"source":"sourceDB= ", =0A"target":"http://targetHost:5984/targetDB",=0A"filter":"filters_erl/n= o_design",=0A"continuous":true,=0A"since_seq":59210797=0A}'=0A=0A- mathias= =0A=0AOn Jul 12, 2012, at 1:43 , Andreas Kemkes wrote:=0A=0A> To speed up t= he process of breaking up one monolithic database into multiples, I used an= intermediate database to get to the end result:=0A> =0A> =0A> =0A> M=A0 -= - pre-filtered replication -->=A0 I=A0 -- 1..n filtered replications -->=A0= R1..n=0A> =0A> =0A> Afterwards I tried to set up continuous filtered repli= cations directly between M and R1..n.=A0 It seems that the replication algo= rithm runs through the entire file again and does not take into account the= last entry in Rx.=0A> =0A> To make proper use of the existing state of the= databases R1..n, does the continuous replication have the same source (i.e= ., I instead of M)?=0A> =0A> Is it possible to provide a topology agnostic = implementation?=0A> =0A> What would be my best course of action?=0A> =0A> -= - Andreas ---154443274-88175345-1342138507=:57716--