Return-Path: X-Original-To: apmail-couchdb-user-archive@www.apache.org Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id EC19910BA7 for ; Mon, 17 Mar 2014 21:18:12 +0000 (UTC) Received: (qmail 96288 invoked by uid 500); 17 Mar 2014 21:18:11 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 96224 invoked by uid 500); 17 Mar 2014 21:18:10 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 96216 invoked by uid 99); 17 Mar 2014 21:18:10 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Mar 2014 21:18:10 +0000 X-ASF-Spam-Status: No, hits=2.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,TO_NO_BRKTS_HTML_IMG,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jun@iilab.org designates 209.85.212.175 as permitted sender) Received: from [209.85.212.175] (HELO mail-wi0-f175.google.com) (209.85.212.175) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Mar 2014 21:18:06 +0000 Received: by mail-wi0-f175.google.com with SMTP id cc10so2838494wib.14 for ; Mon, 17 Mar 2014 14:17:44 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:content-type:subject:message-id:date:to :mime-version; bh=3M5gViWCwKmFScSXSQWXHOsGys1Lin21j1RqVbAuPvs=; b=W01SUQxA9+YrE7HTsomzufIv0cduAUaEvY0dFICMdoMJ9Kfo6q6/QwFQ3fhYIVh4Wr z31nTaMxStdGsCMh5A0Lhe1omsQPQwqK1Kiikb4LMD6D6nwNKWwWzjwhdIFXBKopbwog TPqUHuevzUxBzswxYrJLJ2J2i8Gp7PNsWVd9vlnCfxkOSEhxxk2pJR2pdRpY9/mLwIgk vebvTFqQgs2I7I9KIc0aSg6q1G33+9nSKks7A18y154MQ33MmUp35YJ5vFsSvefhiUTG W1Z541Ow5844uQ7RfgszSmvvkc5xQp6a1wZdankJmoQUCFrHaj3UqckZE21BKHMv56hU AnsQ== X-Gm-Message-State: ALoCoQm2ikN+NAZ0ChBIb1SPeObuHFTNdtgenB8bSsmtIg5viyzIpe8Sqtd9tuCFFAyccc1YLWuW X-Received: by 10.194.185.113 with SMTP id fb17mr20226309wjc.29.1395091064392; Mon, 17 Mar 2014 14:17:44 -0700 (PDT) Received: from [192.168.1.72] (host86-180-101-127.range86-180.btcentralplus.com. [86.180.101.127]) by mx.google.com with ESMTPSA id g5sm41488037wjs.8.2014.03.17.14.17.43 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 17 Mar 2014 14:17:43 -0700 (PDT) From: Jun Matsushita Content-Type: multipart/signed; boundary="Apple-Mail=_066D6D43-BFCE-4E9E-9976-609BD8E3442B"; protocol="application/pgp-signature"; micalg=pgp-sha1 Subject: Cannot prevent replication of design document in couchdb Message-Id: <97D0CD47-20CB-408E-8B67-D8585B466EF7@iilab.org> Date: Mon, 17 Mar 2014 21:17:41 +0000 To: user@couchdb.apache.org Mime-Version: 1.0 (Mac OS X Mail 6.6 \(1510\)) X-Mailer: Apple Mail (2.1510) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_066D6D43-BFCE-4E9E-9976-609BD8E3442B Content-Type: multipart/alternative; boundary="Apple-Mail=_67EBAB92-A2D8-4716-B9A7-73E95A19F825" --Apple-Mail=_67EBAB92-A2D8-4716-B9A7-73E95A19F825 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Cross posted here. = http://stackoverflow.com/questions/22311868/cannot-prevent-replication-of-= design-document-in-couchdb We're trying to use the couchdb replication over a very high latency = link (slow, frequent disconnections,...). We want to avoid to replicate = the design document which is heavy. We have a filter in place and when = using the following curl command, the design document doesn't appear, as = expected: curl http://x.x.x.x:5984/emr/_changes?filter=3Demr/user_data Our replication document is: { "_id": "e0e38be8cc0b11356dfb03bc8400074d", "_rev": "1-d77117f03d63099e1e505b9f9de3371d", "source": "http://x.x.x.x:5984/emr", "target": "emr", "continuous": true, "filter": "emr/user_data", "create_target": true, "owner": "jun" } We have deactivated authentication while we're debugging. When using an = existing database and removing create_target, the same problem occurs. The source server outputs the following: [Mon, 10 Mar 2014 21:22:03 GMT] [info] [<0.135.0>] Retrying HEAD request = to http://x.x.x.x:5984/emr/ in 0.25 seconds due to error = {conn_failed,{error,etimedout}} [Mon, 10 Mar 2014 21:23:47 GMT] [info] [<0.135.0>] Retrying GET request = to http://x.x.x.x:5984/emr/_design/emr in 0.25 seconds due to error = req_timedout [Mon, 10 Mar 2014 21:24:14 GMT] [error] [<0.135.0>] Replicator, request = GET to "http://x.x.x.x:5984/emr/_design/emr" failed due to error = {error,req_timedout} [Mon, 10 Mar 2014 21:24:14 GMT] [error] [<0.135.0>] Replication manager, = error processing document `e0e38be8cc0b11356dfb03bc8400074d`: Couldn't = open document `_design/emr` from source database = `http://x.x.x.x:5984/emr/`: = {'EXIT',{http_request_failed,"GET","http://x.x.x.x:5984/emr/_design/emr", {error,{error,req_timedout}}}} When using tcpdump, it's clear that the replication fails because the = replication manager attempts to download the heavy design document = (http://x.x.x.x:5984/emr/_design/emr). FYI the replicator's configuration is: replicator connection_timeout 5000 =20 db _replicator=20 http_connections 1 =20 max_replication_retry_count 3 =20 retries_per_request 1 =20 socket_options [{keepalive, true}, {nodelay, = true}] =20 ssl_certificate_max_depth 3 =20 verify_ssl_certificates false =20 worker_batch_size 1 =20 worker_processes 1 Hope someone can help! -- Jun Matsushita Co-founder, CEO mobile: +44 7429 144 691 skype: junjulien iilab.org @iilab information innovation lab --Apple-Mail=_67EBAB92-A2D8-4716-B9A7-73E95A19F825 Content-Type: multipart/related; type="text/html"; boundary="Apple-Mail=_35264234-8E30-4A9F-AD8E-C1F0E2BEA98D" --Apple-Mail=_35264234-8E30-4A9F-AD8E-C1F0E2BEA98D Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii Cross = posted here. http://stackoverflow.com/questions/223= 11868/cannot-prevent-replication-of-design-document-in-couchdb

curl http://x.= x.x.x:5984/emr/_changes?filter=3Demr/user_data

{ "_id": "e0e38be8cc0b11356dfb03bc8400074d", "_rev": "1-d77117f03d63099e1e505b9f9de3371d", "source": "http://x.x.x.x:5984/emr", "target": "emr", "continuous": true, "filter": "emr/user_data", "create_target": true, "owner": "jun" }

[Mon, 10 Mar = 2014 21:22:03 GMT] [info] [<0.135.0>] Retrying HEAD request to http://x.x.x.x:5984/emr/ in 0.25 = seconds due to error {conn_failed,{error,etimedout}} [Mon, 10 Mar 2014 21:23:47 GMT] [info] [<0.135.0>] Retrying GET = request to http://x.x.x.x:5984/emr/_desi= gn/emr in 0.25 seconds due to error req_timedout [Mon, 10 Mar 2014 21:24:14 GMT] [error] [<0.135.0>] Replicator, = request GET to "http://x.x.x.x:5984/emr/_desi= gn/emr" failed due to error {error,req_timedout} [Mon, 10 Mar 2014 21:24:14 GMT] [error] [<0.135.0>] Replication = manager, error processing document `e0e38be8cc0b11356dfb03bc8400074d`: = Couldn't open document `_design/emr` from source database `http://x.x.x.x:5984/emr/`: = {'EXIT',{http_request_failed,"GET","http://x.x.x.x:5984/emr/_desi= gn/emr", {error,{error,req_timedout}}}}

FYI the = replicator's configuration is:

replicator  =
connection_timeout          5000   =20
            db                          _replicator=20
            http_connections            1  =20
            max_replication_retry_count 3  =20
            retries_per_request         1  =20
            socket_options              [{keepalive, true}, {nodelay, =
true}]   =20
            ssl_certificate_max_depth   3  =20
            verify_ssl_certificates     false  =20
            worker_batch_size           1  =20
            worker_processes            1

Hope someone can help!

--

Jun = Matsushita
Co-founder, CEO

mobile: = +44 7429 144 691
skype: = junjulien
information = innovation lab



= --Apple-Mail=_35264234-8E30-4A9F-AD8E-C1F0E2BEA98D Content-Transfer-Encoding: base64 Content-Disposition: inline; filename=iilab-logo-signature.png Content-Type: image/png; name="iilab-logo-signature.png" Content-Id: iVBORw0KGgoAAAANSUhEUgAAAJYAAABJCAYAAADfad8YAAAAGXRFWHRTb2Z0d2FyZQBBZG9iZSBJ bWFnZVJlYWR5ccllPAAAB0xJREFUeNrsXT1s20YUPgfe0kFd0tHynsI2OrRLawkdutny2CkSkN3W 2gyyhnaVtBegPHmsOmZwzaRLOhSR4e5Wx3hSgXpO31O+qy+UTuLPkSLp9wEHihR/Hnnf3Xv37j1S KYFAIBAIBAKBa2zIIyguvv7z9S4tPCq8HFPp/v7FNyMhliAJqaq0eEulEvirTuTy1y3fI6miwqK5 gFSMZ3kQTohVPlSFWIIksKm7X8XGEiS1s3q0ODE2Dcm+agmxBK6MeC5TItVYnohAIBAIBAJBeSHG +8M1+hu06GnDn0qbjP+hEEuQdCR5s+AvZ9NB4iB9mGhath+7uoAQS5AKNi1dJU9uskeXnW79iN2s PpbRp+OnEY+ftSaX+j5FdcKy+nmIJogIlrezYLuz6SBbj+Xhwj16gCcRz9nDsR318XRDWDxTOZmh X4Eq7rFWtN4EDaEd2Nx32ZhtxKpYfoeBuf+WKIXckos10adssPOS1tupq0LCAC1xQiUqi8+MVjyQ Ksw1uabKHiXhnlgIb92IKSwfO5JqWz/ev1QHtHhM5XbjO3WxduNdUApSPafFgbH+hMh1ntX1xd1Q XhwE1j/P8uJCrPLiNrD+rxBL4AI8cLozSHae5cXFxiopyJ66psX3ZFtt0++brK8vxCo/wRKRClEQ s4TYKMmwQizBMlJdKmNmgdaZXHtiYwmSkKqp5qerdsNO8QmxBDZULdv3H7QqpJZVg20QnOucwl7w M5anCnl2F/w9hkyTAjzaSSJiQb+O40xOJjnWAZk4MqKhVkye075MMDZGu2lVKEKIWJZjC6GC+7Mc PNcaOdwoCtgLr9T/0z2/YQQZxBByVwKNMtT87zJVWAvzMFI4NhahQGYubBtwb8QZwdtUQRtmUR9m 89t4SLzvDR17mpKNwiMyD5XTV/eRBKY8OsJAx711tEwgZhr4CcT6lsqPRLQ5rzwaWx0E89EI62Eb YeFVYSDNfLiqB4IK5NLHUHoWe0a/t1ykp4MMv6j76JClSQpGhAGXNgip49kOab3lMsMZJHoS2PyU yvUC2cZooJHxqOCkaoBU/AD2mBhR1Br8Mts4vpm05wKp9BB9CJmGUc6B/fdwPPf6l3jBmiu8W7Dt znXdFJpYIEYbXfQ45jm4xziCauzAyE5CKiZBCySfxpUJvWcLatQZucieug3YSX9RcR5SU3hVGDUm 33KOCVXcAOrnWM2H7YaBZ5Bq6OjehiAsq3uPfteXkfUP1eLe9wWM8sGXyntjIddFGmQSP9ZiaII2 YqpkLkPXSSBoOCOQtrNi969gPz1W82EzmUKINW9EV2OMxnraUE9JvBZU9ckKVW2GylwLsfKDV1hG sWfYb1bFaHSaIum1XWRNKiXVd4H/X9DvcyFWscGkmmSQB6lVdXPZTkSoGyrX634oQiw3OMtIVbOt VcEMQ64hxHKDrLKSdKZy7okl8VjJkeW7P30s99dxo0bQ3xQj4OmDIxYcityyK0ZFVJT7OczMXigL f5uz871/OXNLHMNNwT6vc1vEKV3XC9h37Ezes810bJaQTPyggtENE5RZS6Pyt+UU+zHUTNZvKh47 VIXPQSqF5SdUfrA81+CggZ9vR1nmEjdLQigemXnGAx/DoI4Ud4W5wqiV9k/WqtfhuT4LrD+17NdY MiIupypENEAPLYh7o25BAubygHcBMr2J2CuX08YCqTzc4Lq+erWT8fUqDnutn42eixNaBxbbbsSJ FAvs00HpiGV8q0+Tal1fZahkfL1d5egNMWSo36nwbwTioL8T2KGzmYBlDbnIPVYPy6M1f+qjlnFj 0oORTAHXwmnY/QvpIMUkcU25T4rYiSlPI2MSX+W9jorqedct1/Un1KoxjzvM6L61P24kxEq35Trr rdALxnWeNlJMfNDyVTHsL0SamMwVGuSIeZwPA/4kZfk6q0ZiQqzkmCRUXbaKizMIeAVydRwnPQSN 9qbKJjxHiKUc+ZDgD6sm6A26WHquVSLO52G1VZQKKiSxMBKcJZwmrUgjWWFoELYWQ54ubDTP8e32 cN5+kT5UUGQbawDbppeQVJdYbSck+ynIyYb8pQvCGxEFftavK3iwxEJF6kRTL0bF7YJUrALryOXz E8rUArm4x3sbN9ITx+nXBbBr4aho9VP0Sei6rgAMx7uryGF866ej7NNBO0nIRde4wvm55/LDyGWQ /Vjdh6h00YDWCqOBTB7Euxu4l+EkTnX/3Z4a3tjCrfzKsJm0j2rHcCv01eLMmqlKOP/HuYAkxwhy NQ25fMhlEpnl2oJcepQ7y/Bet78qkN2tt4VKyN1c0RtME/QkcY9tRyWX+vAyjQEq8VDZfUpjnH+0 pNLqIS89xr4Ti1y8nXuvLkhzqJZn2IxB9kGOHKA9Ne805pGvv0rG0n5hNWjf5GVEBXX30Tun1jyJ vkzWS8sIub3q1QaljXnP69A8rySKiJU9qkzpCJbhzEIqX4glSNK7DmGTToxBRT3N11gKBAKBQFAS /CfAAMo1weWVEhrrAAAAAElFTkSuQmCC --Apple-Mail=_35264234-8E30-4A9F-AD8E-C1F0E2BEA98D-- --Apple-Mail=_67EBAB92-A2D8-4716-B9A7-73E95A19F825-- --Apple-Mail=_066D6D43-BFCE-4E9E-9976-609BD8E3442B Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - http://gpgtools.org iQEcBAEBAgAGBQJTJ2Z1AAoJECoH9wygNueSGbwH/256cDHxutm9OxgpeYNKwbl6 lF6+VBSVxwSa+aqbv/vJvKGwI6xPr4r8yeXwb18jfMxhOyhhuec3Uc+MdIqx8wF2 PxBZbKQxsSgcFgRB6AXiFGm//1kbQmP4kYkiQTniYrY590/SMxVMJogOR2zygVqz fi18VB8bSSq21lc3IwLCRIxtHLLbVleDy5S5hesN4nQ/qD+IunVxSZDqSvgoogOd ACKFvln27UJgtFbHrfE53BeEfCx+7ktEgq5rxdFivFZ6VvOzWd4iJgFqA5yLk2rw hSM/bSVYbMuHtRBYOAYNIvY+kTTToqrdd/w/QURGYgIID/kZHgzdp15TmcfNPnQ= =AymT -----END PGP SIGNATURE----- --Apple-Mail=_066D6D43-BFCE-4E9E-9976-609BD8E3442B--