Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: pass (nike.apache.org: domain of dave@muse.net.nz designates
 209.85.212.52 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CALp38EMUfBTz=5HMfikFETRO2_ckTArNmmDrb=SMmJVHzzHdow@mail.gmail.com>
References: 
 <CALp38ENfFkmUgRB7cTTGEeX6oukV=7+YuYhM3uHeZfHga4h_jQ@mail.gmail.com>
	<CACrj35FNrx5xgkD73GgYWBgrDozeXVO4yJkQgfM5ECa3xV1Btw@mail.gmail.com>
	<CALp38EP8roLd8f=HzhcWD5Zpw5Emb95s4SOeNCJLnfasFr0xtA@mail.gmail.com>
	<CACrj35HNgW6FnTsCRx-ytEvFuLouvsEYfwKk3ERP1h9VwYB21g@mail.gmail.com>
	<CALp38ENvjLXh4gXZ8jhAiS2Ze5uqFifSS1R2HFwU-OW2QS7hpg@mail.gmail.com>
	<CACrj35EtBGMpc1W+BYCWZ-xYcVgN1RJzZcpMyTCkG1wbS0knig@mail.gmail.com>
	<CALp38EMUfBTz=5HMfikFETRO2_ckTArNmmDrb=SMmJVHzzHdow@mail.gmail.com>
Date: Fri, 8 Jun 2012 10:38:38 +0200
Message-ID: 
 <CAHZBNKYtzN=TMktL4+==uZBmRFdZFua5CCNcmGa27yw4Y0f7Zg@mail.gmail.com>
Subject: Re: Adding vs replicating documents
From: Dave Cottlehuber <dave@muse.net.nz>
To: user@couchdb.apache.org
Content-Type: multipart/alternative; boundary=20cf307ca538389fc404c1f1ed07

--20cf307ca538389fc404c1f1ed07
Content-Type: text/plain; charset=ISO-8859-1

On 8 June 2012 06:26, Luca Matteis <lmatteis@gmail.com> wrote:

> Ok, say I install a local Couch that I upload my 1gb of data to.
> Whenever a change is made to a JSON document in my file, my routine
> will still have to go through all the records and update my local
> Couch, which would result in the entire DB updating, therefore the
> replication would need to transfer *everything* to my hosted Couch
> once again.
>
>
Continuous replication would be an obvious solution to this.

If you need to intervene programmatically then sit on the _changes feed,
keep track of the ids that change and then specify the URLs to replicate
manually. This is covered on the wiki & in the guide also, you have the
links
by now  :-)

If your JSON docs are generated by script with ids, then you can simply
regenerate them into your local couch (no need for replication) and
the revs etc will all match up nicely with the remote end.

Key misconceptions:

#1 changes feed will allow you to find out changes since a given DB update.

#2 replication does not transfer all documents, it compares docs and
missing revs
and makes smart decisions on what needs to be transferred. If a doc exists
in the source but not in the destination, the whole of that doc *does* of
course
need to be transferred. That's likely a simplistic summary but will do for
the
moment.

A+
Dave

--20cf307ca538389fc404c1f1ed07--