incubator-couchdb-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Benoit Chesneau <bchesn...@gmail.com>
Subject Re: Cleanup of an online database
Date Mon, 30 Sep 2013 09:38:52 GMT
On Mon, Sep 30, 2013 at 11:22 AM, Boaz Citrin <bcitrin@gmail.com> wrote:

> Hello,
>
> Having a database with massive writes and updates, its file (and views) get
> huge and fragmented.
> Even a daily compaction takes few hours, and we cannot allow pausing these
> updates as users count on latest information.


> So we need some kind of online cleanup...
>
> I wonder it we could somehow copy files to a side database, run compaction,
> replicate latest changes and swap databases.
>
> Can anyone recommend a procedure?
>
> Thanks!
>


Replication to a new db will remove any fragmentation but can be
complicated since you switch the dbs for the user.

I would go for small dbs running compaction in background. Maybe you can
shard your content so it can goes in different dbs or use bigcouch to shard
your dbs transparently.

- benoit

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message