Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: pass (athena.apache.org: domain of fdmanana@gmail.com designates
 209.85.210.52 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:sender:in-reply-to:references:date
         :x-google-sender-auth:message-id:subject:from:to:content-type
         :content-transfer-encoding;
        b=RkiW8vyvqGSkgeaWQh7NKafmrNo8ajKi8K3gQpoWfvI7grmjnBGBwzvTf/Ntc1u8IW
         n75qJEPzk6TT47wVsZ7Q3WRIlLqii/E/jQ8Ms47Cd0VK+3qZHi/cf4dgI0dsNIjIw7jF
         DvF1CbXTjEmYcy5AH6+X0Diov1oj7hS5mc4FM=
MIME-Version: 1.0
Sender: fdmanana@gmail.com
In-Reply-To: <BANLkTimHUXm5A+n0_WLAahnZwf+j-nUjLQ@mail.gmail.com>
References: <BANLkTimHUXm5A+n0_WLAahnZwf+j-nUjLQ@mail.gmail.com>
Date: Sat, 25 Jun 2011 22:49:45 +0100
Message-ID: <BANLkTinVZZDBrgSPUOtDxCjtm1PwXZf_wg@mail.gmail.com>
Subject: Re: CouchDB compaction [again]...
From: Filipe David Manana <fdmanana@apache.org>
To: user@couchdb.apache.org
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

On Sat, Jun 25, 2011 at 6:32 AM, kowsik <kowsik@gmail.com> wrote:
> We are running a cluster of 1.0.2 CouchDB's in production
> (http://blitz.io) and the one and only thing that we have to look into
> periodically is compaction. Are there plans for automatic compaction
> in the roadmap so we can completely relax?

Hi Kowsik,

I've recently made a configurable compaction daemon (database and
views). It's proposed in:
https://issues.apache.org/jira/browse/COUCHDB-1153

I still have quite a few enhancements in my head todo, but in general
it's ok for many cases. It was included in the Couchbase 2.0 Single
preview CouchDB distribution. So far it had positive feedback, and no
bugs found yet.

The documentation for it:
https://github.com/fdmanana/couchdb/blob/compaction_daemon/etc/couchdb/defa=
ult.ini.tpl.in#L189

It makes use of recent "data_size" attribute added to trunk:
https://issues.apache.org/jira/browse/COUCHDB-1132


With the recent work by
> @fdmanana and @damienkatz I realize that the db size doesn't grow as
> rapidly now as before, what with the snappy compression and what not.
> But still this periodic checking in gets in the way of relaxing. Turns
> out 1.0.2 has a bug with compaction and _changes where CouchDB can
> just go poof and not leave a trace behind. It's been fixed since then,
> but still...
>
> While we <3 CouchDB and would like to check on it every now and then,
> we'd rather relax and be assured that it's always there in the
> background, mapping and reducing and being happy about it. One less
> thing to "monitor" and be paged on.
>
> Does anyone else have a write heavy couch cluster that they are
> running in production with multi-master replication and _changes?
> Would love to exchange notes on what you are doing to keep the DB size
> sane.
>
> Thanks,
>
> K.
> ---
> http://blitz.io
> http://twitter.com/pcapr
> http://blog.mudynamics.com
>


--=20
Filipe David Manana,
fdmanana@gmail.com, fdmanana@apache.org

"Reasonable men adapt themselves to the world.
=C2=A0Unreasonable men adapt the world to themselves.
=C2=A0That's why all progress depends on unreasonable men."