Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: pass (athena.apache.org: local policy)
Date: Mon, 14 May 2012 13:12:34 -0700
From: James Marca <jmarca@translab.its.uci.edu>
To: user@couchdb.apache.org
Subject: Re: reducing db size
Message-ID: <20120514201234.GC2665@translab.its.uci.edu>
Mail-Followup-To: user@couchdb.apache.org
References: 
 <CAGxYWpbsi4bNwsMtTWe00Cysjwt1P4uRB2kDfPJyYyckvC3BMg@mail.gmail.com>
 <CAJ_m3YCgFFASn9219GLrPOZHLND+H3x6h2Cgd38NYAhNbEB=BA@mail.gmail.com>
 <CAGxYWpa9RkLNs0fcLFf4tJwEn9hz8mh1d2d7K0EL+xm9W1+TdQ@mail.gmail.com>
 <CAGxYWpbV7_pV0Ag-Yd8WU+sXiwKaenC1-g4LQjhF+PX8-TrFDw@mail.gmail.com>
Mime-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha1;
	protocol="application/pgp-signature"; boundary="QRj9sO5tAVLaXnSD"
Content-Disposition: inline
In-Reply-To: 
 <CAGxYWpbV7_pV0Ag-Yd8WU+sXiwKaenC1-g4LQjhF+PX8-TrFDw@mail.gmail.com>
User-Agent: Mutt/1.4.1i

--QRj9sO5tAVLaXnSD
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

On Mon, May 14, 2012 at 04:01:25PM -0400, Tim Tisdall wrote:
> Okay, I see that you can tell that it's running by doing a GET on the
> database in question and looking for the "compact_running":true .  Howeve=
r,
> I don't seem to see any changes in the db's file size.

As the documentation of the compaction code explains, compaction must
finish, and then the new smaller db replaces the old bigger db.

That way if compaction stops, or breaks, you still have your data.

The wiki does a decent job of explaining all this if you can find the
right parts.  What I said above is found at
http://wiki.apache.org/couchdb/Technical%20Overview#Compaction


>=20
> On Mon, May 14, 2012 at 3:42 PM, Tim Tisdall <tisdall@gmail.com> wrote:
>=20
> > Yes, I did it with a PUT for each id.  When you call for compaction, is
> > there a way to see the progress or a way to know if it's done?
> >
> >
> > On Mon, May 14, 2012 at 3:20 PM, Paul Davis <paul.joseph.davis@gmail.co=
m>wrote:
> >
> >> How did you insert them? If you did a PUT per docid you'll still want
> >> to compact afterwards.
> >>
> >> On Mon, May 14, 2012 at 2:13 PM, Tim Tisdall <tisdall@gmail.com> wrote:
> >> > I've got several gigabytes of data that I'm trying to store in a
> >> couchdb on
> >> > a single machine.  I've placed a section of the data in an sqlite db=
 and
> >> > the file is about 5.9gb.  I'm currently placing the same data into
> >> couchdb
> >> > and while it hasn't finished yet, the file size is already 10gb and
> >> > continuing to grow.  The sqlite database is essentially a table of i=
ds
> >> with
> >> > a json block of text for each, so I figured the couchdb wouldn't be =
too
> >> > much different in size.
> >> >
> >> > Does anyone have some recommendations on how to reduce the size of t=
he
> >> db?
> >> >  Right now I've only inserted data and have not made any "updates" to
> >> > documents, so there should be no revision copies to be cleared away.
> >>
> >
> >

--QRj9sO5tAVLaXnSD
Content-Type: application/pgp-signature
Content-Disposition: inline

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.6 (GNU/Linux)

iD8DBQFPsWcy+t/6L/9qydcRAnSXAJwO3QsGC3rXCDE7fSGLH7udGu4YTQCfRuSC
A7xspE7cHs4C2YITODm7unI=
=Zwg2
-----END PGP SIGNATURE-----

--QRj9sO5tAVLaXnSD--

-- 
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.