Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: pass (athena.apache.org: domain of rogutes@googlemail.com
 designates 74.125.83.52 as permitted sender)
Date: Wed, 28 Dec 2011 20:59:42 +0200
From: =?utf-8?Q?Rogut=C4=97s?= Sparnuotos <rogutes@googlemail.com>
To: user@couchdb.apache.org
Subject: Re: couchdb disk storage format - why so large overhead?
Message-ID: <20111228185941.GA32127@urvas>
Mail-Followup-To: user@couchdb.apache.org
References: 
 <CAHqJuML_HvJxHq77-ZrAnsmy1qQeaYF_0TArir-=gz7F0L-GKg@mail.gmail.com>
 <CAAL6JQihq+nVDU=Nn2S6cjJf84Q_Fysck+xrNm-0896MQ_uS6g@mail.gmail.com>
 <CAHqJuMKGuQ50-T3VaXi=0sZQQjYuPVjg1AQm8g5-aB36dA2HDw@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
Content-Transfer-Encoding: 8bit
In-Reply-To: 
 <CAHqJuMKGuQ50-T3VaXi=0sZQQjYuPVjg1AQm8g5-aB36dA2HDw@mail.gmail.com>

Alexey Loshkarev (2011-12-28 20:17):
> 2011/12/28 Randall Leeds <randall.leeds@gmail.com>:
> > Future releases of CouchDB, starting with the 1.2 release, will allow
> > for compression using google's snappy library which should greatly
> > reduce the overhead you experience.
> 
> Cool!
>
>
> > Also be sure to compact if the
> > ratio of disk usage to dataset size starts to grow too far. An
> > automatic compaction daemon is also coming.
> 
> Will wait for it!

But you were already compacting after every step in your testing, weren't
you?

And, actually, these 2 features are already available in git, so it's
"just" a matter of compiling and testing:
http://wiki.apache.org/couchdb/Running%20CouchDB%20in%20Dev%20Mode
If you try it out, please share your findings.

-- 
--  Rogutės Sparnuotos