Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
MIME-Version: 1.0
In-Reply-To: 
 <CAN-3CBK3SCx7Y5K1oEC+XfzgY2B+-9_0c90m6npM9GkE_myu0g@mail.gmail.com>
References: 
 <CAAOi-OFMhQ0X3iEUC6T0fSdwJLV20Huj4tnJZBSfZ5Q5TtEx7g@mail.gmail.com>
 <CAN-3CBK4OQ5jJDa3ojfxkt=nN0OVpX8JnFUp21-AkgJzLTtN5g@mail.gmail.com>
 <CAAOi-OFWeYtZbLfLbsUV9Egk3j6kFtVa2t9urZu95KH3buLJdw@mail.gmail.com>
 <CAMiZLn07ru9fUgxsmtCsT2rG8ShfRrD=1bpLRN-f1YGG8athTA@mail.gmail.com>
 <CAAOi-OGEvWZrEkDyrxr1W0FKmA=Feso=smesQYU9_joARtSiqQ@mail.gmail.com>
 <CAN-3CBK3SCx7Y5K1oEC+XfzgY2B+-9_0c90m6npM9GkE_myu0g@mail.gmail.com>
From: Daniel Gonzalez <gonvaled@gonvaled.com>
Date: Fri, 16 Mar 2012 10:10:44 +0100
Message-ID: 
 <CAAOi-OEBZye==s9uE6amc2_ojzTPbf4SjW6OM1p=PjijpO5GXw@mail.gmail.com>
Subject: Re: Size of couchdb documents
To: user@couchdb.apache.org
Content-Type: multipart/alternative; boundary=20cf303f6acc9f219804bb5896ce

--20cf303f6acc9f219804bb5896ce
Content-Type: text/plain; charset=ISO-8859-1

>
> Hi, Daniel. That's great news! Also, I have an update from a CouchDB 1.2.0
> test.
>
> I have a database here with 10 million documents, most several KB of
> English text. upgrade to version 1.2 changed the database size from
> 38GB to is 9.2GB, or now 0.94 KB per document.
>

That is interesting. Is CouchDB reducing the size of your stored data?
Compression? Or is the average size of your input data smaller than 0.94KB?
(I am not sure what "most several KB" means)


>
> So you should see an even greater improvement when 1.2.0 comes out
> Real Soon Now.
>
> > I have one more question. Is the alphabet I have shown above "ordered"
> for
> > couchdb?
>
> The sort order may not be quite what you expect, especially if you
> work with Unix or servers a lot.
>
> It is described here:
> http://wiki.apache.org/couchdb/View_collation#Collation_Specification
>
> Basically CouchDB follows (uses!) ICU. The major point is that
> different letter sequences are compared case-insensitively, but
> same-letter strings are case sensitive (lower case first). To me, it
> more or less follows how an English dictionary would do it.
>
> --
> Iris Couch
>

I have now changed my encoding dictionary to:

"-@0123456789aAbBcCdDeEfFgGhHiIjJkKlLmMnNoOpPqQrRsStTuUvVwWxXyYzZ"

As suggested by Jamie Talbot. That seems to be ordered in the ICU (or UCA?)
sense.

Regarding size of documents, having now nearly 20 millions of documens, and
7.4GB, I can defenitely say that the situation has indeed improved a lot. I
have now 400 bytes/doc, down from originally 3KB/doc.

--20cf303f6acc9f219804bb5896ce--