Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
MIME-Version: 1.0
In-Reply-To: 
 <CAMiZLn07ru9fUgxsmtCsT2rG8ShfRrD=1bpLRN-f1YGG8athTA@mail.gmail.com>
References: 
 <CAAOi-OFMhQ0X3iEUC6T0fSdwJLV20Huj4tnJZBSfZ5Q5TtEx7g@mail.gmail.com>
 <CAN-3CBK4OQ5jJDa3ojfxkt=nN0OVpX8JnFUp21-AkgJzLTtN5g@mail.gmail.com>
 <CAAOi-OFWeYtZbLfLbsUV9Egk3j6kFtVa2t9urZu95KH3buLJdw@mail.gmail.com>
 <CAMiZLn07ru9fUgxsmtCsT2rG8ShfRrD=1bpLRN-f1YGG8athTA@mail.gmail.com>
From: Daniel Gonzalez <gonvaled@gonvaled.com>
Date: Thu, 15 Mar 2012 16:14:53 +0100
Message-ID: 
 <CAAOi-OGEvWZrEkDyrxr1W0FKmA=Feso=smesQYU9_joARtSiqQ@mail.gmail.com>
Subject: Re: Size of couchdb documents
To: user@couchdb.apache.org
Content-Type: multipart/alternative; boundary=20cf303f6acc04e96204bb498f92

--20cf303f6acc04e96204bb498f92
Content-Type: text/plain; charset=ISO-8859-1

Hi Matthieu,

This really seems to help. I am using now a base62 encoded monotonically
increasing integer, which means my doc_id goes from "0" onwards, using the
alphabet:

ABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789abcdefghijklmnopqrstuvwxyz

I am getting now 3000 docs/s, more or less stable, and the size of my
documents has decreased from 3KB to 0.4 KB.
I am not sure whether this metrics will worsen when the database grows, but
my feeling is that the situation has improved a lot just by changing the
doc_id.

I have one more question. Is the alphabet I have shown above "ordered" for
couchdb?

Thanks,
Daniel

On Thu, Mar 15, 2012 at 3:09 PM, Matthieu Rakotojaona <
matthieu.rakotojaona@gmail.com> wrote:

> On Thu, Mar 15, 2012 at 3:00 PM, Daniel Gonzalez <gonvaled@gonvaled.com>
> wrote:
> > I understand the overheads that you are referring to, but it still
> schocks
> > me that Couchdb needs 8 times as much space to store the data.
> >
> > Are there any guidelines on what to do/avoid in order to get a lower
> > overhead ratio?
>
> I got surprisingly good results when changing the _id design. I advise
> you to follow what is written in this page :
> http://wiki.apache.org/couchdb/Performance#File_size
>
> Basically :
> - use shorter _ids
> - use sequential _ids. If you cannot (eg because you have multiple
> disconnected parts that will have to merge often and that would cause
> too many clashes), you can use couchdb's own semi-sequential generated
> uuids. Yes, uuids are contradictory to the first point.
>
>
> --
> Matthieu RAKOTOJAONA
>

--20cf303f6acc04e96204bb498f92--