Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: pass (athena.apache.org: local policy)
From: Peter Hsu <phsu@abaca.com>
To: "user@couchdb.apache.org" <user@couchdb.apache.org>
Date: Tue, 7 Jul 2009 13:52:56 -0700
Subject: RE: view size extremely disk inefficient
Thread-Topic: view size extremely disk inefficient
Thread-Index: Acn/N2iE2hXAPzZmR1qxnKexNM8o8QADVkeQ
Message-ID: <22E9DC658696E640A074D8B363795BE62D6C5C1C65@mail1.ABACA.local>
References: <22E9DC658696E640A074D8B363795BE62D6C5C1C54@mail1.ABACA.local>
	<830466B8-361B-47A4-89AE-1990FD4CBBD8@apache.org>
In-Reply-To: <830466B8-361B-47A4-89AE-1990FD4CBBD8@apache.org>
Accept-Language: en-US
Content-Language: en-US
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

Is that available in 0.9.0?

I tried a POST but I get a 405 error.

[Tue, 07 Jul 2009 13:46:08 GMT] [info] [<0.22689.306>] 172.16.80.64 - - 'GE=
T' /mydb/_compact/meta_in 404

[Tue, 07 Jul 2009 13:47:43 GMT] [info] [<0.22706.306>] 172.16.80.64 - - 'PO=
ST' /mydb/_compact/meta_in 405

-----Original Message-----
From: Adam Kocoloski [mailto:kocolosk@apache.org]=20
Sent: Tuesday, July 07, 2009 12:16 PM
To: user@couchdb.apache.org
Subject: Re: view size extremely disk inefficient

On Jul 7, 2009, at 2:56 PM, Peter Hsu wrote:

> I need help explaining why the sizes of my views are so large.
>
> The emitted rows for the document have a key length of about 40 =20
> bytes (it's an array, if that matters) and a view length of about =20
> 400 bytes (raw json).   However, I'm seeing over 2k/row average over =20
> the view.  Factoring in the overhead of writing the btrees still =20
> doesn't really make sense.
>
> At 10M docs, I have almost 3.2k/message.  The views were generated =20
> at 3000 doc increments.  At the beginning, with the first view =20
> generation, the view size was about 2MB.  This is about 800 bytes =20
> per row, which could be reasonable.
>
> I measured the incremental size of the view after every 3000 rows =20
> were added to the view.  By the time I'm at 30k rows, I'm seeing an =20
> increment in the view size of 4MB, which is over 1k/doc.  By the end =20
> of 10M messages, it's over a 10MB increment, which is over 3k/doc.
>
> It may be interesting that a lot of my keys are identical.  Does =20
> that affect things?
>
> This is with the 0.9.0 running on cent5 (64 bit).
>
> Peter

Hi Peter, have you tried compacting the view?

POST /dbname/_compact/designname

Best, Adam