From user-return-13502-apmail-couchdb-user-archive=couchdb.apache.org@couchdb.apache.org Thu Nov 04 10:55:04 2010 Return-Path: Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: (qmail 40469 invoked from network); 4 Nov 2010 10:55:04 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 4 Nov 2010 10:55:04 -0000 Received: (qmail 68621 invoked by uid 500); 4 Nov 2010 10:55:34 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 68442 invoked by uid 500); 4 Nov 2010 10:55:32 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 68429 invoked by uid 99); 4 Nov 2010 10:55:31 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Nov 2010 10:55:31 +0000 X-ASF-Spam-Status: No, hits=-2.3 required=10.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [145.58.30.185] (HELO out1b.mail.omroep.nl) (145.58.30.185) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Nov 2010 10:55:24 +0000 Received: from localhost (ou1bclean [10.10.30.159]) by out1b.mail.omroep.nl (Postfix MTA - NPO ICT) with ESMTP id 8DFB930000B0 for ; Thu, 4 Nov 2010 11:55:02 +0100 (CET) X-Virus-Scanned: NPO ICT Received: from tweehoog.vpro.nl (tweehoog.vpro.nl [145.58.169.4]) by out1b.mail.omroep.nl (Postfix MTA - NPO ICT) with ESMTP id 7599530000AC for ; Thu, 4 Nov 2010 11:55:02 +0100 (CET) Received: from exmail.vpro.nl ([145.58.171.81] helo=VS-EX-01.intra.vpro.nl) by tweehoog.vpro.nl with esmtp (Exim 3.36 #1) id 1PDxTC-0006bb-00 for user@couchdb.apache.org; Thu, 04 Nov 2010 11:55:02 +0100 Received: from VS-EX-01.intra.vpro.nl ([145.58.171.81]) by VS-EX-01.intra.vpro.nl ([145.58.171.81]) with mapi; Thu, 4 Nov 2010 11:55:02 +0100 From: Nils Breunese To: "user@couchdb.apache.org" Date: Thu, 4 Nov 2010 11:55:01 +0100 Subject: Re: How to speedup view generation? Thread-Topic: How to speedup view generation? Thread-Index: Act8Drrgz0eUtWNgT6e7eH3WakwDoQ== Message-ID: <01C49E70-2588-4811-AFC9-3E0C974DB885@vpro.nl> References: <4CD28DD8.4060908@free.fr> In-Reply-To: <4CD28DD8.4060908@free.fr> Accept-Language: nl-NL Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: nl-NL Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 cdr53x wrote: > What is the size of the design document files on the drive ? > > I noticed that large views use quite large file ;). > > I also noticed that the view group indexers take a large amount time to > achieve the last 30% of the task. At least twice then to complete the > first 70%. > > In my case I have a 'small' database containing 400K docs. I also hava > a design doc that indexes 80% of the docs with 8 views. Map functions > only emit a single property per doc and a null value, so they should be > compact. > > The overall size of this desing doc .view file on disk is 17G ;). Also after compaction? http://wiki.apache.org/couchdb/Compaction Nils. ------------------------------------------------------------------------ VPRO phone: +31(0)356712911 e-mail: info@vpro.nl web: www.vpro.nl ------------------------------------------------------------------------