Return-Path: Delivered-To: apmail-incubator-couchdb-user-archive@locus.apache.org Received: (qmail 54538 invoked from network); 9 Nov 2008 14:44:04 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 9 Nov 2008 14:44:04 -0000 Received: (qmail 90571 invoked by uid 500); 9 Nov 2008 14:44:11 -0000 Delivered-To: apmail-incubator-couchdb-user-archive@incubator.apache.org Received: (qmail 90110 invoked by uid 500); 9 Nov 2008 14:44:10 -0000 Mailing-List: contact couchdb-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: couchdb-user@incubator.apache.org Delivered-To: mailing list couchdb-user@incubator.apache.org Received: (qmail 90099 invoked by uid 99); 9 Nov 2008 14:44:10 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 09 Nov 2008 06:44:10 -0800 X-ASF-Spam-Status: No, hits=0.2 required=10.0 tests=RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [209.68.5.15] (HELO relay01.pair.com) (209.68.5.15) by apache.org (qpsmtpd/0.29) with SMTP; Sun, 09 Nov 2008 14:42:52 +0000 Received: (qmail 26086 invoked from network); 9 Nov 2008 14:43:32 -0000 Received: from 96.33.90.152 (HELO ?192.168.1.200?) (96.33.90.152) by relay01.pair.com with SMTP; 9 Nov 2008 14:43:32 -0000 X-pair-Authenticated: 96.33.90.152 Message-Id: From: Damien Katz To: couchdb-user@incubator.apache.org In-Reply-To: Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Subject: Re: What Factors Influence Compaction Time? Date: Sun, 9 Nov 2008 09:43:32 -0500 References: <9E43A47A-FC7B-44D6-A4D4-41D71BC6CA29@apache.org> X-Mailer: Apple Mail (2.929.2) X-Virus-Checked: Checked by ClamAV on apache.org That seems kind of slow, only 343 docs/sec. I'd say there is a lot of room for improvement there. How large are the docs? On Nov 9, 2008, at 9:32 AM, Ben Browning wrote: > Thanks Jan - I think that answers everything for now. I've got a test > database with only 330 thousand documents and compaction currently > takes 16 minutes. There are some writes during compaction but nowhere > near full load. This sounds quite high to me since I expect my real > dataset to grow many times this size - I've got some work to do to > figure out where the bottleneck is.