Return-Path: X-Original-To: apmail-couchdb-user-archive@www.apache.org Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6EAD31090C for ; Sat, 26 Oct 2013 15:25:40 +0000 (UTC) Received: (qmail 84422 invoked by uid 500); 26 Oct 2013 15:25:37 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 84390 invoked by uid 500); 26 Oct 2013 15:25:35 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 84382 invoked by uid 99); 26 Oct 2013 15:25:33 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 26 Oct 2013 15:25:33 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of kxepal@gmail.com designates 74.125.82.54 as permitted sender) Received: from [74.125.82.54] (HELO mail-wg0-f54.google.com) (74.125.82.54) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 26 Oct 2013 15:25:26 +0000 Received: by mail-wg0-f54.google.com with SMTP id c11so5076455wgh.9 for ; Sat, 26 Oct 2013 08:25:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=RUju6r6x21f7xN4qErI4I5LG4C9Y46oaXt0nxOwejig=; b=GgFfMLpCcVu5W7TeqFOzP0O73tuZOyp5+KnYSEgVOWXzj3aitMMZxxCvIWaWftSnBx 4x0acwEpf8w/kRF9vFQ+4t7UpoJv+1cMw4o6B6SX9JVYGrgMlE42ofvVbYjoZlqFhw24 WcCKEa1Vlbj6G1DlVqpAvRmZy/8AP6yEPIME6M2Z6xSH+YOfbbDSogjGb+lYp7TZXm8R GDj7pi8My5HWUQX/krH0Q1VudNJG6VjqDvyWR1vI+jSyWC1Ouv9O45S8smhLADmIg0bZ MGXqq6l5VXXHQIHG83/bObsnCAJnQMh+2xeCbqmSg2Q1ig4YvxyStnzpWV86gt1Rm8ea 7obQ== MIME-Version: 1.0 X-Received: by 10.180.13.113 with SMTP id g17mr2723832wic.19.1382801106652; Sat, 26 Oct 2013 08:25:06 -0700 (PDT) Received: by 10.180.74.208 with HTTP; Sat, 26 Oct 2013 08:25:06 -0700 (PDT) In-Reply-To: References: Date: Sat, 26 Oct 2013 19:25:06 +0400 Message-ID: Subject: Re: Finding the right value for compaction configuration parameters From: Alexander Shorin To: "user@couchdb.apache.org" Content-Type: text/plain; charset=UTF-8 X-Virus-Checked: Checked by ClamAV on apache.org Feel free to post here! I think others would be also interested in your experience and could share (I hope so) their own too. -- ,,,^..^,,, On Sat, Oct 26, 2013 at 7:05 PM, Boaz Citrin wrote: > Hi Alexander, > > Yes, I have some numbers, do you want me to share here or somewhere else? > > Best, > > Boaz > > > On Mon, Oct 21, 2013 at 12:32 AM, Alexander Shorin wrote: > >> Hi Boaz! >> >> On Fri, Oct 18, 2013 at 12:57 AM, Boaz Citrin wrote: >> > Testing database compaction with various doc_buffer_size values I get >> > completely different results. >> > Documentation is fairly vague, so I wonder how to choose the right value; >> > What parameters affect this - HD buffer size, average doc size, >> > database size, fragmentation, etc... ?! >> > >> > Same goes for view compaction and keyvalue_buffer_size. >> >> These parameters does affect on what they are named: they defines >> buffer size for copying data from db/view file to the .compact one. >> What information you think is missed? >> >> > (For me the the compaction with default values was many times slower >> > than with the values that gave the faster compaction). >> >> All numbers have their cost: large buffers requires more memory while >> they reduces I/O operations and vice versa. Much likely, that default >> values wouldn't provide you high performance since they aimed to fit >> everyone, but that's why you may tweak them for your needs (: >> >> I believe, that it's possible to revise them, but first need to >> collect information in what environment which values are effective and >> which are not. Would you like to help us with that? >> >> >> -- >> ,,,^..^,,, >>