Return-Path: X-Original-To: apmail-couchdb-user-archive@www.apache.org Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D2196108E6 for ; Sat, 26 Oct 2013 15:06:20 +0000 (UTC) Received: (qmail 67881 invoked by uid 500); 26 Oct 2013 15:06:17 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 67817 invoked by uid 500); 26 Oct 2013 15:06:15 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 67809 invoked by uid 99); 26 Oct 2013 15:06:12 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 26 Oct 2013 15:06:12 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of bcitrin@gmail.com designates 209.85.192.180 as permitted sender) Received: from [209.85.192.180] (HELO mail-pd0-f180.google.com) (209.85.192.180) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 26 Oct 2013 15:06:06 +0000 Received: by mail-pd0-f180.google.com with SMTP id p10so5186935pdj.25 for ; Sat, 26 Oct 2013 08:05:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=h1kIsyya5qPmbVBxm3znXGYXFN1FpUPr0MTGhPshTUc=; b=PV9O1T0Lxz7OWWxPgXP/Jc4MaXUygUxV7YjayM27CQekqmzLls38J86BXhRfDjLqJO umxcZeLTDE82wUBVRP2z+r9U+Q3xBSKleXO5TV+sseWMIZfJMhBuzGYql7jf88j6CnxS +fjSauxYU7AiPoK4x780+9dhUbJ2hV/GkmE52B1UZoauHiMYXsmGq0aabcAILGOUel8M CEBM+3EI7vZJxasyFYSEDqOZOdluPLbhYATtpanAuNYkgaJjNghjS2MaJD8dgWWT0F0K fMYZHfdAbYLOpTHldKLmMA5ibSgGmLwHHx3LSOg0B3KAXDdGg3VEcc88kMDENRJnDgIB E8LQ== MIME-Version: 1.0 X-Received: by 10.68.175.33 with SMTP id bx1mr12381568pbc.21.1382799944776; Sat, 26 Oct 2013 08:05:44 -0700 (PDT) Received: by 10.70.85.138 with HTTP; Sat, 26 Oct 2013 08:05:44 -0700 (PDT) In-Reply-To: References: Date: Sat, 26 Oct 2013 18:05:44 +0300 Message-ID: Subject: Re: Finding the right value for compaction configuration parameters From: Boaz Citrin To: user@couchdb.apache.org Content-Type: multipart/alternative; boundary=047d7bd6b2ae8102b104e9a6337c X-Virus-Checked: Checked by ClamAV on apache.org --047d7bd6b2ae8102b104e9a6337c Content-Type: text/plain; charset=ISO-8859-1 Hi Alexander, Yes, I have some numbers, do you want me to share here or somewhere else? Best, Boaz On Mon, Oct 21, 2013 at 12:32 AM, Alexander Shorin wrote: > Hi Boaz! > > On Fri, Oct 18, 2013 at 12:57 AM, Boaz Citrin wrote: > > Testing database compaction with various doc_buffer_size values I get > > completely different results. > > Documentation is fairly vague, so I wonder how to choose the right value; > > What parameters affect this - HD buffer size, average doc size, > > database size, fragmentation, etc... ?! > > > > Same goes for view compaction and keyvalue_buffer_size. > > These parameters does affect on what they are named: they defines > buffer size for copying data from db/view file to the .compact one. > What information you think is missed? > > > (For me the the compaction with default values was many times slower > > than with the values that gave the faster compaction). > > All numbers have their cost: large buffers requires more memory while > they reduces I/O operations and vice versa. Much likely, that default > values wouldn't provide you high performance since they aimed to fit > everyone, but that's why you may tweak them for your needs (: > > I believe, that it's possible to revise them, but first need to > collect information in what environment which values are effective and > which are not. Would you like to help us with that? > > > -- > ,,,^..^,,, > --047d7bd6b2ae8102b104e9a6337c--