From user-return-15728-apmail-couchdb-user-archive=couchdb.apache.org@couchdb.apache.org Fri Apr 08 15:32:50 2011 Return-Path: Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: (qmail 56582 invoked from network); 8 Apr 2011 15:32:50 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 8 Apr 2011 15:32:50 -0000 Received: (qmail 66067 invoked by uid 500); 8 Apr 2011 15:32:48 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 66014 invoked by uid 500); 8 Apr 2011 15:32:48 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 66006 invoked by uid 99); 8 Apr 2011 15:32:48 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 08 Apr 2011 15:32:48 +0000 X-ASF-Spam-Status: No, hits=4.6 required=5.0 tests=FS_REPLICA,SPF_SOFTFAIL X-Spam-Check-By: apache.org Received-SPF: softfail (athena.apache.org: transitioning domain of steve.webb@beatport.com does not designate 208.92.203.1 as permitted sender) Received: from [208.92.203.1] (HELO steve-laptop.beatport.com) (208.92.203.1) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 08 Apr 2011 15:32:43 +0000 Received: from steve-laptop.beatport.com (localhost [127.0.0.1]) by steve-laptop.beatport.com (8.14.3/8.14.3/Debian-9.1ubuntu1) with ESMTP id p38FVscs022518; Fri, 8 Apr 2011 09:31:54 -0600 Received: from localhost (steve@localhost) by steve-laptop.beatport.com (8.14.3/8.14.3/Submit) with ESMTP id p38FVr3r022508; Fri, 8 Apr 2011 09:31:54 -0600 X-Authentication-Warning: steve-laptop.beatport.com: steve owned process doing -bs Date: Fri, 8 Apr 2011 09:31:53 -0600 (MDT) From: steve.webb@beatport.com X-X-Sender: steve@steve-laptop.beatport.com To: Filipe David Manana cc: user@couchdb.apache.org, steve.webb@beatport.com Subject: Re: Couch Replication: slave on-disk size bloat In-Reply-To: Message-ID: References: User-Agent: Alpine 2.00 (DEB 1167 2008-08-23) MIME-Version: 1.0 Content-Type: MULTIPART/MIXED; BOUNDARY="8323329-12467997-1302276714=:22381" --8323329-12467997-1302276714=:22381 Content-Type: TEXT/PLAIN; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8BIT I'm not sure what's in the databases. Why? Would large attachments explain this in some way? - Steve On Fri, 8 Apr 2011, Filipe David Manana wrote: > Do you have many and/or large attachments? > > On Thu, Apr 7, 2011 at 10:24 PM, wrote: >> Hello there. >> >> New couch admin here. >> >> I've got two couchdb machines that are not being written to. >> >> I cleaned off the slave, then replicated and compacted the DBs on the slave >> and the slave DB size on-disk is *way* more than on the master. >> >> Also, we've found that when the slaves are being actively written >> (replicated) to, over time, they grow > 10x the size of the master's file >> size. >> >> Master: >> >> -rw-r--r--  1 couchdb couchdb      20565 Apr  7 12:02 api-keys.couch >> -rw-r--r--  1 couchdb couchdb 2414678118 Apr  7 11:41 similar-tracks.couch >> -rw-r--r--  1 couchdb couchdb  851714150 Apr  7 11:52 sitemap.couch >> drwxr-xr-x  2 couchdb couchdb       4096 Feb 15 01:10 .sitemap_design >> -rw-r--r--  1 couchdb couchdb   76939362 Apr  7 11:27 top-downloads.couch >> -rw-r--r--  1 couchdb couchdb  268513382 Apr  7 11:30 >> users-also-bought.couch >> >> Slave (after delete, replication and compaction): >> >> -rw-r--r--  1 couchdb couchdb       8280 Apr  7 12:02 api-keys.couch >> -rw-r--r--  1 couchdb couchdb 5261164653 Apr  7 14:16 similar-tracks.couch >> -rw-r--r--  1 couchdb couchdb  860319850 Apr  7 13:58 sitemap.couch >> -rw-r--r--  1 couchdb couchdb  122777700 Apr  7 13:50 top-downloads.couch >> -rw-r--r--  1 couchdb couchdb  285810794 Apr  7 13:52 >> users-also-bought.couch >> >> Q1: Is this normal? >> Q2: Is there a way to fix this or turn off whatever is turned on that causes >> this? >> >> - Steve Webb >> >> -- >> Steve Webb | System Administrator >> Beatport | Play With Music >> ------------------------------------------ >> 2399 Blake Street, Suite 170 >> Denver, Colorado USA 80205 >> tel: +1.720.932.9103 >> fax: +1.720.932.9104 >> noc: +1.303.565.2710 >> mobile: +1.303.564.4269 >> > > > > -- Steve Webb | System Administrator Beatport | Play With Music ------------------------------------------ 2399 Blake Street, Suite 170 Denver, Colorado USA 80205 tel: +1.720.932.9103 fax: +1.720.932.9104 noc: +1.303.565.2710 mobile: +1.303.564.4269 --8323329-12467997-1302276714=:22381--