Return-Path: X-Original-To: apmail-couchdb-user-archive@www.apache.org Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D1F31D3FE for ; Thu, 6 Sep 2012 21:31:00 +0000 (UTC) Received: (qmail 34535 invoked by uid 500); 6 Sep 2012 21:30:59 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 34483 invoked by uid 500); 6 Sep 2012 21:30:59 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 34474 invoked by uid 99); 6 Sep 2012 21:30:59 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Sep 2012 21:30:59 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FSL_RCVD_USER,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of tisdall@gmail.com designates 209.85.215.52 as permitted sender) Received: from [209.85.215.52] (HELO mail-lpp01m010-f52.google.com) (209.85.215.52) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Sep 2012 21:30:51 +0000 Received: by lage4 with SMTP id e4so1308567lag.11 for ; Thu, 06 Sep 2012 14:30:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; bh=3jWz0zuUlBvhogNuzA23JMqaZK/shPUIbIy/4d0O21E=; b=y11CK3zSws+SXNjutM4DshFQsEJTeIKyXZcMReUCWNczyFqXRLV4M2mowvcZMevpYd Vjx64ixhENUZY3aC6TmTjTBBXJY9xKVrIr2qr4j39QmNCRrec3xBSk4bprSxnjQ7oRSg hQo4ZqRN3md2jIQXSSR5SG4wH6zUaKl2vu/hXT/qteUapzsIUU12AkoTZIqiQiylkAag DpVFHqKbf5ibGDrkD7rZSLuIe1V+ks6ekY/TkLO4dqUEivS0zADmejLDjgoW/Z9OsDRC 6Pq3ttJhOe3KF0jP7YZCwxXZNZwvabSl+usx7KY5ZE2V5sDl81uhOqPG9y5JTu5oQhcX AwZQ== MIME-Version: 1.0 Received: by 10.152.110.40 with SMTP id hx8mr3311053lab.9.1346967031341; Thu, 06 Sep 2012 14:30:31 -0700 (PDT) Received: by 10.112.95.47 with HTTP; Thu, 6 Sep 2012 14:30:31 -0700 (PDT) In-Reply-To: References: Date: Thu, 6 Sep 2012 17:30:31 -0400 Message-ID: Subject: Re: dropping revision records From: Tim Tisdall To: user@couchdb.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Are there docs in the wiki on how _rev_limit works? I tried looking for documentation with Google, but couldn't find any. Where exactly is that set, and does that affect the total number of revisions across the database or the total per document? On Thu, Sep 6, 2012 at 4:35 PM, Robert Newson wrote: > > I think Tim was clear that this was post-compaction, though. The 2gb is t= he historic _rev values for all these documents. > > You could lower _rev_limit and recompact to flush these out. > > B. > > On 6 Sep 2012, at 20:46, Benoit Chesneau wrote: > >> On Thu, Sep 6, 2012 at 4:18 PM, Tim Tisdall wrote: >>> I had a database of about 10.8gb with almost 15 million records which >>> was fully compacted. I had to back it up by dumping all the JSON and >>> then restoring it by inserting it back in. After it was done and I >>> compacted it the database was now only 8.8gb! I shed 2gb because of >>> dropping the revision stubs still in the database. This is likely >>> because each record had about 6 revisions (so around 90 million >>> stubs). All of this is understandable, but 2gb isn't really >>> negligible when running on a virtualized instance of 35gb. The >>> problem, though, is the method I used to dump to JSON and place it >>> back into couchdb took almost 12hrs! >>> >>> Is there a way to drop all of the revision stubs and reset the >>> document's revision tags back to "1-" values? I know this would >>> completely break any kind of replication, but in this instance I am >>> not doing any. >> >> It would break more than the replication. Compacting your database is >> the solution. >> >> - beno=EEt >