From user-return-20809-apmail-couchdb-user-archive=couchdb.apache.org@couchdb.apache.org Mon May 14 19:13:59 2012 Return-Path: X-Original-To: apmail-couchdb-user-archive@www.apache.org Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BAF9ACACA for ; Mon, 14 May 2012 19:13:59 +0000 (UTC) Received: (qmail 30020 invoked by uid 500); 14 May 2012 19:13:58 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 29951 invoked by uid 500); 14 May 2012 19:13:58 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 29939 invoked by uid 99); 14 May 2012 19:13:58 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 14 May 2012 19:13:58 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of tisdall@gmail.com designates 74.125.82.42 as permitted sender) Received: from [74.125.82.42] (HELO mail-wg0-f42.google.com) (74.125.82.42) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 14 May 2012 19:13:51 +0000 Received: by wgbds11 with SMTP id ds11so3642686wgb.5 for ; Mon, 14 May 2012 12:13:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=BOWnvDzUf53kcOpxg8NNeaM96tOfsCk84PEAsrzm2GQ=; b=YndMWwtvQ9wRKVEXiBJuutLxGwDyOlUpNIOkAoMg58SiMmC3/nWdYbQBR5i0a0vyEP TBGpNqz849NpBVGc2iNhOZVoaV/g/k9uh80PzHa7yrr214cc6TOJ5q7PYCWZ295RoTch UHdZBNr0P9MADtF3AOZxMCshdcbWK4SijgFKbtyw4nV5ePpKozp0y/Hd2J3P3T/r1O9U jorEvpnphEAKELwHSeGUStC1Q3MT+X9hwqvE34sg9MBnlbxEy5dPdwNqogyNnDKPpu50 OtvH8XCWgILJtKWjbOA3faRkWaUkvZA38II5GSXpFGJQtvbL18r9AVANGRRoh4rTWNWJ bnbQ== MIME-Version: 1.0 Received: by 10.180.86.5 with SMTP id l5mr22765868wiz.6.1337022810491; Mon, 14 May 2012 12:13:30 -0700 (PDT) Received: by 10.216.90.77 with HTTP; Mon, 14 May 2012 12:13:30 -0700 (PDT) Date: Mon, 14 May 2012 15:13:30 -0400 Message-ID: Subject: reducing db size From: Tim Tisdall To: user@couchdb.apache.org Content-Type: multipart/alternative; boundary=f46d04430686ad0c7004c003e1b8 X-Virus-Checked: Checked by ClamAV on apache.org --f46d04430686ad0c7004c003e1b8 Content-Type: text/plain; charset=ISO-8859-1 I've got several gigabytes of data that I'm trying to store in a couchdb on a single machine. I've placed a section of the data in an sqlite db and the file is about 5.9gb. I'm currently placing the same data into couchdb and while it hasn't finished yet, the file size is already 10gb and continuing to grow. The sqlite database is essentially a table of ids with a json block of text for each, so I figured the couchdb wouldn't be too much different in size. Does anyone have some recommendations on how to reduce the size of the db? Right now I've only inserted data and have not made any "updates" to documents, so there should be no revision copies to be cleared away. --f46d04430686ad0c7004c003e1b8--