Return-Path: X-Original-To: apmail-couchdb-user-archive@www.apache.org Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F3D6ECAED for ; Mon, 14 May 2012 19:22:00 +0000 (UTC) Received: (qmail 58010 invoked by uid 500); 14 May 2012 19:21:59 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 57967 invoked by uid 500); 14 May 2012 19:21:59 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 57959 invoked by uid 99); 14 May 2012 19:21:59 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 14 May 2012 19:21:59 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of paul.joseph.davis@gmail.com designates 209.85.212.52 as permitted sender) Received: from [209.85.212.52] (HELO mail-vb0-f52.google.com) (209.85.212.52) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 14 May 2012 19:21:53 +0000 Received: by vbzb23 with SMTP id b23so7146263vbz.11 for ; Mon, 14 May 2012 12:21:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:content-transfer-encoding; bh=tK4y62btc5PN8XEObjQiC2SNsmQvHg4TKI4EmGKraaw=; b=OG6nooTE7RgMFlP/Q7Nnlfc8oZuHhKBp/9SIJbcIzcz8ZKl1fgzXKGR1eytCkzl6XP +n/68Rct2crFOrCz5+PNTmLIYqAkvNO3zDjLQnIR9hMQE51Dd2RPkpUtKMLp8pqIIdzo CmYBJ6Sq+XB6IhgN7Jmo3IZJ+LEON07qbX/TFqKLF161axiOuA7vP+FdxfFICJqABKy/ ys/16O4Fk4Cq918SnE3EyJRDHnTZqL1Eth8otnJTKQwxyF/UaFW+KgAnuM973oN9Gmpc V7IgxBRBklLbUqO+OgPN1bvT+3pwZyNXGSICkL2dJqed016xhN31GOudW69a5LsXNe2W KXXQ== Received: by 10.52.172.201 with SMTP id be9mr3598758vdc.43.1337023292431; Mon, 14 May 2012 12:21:32 -0700 (PDT) MIME-Version: 1.0 Received: by 10.220.10.14 with HTTP; Mon, 14 May 2012 12:20:51 -0700 (PDT) In-Reply-To: References: From: Paul Davis Date: Mon, 14 May 2012 14:20:51 -0500 Message-ID: Subject: Re: reducing db size To: user@couchdb.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org How did you insert them? If you did a PUT per docid you'll still want to compact afterwards. On Mon, May 14, 2012 at 2:13 PM, Tim Tisdall wrote: > I've got several gigabytes of data that I'm trying to store in a couchdb = on > a single machine. =A0I've placed a section of the data in an sqlite db an= d > the file is about 5.9gb. =A0I'm currently placing the same data into couc= hdb > and while it hasn't finished yet, the file size is already 10gb and > continuing to grow. =A0The sqlite database is essentially a table of ids = with > a json block of text for each, so I figured the couchdb wouldn't be too > much different in size. > > Does anyone have some recommendations on how to reduce the size of the db= ? > =A0Right now I've only inserted data and have not made any "updates" to > documents, so there should be no revision copies to be cleared away.