Return-Path: X-Original-To: apmail-couchdb-user-archive@www.apache.org Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A192F6607 for ; Thu, 4 Aug 2011 09:01:26 +0000 (UTC) Received: (qmail 97135 invoked by uid 500); 4 Aug 2011 09:01:25 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 96754 invoked by uid 500); 4 Aug 2011 09:00:59 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 96644 invoked by uid 99); 4 Aug 2011 09:00:40 -0000 Received: from minotaur.apache.org (HELO minotaur.apache.org) (140.211.11.9) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Aug 2011 09:00:40 +0000 Received: from localhost (HELO mail-iy0-f174.google.com) (127.0.0.1) (smtp-auth username rnewson, mechanism plain) by minotaur.apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Aug 2011 09:00:38 +0000 Received: by iyf40 with SMTP id 40so1018653iyf.5 for ; Thu, 04 Aug 2011 02:00:38 -0700 (PDT) MIME-Version: 1.0 Received: by 10.42.177.74 with SMTP id bh10mr554382icb.258.1312448438056; Thu, 04 Aug 2011 02:00:38 -0700 (PDT) Received: by 10.231.217.13 with HTTP; Thu, 4 Aug 2011 02:00:37 -0700 (PDT) In-Reply-To: References: Date: Thu, 4 Aug 2011 10:00:37 +0100 Message-ID: Subject: Re: unusable database in 1.0.1. steps to take? From: Robert Newson To: user@couchdb.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi Jason, What filesystem is this stored on? Are you running with delayed_commits set to true or false? Finally, are you able to share the database file with the CouchDB development team? B. On 4 August 2011 03:39, Jason Konrad wrote: > I have a database that has become unusable today. The only way I can > get the couchdb server to function is to remove "thedb" which it > doesn't like. I've attached a file with some of the log data as well > as some errorr futon throws up. I'm looking for any ideas for next > steps to try and "recover" this database. > > This is running on a CentOS5 system with erlang-R12B-5.12.el5 and > couchdb-1.0.1-2.el5 > > Let me give you a little context to how this came about. I have one > database, not the one with problems, that has a high update rate on > documents. Combined with smallish disks this requires compaction a > couple times a week. The compactions have been going well but the data > is not always freed up from the system after the compaction. In order > to get the disk space to free up I restart couchdb. This process had > been working for a few months but not today. > > On the restart of couchdb the first signs of something out of the > ordinary was happening, two views were being completely recalulated. > These calculations can take hours to finish but today that was not the > case. After about 30 min the views stopped calculating and couchdb > started throwing 500 response codes for everything no matter what > database was being used ( there are 26 total, 1 bad one ). I tried > restarting couchdb but all that would happen is the log file would get > loads of data like the stuff in the attached file and then eventually > couchdb would terminate. > > > Respect, > =A0Jason >