Return-Path: X-Original-To: apmail-couchdb-user-archive@www.apache.org Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 999649425 for ; Mon, 17 Oct 2011 07:58:20 +0000 (UTC) Received: (qmail 16290 invoked by uid 500); 17 Oct 2011 07:58:18 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 16239 invoked by uid 500); 17 Oct 2011 07:58:18 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 16191 invoked by uid 99); 17 Oct 2011 07:58:16 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Oct 2011 07:58:16 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of paolo.negri@wooga.net designates 209.85.161.180 as permitted sender) Received: from [209.85.161.180] (HELO mail-gx0-f180.google.com) (209.85.161.180) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Oct 2011 07:58:11 +0000 Received: by ggnv2 with SMTP id v2so1691448ggn.11 for ; Mon, 17 Oct 2011 00:57:50 -0700 (PDT) Received: by 10.68.30.65 with SMTP id q1mr28989303pbh.91.1318838270086; Mon, 17 Oct 2011 00:57:50 -0700 (PDT) MIME-Version: 1.0 Received: by 10.142.84.14 with HTTP; Mon, 17 Oct 2011 00:57:30 -0700 (PDT) In-Reply-To: References: From: Paolo Negri Date: Mon, 17 Oct 2011 09:57:30 +0200 Message-ID: Subject: Re: timeout hitting a database url after launching compaction To: user@couchdb.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable IO activity is not monitored, there's only one db on the couchdb instance and the described job is the only activity executed on this machine. Delaying the first request on the database url by 30 seconds did actually prevent the problem from happening again. So the issue seems to happen specifically at the moment right after compaction is started. The database is about 7GB big once compressed, the server is hosted on ec2 with the database directory placed on his own dedicated ephemeral storage. Thanks, Paolo On Fri, Oct 14, 2011 at 9:05 PM, Paul Davis w= rote: > Do you monitor IO activity or system responsiveness when you're doing > this. I've seen some compactions wallop a system when it switches over > due to removing large old files and such. It doesn't sound like this > is big enough for that case but it might be something worth checking. > > On Fri, Oct 14, 2011 at 3:41 AM, Paolo Negri wrot= e: >> Dear list, >> >> We have a script that does the following (strictly sequentially) >> >> 1) update 300K docs in a db >> 2) launch compaction of the db >> 3) poll at a 30 sec frequency http://127.0.0.1:5984/database to know >> when compaction completed >> >> Last night we got a timeout error during 3, we think that this might >> be because the first polling (GET =A0http://127.0.0.1:5984/database) is >> done right after triggering compaction >> >> I thought the dev team might be interested in knowing that this is happe= ning >> >> There's no other activity on the couchdb instance other than what >> described in this email. >> >> ERROR unexpectd response checking compaction db: {ok,"500", >> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 [{"Server", >> >> "CouchDB/1.3.0a-74613f5-git (Erlang OTP/R14B04)"}, >> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0{"Date", >> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 "Fri, 14 Oct 2011 >> 01:46:37 GMT"}, >> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0{"Content-Type", >> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 "text/plain; charset=3Dutf-8"}, >> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0{"Content-Length","350"}, >> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0{"Cache-Control", >> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 "must-revalidate"}], >> >> <<"{\"error\":\"{timeout,{gen_server,call,[<0.21934.9>,{open_ref_count,<= 0.4090.13>}]}}\",\"reason\":\"{gen_server,call,\\n >> =A0 [couch_server,\\n =A0 =A0 {open,<<\\\"backup\\\">>,\\n >> [{user_ctx,\\n =A0 =A0 =A0 =A0 =A0 =A0 =A0{user_ctx,null,\\n >> [<<\\\"_admin\\\">>],\\n =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0<<\\\"{couch= _httpd_auth, >> default_authentication_handler}\\\">>}}]},\\n =A0 =A0 infinity]}\"}\n">>= } >> >> >> Thanks, >> >> Paolo >> > --=20 Engineering http://www.wooga.com | phone +49-30-8962 5058=A0 | fax +49-30-8964 9064 wooga GmbH | Saarbruecker Str. 38 | 10405 Berlin | Germany Sitz der Gesellschaft: Berlin; HRB 117846 B Registergericht Berlin-Charlottenburg Geschaeftsfuehrung: Jens Begemann, Philipp Moeser