Return-Path: Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: (qmail 34159 invoked from network); 9 Jan 2009 23:50:30 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 9 Jan 2009 23:50:30 -0000 Received: (qmail 75533 invoked by uid 500); 9 Jan 2009 23:50:29 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 75502 invoked by uid 500); 9 Jan 2009 23:50:29 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 75491 invoked by uid 99); 9 Jan 2009 23:50:29 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 09 Jan 2009 15:50:29 -0800 X-ASF-Spam-Status: No, hits=2.4 required=10.0 tests=NORMAL_HTTP_TO_IP,SPF_PASS,URIBL_RHS_DOB,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of vanpelt@gmail.com designates 209.85.198.225 as permitted sender) Received: from [209.85.198.225] (HELO rv-out-0506.google.com) (209.85.198.225) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 09 Jan 2009 23:50:20 +0000 Received: by rv-out-0506.google.com with SMTP id g37so9505507rvb.35 for ; Fri, 09 Jan 2009 15:50:00 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=JIDFya8nSDSt0ZYw0G+nuhpQBGz2IUd864GQb8S8+WA=; b=TmRJKazQVlzzd+CVhVpWLU8wZ8NTSh7VxZhM+7D01VmzjqXF4K/0y779npwzlCVrTc zalQV0SdaakUQHHMTTmacktuv/75AJzki3lOd4US8CN5fEzBBbOR1w6CSC1W0acOHUXR Ruycc3uOu3HuprUvsXjigwLk40JZF19xhTAMM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=RUtTa9STehoeyctrsbQ7pbfGE65DpIVNFXU7M+6Ggfw0dR+RbG5yJ06EYpZS4iymiE qfAOFqdc/pUPuvaA585WcdB3M/iFVC4lMui3QwM4dRgPvlxWYrOZLfYRSGE7VdJ37qvd HB0qpXsdt3rjbNmtcfxHXe3DaUP0Fw4P/AlSE= Received: by 10.140.204.7 with SMTP id b7mr13011321rvg.117.1231545000612; Fri, 09 Jan 2009 15:50:00 -0800 (PST) Received: by 10.141.62.12 with HTTP; Fri, 9 Jan 2009 15:50:00 -0800 (PST) Message-ID: <9d5c45d10901091550x364a8136q96dd1fe8f473a884@mail.gmail.com> Date: Fri, 9 Jan 2009 15:50:00 -0800 From: "Chris Van Pelt" To: user@couchdb.apache.org Subject: Re: Couch processes... In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <9d5c45d10901091329qacc95a6k8668f0f42bf56ed4@mail.gmail.com> <9d5c45d10901091405s75e6697cp130d505c1c03ccf@mail.gmail.com> X-Virus-Checked: Checked by ClamAV on apache.org All but two of the tests pass: replication: # Exception raised: {"message":"syntax error","fileName":"http://127.0.0.1:6984/_utils/script/json2.js","lineNumber":150,"stack":"()@:0\neval(\"()\")@:0\n(\"\")@http://127.0.0.1:6984/_utils/script/json2.js:150\n(\"test_suite_db_a\",\"http://127.0.0.1:6984/test_suite_db_b\")@http://127.0.0.1:6984/_utils/script/couch.js?0.8.0:273\n((void 0))@http://127.0.0.1:6984/_utils/script/couch_test_runner.js:55\nrun(0)@http://127.0.0.1:6984/_utils/script/couch_test_runner.js:78\n","name":"SyntaxError"} config: # Assertion failed: config.httpd.port == port These failures look unrelated to my runaway process / failed view creation. The beam.smp literally runs for hours at 100% never creating a view over documents that used to take at most 15 minutes to generate a view for in 8.1. There are no messages in the log to indicate failure. I've tested the view on my development box and it runs fine. How can I dig deeper into this problem? Chris On Fri, Jan 9, 2009 at 3:05 PM, Chris Anderson wrote: > Does the test suite pass for you? > > Thanks, > Chris > > On Fri, Jan 9, 2009 at 2:05 PM, Chris Van Pelt wrote: >> I know, I dumped and loaded. I can access individual documents fine. >> It's the view generation that is borked. >> >> Chris >> >> On Fri, Jan 9, 2009 at 1:58 PM, Chris Anderson wrote: >>> Upgrading existing databases from 0.8.1 requires a dump/load cycle as >>> the backing file format store has changed. See >>> http://wiki.apache.org/couchdb/Breaking_changes for help. >>> >>> On Fri, Jan 9, 2009 at 1:29 PM, Chris Van Pelt wrote: >>>> I recently upgraded to trunk and now my DB is misbehaving. It's >>>> having trouble generating my view. I'm wondering if there is a good >>>> way to figure out where Couch is spending all of it's time. >>>> >>>> Upon requesting the view, I see a couchjs process fired off, and than >>>> my beam.smp process starts to pick up steam. The beam.smp process >>>> sits around 100% CPU and slowly grows in memory consumption. couchjs >>>> process chills at around 8% CPU, often times another couchjs process >>>> is fired off as well. Both of these processes tend to slowly decrease >>>> in resource consumption. I looked in my .dbname view directory and >>>> noticed that the view file grows in size initially to about 14MB, then >>>> beam.smp sits at 100% CPU for 15-20 minutes before the view files >>>> changes in size. >>>> >>>> Since updating to trunk the view seems to never finish rendering. I >>>> have 9000 documents and 8.1 was rendering it slowly, but it was able >>>> to render it. I just rewrote my mapReduce to look more like a >>>> mapCombine and tried to regenerate the view. It's been 30 minutes, >>>> the view file is still at 14MB, nothing has been written to the log, I >>>> have 2 couchjs process at about 5% CPU and the beam.smp process is at >>>> 85%. >>>> >>>> Is there a good way to debug this? One other interesting thing I >>>> noticed was the couchdb executable actually launching two identical >>>> processes... >>>> >>>> Any help would be much appreciated. >>>> >>>> Chris >>>> >>> >>> >>> >>> -- >>> Chris Anderson >>> http://jchris.mfdz.com >>> >> > > > > -- > Chris Anderson > http://jchris.mfdz.com >