Return-Path: Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: (qmail 20270 invoked from network); 29 Jan 2009 21:31:18 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 29 Jan 2009 21:31:18 -0000 Received: (qmail 39002 invoked by uid 500); 29 Jan 2009 21:31:16 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 38970 invoked by uid 500); 29 Jan 2009 21:31:16 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 38959 invoked by uid 99); 29 Jan 2009 21:31:16 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Jan 2009 13:31:16 -0800 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of paul.joseph.davis@gmail.com designates 209.85.198.227 as permitted sender) Received: from [209.85.198.227] (HELO rv-out-0506.google.com) (209.85.198.227) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Jan 2009 21:31:09 +0000 Received: by rv-out-0506.google.com with SMTP id g37so107936rvb.35 for ; Thu, 29 Jan 2009 13:30:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=i2N6nB0/irvLX/j0KMnWOJw9ABdOOy2JRTFmv29LHIU=; b=U+oz+mYnyPZyJuCdNEFXCR0f/Ze3p0WxSPYUkzZlB+3znpgOYKr+tZRyLk97ErG0Fb gaqzgDBhSxVfRiNjJpPKpKSH9g+RZhphBcw/yklkRHVFoyv8h1YD2tVy1W2GGcSDbzJA MUxcOWb6qSdo3nbvgf0XUwrnalLG/2B51hWWo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=w74Ck58l2h3wug8iYmGxprWP7jzmsXAaIpnN60UPIBiW7QmoIEGeuSbnH9uiYXhDnC 2rmW8FJ4yp1DyLDcxlGYhN9+n/XsvxtjozUP7Lh9qgVZ4DUFr9TGW52AEZZgfWgrmHRb vTrhdJel7eqvyUHDdNQGSDG7fsvGKmC1oiiDY= MIME-Version: 1.0 Received: by 10.141.5.3 with SMTP id h3mr199021rvi.213.1233264649389; Thu, 29 Jan 2009 13:30:49 -0800 (PST) In-Reply-To: References: <8A73D79E-EB60-4C2B-817E-D956FAAFE10E@me.com> Date: Thu, 29 Jan 2009 16:30:49 -0500 Message-ID: Subject: Re: CouchDB huge performance difference between Mac OS / Linux From: Paul Davis To: user@couchdb.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org Also discussing on IRC, we're wondering if the view is actually built correctly and something else is going wrong. An easy method to debug this if you get a copy of trunk, Futon has a panel that shows you actively running tasks so you'll be able to keep an eye on what couchdb is actually doing in terms of things like view generation and compaction. (replication is on the agenda) HTH, Paul Davis On Thu, Jan 29, 2009 at 4:15 PM, Paul Davis wrote: > Without thinking too hard, could this be an effect of fsync in a VM? > If you're feeling experimentally inclined, you could try and see the > performance after commenting out the two calls to fsync in write > header to see what happens. > > Also, the idea that fsync is slow in a VM could be outdated. Its just > one of those fuzzy memories of reading something somewhere as opposed > to any personal experience. > > HTH, > Paul Davis > > On Thu, Jan 29, 2009 at 3:40 PM, Niket Patel wrote: >> While views are generating first time on 6000 docs size db. ( same database >> for both machines ) >> Mac ( 2Ghz core 2 duo, 2 GB ) take few seconds >> Ubuntu Linux ( 2.4 Ghz 1.7 GB ) on Amazon takes forever ( 60 mins still >> waiting ) >> >> CouchDB version : 0.9.0a738990-incubating >> Erlang Version : >> - Mac : Erlang (BEAM) emulator version 5.6.5 [source] [smp:2] >> [async-threads:0] [kernel-poll:false] >> - Linux : Erlang (BEAM) emulator version 5.6.5 [source] [async-threads:0] >> [hipe] [kernel-poll:false] >> >> One observation, First "couchjs" and "beam" processes are running when view >> generation starts after few second couchjs goes away but 'beam' ( >> /usr/local/lib/erlang/erts-5.6.5/bin/beam ) keep running consuming 45% CPU >> all time >> >