Return-Path: X-Original-To: apmail-jackrabbit-users-archive@minotaur.apache.org Delivered-To: apmail-jackrabbit-users-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B43B99E10 for ; Mon, 20 Feb 2012 17:51:58 +0000 (UTC) Received: (qmail 38511 invoked by uid 500); 20 Feb 2012 17:51:58 -0000 Delivered-To: apmail-jackrabbit-users-archive@jackrabbit.apache.org Received: (qmail 38469 invoked by uid 500); 20 Feb 2012 17:51:58 -0000 Mailing-List: contact users-help@jackrabbit.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@jackrabbit.apache.org Delivered-To: mailing list users@jackrabbit.apache.org Received: (qmail 38461 invoked by uid 99); 20 Feb 2012 17:51:58 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 17:51:58 +0000 X-ASF-Spam-Status: No, hits=-2.3 required=5.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of christian.stocker@liip.ch designates 207.126.144.145 as permitted sender) Received: from [207.126.144.145] (HELO eu1sys200aog118.obsmtp.com) (207.126.144.145) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 17:51:51 +0000 Received: from mail-ww0-f45.google.com ([74.125.82.45]) (using TLSv1) by eu1sys200aob118.postini.com ([207.126.147.11]) with SMTP ID DSNKT0KIIc0tn8Tu5FFZ45egU1m0UATqizhS@postini.com; Mon, 20 Feb 2012 17:51:31 UTC Received: by mail-ww0-f45.google.com with SMTP id dt12so4087862wgb.26 for ; Mon, 20 Feb 2012 09:51:29 -0800 (PST) Received-SPF: pass (google.com: domain of christian.stocker@liip.ch designates 10.180.92.71 as permitted sender) client-ip=10.180.92.71; Authentication-Results: mr.google.com; spf=pass (google.com: domain of christian.stocker@liip.ch designates 10.180.92.71 as permitted sender) smtp.mail=christian.stocker@liip.ch Received: from mr.google.com ([10.180.92.71]) by 10.180.92.71 with SMTP id ck7mr23874973wib.3.1329760289644 (num_hops = 1); Mon, 20 Feb 2012 09:51:29 -0800 (PST) Received: by 10.180.92.71 with SMTP id ck7mr19897157wib.3.1329760289566; Mon, 20 Feb 2012 09:51:29 -0800 (PST) Received: from air11.local (84-72-46-53.dclient.hispeed.ch. [84.72.46.53]) by mx.google.com with ESMTPS id y1sm42772213wiw.6.2012.02.20.09.51.28 (version=TLSv1/SSLv3 cipher=OTHER); Mon, 20 Feb 2012 09:51:28 -0800 (PST) Message-ID: <4F428821.9030207@liip.ch> Date: Mon, 20 Feb 2012 18:51:29 +0100 From: Christian Stocker Organization: Liip AG User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:10.0.2) Gecko/20120216 Thunderbird/10.0.2 MIME-Version: 1.0 To: users@jackrabbit.apache.org Subject: Re: cpu load issues with 2.3.6 References: <8E6EA65C-1050-43CD-B6D4-6DF8EF475DF9@pooteeweet.org> <4F426546.3010303@liip.ch> In-Reply-To: <4F426546.3010303@liip.ch> X-Enigmail-Version: 1.3.5 OpenPGP: id=0748D5FE; url=http://gpg-keyserver.de/pks/lookup?op=get&search=0xC2BAFBC30748D5FE Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Gm-Message-State: ALoCoQm0F0Iywptx/ouyqxtHSDR4MT4zAz43m1C/gcJDf/0S8vP0XODyntB9JMUVf5VHN8vh8zx5 Hi After looking at it further, it's mainly the LOCK PUT REPORT ... which is the culprit. The PUT request changes the list of referenced nodes in one node, and the REPORT request tries to resolve one of the referenced UUIDs to an absolute path. It's a bug in the PHP Library Jackalope that it makes that REPORT call at al (which we will get rid of soon), but I guess, jackalope shouldn't end up using 100% CPU, if someone does that. Greetings chregu On 20.02.12 16:22, Christian Stocker wrote: > Hi > > I discovered the same issue (on the same project as lukas, but on a > totally different task). It has nothing to do with clustering, but with > adding and removing references to a Weak Reference Multi-Value property > within the same session. > > In PHPCR/Jackalope, I do the following: > *** > // remove the weakreference property if one was there > $m->setProperty("refs",null); > $session->save(); > > //add some references > $m->setProperty("refs",$refs,10); > $session->save(); > > //remove one and set the others again > array_pop($refs); > $m->setProperty("refs",$refs,10); > $session->save(); > *** > > If I do the last setProperty() with a new session, then it works. > > On the HTTP level it looks like this: > > https://gist.github.com/1869626 > > The last REPORT (where we try to resolve the UUID to a path), it hangs. > > (I actually don't know, why there's a REPORT there, I have to dig into > that, but the fact that it stops is nevertheless a bad sign) > > Any help is really appreciated > > chregu > > > > > On 16.02.12 15:27, Lukas Kahwe Smith wrote: >> >> On Feb 16, 2012, at 12:02 , Jukka Zitting wrote: >> >>> Hi, >>> >>> On Thu, Feb 16, 2012 at 11:49 AM, Lukas Kahwe Smith wrote: >>>> just wanted to check if anyone else is seeing issues with 2.3.6 (or later). >>>> we are using Jackrabbit standalone in a 2 node cluster. >>>> we are frequently seeing one node in the cluster using 100% CPU. >>> >>> I don't recall such issues. Getting a few thread dumps of a process in >>> such a state should help identify what's keeping it busy. >> >> >> here it is: >> http://pastie.org/private/jyorgp7qyhchckiyfzja >> >> just FYI, we have a very similar configuration in production using jackrabbit 2.3.1 with our old getNodes() patch, where we do not have this issue. well we do see the CPU load increasing there as well .. but at a much much much slower pace to the point where its not a concern for us. >> >> so it seems to be caused by something that was done between 2.3.1 and 2.3.6 >> >> regards, >> Lukas Kahwe Smith >> mls@pooteeweet.org >> >> >