From users-return-227575-apmail-tomcat-users-archive=tomcat.apache.org@tomcat.apache.org Fri Sep 9 08:55:27 2011 Return-Path: X-Original-To: apmail-tomcat-users-archive@www.apache.org Delivered-To: apmail-tomcat-users-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D3377859D for ; Fri, 9 Sep 2011 08:55:27 +0000 (UTC) Received: (qmail 72263 invoked by uid 500); 9 Sep 2011 08:55:22 -0000 Delivered-To: apmail-tomcat-users-archive@tomcat.apache.org Received: (qmail 71988 invoked by uid 500); 9 Sep 2011 08:55:08 -0000 Mailing-List: contact users-help@tomcat.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: "Tomcat Users List" Delivered-To: mailing list users@tomcat.apache.org Received: (qmail 71962 invoked by uid 99); 9 Sep 2011 08:55:05 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 09 Sep 2011 08:55:05 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of dave@stubbs.uk.com designates 217.151.101.226 as permitted sender) Received: from [217.151.101.226] (HELO hostb.stubbs.uk.com) (217.151.101.226) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 09 Sep 2011 08:54:56 +0000 Received: from W764OFFICE ([10.0.0.210]) by hostb.stubbs.uk.com ([10.0.0.150] running VPOP3) with ESMTP for ; Fri, 9 Sep 2011 09:54:36 +0100 From: "Dave Stubbs" To: Subject: Tomcat 5.5.27 - Solaris 10 - Tomcat process starts additional copies of itself with only 1 thread and no CPU Date: Fri, 9 Sep 2011 09:54:36 +0100 Message-ID: <004001cc6ece$19d1a5f0$4d74f1d0$@stubbs.uk.com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_NextPart_000_0041_01CC6ED6.7B987EF0" X-Mailer: Microsoft Outlook 14.0 Thread-Index: AcxuScVvU9XMI6nwTyq6zsA8ZfHorQAhErdw Content-Language: en-gb X-Server: VPOP3 V4.0.0e - Registered X-Virus-Checked: Checked by ClamAV on apache.org ------=_NextPart_000_0041_01CC6ED6.7B987EF0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit We're experiencing a problem on both production and test systems that has only started to occur in the last few weeks (no new version of any software have been put live to anyone's knowledge) that has us quite stumped. We are seeing tomcat starting up additional copies of itself, each new copy is allocating a chunk of storage, it only starts 1 thread, nothing gets written to any logs and no CPU is being listed as having been used. This keeps happening, and if it's not monitored the system memory all gets taken up and we start to get SIGBUS errors. We've tried turning all logging on, there don't appear to be any software related events at the heart of the issue, and we can't see any system triggers. When we list the system tasks we see that the ghost process PPID is the same as the PID of the still running main tomcat instance. Here is list of what happened when it wasn't picked up for a while. tomcat 21115 21114 0 14:46:44 ? 193:04 /usr/java/bin/java -Djava.util.logging.config.file=/opt/apache-tomcat -5.5.27-ti tomcat 773 21115 0 17:29:27 ? 0:00 /usr/java/bin/java -Djava.util.logging.config.file=/opt/apache-tomcat -5.5.27-ti tomcat 4270 21115 0 18:29:29 ? 0:00 /usr/java/bin/java -Djava.util.logging.config.file=/opt/apache-tomcat -5.5.27-ti tomcat 5988 21115 0 18:59:32 ? 0:00 /usr/java/bin/java -Djava.util.logging.config.file=/opt/apache-tomcat -5.5.27-ti tomcat 27209 21115 0 01:01:02 ? 0:00 /usr/java/bin/java -Djava.util.logging.config.file=/opt/apache-tomcat -5.5.27-ti tomcat 13155 21115 0 05:32:09 ? 0:00 /usr/java/bin/java -Djava.util.logging.config.file=/opt/apache-tomcat -5.5.27-ti tomcat 16785 21115 0 06:34:52 ? 0:00 /usr/java/bin/java -Djava.util.logging.config.file=/opt/apache-tomcat -5.5.27-ti tomcat 12948 21115 0 20:58:50 ? 0:00 /usr/java/bin/java -Djava.util.logging.config.file=/opt/apache-tomcat -5.5.27-ti tomcat 20054 21115 0 23:00:21 ? 0:00 /usr/java/bin/java -Djava.util.logging.config.file=/opt/apache-tomcat -5.5.27-ti tomcat 23730 21115 0 00:03:47 ? 0:00 /usr/java/bin/java -Djava.util.logging.config.file=/opt/apache-tomcat -5.5.27-ti The main process 21115 starts off fine, and is even still running with no problems the next day, but we keep getting these ghost processes (for want of a better description). We have multiple tomcat servers running on the same system, but this is the only one experiencing the problem, all of the others are unaffected. The web apps themselves are pretty standard, servlets, JSPs, web services, Oracle DB connection and a JMX link to an Apache MQ server for monitoring purposes. This isn't even a heavily used application. The web has come up empty for us, we can't find any information on this fault at all, so would really appreciate any help you may be able to give us. Regards Dave ------=_NextPart_000_0041_01CC6ED6.7B987EF0--