From users-return-268731-archive-asf-public=cust-asf.ponee.io@tomcat.apache.org Tue Nov 12 07:51:24 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id EB766180656 for ; Tue, 12 Nov 2019 08:51:23 +0100 (CET) Received: (qmail 68065 invoked by uid 500); 12 Nov 2019 07:51:19 -0000 Mailing-List: contact users-help@tomcat.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: "Tomcat Users List" Delivered-To: mailing list users@tomcat.apache.org Received: (qmail 68051 invoked by uid 99); 12 Nov 2019 07:51:19 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 Nov 2019 07:51:19 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 86F42C1071 for ; Tue, 12 Nov 2019 07:51:18 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.271 X-Spam-Level: * X-Spam-Status: No, score=1.271 tagged_above=-999 required=6.31 tests=[FORGED_SPF_HELO=1, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_PASS=-0.001, SPF_SOFTFAIL=0.972] autolearn=disabled Received: from mx1-he-de.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id BG2tAvXxuCUV for ; Tue, 12 Nov 2019 07:51:16 +0000 (UTC) Received-SPF: Softfail (mailfrom) identity=mailfrom; client-ip=213.120.69.34; helo=sa-prd-fep-045.btinternet.com; envelope-from=markt@apache.org; receiver= Received: from sa-prd-fep-045.btinternet.com (mailomta28-sa.btinternet.com [213.120.69.34]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id E83987DD69 for ; Tue, 12 Nov 2019 07:51:15 +0000 (UTC) Received: from sa-prd-rgout-002.btmx-prd.synchronoss.net ([10.2.38.5]) by sa-prd-fep-045.btinternet.com with ESMTP id <20191112075109.KXFF5239.sa-prd-fep-045.btinternet.com@sa-prd-rgout-002.btmx-prd.synchronoss.net> for ; Tue, 12 Nov 2019 07:51:09 +0000 Authentication-Results: btinternet.com; auth=pass (LOGIN) smtp.auth=medthomas@btinternet.com X-Originating-IP: [213.121.9.136] X-OWM-Source-IP: 213.121.9.136 (GB) X-OWM-Env-Sender: medthomas@btinternet.com X-VadeSecure-score: verdict=clean score=0/300, class=clean X-RazorGate-Vade: gggruggvucftvghtrhhoucdtuddrgedufedruddvkedgheekucetufdoteggodetrfdotffvucfrrhhofhhilhgvmecuueftkffvkffujffvgffngfevqffopdfqfgfvnecuuegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmdenucfjughrpeffjghfgggtgffuvffhkfesthhqmhdttddtjeenucfhrhhomhepofgrrhhkucfvhhhomhgrshcuoehmrghrkhhtsegrphgrtghhvgdrohhrgheqnecuffhomhgrihhnpehthhhrvggrugdrrhhunhdpuhhtihhlrdhnvghtnecukfhppedvudefrdduvddurdelrddufeeinecurfgrrhgrmhephhgvlhhopehmrghilhdrhhhomhgvihhnsghogidrnhgvthdpihhnvghtpedvudefrdduvddurdelrddufeeipdhmrghilhhfrhhomhepoehmrghrkhhtsegrphgrtghhvgdrohhrgheqpdhrtghpthhtohepoehushgvrhhssehtohhmtggrthdrrghprggthhgvrdhorhhgqecuqfftvefrvfeprhhftgekvddvnehushgvrhhssehtohhmtggrthdrrghprggthhgvrdhorhhgnecuvehluhhsthgvrhfuihiivgeptd X-RazorGate-Vade-Verdict: clean 0 X-RazorGate-Vade-Classification: clean Received: from mail.homeinbox.net (213.121.9.136) by sa-prd-rgout-002.btmx-prd.synchronoss.net (5.8.337) (authenticated as medthomas@btinternet.com) id 5DC13795012FEF39 for users@tomcat.apache.org; Tue, 12 Nov 2019 07:51:09 +0000 Received: from localhost (localhost [127.0.0.1]) by mail.homeinbox.net (Postfix) with ESMTP id 0E11FF001F9 for ; Tue, 12 Nov 2019 07:51:09 +0000 (GMT) X-Virus-Scanned: Debian amavisd-new at homeinbox.net Received: from mail.homeinbox.net ([127.0.0.1]) by localhost (server03.homeinbox.net [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id zeF0nQSvO5a2 for ; Tue, 12 Nov 2019 07:51:08 +0000 (GMT) Received: from marksphone.homeinbox.net (marksphone.homeinbox.net [192.168.23.203]) by mail.homeinbox.net (Postfix) with ESMTPSA id CF994F001B5 for ; Tue, 12 Nov 2019 07:51:08 +0000 (GMT) Date: Tue, 12 Nov 2019 07:51:12 +0000 In-Reply-To: References: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Subject: Re: tomcat thread incurring CPU load To: Tomcat Users List From: Mark Thomas Message-ID: <0F7034A9-A36D-4782-A3EC-48F58F4A5B72@apache.org> On November 12, 2019 12:54:53 AM UTC, "M=2E Manna" w= rote: >Just to give an update again: > >1) We reverted the APR to 1=2E2=2E21 - but observed no difference=2E >2) We took 3 thread dumps over 1 min interval (without any user >sessions) - >All threads are tomcat's internal pool threads=2E > >When we checked the thread details (using fasthread=2Eio) - we didn't see >any >of our application stack=2E Since there is no user traffic, this is >coming >from tomcat internally=2E At this stage, we cannot really figure out >what's >the root cause=2E > >Any help is appreciated=2E Migrated from what (full version info please)? Operating system exact version? JRE vendor and exact version? Do you see the same behavior with the latest 8=2E5=2Ex and latest Tomcat N= ative? What triggers this behaviour? How often do you see this behaviour? And anything else you think might be relevant=2E Mark > >Thanks, > >On Mon, 11 Nov 2019 at 20:57, M=2E Manna wrote: > >> Hello All, >> >> Any thoughts regarding this? Slightly clueless at this point, so any >> direction will be appreciated=2E >> >> We are seeing the poll taking all the CPU time=2E We are using >> OperatingSystemMXBean=2EgetProcessCpuLoad() and >> OperatingSystemMXBean=2EgetSystemCpuLoad() to get our metrics (then >x100 to >> get the pct)=2E >> >> Thanks, >> >> >> On Mon, 11 Nov 2019 at 17:46, M=2E Manna wrote: >> >>> Hello, >>> >>> after migrating to 8=2E5=2E45, we are seeing a lot of cpu load by >following >>> JVM thread dump: >>> >>> "https-openssl-apr-0=2E0=2E0=2E0-8443-Poller" : 102 : RUNNABLE : >>> cpu=3D172902703125000 : cpuLoad=3D 74=2E181015 >>> >>> BlockedCount:8464 BlockedTime:0 LockName:null LockOwnerID:-1 >>> LockOwnerName:null >>> >>> WaitedCount:5397 WaitedTime:0 InNative:false IsSuspended:false at >>> org=2Eapache=2Etomcat=2Ejni=2EPoll=2Epoll(Poll=2Ejava:-2) >>> >>> at >>> >org=2Eapache=2Etomcat=2Eutil=2Enet=2EAprEndpoint$Poller=2Erun(AprEndpoint= =2Ejava:1547) >>> >>> at java=2Elang=2EThread=2Erun(Thread=2Ejava:748) >>> >>> >>> These are coming after 2-3 successful jvm dump=2E Is this something >>> familiar to anybody? >>> >>> Thanks, >>> >> --------------------------------------------------------------------- To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org For additional commands, e-mail: users-help@tomcat.apache.org