Return-Path: X-Original-To: apmail-lucene-solr-user-archive@minotaur.apache.org Delivered-To: apmail-lucene-solr-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 955F1183B1 for ; Wed, 12 Aug 2015 09:31:00 +0000 (UTC) Received: (qmail 69647 invoked by uid 500); 12 Aug 2015 09:30:39 -0000 Delivered-To: apmail-lucene-solr-user-archive@lucene.apache.org Received: (qmail 69582 invoked by uid 500); 12 Aug 2015 09:30:39 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 69571 invoked by uid 99); 12 Aug 2015 09:30:39 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 12 Aug 2015 09:30:39 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 36BDA181A94 for ; Wed, 12 Aug 2015 09:30:39 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.992 X-Spam-Level: *** X-Spam-Status: No, score=3.992 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, KAM_TIME=3, MIME_QP_LONG_LINE=0.001, T_RP_MATCHES_RCVD=-0.01, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id i2phfA63LbvX for ; Wed, 12 Aug 2015 09:30:33 +0000 (UTC) Received: from mail.openindex.io (mail.openindex.io [178.21.113.82]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTP id E04D442B91 for ; Wed, 12 Aug 2015 09:30:32 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by mail.openindex.io (Postfix) with ESMTP id 736C13CE267 for ; Wed, 12 Aug 2015 09:30:26 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at mail.openindex.io Received: from mail.openindex.io ([127.0.0.1]) by localhost (mail.openindex.io [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id PTzC77gICTab for ; Wed, 12 Aug 2015 09:30:25 +0000 (UTC) Received: from mail.openindex.io (localhost [127.0.0.1]) by mail.openindex.io (Postfix) with ESMTP id 96B003CE266 for ; Wed, 12 Aug 2015 09:30:25 +0000 (UTC) Subject: RE: High CPU DistributedQueue and OverseerAutoReplicaFailoverThread From: =?utf-8?Q?Markus_Jelsma?= To: =?utf-8?Q?solr-user=40lucene=2Eapache=2Eorg?= Date: Wed, 12 Aug 2015 09:30:25 +0000 Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable In-Reply-To: References: X-Priority: 3 (Normal) X-Mailer: Zarafa 7.1.10-44973 Message-Id: Hi - anyone to share some hints on the topic=3F Regards, M.=20 =20 -----Original message----- > From:Markus Jelsma > Sent: Wednesday 5th August 2015 12:13 > To: solr-user > Subject: High CPU DistributedQueue and OverseerAutoReplicaFailoverThread >=20 > Hello=C2=A0 - we have a single Solr 5.2.1 node that (for now) contains four single shard collections. Only two collections actually contain data and are queried. The machine has some unusual latency that led me to sample the CPU time with VisualVM. On that node we see that DistributedQueue$LatchWachter.await() and OverseerAutoReplicaFailoverThread() claiming a lot of CPU time, DistributedQueue takes the most of it. I have set logging to DEBUG but no Zookeeper logging is printed, the connections are stable and updates rarely come in.=20 >=20 > Is it because the node runs the overseer=3F If so, how can i prevent it from taking quite a lot of CPU time on a node with four collections where no state changes occur=3F >=20 > Any other thoughts=3F > Markus >=20