From builds-return-1498-archive-asf-public=cust-asf.ponee.io@lucene.apache.org Tue Dec 10 14:10:22 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 03257180630 for ; Tue, 10 Dec 2019 15:10:21 +0100 (CET) Received: (qmail 88717 invoked by uid 500); 10 Dec 2019 14:10:21 -0000 Mailing-List: contact builds-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list builds@lucene.apache.org Received: (qmail 88704 invoked by uid 99); 10 Dec 2019 14:10:21 -0000 Received: from Unknown (HELO mailrelay1-lw-us.apache.org) (10.10.3.159) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Dec 2019 14:10:21 +0000 Received: from jenkins02.apache.org (jenkins02.apache.org [195.201.213.130]) by mailrelay1-lw-us.apache.org (ASF Mail Server at mailrelay1-lw-us.apache.org) with ESMTP id 514CA4FBC for ; Tue, 10 Dec 2019 14:10:18 +0000 (UTC) Received: from jenkins02.apache.org (localhost.localdomain [127.0.0.1]) by jenkins02.apache.org (ASF Mail Server at jenkins02.apache.org) with ESMTP id CFC8033E0136 for ; Tue, 10 Dec 2019 14:10:17 +0000 (UTC) Date: Tue, 10 Dec 2019 14:06:36 +0000 (UTC) From: Apache Jenkins Server To: builds@lucene.apache.org Message-ID: <205415206.18058.1575987017856.JavaMail.jenkins@jenkins02> In-Reply-To: <1100291456.17581.1575906479559.JavaMail.jenkins@jenkins02> References: <1100291456.17581.1575906479559.JavaMail.jenkins@jenkins02> Subject: [JENKINS] Lucene-Solr-NightlyTests-master - Build # 2041 - Still Unstable MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_18057_856463870.1575987017599" X-Jenkins-Job: Lucene-Solr-NightlyTests-master X-Jenkins-Result: UNSTABLE ------=_Part_18057_856463870.1575987017599 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/2041/ 9 tests failed. FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsThreadLea= kTest Error Message: access denied ("java.io.FilePermission" "<>" "execute") Stack Trace: java.security.AccessControlException: access denied ("java.io.FilePermissio= n" "<>" "execute") =09at __randomizedtesting.SeedInfo.seed([259547C72E0C74B3]:0) =09at java.base/java.security.AccessControlContext.checkPermission(AccessCo= ntrolContext.java:472) =09at java.base/java.security.AccessController.checkPermission(AccessContro= ller.java:897) =09at java.base/java.lang.SecurityManager.checkPermission(SecurityManager.j= ava:322) =09at java.base/java.lang.SecurityManager.checkExec(SecurityManager.java:57= 2) =09at java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1096) =09at java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1071) =09at org.apache.hadoop.util.Shell.runCommand(Shell.java:938) =09at org.apache.hadoop.util.Shell.run(Shell.java:901) =09at org.apache.hadoop.fs.DF.getFilesystem(DF.java:74) =09at org.apache.hadoop.hdfs.server.namenode.NameNodeResourceChecker$Checke= dVolume.(NameNodeResourceChecker.java:70) =09at org.apache.hadoop.hdfs.server.namenode.NameNodeResourceChecker.addDir= ToCheck(NameNodeResourceChecker.java:166) =09at org.apache.hadoop.hdfs.server.namenode.NameNodeResourceChecker.= (NameNodeResourceChecker.java:135) =09at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startCommonServic= es(FSNamesystem.java:1168) =09at org.apache.hadoop.hdfs.server.namenode.NameNode.startCommonServices(N= ameNode.java:791) =09at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.j= ava:717) =09at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:= 940) =09at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:= 913) =09at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNo= de.java:1646) =09at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.j= ava:1314) =09at org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSClu= ster.java:1083) =09at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniD= FSCluster.java:958) =09at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSClust= er.java:890) =09at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:518) =09at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.ja= va:477) =09at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:= 134) =09at org.apache.solr.cloud.hdfs.HdfsThreadLeakTest.beforeClass(HdfsThreadL= eakTest.java:42) =09at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nativ= e Method) =09at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native= MethodAccessorImpl.java:62) =09at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De= legatingMethodAccessorImpl.java:43) =09at java.base/java.lang.reflect.Method.invoke(Method.java:566) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1750) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Random= izedRunner.java:878) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:894) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:41) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:53) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:54) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:368) =09at java.base/java.lang.Thread.run(Thread.java:834) FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsThreadLea= kTest Error Message: 15 threads leaked from SUITE scope at org.apache.solr.cloud.hdfs.HdfsThread= LeakTest: 1) Thread[id=3D2584, name=3DSession-HouseKeeper-5f1c7df1, sta= te=3DTIMED_WAITING, group=3DTGRP-HdfsThreadLeakTest] at java.base@1= 1.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.= 0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) = at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) = at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$D= elayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182) at java= .base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQu= eue.take(ScheduledThreadPoolExecutor.java:899) at java.base@11.0.4/= java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:105= 4) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runW= orker(ThreadPoolExecutor.java:1114) at java.base@11.0.4/java.util.c= oncurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) = at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 2) Thread[id= =3D2593, name=3DIPC Server idle connection scanner for port 45640, state=3D= WAITING, group=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/java.= lang.Object.wait(Native Method) at java.base@11.0.4/java.lang.Objec= t.wait(Object.java:328) at java.base@11.0.4/java.util.TimerThread.m= ainLoop(Timer.java:527) at java.base@11.0.4/java.util.TimerThread.r= un(Timer.java:506) 3) Thread[id=3D2583, name=3Dqtp96805673-2583, state= =3DTIMED_WAITING, group=3DTGRP-HdfsThreadLeakTest] at java.base@11.= 0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.= 4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) = at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchron= izer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) = at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueu= e.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$= Runner.idleJobPoll(QueuedThreadPool.java:850) at app//org.eclipse.j= etty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889) = at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 4) Thread= [id=3D2581, name=3Dqtp96805673-2581, state=3DTIMED_WAITING, group=3DTGRP-Hd= fsThreadLeakTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park= (Native Method) at java.base@11.0.4/java.util.concurrent.locks.Lock= Support.parkNanos(LockSupport.java:234) at java.base@11.0.4/java.ut= il.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(A= bstractQueuedSynchronizer.java:2123) at app//org.eclipse.jetty.util= .BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at app//org.e= clipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPo= ol.java:850) at app//org.eclipse.jetty.util.thread.QueuedThreadPool= $Runner.run(QueuedThreadPool.java:889) at java.base@11.0.4/java.lan= g.Thread.run(Thread.java:834) 5) Thread[id=3D2582, name=3Dqtp96805673-25= 82, state=3DTIMED_WAITING, group=3DTGRP-HdfsThreadLeakTest] at java= .base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.b= ase@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.jav= a:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueue= dSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:21= 23) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(Blocking= ArrayQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedTh= readPool$Runner.idleJobPoll(QueuedThreadPool.java:850) at app//org.= eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java= :889) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) = 6) Thread[id=3D2577, name=3Dqtp96805673-2577, state=3DRUNNABLE, group=3DTGR= P-HdfsThreadLeakTest] at java.base@11.0.4/sun.nio.ch.EPoll.wait(Nat= ive Method) at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSele= ct(EPollSelectorImpl.java:120) at java.base@11.0.4/sun.nio.ch.Selec= torImpl.lockAndDoSelect(SelectorImpl.java:124) at java.base@11.0.4/= sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) at app//org.e= clipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.jav= a:464) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProduce= r.produce(ManagedSelector.java:401) at app//org.eclipse.jetty.util.= thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357) = at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(Ea= tWhatYouKill.java:181) at app//org.eclipse.jetty.util.thread.strate= gy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at app//org.e= clipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.jav= a:132) at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$202/0x0= 000000100482840.run(Unknown Source) at app//org.eclipse.jetty.util.= thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781) at app//o= rg.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.j= ava:917) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) = 7) Thread[id=3D2573, name=3DTimer for 'NameNode' metrics system, state= =3DTIMED_WAITING, group=3DTGRP-HdfsThreadLeakTest] at java.base@11.= 0.4/java.lang.Object.wait(Native Method) at java.base@11.0.4/java.u= til.TimerThread.mainLoop(Timer.java:553) at java.base@11.0.4/java.u= til.TimerThread.run(Timer.java:506) 8) Thread[id=3D2578, name=3Dqtp96805= 673-2578-acceptor-0@4c958735-ServerConnector@532fdd7f{HTTP/1.1,[http/1.1]}{= lucene2-us-west.apache.org:37657}, state=3DRUNNABLE, group=3DTGRP-HdfsThrea= dLeakTest] at java.base@11.0.4/sun.nio.ch.ServerSocketChannelImpl.a= ccept0(Native Method) at java.base@11.0.4/sun.nio.ch.ServerSocketCh= annelImpl.accept(ServerSocketChannelImpl.java:533) at java.base@11.= 0.4/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:= 285) at app//org.eclipse.jetty.server.ServerConnector.accept(Server= Connector.java:385) at app//org.eclipse.jetty.server.AbstractConnec= tor$Acceptor.run(AbstractConnector.java:648) at app//org.eclipse.je= tty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781) = at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThr= eadPool.java:917) at java.base@11.0.4/java.lang.Thread.run(Thread.j= ava:834) 9) Thread[id=3D2590, name=3DFSEditLogAsync, state=3DWAITING, gr= oup=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.internal.mis= c.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurre= nt.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.4= /java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awai= t(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.4/java.ut= il.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:417) = at app//org.apache.hadoop.hdfs.server.namenode.FSEditLogAsync.dequeueEdit(F= SEditLogAsync.java:221) at app//org.apache.hadoop.hdfs.server.namen= ode.FSEditLogAsync.run(FSEditLogAsync.java:229) at java.base@11.0.4= /java.lang.Thread.run(Thread.java:834) 10) Thread[id=3D2574, name=3Dorg.a= pache.hadoop.util.JvmPauseMonitor$Monitor@3536d80, state=3DTIMED_WAITING, g= roup=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/java.lang.Threa= d.sleep(Native Method) at app//org.apache.hadoop.util.JvmPauseMonit= or$Monitor.run(JvmPauseMonitor.java:192) at java.base@11.0.4/java.l= ang.Thread.run(Thread.java:834) 11) Thread[id=3D2592, name=3DSocket Reade= r #1 for port 45640, state=3DRUNNABLE, group=3DTGRP-HdfsThreadLeakTest] = at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method) at ja= va.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java= :120) at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(S= electorImpl.java:124) at java.base@11.0.4/sun.nio.ch.SelectorImpl.s= elect(SelectorImpl.java:141) at app//org.apache.hadoop.ipc.Server$L= istener$Reader.doRunLoop(Server.java:1097) at app//org.apache.hadoo= p.ipc.Server$Listener$Reader.run(Server.java:1076) 12) Thread[id=3D2575, = name=3Dpool-3-thread-1, state=3DTIMED_WAITING, group=3DTGRP-HdfsThreadLeakT= est] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Metho= d) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkN= anos(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent= .locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueued= Synchronizer.java:2123) at java.base@11.0.4/java.util.concurrent.Sc= heduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor= .java:1182) at java.base@11.0.4/java.util.concurrent.ScheduledThrea= dPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899) = at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(= ThreadPoolExecutor.java:1054) at java.base@11.0.4/java.util.concurr= ent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at j= ava.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPo= olExecutor.java:628) at java.base@11.0.4/java.lang.Thread.run(Threa= d.java:834) 13) Thread[id=3D2576, name=3Dqtp96805673-2576, state=3DRUNNAB= LE, group=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/sun.nio.ch= .EPoll.wait(Native Method) at java.base@11.0.4/sun.nio.ch.EPollSele= ctorImpl.doSelect(EPollSelectorImpl.java:120) at java.base@11.0.4/s= un.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124) at ja= va.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) = at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(Mana= gedSelector.java:464) at app//org.eclipse.jetty.io.ManagedSelector$= SelectorProducer.produce(ManagedSelector.java:401) at app//org.ecli= pse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.ja= va:357) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKi= ll.doProduce(EatWhatYouKill.java:181) at app//org.eclipse.jetty.uti= l.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) = at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(Eat= WhatYouKill.java:132) at app//org.eclipse.jetty.io.ManagedSelector$= $Lambda$202/0x0000000100482840.run(Unknown Source) at app//org.ecli= pse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781) = at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Que= uedThreadPool.java:917) at java.base@11.0.4/java.lang.Thread.run(Th= read.java:834) 14) Thread[id=3D2580, name=3Dqtp96805673-2580, state=3DTIM= ED_WAITING, group=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jd= k.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java= .util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) = at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$C= onditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at = app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java= :392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner= .idleJobPoll(QueuedThreadPool.java:850) at app//org.eclipse.jetty.u= til.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889) a= t java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 15) Thread[id=3D= 2579, name=3Dqtp96805673-2579, state=3DTIMED_WAITING, group=3DTGRP-HdfsThre= adLeakTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Nativ= e Method) at java.base@11.0.4/java.util.concurrent.locks.LockSuppor= t.parkNanos(LockSupport.java:234) at java.base@11.0.4/java.util.con= current.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Abstrac= tQueuedSynchronizer.java:2123) at app//org.eclipse.jetty.util.Block= ingArrayQueue.poll(BlockingArrayQueue.java:392) at app//org.eclipse= .jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.jav= a:850) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runne= r.run(QueuedThreadPool.java:889) at java.base@11.0.4/java.lang.Thre= ad.run(Thread.java:834) Stack Trace: com.carrotsearch.randomizedtesting.ThreadLeakError: 15 threads leaked from = SUITE scope at org.apache.solr.cloud.hdfs.HdfsThreadLeakTest:=20 1) Thread[id=3D2584, name=3DSession-HouseKeeper-5f1c7df1, state=3DTIMED_= WAITING, group=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecuto= r$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182) at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecuto= r$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask= (ThreadPoolExecutor.java:1054) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWork= er(ThreadPoolExecutor.java:1114) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.= run(ThreadPoolExecutor.java:628) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 2) Thread[id=3D2593, name=3DIPC Server idle connection scanner for port = 45640, state=3DWAITING, group=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/java.lang.Object.wait(Native Method) at java.base@11.0.4/java.lang.Object.wait(Object.java:328) at java.base@11.0.4/java.util.TimerThread.mainLoop(Timer.java:527) at java.base@11.0.4/java.util.TimerThread.run(Timer.java:506) 3) Thread[id=3D2583, name=3Dqtp96805673-2583, state=3DTIMED_WAITING, gro= up=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArra= yQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJ= obPoll(QueuedThreadPool.java:850) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:889) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 4) Thread[id=3D2581, name=3Dqtp96805673-2581, state=3DTIMED_WAITING, gro= up=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArra= yQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJ= obPoll(QueuedThreadPool.java:850) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:889) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 5) Thread[id=3D2582, name=3Dqtp96805673-2582, state=3DTIMED_WAITING, gro= up=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArra= yQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJ= obPoll(QueuedThreadPool.java:850) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:889) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 6) Thread[id=3D2577, name=3Dqtp96805673-2577, state=3DRUNNABLE, group=3D= TGRP-HdfsThreadLeakTest] at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method) at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSele= ctorImpl.java:120) at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(Selecto= rImpl.java:124) at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.jav= a:141) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.selec= t(ManagedSelector.java:464) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produ= ce(ManagedSelector.java:401) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produ= ceTask(EatWhatYouKill.java:357) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doPro= duce(EatWhatYouKill.java:181) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryPr= oduce(EatWhatYouKill.java:168) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produ= ce(EatWhatYouKill.java:132) at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$202/0x00000001= 00482840.run(Unknown Source) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(Queue= dThreadPool.java:781) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:917) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 7) Thread[id=3D2573, name=3DTimer for 'NameNode' metrics system, state= =3DTIMED_WAITING, group=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/java.lang.Object.wait(Native Method) at java.base@11.0.4/java.util.TimerThread.mainLoop(Timer.java:553) at java.base@11.0.4/java.util.TimerThread.run(Timer.java:506) 8) Thread[id=3D2578, name=3Dqtp96805673-2578-acceptor-0@4c958735-ServerC= onnector@532fdd7f{HTTP/1.1,[http/1.1]}{lucene2-us-west.apache.org:37657}, s= tate=3DRUNNABLE, group=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/sun.nio.ch.ServerSocketChannelImpl.accept0(Nati= ve Method) at java.base@11.0.4/sun.nio.ch.ServerSocketChannelImpl.accept(Serve= rSocketChannelImpl.java:533) at java.base@11.0.4/sun.nio.ch.ServerSocketChannelImpl.accept(Serve= rSocketChannelImpl.java:285) at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConne= ctor.java:385) at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(Abs= tractConnector.java:648) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(Queue= dThreadPool.java:781) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:917) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 9) Thread[id=3D2590, name=3DFSEditLogAsync, state=3DWAITING, group=3DTGR= P-HdfsThreadLeakTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(Loc= kSupport.java:194) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.4/java.util.concurrent.ArrayBlockingQueue.take(Ar= rayBlockingQueue.java:417) at app//org.apache.hadoop.hdfs.server.namenode.FSEditLogAsync.deque= ueEdit(FSEditLogAsync.java:221) at app//org.apache.hadoop.hdfs.server.namenode.FSEditLogAsync.run(F= SEditLogAsync.java:229) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 10) Thread[id=3D2574, name=3Dorg.apache.hadoop.util.JvmPauseMonitor$Monit= or@3536d80, state=3DTIMED_WAITING, group=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/java.lang.Thread.sleep(Native Method) at app//org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPause= Monitor.java:192) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 11) Thread[id=3D2592, name=3DSocket Reader #1 for port 45640, state=3DRUN= NABLE, group=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method) at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSele= ctorImpl.java:120) at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(Selecto= rImpl.java:124) at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.jav= a:141) at app//org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Serv= er.java:1097) at app//org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.jav= a:1076) 12) Thread[id=3D2575, name=3Dpool-3-thread-1, state=3DTIMED_WAITING, grou= p=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecuto= r$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182) at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecuto= r$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask= (ThreadPoolExecutor.java:1054) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWork= er(ThreadPoolExecutor.java:1114) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.= run(ThreadPoolExecutor.java:628) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 13) Thread[id=3D2576, name=3Dqtp96805673-2576, state=3DRUNNABLE, group=3D= TGRP-HdfsThreadLeakTest] at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method) at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSele= ctorImpl.java:120) at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(Selecto= rImpl.java:124) at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.jav= a:141) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.selec= t(ManagedSelector.java:464) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produ= ce(ManagedSelector.java:401) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produ= ceTask(EatWhatYouKill.java:357) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doPro= duce(EatWhatYouKill.java:181) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryPr= oduce(EatWhatYouKill.java:168) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produ= ce(EatWhatYouKill.java:132) at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$202/0x00000001= 00482840.run(Unknown Source) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(Queue= dThreadPool.java:781) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:917) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 14) Thread[id=3D2580, name=3Dqtp96805673-2580, state=3DTIMED_WAITING, gro= up=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArra= yQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJ= obPoll(QueuedThreadPool.java:850) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:889) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 15) Thread[id=3D2579, name=3Dqtp96805673-2579, state=3DTIMED_WAITING, gro= up=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArra= yQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJ= obPoll(QueuedThreadPool.java:850) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:889) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) =09at __randomizedtesting.SeedInfo.seed([259547C72E0C74B3]:0) FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsThreadLea= kTest Error Message: There are still zombie threads that couldn't be terminated: 1) Thread[id= =3D2584, name=3DSession-HouseKeeper-5f1c7df1, state=3DTIMED_WAITING, group= =3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.internal.misc.U= nsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.= locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@11.0= .4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.aw= aitNanos(AbstractQueuedSynchronizer.java:2123) at java.base@11.0.4/= java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Sche= duledThreadPoolExecutor.java:1182) at java.base@11.0.4/java.util.co= ncurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadP= oolExecutor.java:899) at java.base@11.0.4/java.util.concurrent.Thre= adPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@1= 1.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.= java:1114) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecu= tor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.4/jav= a.lang.Thread.run(Thread.java:834) 2) Thread[id=3D2593, name=3DIPC Serve= r idle connection scanner for port 45640, state=3DWAITING, group=3DTGRP-Hdf= sThreadLeakTest] at java.base@11.0.4/java.lang.Object.wait(Native M= ethod) at java.base@11.0.4/java.lang.Object.wait(Object.java:328) = at java.base@11.0.4/java.util.TimerThread.mainLoop(Timer.java:527) = at java.base@11.0.4/java.util.TimerThread.run(Timer.java:506) 3) = Thread[id=3D2583, name=3Dqtp96805673-2583, state=3DTIMED_WAITING, group=3DT= GRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.internal.misc.Unsaf= e.park(Native Method) at java.base@11.0.4/java.util.concurrent.lock= s.LockSupport.parkNanos(LockSupport.java:234) at java.base@11.0.4/j= ava.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitN= anos(AbstractQueuedSynchronizer.java:2123) at app//org.eclipse.jett= y.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at app/= /org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedTh= readPool.java:850) at app//org.eclipse.jetty.util.thread.QueuedThre= adPool$Runner.run(QueuedThreadPool.java:889) at java.base@11.0.4/ja= va.lang.Thread.run(Thread.java:834) 4) Thread[id=3D2581, name=3Dqtp96805= 673-2581, state=3DTIMED_WAITING, group=3DTGRP-HdfsThreadLeakTest] a= t java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at = java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSuppo= rt.java:234) at java.base@11.0.4/java.util.concurrent.locks.Abstrac= tQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.j= ava:2123) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(Bl= ockingArrayQueue.java:392) at app//org.eclipse.jetty.util.thread.Qu= euedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850) at app= //org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPoo= l.java:889) at java.base@11.0.4/java.lang.Thread.run(Thread.java:83= 4) 5) Thread[id=3D2582, name=3Dqtp96805673-2582, state=3DTIMED_WAITING, = group=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.internal.m= isc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concur= rent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base= @11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObje= ct.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//org.ecl= ipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) = at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll= (QueuedThreadPool.java:850) at app//org.eclipse.jetty.util.thread.Q= ueuedThreadPool$Runner.run(QueuedThreadPool.java:889) at java.base@= 11.0.4/java.lang.Thread.run(Thread.java:834) 6) Thread[id=3D2577, name= =3Dqtp96805673-2577, state=3DRUNNABLE, group=3DTGRP-HdfsThreadLeakTest] = at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method) at ja= va.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java= :120) at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(S= electorImpl.java:124) at java.base@11.0.4/sun.nio.ch.SelectorImpl.s= elect(SelectorImpl.java:141) at app//org.eclipse.jetty.io.ManagedSe= lector$SelectorProducer.select(ManagedSelector.java:464) at app//or= g.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector= .java:401) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYo= uKill.produceTask(EatWhatYouKill.java:357) at app//org.eclipse.jett= y.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181) = at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProd= uce(EatWhatYouKill.java:168) at app//org.eclipse.jetty.util.thread.= strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132) at app//or= g.eclipse.jetty.io.ManagedSelector$$Lambda$202/0x0000000100482840.run(Unkno= wn Source) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.r= unJob(QueuedThreadPool.java:781) at app//org.eclipse.jetty.util.thr= ead.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917) at java.= base@11.0.4/java.lang.Thread.run(Thread.java:834) 7) Thread[id=3D2573, n= ame=3DTimer for 'NameNode' metrics system, state=3DTIMED_WAITING, group=3DT= GRP-HdfsThreadLeakTest] at java.base@11.0.4/java.lang.Object.wait(N= ative Method) at java.base@11.0.4/java.util.TimerThread.mainLoop(Ti= mer.java:553) at java.base@11.0.4/java.util.TimerThread.run(Timer.j= ava:506) 8) Thread[id=3D2578, name=3Dqtp96805673-2578, state=3DTIMED_WAI= TING, group=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.inte= rnal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.= concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at jav= a.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$Conditi= onObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//o= rg.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) = at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJ= obPoll(QueuedThreadPool.java:850) at app//org.eclipse.jetty.util.th= read.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889) at java= .base@11.0.4/java.lang.Thread.run(Thread.java:834) 9) Thread[id=3D2592, = name=3DSocket Reader #1 for port 45640, state=3DRUNNABLE, group=3DTGRP-Hdfs= ThreadLeakTest] at java.base@11.0.4/sun.nio.ch.IOUtil.write1(Native= Method) at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.wakeup(EP= ollSelectorImpl.java:254) at java.base@11.0.4/java.nio.channels.spi= .AbstractSelector$1.interrupt(AbstractSelector.java:213) at java.ba= se@11.0.4/java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.jav= a:219) at java.base@11.0.4/sun.nio.ch.SelectorImpl.begin(SelectorIm= pl.java:94) at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSele= ct(EPollSelectorImpl.java:116) at java.base@11.0.4/sun.nio.ch.Selec= torImpl.lockAndDoSelect(SelectorImpl.java:124) at java.base@11.0.4/= sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) at app//org.a= pache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:1097) = at app//org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:1076)= 10) Thread[id=3D2575, name=3Dpool-3-thread-1, state=3DTIMED_WAITING, gro= up=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.internal.misc= .Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurren= t.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@11= .0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.= awaitNanos(AbstractQueuedSynchronizer.java:2123) at java.base@11.0.= 4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Sc= heduledThreadPoolExecutor.java:1182) at java.base@11.0.4/java.util.= concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThrea= dPoolExecutor.java:899) at java.base@11.0.4/java.util.concurrent.Th= readPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base= @11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecuto= r.java:1114) at java.base@11.0.4/java.util.concurrent.ThreadPoolExe= cutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.4/j= ava.lang.Thread.run(Thread.java:834) 11) Thread[id=3D2576, name=3Dqtp9680= 5673-2576, state=3DRUNNABLE, group=3DTGRP-HdfsThreadLeakTest] at ja= va.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method) at java.base@11= .0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120) = at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImp= l.java:124) at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(Sele= ctorImpl.java:141) at app//org.eclipse.jetty.io.ManagedSelector$Sel= ectorProducer.select(ManagedSelector.java:464) at app//org.eclipse.= jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:401)= at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.prod= uceTask(EatWhatYouKill.java:357) at app//org.eclipse.jetty.util.thr= ead.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181) at a= pp//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWha= tYouKill.java:168) at app//org.eclipse.jetty.util.thread.strategy.E= atWhatYouKill.produce(EatWhatYouKill.java:132) at app//org.eclipse.= jetty.io.ManagedSelector$$Lambda$202/0x0000000100482840.run(Unknown Source)= at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(Queu= edThreadPool.java:781) at app//org.eclipse.jetty.util.thread.Queued= ThreadPool$Runner.run(QueuedThreadPool.java:917) at java.base@11.0.= 4/java.lang.Thread.run(Thread.java:834) 12) Thread[id=3D2580, name=3Dqtp9= 6805673-2580, state=3DTIMED_WAITING, group=3DTGRP-HdfsThreadLeakTest] = at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) = at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockS= upport.java:234) at java.base@11.0.4/java.util.concurrent.locks.Abs= tractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchroniz= er.java:2123) at app//org.eclipse.jetty.util.BlockingArrayQueue.pol= l(BlockingArrayQueue.java:392) at app//org.eclipse.jetty.util.threa= d.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850) at= app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThrea= dPool.java:889) at java.base@11.0.4/java.lang.Thread.run(Thread.jav= a:834) 13) Thread[id=3D2579, name=3Dqtp96805673-2579, state=3DTIMED_WAITI= NG, group=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.intern= al.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.co= ncurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.= base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$Condition= Object.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//org= .eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) = at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJob= Poll(QueuedThreadPool.java:850) at app//org.eclipse.jetty.util.thre= ad.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889) at java.b= ase@11.0.4/java.lang.Thread.run(Thread.java:834) Stack Trace: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie = threads that couldn't be terminated: 1) Thread[id=3D2584, name=3DSession-HouseKeeper-5f1c7df1, state=3DTIMED_= WAITING, group=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecuto= r$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182) at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecuto= r$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask= (ThreadPoolExecutor.java:1054) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWork= er(ThreadPoolExecutor.java:1114) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.= run(ThreadPoolExecutor.java:628) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 2) Thread[id=3D2593, name=3DIPC Server idle connection scanner for port = 45640, state=3DWAITING, group=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/java.lang.Object.wait(Native Method) at java.base@11.0.4/java.lang.Object.wait(Object.java:328) at java.base@11.0.4/java.util.TimerThread.mainLoop(Timer.java:527) at java.base@11.0.4/java.util.TimerThread.run(Timer.java:506) 3) Thread[id=3D2583, name=3Dqtp96805673-2583, state=3DTIMED_WAITING, gro= up=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArra= yQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJ= obPoll(QueuedThreadPool.java:850) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:889) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 4) Thread[id=3D2581, name=3Dqtp96805673-2581, state=3DTIMED_WAITING, gro= up=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArra= yQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJ= obPoll(QueuedThreadPool.java:850) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:889) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 5) Thread[id=3D2582, name=3Dqtp96805673-2582, state=3DTIMED_WAITING, gro= up=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArra= yQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJ= obPoll(QueuedThreadPool.java:850) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:889) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 6) Thread[id=3D2577, name=3Dqtp96805673-2577, state=3DRUNNABLE, group=3D= TGRP-HdfsThreadLeakTest] at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method) at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSele= ctorImpl.java:120) at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(Selecto= rImpl.java:124) at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.jav= a:141) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.selec= t(ManagedSelector.java:464) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produ= ce(ManagedSelector.java:401) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produ= ceTask(EatWhatYouKill.java:357) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doPro= duce(EatWhatYouKill.java:181) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryPr= oduce(EatWhatYouKill.java:168) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produ= ce(EatWhatYouKill.java:132) at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$202/0x00000001= 00482840.run(Unknown Source) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(Queue= dThreadPool.java:781) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:917) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 7) Thread[id=3D2573, name=3DTimer for 'NameNode' metrics system, state= =3DTIMED_WAITING, group=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/java.lang.Object.wait(Native Method) at java.base@11.0.4/java.util.TimerThread.mainLoop(Timer.java:553) at java.base@11.0.4/java.util.TimerThread.run(Timer.java:506) 8) Thread[id=3D2578, name=3Dqtp96805673-2578, state=3DTIMED_WAITING, gro= up=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArra= yQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJ= obPoll(QueuedThreadPool.java:850) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:889) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 9) Thread[id=3D2592, name=3DSocket Reader #1 for port 45640, state=3DRUN= NABLE, group=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/sun.nio.ch.IOUtil.write1(Native Method) at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.wakeup(EPollSelect= orImpl.java:254) at java.base@11.0.4/java.nio.channels.spi.AbstractSelector$1.interr= upt(AbstractSelector.java:213) at java.base@11.0.4/java.nio.channels.spi.AbstractSelector.begin(Ab= stractSelector.java:219) at java.base@11.0.4/sun.nio.ch.SelectorImpl.begin(SelectorImpl.java= :94) at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSele= ctorImpl.java:116) at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(Selecto= rImpl.java:124) at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.jav= a:141) at app//org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Serv= er.java:1097) at app//org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.jav= a:1076) 10) Thread[id=3D2575, name=3Dpool-3-thread-1, state=3DTIMED_WAITING, grou= p=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecuto= r$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182) at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecuto= r$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask= (ThreadPoolExecutor.java:1054) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWork= er(ThreadPoolExecutor.java:1114) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.= run(ThreadPoolExecutor.java:628) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 11) Thread[id=3D2576, name=3Dqtp96805673-2576, state=3DRUNNABLE, group=3D= TGRP-HdfsThreadLeakTest] at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method) at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSele= ctorImpl.java:120) at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(Selecto= rImpl.java:124) at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.jav= a:141) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.selec= t(ManagedSelector.java:464) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produ= ce(ManagedSelector.java:401) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produ= ceTask(EatWhatYouKill.java:357) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doPro= duce(EatWhatYouKill.java:181) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryPr= oduce(EatWhatYouKill.java:168) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produ= ce(EatWhatYouKill.java:132) at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$202/0x00000001= 00482840.run(Unknown Source) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(Queue= dThreadPool.java:781) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:917) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 12) Thread[id=3D2580, name=3Dqtp96805673-2580, state=3DTIMED_WAITING, gro= up=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArra= yQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJ= obPoll(QueuedThreadPool.java:850) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:889) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 13) Thread[id=3D2579, name=3Dqtp96805673-2579, state=3DTIMED_WAITING, gro= up=3DTGRP-HdfsThreadLeakTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArra= yQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJ= obPoll(QueuedThreadPool.java:850) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:889) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) =09at __randomizedtesting.SeedInfo.seed([259547C72E0C74B3]:0) FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsTlogRepla= yBufferedWhileIndexingTest Error Message: access denied ("java.io.FilePermission" "<>" "execute") Stack Trace: java.security.AccessControlException: access denied ("java.io.FilePermissio= n" "<>" "execute") =09at __randomizedtesting.SeedInfo.seed([259547C72E0C74B3]:0) =09at java.base/java.security.AccessControlContext.checkPermission(AccessCo= ntrolContext.java:472) =09at java.base/java.security.AccessController.checkPermission(AccessContro= ller.java:897) =09at java.base/java.lang.SecurityManager.checkPermission(SecurityManager.j= ava:322) =09at java.base/java.lang.SecurityManager.checkExec(SecurityManager.java:57= 2) =09at java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1096) =09at java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1071) =09at org.apache.hadoop.util.Shell.runCommand(Shell.java:938) =09at org.apache.hadoop.util.Shell.run(Shell.java:901) =09at org.apache.hadoop.fs.DF.getFilesystem(DF.java:74) =09at org.apache.hadoop.hdfs.server.namenode.NameNodeResourceChecker$Checke= dVolume.(NameNodeResourceChecker.java:70) =09at org.apache.hadoop.hdfs.server.namenode.NameNodeResourceChecker.addDir= ToCheck(NameNodeResourceChecker.java:166) =09at org.apache.hadoop.hdfs.server.namenode.NameNodeResourceChecker.= (NameNodeResourceChecker.java:135) =09at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startCommonServic= es(FSNamesystem.java:1168) =09at org.apache.hadoop.hdfs.server.namenode.NameNode.startCommonServices(N= ameNode.java:791) =09at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.j= ava:717) =09at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:= 940) =09at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:= 913) =09at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNo= de.java:1646) =09at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.j= ava:1314) =09at org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSClu= ster.java:1083) =09at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniD= FSCluster.java:958) =09at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSClust= er.java:890) =09at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:518) =09at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.ja= va:477) =09at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:= 134) =09at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:= 66) =09at org.apache.solr.cloud.hdfs.HdfsTlogReplayBufferedWhileIndexingTest.se= tupClass(HdfsTlogReplayBufferedWhileIndexingTest.java:43) =09at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nativ= e Method) =09at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native= MethodAccessorImpl.java:62) =09at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De= legatingMethodAccessorImpl.java:43) =09at java.base/java.lang.reflect.Method.invoke(Method.java:566) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1750) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Random= izedRunner.java:878) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:894) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:41) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:53) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:54) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:368) =09at java.base/java.lang.Thread.run(Thread.java:834) FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsTlogRepla= yBufferedWhileIndexingTest Error Message: 15 threads leaked from SUITE scope at org.apache.solr.cloud.hdfs.HdfsTlogRe= playBufferedWhileIndexingTest: 1) Thread[id=3D15321, name=3Dqtp83782166= 6-15321, state=3DTIMED_WAITING, group=3DTGRP-HdfsTlogReplayBufferedWhileInd= exingTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native= Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport= .parkNanos(LockSupport.java:234) at java.base@11.0.4/java.util.conc= urrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Abstract= QueuedSynchronizer.java:2123) at app//org.eclipse.jetty.util.Blocki= ngArrayQueue.poll(BlockingArrayQueue.java:392) at app//org.eclipse.= jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java= :850) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner= .run(QueuedThreadPool.java:889) at java.base@11.0.4/java.lang.Threa= d.run(Thread.java:834) 2) Thread[id=3D15324, name=3DSession-HouseKeeper-= 233733b8, state=3DTIMED_WAITING, group=3DTGRP-HdfsTlogReplayBufferedWhileIn= dexingTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Nativ= e Method) at java.base@11.0.4/java.util.concurrent.locks.LockSuppor= t.parkNanos(LockSupport.java:234) at java.base@11.0.4/java.util.con= current.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Abstrac= tQueuedSynchronizer.java:2123) at java.base@11.0.4/java.util.concur= rent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolE= xecutor.java:1182) at java.base@11.0.4/java.util.concurrent.Schedul= edThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java= :899) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.g= etTask(ThreadPoolExecutor.java:1054) at java.base@11.0.4/java.util.= concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) = at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(T= hreadPoolExecutor.java:628) at java.base@11.0.4/java.lang.Thread.ru= n(Thread.java:834) 3) Thread[id=3D15320, name=3Dqtp837821666-15320, stat= e=3DTIMED_WAITING, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] = at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) = at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(Lo= ckSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.= AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchro= nizer.java:2123) at app//org.eclipse.jetty.util.BlockingArrayQueue.= poll(BlockingArrayQueue.java:392) at app//org.eclipse.jetty.util.th= read.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850) = at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedTh= readPool.java:889) at java.base@11.0.4/java.lang.Thread.run(Thread.= java:834) 4) Thread[id=3D15317, name=3Dqtp837821666-15317, state=3DRUNNA= BLE, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] at java.= base@11.0.4/sun.nio.ch.EPoll.wait(Native Method) at java.base@11.0.= 4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120) = at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.j= ava:124) at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(Selecto= rImpl.java:141) at app//org.eclipse.jetty.io.ManagedSelector$Select= orProducer.select(ManagedSelector.java:464) at app//org.eclipse.jet= ty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:401) = at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce= Task(EatWhatYouKill.java:357) at app//org.eclipse.jetty.util.thread= .strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181) at app/= /org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYo= uKill.java:168) at app//org.eclipse.jetty.util.thread.strategy.EatW= hatYouKill.produce(EatWhatYouKill.java:132) at app//org.eclipse.jet= ty.io.ManagedSelector$$Lambda$171/0x00000001003cc440.run(Unknown Source) = at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedT= hreadPool.java:781) at app//org.eclipse.jetty.util.thread.QueuedThr= eadPool$Runner.run(QueuedThreadPool.java:917) at java.base@11.0.4/j= ava.lang.Thread.run(Thread.java:834) 5) Thread[id=3D15333, name=3DIPC Se= rver idle connection scanner for port 41100, state=3DWAITING, group=3DTGRP-= HdfsTlogReplayBufferedWhileIndexingTest] at java.base@11.0.4/java.l= ang.Object.wait(Native Method) at java.base@11.0.4/java.lang.Object= .wait(Object.java:328) at java.base@11.0.4/java.util.TimerThread.ma= inLoop(Timer.java:527) at java.base@11.0.4/java.util.TimerThread.ru= n(Timer.java:506) 6) Thread[id=3D15315, name=3Dpool-3-thread-1, state=3D= TIMED_WAITING, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] = at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) = at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSu= pport.java:234) at java.base@11.0.4/java.util.concurrent.locks.Abst= ractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronize= r.java:2123) at java.base@11.0.4/java.util.concurrent.ScheduledThre= adPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)= at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecut= or$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899) at j= ava.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolE= xecutor.java:1054) at java.base@11.0.4/java.util.concurrent.ThreadP= oolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11= .0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.= java:628) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)= 7) Thread[id=3D15319, name=3Dqtp837821666-15319, state=3DTIMED_WAITING,= group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] at java.base= @11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@1= 1.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234= ) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSync= hronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) = at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArray= Queue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadP= ool$Runner.idleJobPoll(QueuedThreadPool.java:850) at app//org.eclip= se.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)= at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 8) Th= read[id=3D15313, name=3DTimer for 'NameNode' metrics system, state=3DTIMED_= WAITING, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] at j= ava.base@11.0.4/java.lang.Object.wait(Native Method) at java.base@1= 1.0.4/java.util.TimerThread.mainLoop(Timer.java:553) at java.base@1= 1.0.4/java.util.TimerThread.run(Timer.java:506) 9) Thread[id=3D15330, na= me=3DFSEditLogAsync, state=3DWAITING, group=3DTGRP-HdfsTlogReplayBufferedWh= ileIndexingTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(= Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockS= upport.park(LockSupport.java:194) at java.base@11.0.4/java.util.con= current.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueu= edSynchronizer.java:2081) at java.base@11.0.4/java.util.concurrent.= ArrayBlockingQueue.take(ArrayBlockingQueue.java:417) at app//org.ap= ache.hadoop.hdfs.server.namenode.FSEditLogAsync.dequeueEdit(FSEditLogAsync.= java:221) at app//org.apache.hadoop.hdfs.server.namenode.FSEditLogA= sync.run(FSEditLogAsync.java:229) at java.base@11.0.4/java.lang.Thr= ead.run(Thread.java:834) 10) Thread[id=3D15332, name=3DSocket Reader #1 f= or port 41100, state=3DRUNNABLE, group=3DTGRP-HdfsTlogReplayBufferedWhileIn= dexingTest] at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method= ) at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSe= lectorImpl.java:120) at java.base@11.0.4/sun.nio.ch.SelectorImpl.lo= ckAndDoSelect(SelectorImpl.java:124) at java.base@11.0.4/sun.nio.ch= .SelectorImpl.select(SelectorImpl.java:141) at app//org.apache.hado= op.ipc.Server$Listener$Reader.doRunLoop(Server.java:1097) at app//o= rg.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:1076) 11) Thr= ead[id=3D15314, name=3Dorg.apache.hadoop.util.JvmPauseMonitor$Monitor@3f36b= 12f, state=3DTIMED_WAITING, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexin= gTest] at java.base@11.0.4/java.lang.Thread.sleep(Native Method) = at app//org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMo= nitor.java:192) at java.base@11.0.4/java.lang.Thread.run(Thread.jav= a:834) 12) Thread[id=3D15318, name=3Dqtp837821666-15318-acceptor-0@324184= 97-ServerConnector@9cf4e35{HTTP/1.1,[http/1.1]}{lucene2-us-west.apache.org:= 35442}, state=3DRUNNABLE, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingT= est] at java.base@11.0.4/sun.nio.ch.ServerSocketChannelImpl.accept0= (Native Method) at java.base@11.0.4/sun.nio.ch.ServerSocketChannelI= mpl.accept(ServerSocketChannelImpl.java:533) at java.base@11.0.4/su= n.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:285) = at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnec= tor.java:385) at app//org.eclipse.jetty.server.AbstractConnector$Ac= ceptor.run(AbstractConnector.java:648) at app//org.eclipse.jetty.ut= il.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781) at app= //org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPoo= l.java:917) at java.base@11.0.4/java.lang.Thread.run(Thread.java:83= 4) 13) Thread[id=3D15322, name=3Dqtp837821666-15322, state=3DTIMED_WAITIN= G, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] at java.ba= se@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base= @11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:2= 34) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSy= nchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)= at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArr= ayQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThrea= dPool$Runner.idleJobPoll(QueuedThreadPool.java:850) at app//org.ecl= ipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:88= 9) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 14) = Thread[id=3D15316, name=3Dqtp837821666-15316, state=3DRUNNABLE, group=3DTGR= P-HdfsTlogReplayBufferedWhileIndexingTest] at java.base@11.0.4/sun.= nio.ch.EPoll.wait(Native Method) at java.base@11.0.4/sun.nio.ch.EPo= llSelectorImpl.doSelect(EPollSelectorImpl.java:120) at java.base@11= .0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124) = at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) = at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.selec= t(ManagedSelector.java:464) at app//org.eclipse.jetty.io.ManagedSel= ector$SelectorProducer.produce(ManagedSelector.java:401) at app//or= g.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouK= ill.java:357) at app//org.eclipse.jetty.util.thread.strategy.EatWha= tYouKill.doProduce(EatWhatYouKill.java:181) at app//org.eclipse.jet= ty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) = at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produ= ce(EatWhatYouKill.java:132) at app//org.eclipse.jetty.io.ManagedSel= ector$$Lambda$171/0x00000001003cc440.run(Unknown Source) at app//or= g.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:7= 81) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.r= un(QueuedThreadPool.java:917) at java.base@11.0.4/java.lang.Thread.= run(Thread.java:834) 15) Thread[id=3D15323, name=3Dqtp837821666-15323, st= ate=3DTIMED_WAITING, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] = at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) = at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(= LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.lock= s.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynch= ronizer.java:2123) at app//org.eclipse.jetty.util.BlockingArrayQueu= e.poll(BlockingArrayQueue.java:392) at app//org.eclipse.jetty.util.= thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850) = at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Queued= ThreadPool.java:889) at java.base@11.0.4/java.lang.Thread.run(Threa= d.java:834) Stack Trace: com.carrotsearch.randomizedtesting.ThreadLeakError: 15 threads leaked from = SUITE scope at org.apache.solr.cloud.hdfs.HdfsTlogReplayBufferedWhileIndexi= ngTest:=20 1) Thread[id=3D15321, name=3Dqtp837821666-15321, state=3DTIMED_WAITING, = group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArra= yQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJ= obPoll(QueuedThreadPool.java:850) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:889) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 2) Thread[id=3D15324, name=3DSession-HouseKeeper-233733b8, state=3DTIMED= _WAITING, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecuto= r$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182) at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecuto= r$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask= (ThreadPoolExecutor.java:1054) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWork= er(ThreadPoolExecutor.java:1114) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.= run(ThreadPoolExecutor.java:628) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 3) Thread[id=3D15320, name=3Dqtp837821666-15320, state=3DTIMED_WAITING, = group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArra= yQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJ= obPoll(QueuedThreadPool.java:850) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:889) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 4) Thread[id=3D15317, name=3Dqtp837821666-15317, state=3DRUNNABLE, group= =3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method) at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSele= ctorImpl.java:120) at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(Selecto= rImpl.java:124) at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.jav= a:141) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.selec= t(ManagedSelector.java:464) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produ= ce(ManagedSelector.java:401) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produ= ceTask(EatWhatYouKill.java:357) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doPro= duce(EatWhatYouKill.java:181) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryPr= oduce(EatWhatYouKill.java:168) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produ= ce(EatWhatYouKill.java:132) at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$171/0x00000001= 003cc440.run(Unknown Source) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(Queue= dThreadPool.java:781) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:917) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 5) Thread[id=3D15333, name=3DIPC Server idle connection scanner for port= 41100, state=3DWAITING, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTe= st] at java.base@11.0.4/java.lang.Object.wait(Native Method) at java.base@11.0.4/java.lang.Object.wait(Object.java:328) at java.base@11.0.4/java.util.TimerThread.mainLoop(Timer.java:527) at java.base@11.0.4/java.util.TimerThread.run(Timer.java:506) 6) Thread[id=3D15315, name=3Dpool-3-thread-1, state=3DTIMED_WAITING, gro= up=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecuto= r$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182) at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecuto= r$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask= (ThreadPoolExecutor.java:1054) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWork= er(ThreadPoolExecutor.java:1114) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.= run(ThreadPoolExecutor.java:628) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 7) Thread[id=3D15319, name=3Dqtp837821666-15319, state=3DTIMED_WAITING, = group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArra= yQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJ= obPoll(QueuedThreadPool.java:850) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:889) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 8) Thread[id=3D15313, name=3DTimer for 'NameNode' metrics system, state= =3DTIMED_WAITING, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] at java.base@11.0.4/java.lang.Object.wait(Native Method) at java.base@11.0.4/java.util.TimerThread.mainLoop(Timer.java:553) at java.base@11.0.4/java.util.TimerThread.run(Timer.java:506) 9) Thread[id=3D15330, name=3DFSEditLogAsync, state=3DWAITING, group=3DTG= RP-HdfsTlogReplayBufferedWhileIndexingTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(Loc= kSupport.java:194) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.4/java.util.concurrent.ArrayBlockingQueue.take(Ar= rayBlockingQueue.java:417) at app//org.apache.hadoop.hdfs.server.namenode.FSEditLogAsync.deque= ueEdit(FSEditLogAsync.java:221) at app//org.apache.hadoop.hdfs.server.namenode.FSEditLogAsync.run(F= SEditLogAsync.java:229) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 10) Thread[id=3D15332, name=3DSocket Reader #1 for port 41100, state=3DRU= NNABLE, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method) at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSele= ctorImpl.java:120) at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(Selecto= rImpl.java:124) at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.jav= a:141) at app//org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Serv= er.java:1097) at app//org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.jav= a:1076) 11) Thread[id=3D15314, name=3Dorg.apache.hadoop.util.JvmPauseMonitor$Moni= tor@3f36b12f, state=3DTIMED_WAITING, group=3DTGRP-HdfsTlogReplayBufferedWhi= leIndexingTest] at java.base@11.0.4/java.lang.Thread.sleep(Native Method) at app//org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPause= Monitor.java:192) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 12) Thread[id=3D15318, name=3Dqtp837821666-15318-acceptor-0@32418497-Serv= erConnector@9cf4e35{HTTP/1.1,[http/1.1]}{lucene2-us-west.apache.org:35442},= state=3DRUNNABLE, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] at java.base@11.0.4/sun.nio.ch.ServerSocketChannelImpl.accept0(Nati= ve Method) at java.base@11.0.4/sun.nio.ch.ServerSocketChannelImpl.accept(Serve= rSocketChannelImpl.java:533) at java.base@11.0.4/sun.nio.ch.ServerSocketChannelImpl.accept(Serve= rSocketChannelImpl.java:285) at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConne= ctor.java:385) at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(Abs= tractConnector.java:648) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(Queue= dThreadPool.java:781) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:917) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 13) Thread[id=3D15322, name=3Dqtp837821666-15322, state=3DTIMED_WAITING, = group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArra= yQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJ= obPoll(QueuedThreadPool.java:850) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:889) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 14) Thread[id=3D15316, name=3Dqtp837821666-15316, state=3DRUNNABLE, group= =3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method) at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSele= ctorImpl.java:120) at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(Selecto= rImpl.java:124) at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.jav= a:141) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.selec= t(ManagedSelector.java:464) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produ= ce(ManagedSelector.java:401) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produ= ceTask(EatWhatYouKill.java:357) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doPro= duce(EatWhatYouKill.java:181) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryPr= oduce(EatWhatYouKill.java:168) at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produ= ce(EatWhatYouKill.java:132) at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$171/0x00000001= 003cc440.run(Unknown Source) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(Queue= dThreadPool.java:781) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:917) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 15) Thread[id=3D15323, name=3Dqtp837821666-15323, state=3DTIMED_WAITING, = group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArra= yQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJ= obPoll(QueuedThreadPool.java:850) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(Q= ueuedThreadPool.java:889) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) =09at __randomizedtesting.SeedInfo.seed([259547C72E0C74B3]:0) FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsTlogRepla= yBufferedWhileIndexingTest Error Message: There are still zombie threads that couldn't be terminated: 1) Thread[id= =3D15321, name=3Dqtp837821666-15321, state=3DTIMED_WAITING, group=3DTGRP-Hd= fsTlogReplayBufferedWhileIndexingTest] at java.base@11.0.4/jdk.inte= rnal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.= concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at jav= a.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$Conditi= onObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//o= rg.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) = at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJ= obPoll(QueuedThreadPool.java:850) at app//org.eclipse.jetty.util.th= read.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889) at java= .base@11.0.4/java.lang.Thread.run(Thread.java:834) 2) Thread[id=3D15324,= name=3DSession-HouseKeeper-233733b8, state=3DTIMED_WAITING, group=3DTGRP-H= dfsTlogReplayBufferedWhileIndexingTest] at java.base@11.0.4/jdk.int= ernal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util= .concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at ja= va.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$Condit= ionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at java.= base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQue= ue.take(ScheduledThreadPoolExecutor.java:1182) at java.base@11.0.4/= java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Sche= duledThreadPoolExecutor.java:899) at java.base@11.0.4/java.util.con= current.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at= java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadP= oolExecutor.java:1114) at java.base@11.0.4/java.util.concurrent.Thr= eadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.bas= e@11.0.4/java.lang.Thread.run(Thread.java:834) 3) Thread[id=3D15320, nam= e=3Dqtp837821666-15320, state=3DTIMED_WAITING, group=3DTGRP-HdfsTlogReplayB= ufferedWhileIndexingTest] at java.base@11.0.4/jdk.internal.misc.Uns= afe.park(Native Method) at java.base@11.0.4/java.util.concurrent.lo= cks.LockSupport.parkNanos(LockSupport.java:234) at java.base@11.0.4= /java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awai= tNanos(AbstractQueuedSynchronizer.java:2123) at app//org.eclipse.je= tty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at ap= p//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(Queued= ThreadPool.java:850) at app//org.eclipse.jetty.util.thread.QueuedTh= readPool$Runner.run(QueuedThreadPool.java:889) at java.base@11.0.4/= java.lang.Thread.run(Thread.java:834) 4) Thread[id=3D15317, name=3Dqtp83= 7821666-15317, state=3DRUNNABLE, group=3DTGRP-HdfsTlogReplayBufferedWhileIn= dexingTest] at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method= ) at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSe= lectorImpl.java:120) at java.base@11.0.4/sun.nio.ch.SelectorImpl.lo= ckAndDoSelect(SelectorImpl.java:124) at java.base@11.0.4/sun.nio.ch= .SelectorImpl.select(SelectorImpl.java:141) at app//org.eclipse.jet= ty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:464) = at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(= ManagedSelector.java:401) at app//org.eclipse.jetty.util.thread.str= ategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357) at app//o= rg.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKi= ll.java:181) at app//org.eclipse.jetty.util.thread.strategy.EatWhat= YouKill.tryProduce(EatWhatYouKill.java:168) at app//org.eclipse.jet= ty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132) = at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$171/0x00000001003= cc440.run(Unknown Source) at app//org.eclipse.jetty.util.thread.Que= uedThreadPool.runJob(QueuedThreadPool.java:781) at app//org.eclipse= .jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917) = at java.base@11.0.4/java.lang.Thread.run(Thread.java:834) 5) Thre= ad[id=3D15333, name=3DIPC Server idle connection scanner for port 41100, st= ate=3DWAITING, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] = at java.base@11.0.4/java.lang.Object.wait(Native Method) at java.= base@11.0.4/java.lang.Object.wait(Object.java:328) at java.base@11.= 0.4/java.util.TimerThread.mainLoop(Timer.java:527) at java.base@11.= 0.4/java.util.TimerThread.run(Timer.java:506) 6) Thread[id=3D15315, name= =3Dpool-3-thread-1, state=3DTIMED_WAITING, group=3DTGRP-HdfsTlogReplayBuffe= redWhileIndexingTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.= park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.= LockSupport.parkNanos(LockSupport.java:234) at java.base@11.0.4/jav= a.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNan= os(AbstractQueuedSynchronizer.java:2123) at java.base@11.0.4/java.u= til.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledT= hreadPoolExecutor.java:1182) at java.base@11.0.4/java.util.concurre= nt.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExe= cutor.java:899) at java.base@11.0.4/java.util.concurrent.ThreadPool= Executor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.4/= java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1= 114) at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Wo= rker.run(ThreadPoolExecutor.java:628) at java.base@11.0.4/java.lang= .Thread.run(Thread.java:834) 7) Thread[id=3D15319, name=3Dqtp837821666-1= 5319, state=3DTIMED_WAITING, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexi= ngTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Me= thod) at java.bas [...truncated too long message...] [junit4] > at java.base@11.0.4/sun.nio.ch.SelectorImpl.select= (SelectorImpl.java:141) [junit4] > at app//org.eclipse.jetty.io.ManagedSelector$Selec= torProducer.select(ManagedSelector.java:464) [junit4] > at app//org.eclipse.jetty.io.ManagedSelector$Selec= torProducer.produce(ManagedSelector.java:401) [junit4] > at app//org.eclipse.jetty.util.thread.strategy.Eat= WhatYouKill.produceTask(EatWhatYouKill.java:357) [junit4] > at app//org.eclipse.jetty.util.thread.strategy.Eat= WhatYouKill.doProduce(EatWhatYouKill.java:181) [junit4] > at app//org.eclipse.jetty.util.thread.strategy.Eat= WhatYouKill.tryProduce(EatWhatYouKill.java:168) [junit4] > at app//org.eclipse.jetty.util.thread.strategy.Eat= WhatYouKill.produce(EatWhatYouKill.java:132) [junit4] > at app//org.eclipse.jetty.io.ManagedSelector$$Lamb= da$171/0x00000001003cc440.run(Unknown Source) [junit4] > at app//org.eclipse.jetty.util.thread.QueuedThread= Pool.runJob(QueuedThreadPool.java:781) [junit4] > at app//org.eclipse.jetty.util.thread.QueuedThread= Pool$Runner.run(QueuedThreadPool.java:917) [junit4] > at java.base@11.0.4/java.lang.Thread.run(Thread.ja= va:834) [junit4] > 5) Thread[id=3D15333, name=3DIPC Server idle connection= scanner for port 41100, state=3DWAITING, group=3DTGRP-HdfsTlogReplayBuffer= edWhileIndexingTest] [junit4] > at java.base@11.0.4/java.lang.Object.wait(Native M= ethod) [junit4] > at java.base@11.0.4/java.lang.Object.wait(Object.j= ava:328) [junit4] > at java.base@11.0.4/java.util.TimerThread.mainLoop= (Timer.java:527) [junit4] > at java.base@11.0.4/java.util.TimerThread.run(Time= r.java:506) [junit4] > 6) Thread[id=3D15315, name=3Dpool-3-thread-1, state=3DT= IMED_WAITING, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] [junit4] > at java.base@11.0.4/jdk.internal.misc.Unsafe.park(= Native Method) [junit4] > at java.base@11.0.4/java.util.concurrent.locks.Loc= kSupport.parkNanos(LockSupport.java:234) [junit4] > at java.base@11.0.4/java.util.concurrent.locks.Abs= tractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchroniz= er.java:2123) [junit4] > at java.base@11.0.4/java.util.concurrent.Scheduled= ThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1= 182) [junit4] > at java.base@11.0.4/java.util.concurrent.Scheduled= ThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:8= 99) [junit4] > at java.base@11.0.4/java.util.concurrent.ThreadPoo= lExecutor.getTask(ThreadPoolExecutor.java:1054) [junit4] > at java.base@11.0.4/java.util.concurrent.ThreadPoo= lExecutor.runWorker(ThreadPoolExecutor.java:1114) [junit4] > at java.base@11.0.4/java.util.concurrent.ThreadPoo= lExecutor$Worker.run(ThreadPoolExecutor.java:628) [junit4] > at java.base@11.0.4/java.lang.Thread.run(Thread.ja= va:834) [junit4] > 7) Thread[id=3D15319, name=3Dqtp837821666-15319, state= =3DTIMED_WAITING, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] [junit4] > at java.base@11.0.4/jdk.internal.misc.Unsafe.park(= Native Method) [junit4] > at java.base@11.0.4/java.util.concurrent.locks.Loc= kSupport.parkNanos(LockSupport.java:234) [junit4] > at java.base@11.0.4/java.util.concurrent.locks.Abs= tractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchroniz= er.java:2123) [junit4] > at app//org.eclipse.jetty.util.BlockingArrayQueue.= poll(BlockingArrayQueue.java:392) [junit4] > at app//org.eclipse.jetty.util.thread.QueuedThread= Pool$Runner.idleJobPoll(QueuedThreadPool.java:850) [junit4] > at app//org.eclipse.jetty.util.thread.QueuedThread= Pool$Runner.run(QueuedThreadPool.java:889) [junit4] > at java.base@11.0.4/java.lang.Thread.run(Thread.ja= va:834) [junit4] > 8) Thread[id=3D15313, name=3DTimer for 'NameNode' metri= cs system, state=3DTIMED_WAITING, group=3DTGRP-HdfsTlogReplayBufferedWhileI= ndexingTest] [junit4] > at java.base@11.0.4/java.lang.Object.wait(Native M= ethod) [junit4] > at java.base@11.0.4/java.util.TimerThread.mainLoop= (Timer.java:553) [junit4] > at java.base@11.0.4/java.util.TimerThread.run(Time= r.java:506) [junit4] > 9) Thread[id=3D15332, name=3DSocket Reader #1 for port = 41100, state=3DRUNNABLE, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTe= st] [junit4] > at java.base@11.0.4/java.lang.Thread.holdsLock(Nat= ive Method) [junit4] > at java.base@11.0.4/sun.nio.ch.SelectorImpl.proces= sDeregisterQueue(SelectorImpl.java:246) [junit4] > at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.d= oSelect(EPollSelectorImpl.java:114) [junit4] > at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAn= dDoSelect(SelectorImpl.java:124) [junit4] > at java.base@11.0.4/sun.nio.ch.SelectorImpl.select= (SelectorImpl.java:141) [junit4] > at app//org.apache.hadoop.ipc.Server$Listener$Read= er.doRunLoop(Server.java:1097) [junit4] > at app//org.apache.hadoop.ipc.Server$Listener$Read= er.run(Server.java:1076) [junit4] > 10) Thread[id=3D15318, name=3Dqtp837821666-15318, state= =3DTIMED_WAITING, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] [junit4] > at java.base@11.0.4/jdk.internal.misc.Unsafe.park(= Native Method) [junit4] > at java.base@11.0.4/java.util.concurrent.locks.Loc= kSupport.parkNanos(LockSupport.java:234) [junit4] > at java.base@11.0.4/java.util.concurrent.locks.Abs= tractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchroniz= er.java:2123) [junit4] > at app//org.eclipse.jetty.util.BlockingArrayQueue.= poll(BlockingArrayQueue.java:392) [junit4] > at app//org.eclipse.jetty.util.thread.QueuedThread= Pool$Runner.idleJobPoll(QueuedThreadPool.java:850) [junit4] > at app//org.eclipse.jetty.util.thread.QueuedThread= Pool$Runner.run(QueuedThreadPool.java:889) [junit4] > at java.base@11.0.4/java.lang.Thread.run(Thread.ja= va:834) [junit4] > 11) Thread[id=3D15322, name=3Dqtp837821666-15322, state= =3DTIMED_WAITING, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] [junit4] > at java.base@11.0.4/jdk.internal.misc.Unsafe.park(= Native Method) [junit4] > at java.base@11.0.4/java.util.concurrent.locks.Loc= kSupport.parkNanos(LockSupport.java:234) [junit4] > at java.base@11.0.4/java.util.concurrent.locks.Abs= tractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchroniz= er.java:2123) [junit4] > at app//org.eclipse.jetty.util.BlockingArrayQueue.= poll(BlockingArrayQueue.java:392) [junit4] > at app//org.eclipse.jetty.util.thread.QueuedThread= Pool$Runner.idleJobPoll(QueuedThreadPool.java:850) [junit4] > at app//org.eclipse.jetty.util.thread.QueuedThread= Pool$Runner.run(QueuedThreadPool.java:889) [junit4] > at java.base@11.0.4/java.lang.Thread.run(Thread.ja= va:834) [junit4] > 12) Thread[id=3D15316, name=3Dqtp837821666-15316, state= =3DRUNNABLE, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] [junit4] > at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native M= ethod) [junit4] > at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.d= oSelect(EPollSelectorImpl.java:120) [junit4] > at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAn= dDoSelect(SelectorImpl.java:124) [junit4] > at java.base@11.0.4/sun.nio.ch.SelectorImpl.select= (SelectorImpl.java:141) [junit4] > at app//org.eclipse.jetty.io.ManagedSelector$Selec= torProducer.select(ManagedSelector.java:464) [junit4] > at app//org.eclipse.jetty.io.ManagedSelector$Selec= torProducer.produce(ManagedSelector.java:401) [junit4] > at app//org.eclipse.jetty.util.thread.strategy.Eat= WhatYouKill.produceTask(EatWhatYouKill.java:357) [junit4] > at app//org.eclipse.jetty.util.thread.strategy.Eat= WhatYouKill.doProduce(EatWhatYouKill.java:181) [junit4] > at app//org.eclipse.jetty.util.thread.strategy.Eat= WhatYouKill.tryProduce(EatWhatYouKill.java:168) [junit4] > at app//org.eclipse.jetty.util.thread.strategy.Eat= WhatYouKill.produce(EatWhatYouKill.java:132) [junit4] > at app//org.eclipse.jetty.io.ManagedSelector$$Lamb= da$171/0x00000001003cc440.run(Unknown Source) [junit4] > at app//org.eclipse.jetty.util.thread.QueuedThread= Pool.runJob(QueuedThreadPool.java:781) [junit4] > at app//org.eclipse.jetty.util.thread.QueuedThread= Pool$Runner.run(QueuedThreadPool.java:917) [junit4] > at java.base@11.0.4/java.lang.Thread.run(Thread.ja= va:834) [junit4] > 13) Thread[id=3D15323, name=3Dqtp837821666-15323, state= =3DTIMED_WAITING, group=3DTGRP-HdfsTlogReplayBufferedWhileIndexingTest] [junit4] > at java.base@11.0.4/jdk.internal.misc.Unsafe.park(= Native Method) [junit4] > at java.base@11.0.4/java.util.concurrent.locks.Loc= kSupport.parkNanos(LockSupport.java:234) [junit4] > at java.base@11.0.4/java.util.concurrent.locks.Abs= tractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchroniz= er.java:2123) [junit4] > at app//org.eclipse.jetty.util.BlockingArrayQueue.= poll(BlockingArrayQueue.java:392) [junit4] > at app//org.eclipse.jetty.util.thread.QueuedThread= Pool$Runner.idleJobPoll(QueuedThreadPool.java:850) [junit4] > at app//org.eclipse.jetty.util.thread.QueuedThread= Pool$Runner.run(QueuedThreadPool.java:889) [junit4] > at java.base@11.0.4/java.lang.Thread.run(Thread.ja= va:834) [junit4] > =09at __randomizedtesting.SeedInfo.seed([259547C72E0C74B3]= :0) [junit4] Completed [828/890 (3!)] on J0 in 14.47s, 0 tests, 3 errors <<<= FAILURES! [...truncated 53081 lines...] ------=_Part_18057_856463870.1575987017599 Content-Type: text/plain; charset=us-ascii --------------------------------------------------------------------- To unsubscribe, e-mail: builds-unsubscribe@lucene.apache.org For additional commands, e-mail: builds-help@lucene.apache.org ------=_Part_18057_856463870.1575987017599--