lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Steve Rowe <sar...@gmail.com>
Subject Re: [JENKINS-MAVEN] Lucene-Solr-Maven-4.x #157: POMs out of sync
Date Sat, 17 Nov 2012 21:01:33 GMT
I was just looking today at randomizedtesting to see if there was a built-in way to ignore thread leakage (there isn't AFAICT).

Curious that Maven is seeing these failures while the Ant build isn't.

Steve

On Nov 17, 2012, at 3:32 PM, Dawid Weiss <dawid.weiss@cs.put.poznan.pl> wrote:

> These are multiple failures related to the NIO sockets (I think).
> Interesting why this gets reported as a single failure from
> DistributedClusteringComponentTest -- if you look at the log file and
> grep for "NOTE: reproduce with" you'll see this test is neither first
> nor last to fail.
> 
> D.
> 
> On Sat, Nov 17, 2012 at 4:00 PM, Apache Jenkins Server
> <jenkins@builds.apache.org> wrote:
>> Build: https://builds.apache.org/job/Lucene-Solr-Maven-4.x/157/
>> 
>> 8 tests failed.
>> FAILED:  org.apache.solr.handler.clustering.DistributedClusteringComponentTest.org.apache.solr.handler.clustering.DistributedClusteringComponentTest
>> 
>> Error Message:
>> 36 threads leaked from SUITE scope at org.apache.solr.handler.clustering.DistributedClusteringComponentTest:     1) Thread[id=100, name=qtp1220321112-100 Acceptor2 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    2) Thread[id=136, name=qtp20576595-136 Acceptor1 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    3) Thread[id=135, name=qtp20576595-135 Acceptor0 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    4) Thread[id=66, name=qtp815877764-66 Acceptor2 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    5) Thread[id=112, name=qtp676274569-112 Acceptor3 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    6) Thread[id=37, name=qtp125462150-37 Acceptor3 SelectChannelConnector@0.0.0.0:11891, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    7) Thread[id=64, name=qtp815877764-64 Acceptor0 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    8) Thread[id=137, name=qtp20576595-137 Acceptor2 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    9) Thread[id=138, name=qtp20576595-138 Acceptor3 SelectChannelConnector@0.0.0.0:48885, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   10) Thread[id=35, name=qtp125462150-35 Acceptor1 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   11) Thread[id=120, name=qtp959180162-120 Acceptor0 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   12) Thread[id=122, name=qtp959180162-122 Acceptor2 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   13) Thread[id=56, name=qtp2141245713-56 Acceptor3 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   14) Thread[id=99, name=qtp1220321112-99 Acceptor1 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   15) Thread[id=53, name=qtp2141245713-53 Acceptor0 SelectChannelConnector@0.0.0.0:12350, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   16) Thread[id=75, name=qtp126139945-75 Acceptor0 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   17) Thread[id=26, name=qtp196620025-26 Acceptor3 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   18) Thread[id=121, name=qtp959180162-121 Acceptor1 SelectChannelConnector@0.0.0.0:51626, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   19) Thread[id=65, name=qtp815877764-65 Acceptor1 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   20) Thread[id=78, name=qtp126139945-78 Acceptor3 SelectChannelConnector@0.0.0.0:39401, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   21) Thread[id=123, name=qtp959180162-123 Acceptor3 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   22) Thread[id=77, name=qtp126139945-77 Acceptor2 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   23) Thread[id=23, name=qtp196620025-23 Acceptor0 SelectChannelConnector@0.0.0.0:15510, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   24) Thread[id=98, name=qtp1220321112-98 Acceptor0 SelectChannelConnector@0.0.0.0:23057, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   25) Thread[id=36, name=qtp125462150-36 Acceptor2 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   26) Thread[id=34, name=qtp125462150-34 Acceptor0 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   27) Thread[id=110, name=qtp676274569-110 Acceptor1 SelectChannelConnector@0.0.0.0:32790, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   28) Thread[id=76, name=qtp126139945-76 Acceptor1 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   29) Thread[id=24, name=qtp196620025-24 Acceptor1 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   30) Thread[id=67, name=qtp815877764-67 Acceptor3 SelectChannelConnector@0.0.0.0:16879, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   31) Thread[id=25, name=qtp196620025-25 Acceptor2 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   32) Thread[id=55, name=qtp2141245713-55 Acceptor2 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   33) Thread[id=111, name=qtp676274569-111 Acceptor2 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   34) Thread[id=101, name=qtp1220321112-101 Acceptor3 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   35) Thread[id=54, name=qtp2141245713-54 Acceptor1 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   36) Thread[id=109, name=qtp676274569-109 Acceptor0 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)
>> 
>> Stack Trace:
>> com.carrotsearch.randomizedtesting.ThreadLeakError: 36 threads leaked from SUITE scope at org.apache.solr.handler.clustering.DistributedClusteringComponentTest:
>>   1) Thread[id=100, name=qtp1220321112-100 Acceptor2 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   2) Thread[id=136, name=qtp20576595-136 Acceptor1 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   3) Thread[id=135, name=qtp20576595-135 Acceptor0 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   4) Thread[id=66, name=qtp815877764-66 Acceptor2 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   5) Thread[id=112, name=qtp676274569-112 Acceptor3 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   6) Thread[id=37, name=qtp125462150-37 Acceptor3 SelectChannelConnector@0.0.0.0:11891, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   7) Thread[id=64, name=qtp815877764-64 Acceptor0 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   8) Thread[id=137, name=qtp20576595-137 Acceptor2 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   9) Thread[id=138, name=qtp20576595-138 Acceptor3 SelectChannelConnector@0.0.0.0:48885, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  10) Thread[id=35, name=qtp125462150-35 Acceptor1 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  11) Thread[id=120, name=qtp959180162-120 Acceptor0 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  12) Thread[id=122, name=qtp959180162-122 Acceptor2 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  13) Thread[id=56, name=qtp2141245713-56 Acceptor3 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  14) Thread[id=99, name=qtp1220321112-99 Acceptor1 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  15) Thread[id=53, name=qtp2141245713-53 Acceptor0 SelectChannelConnector@0.0.0.0:12350, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  16) Thread[id=75, name=qtp126139945-75 Acceptor0 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  17) Thread[id=26, name=qtp196620025-26 Acceptor3 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  18) Thread[id=121, name=qtp959180162-121 Acceptor1 SelectChannelConnector@0.0.0.0:51626, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  19) Thread[id=65, name=qtp815877764-65 Acceptor1 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  20) Thread[id=78, name=qtp126139945-78 Acceptor3 SelectChannelConnector@0.0.0.0:39401, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  21) Thread[id=123, name=qtp959180162-123 Acceptor3 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  22) Thread[id=77, name=qtp126139945-77 Acceptor2 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  23) Thread[id=23, name=qtp196620025-23 Acceptor0 SelectChannelConnector@0.0.0.0:15510, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  24) Thread[id=98, name=qtp1220321112-98 Acceptor0 SelectChannelConnector@0.0.0.0:23057, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  25) Thread[id=36, name=qtp125462150-36 Acceptor2 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  26) Thread[id=34, name=qtp125462150-34 Acceptor0 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  27) Thread[id=110, name=qtp676274569-110 Acceptor1 SelectChannelConnector@0.0.0.0:32790, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  28) Thread[id=76, name=qtp126139945-76 Acceptor1 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  29) Thread[id=24, name=qtp196620025-24 Acceptor1 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  30) Thread[id=67, name=qtp815877764-67 Acceptor3 SelectChannelConnector@0.0.0.0:16879, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  31) Thread[id=25, name=qtp196620025-25 Acceptor2 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  32) Thread[id=55, name=qtp2141245713-55 Acceptor2 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  33) Thread[id=111, name=qtp676274569-111 Acceptor2 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  34) Thread[id=101, name=qtp1220321112-101 Acceptor3 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  35) Thread[id=54, name=qtp2141245713-54 Acceptor1 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  36) Thread[id=109, name=qtp676274569-109 Acceptor0 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>        at __randomizedtesting.SeedInfo.seed([DFE0AA4498F9B30C]:0)
>> 
>> 
>> FAILED:  org.apache.solr.handler.clustering.DistributedClusteringComponentTest.org.apache.solr.handler.clustering.DistributedClusteringComponentTest
>> 
>> Error Message:
>> There are still zombie threads that couldn't be terminated:    1) Thread[id=100, name=qtp1220321112-100 Acceptor2 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    2) Thread[id=136, name=qtp20576595-136 Acceptor1 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    3) Thread[id=135, name=qtp20576595-135 Acceptor0 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    4) Thread[id=66, name=qtp815877764-66 Acceptor2 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    5) Thread[id=112, name=qtp676274569-112 Acceptor3 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    6) Thread[id=37, name=qtp125462150-37 Acceptor3 SelectChannelConnector@0.0.0.0:11891, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    7) Thread[id=64, name=qtp815877764-64 Acceptor0 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    8) Thread[id=137, name=qtp20576595-137 Acceptor2 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    9) Thread[id=138, name=qtp20576595-138 Acceptor3 SelectChannelConnector@0.0.0.0:48885, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   10) Thread[id=35, name=qtp125462150-35 Acceptor1 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   11) Thread[id=120, name=qtp959180162-120 Acceptor0 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   12) Thread[id=122, name=qtp959180162-122 Acceptor2 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   13) Thread[id=56, name=qtp2141245713-56 Acceptor3 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   14) Thread[id=53, name=qtp2141245713-53 Acceptor0 SelectChannelConnector@0.0.0.0:12350, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   15) Thread[id=99, name=qtp1220321112-99 Acceptor1 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   16) Thread[id=26, name=qtp196620025-26 Acceptor3 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   17) Thread[id=75, name=qtp126139945-75 Acceptor0 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   18) Thread[id=121, name=qtp959180162-121 Acceptor1 SelectChannelConnector@0.0.0.0:51626, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   19) Thread[id=65, name=qtp815877764-65 Acceptor1 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   20) Thread[id=78, name=qtp126139945-78 Acceptor3 SelectChannelConnector@0.0.0.0:39401, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   21) Thread[id=123, name=qtp959180162-123 Acceptor3 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   22) Thread[id=77, name=qtp126139945-77 Acceptor2 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   23) Thread[id=36, name=qtp125462150-36 Acceptor2 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   24) Thread[id=98, name=qtp1220321112-98 Acceptor0 SelectChannelConnector@0.0.0.0:23057, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   25) Thread[id=23, name=qtp196620025-23 Acceptor0 SelectChannelConnector@0.0.0.0:15510, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   26) Thread[id=34, name=qtp125462150-34 Acceptor0 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   27) Thread[id=110, name=qtp676274569-110 Acceptor1 SelectChannelConnector@0.0.0.0:32790, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   28) Thread[id=76, name=qtp126139945-76 Acceptor1 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   29) Thread[id=24, name=qtp196620025-24 Acceptor1 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   30) Thread[id=67, name=qtp815877764-67 Acceptor3 SelectChannelConnector@0.0.0.0:16879, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   31) Thread[id=25, name=qtp196620025-25 Acceptor2 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   32) Thread[id=55, name=qtp2141245713-55 Acceptor2 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   33) Thread[id=111, name=qtp676274569-111 Acceptor2 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   34) Thread[id=101, name=qtp1220321112-101 Acceptor3 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   35) Thread[id=54, name=qtp2141245713-54 Acceptor1 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   36) Thread[id=109, name=qtp676274569-109 Acceptor0 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)
>> 
>> Stack Trace:
>> com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
>>   1) Thread[id=100, name=qtp1220321112-100 Acceptor2 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   2) Thread[id=136, name=qtp20576595-136 Acceptor1 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   3) Thread[id=135, name=qtp20576595-135 Acceptor0 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   4) Thread[id=66, name=qtp815877764-66 Acceptor2 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   5) Thread[id=112, name=qtp676274569-112 Acceptor3 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   6) Thread[id=37, name=qtp125462150-37 Acceptor3 SelectChannelConnector@0.0.0.0:11891, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   7) Thread[id=64, name=qtp815877764-64 Acceptor0 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   8) Thread[id=137, name=qtp20576595-137 Acceptor2 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   9) Thread[id=138, name=qtp20576595-138 Acceptor3 SelectChannelConnector@0.0.0.0:48885, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  10) Thread[id=35, name=qtp125462150-35 Acceptor1 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  11) Thread[id=120, name=qtp959180162-120 Acceptor0 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  12) Thread[id=122, name=qtp959180162-122 Acceptor2 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  13) Thread[id=56, name=qtp2141245713-56 Acceptor3 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  14) Thread[id=53, name=qtp2141245713-53 Acceptor0 SelectChannelConnector@0.0.0.0:12350, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  15) Thread[id=99, name=qtp1220321112-99 Acceptor1 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  16) Thread[id=26, name=qtp196620025-26 Acceptor3 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  17) Thread[id=75, name=qtp126139945-75 Acceptor0 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  18) Thread[id=121, name=qtp959180162-121 Acceptor1 SelectChannelConnector@0.0.0.0:51626, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  19) Thread[id=65, name=qtp815877764-65 Acceptor1 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  20) Thread[id=78, name=qtp126139945-78 Acceptor3 SelectChannelConnector@0.0.0.0:39401, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  21) Thread[id=123, name=qtp959180162-123 Acceptor3 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  22) Thread[id=77, name=qtp126139945-77 Acceptor2 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  23) Thread[id=36, name=qtp125462150-36 Acceptor2 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  24) Thread[id=98, name=qtp1220321112-98 Acceptor0 SelectChannelConnector@0.0.0.0:23057, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  25) Thread[id=23, name=qtp196620025-23 Acceptor0 SelectChannelConnector@0.0.0.0:15510, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  26) Thread[id=34, name=qtp125462150-34 Acceptor0 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  27) Thread[id=110, name=qtp676274569-110 Acceptor1 SelectChannelConnector@0.0.0.0:32790, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  28) Thread[id=76, name=qtp126139945-76 Acceptor1 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  29) Thread[id=24, name=qtp196620025-24 Acceptor1 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  30) Thread[id=67, name=qtp815877764-67 Acceptor3 SelectChannelConnector@0.0.0.0:16879, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  31) Thread[id=25, name=qtp196620025-25 Acceptor2 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  32) Thread[id=55, name=qtp2141245713-55 Acceptor2 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  33) Thread[id=111, name=qtp676274569-111 Acceptor2 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  34) Thread[id=101, name=qtp1220321112-101 Acceptor3 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  35) Thread[id=54, name=qtp2141245713-54 Acceptor1 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>  36) Thread[id=109, name=qtp676274569-109 Acceptor0 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>        at __randomizedtesting.SeedInfo.seed([DFE0AA4498F9B30C]:0)
>> 
>> 
>> FAILED:  org.apache.solr.handler.dataimport.TestSolrEntityProcessorEndToEnd.testFullImportWrongSolrUrl
>> 
>> Error Message:
>> Test abandoned because suite timeout was reached.
>> 
>> Stack Trace:
>> java.lang.Exception: Test abandoned because suite timeout was reached.
>>        at __randomizedtesting.SeedInfo.seed([8A42C2EABF0FA3F8]:0)
>> 
>> 
>> FAILED:  org.apache.solr.handler.dataimport.TestSolrEntityProcessorEndToEnd.org.apache.solr.handler.dataimport.TestSolrEntityProcessorEndToEnd
>> 
>> Error Message:
>> Suite timeout exceeded (>= 7200000 msec).
>> 
>> Stack Trace:
>> java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
>>        at __randomizedtesting.SeedInfo.seed([8A42C2EABF0FA3F8]:0)
>> 
>> 
>> FAILED:  org.apache.solr.TestDistributedSearch.testDistribSearch
>> 
>> Error Message:
>> Test abandoned because suite timeout was reached.
>> 
>> Stack Trace:
>> java.lang.Exception: Test abandoned because suite timeout was reached.
>>        at __randomizedtesting.SeedInfo.seed([E141DDF432EF958A]:0)
>> 
>> 
>> FAILED:  org.apache.solr.TestDistributedSearch.org.apache.solr.TestDistributedSearch
>> 
>> Error Message:
>> Suite timeout exceeded (>= 7200000 msec).
>> 
>> Stack Trace:
>> java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
>>        at __randomizedtesting.SeedInfo.seed([E141DDF432EF958A]:0)
>> 
>> 
>> FAILED:  org.apache.solr.client.solrj.embedded.SolrExampleStreamingBinaryTest.org.apache.solr.client.solrj.embedded.SolrExampleStreamingBinaryTest
>> 
>> Error Message:
>> 4 threads leaked from SUITE scope at org.apache.solr.client.solrj.embedded.SolrExampleStreamingBinaryTest:     1) Thread[id=16, name=qtp613975815-16 Acceptor1 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    2) Thread[id=18, name=qtp613975815-18 Acceptor2 SelectChannelConnector@0.0.0.0:58978, state=RUNNABLE, group=TGRP-SolrExampleStreamingBinaryTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    3) Thread[id=17, name=qtp613975815-17 Acceptor0 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    4) Thread[id=20, name=qtp613975815-20 Acceptor3 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)
>> 
>> Stack Trace:
>> com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE scope at org.apache.solr.client.solrj.embedded.SolrExampleStreamingBinaryTest:
>>   1) Thread[id=16, name=qtp613975815-16 Acceptor1 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   2) Thread[id=18, name=qtp613975815-18 Acceptor2 SelectChannelConnector@0.0.0.0:58978, state=RUNNABLE, group=TGRP-SolrExampleStreamingBinaryTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   3) Thread[id=17, name=qtp613975815-17 Acceptor0 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   4) Thread[id=20, name=qtp613975815-20 Acceptor3 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>        at __randomizedtesting.SeedInfo.seed([1DF0D6034A499321]:0)
>> 
>> 
>> FAILED:  org.apache.solr.client.solrj.embedded.SolrExampleStreamingBinaryTest.org.apache.solr.client.solrj.embedded.SolrExampleStreamingBinaryTest
>> 
>> Error Message:
>> There are still zombie threads that couldn't be terminated:    1) Thread[id=16, name=qtp613975815-16 Acceptor1 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    2) Thread[id=18, name=qtp613975815-18 Acceptor2 SelectChannelConnector@0.0.0.0:58978, state=RUNNABLE, group=TGRP-SolrExampleStreamingBinaryTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    3) Thread[id=17, name=qtp613975815-17 Acceptor0 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    4) Thread[id=20, name=qtp613975815-20 Acceptor3 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)
>> 
>> Stack Trace:
>> com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
>>   1) Thread[id=16, name=qtp613975815-16 Acceptor1 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   2) Thread[id=18, name=qtp613975815-18 Acceptor2 SelectChannelConnector@0.0.0.0:58978, state=RUNNABLE, group=TGRP-SolrExampleStreamingBinaryTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   3) Thread[id=17, name=qtp613975815-17 Acceptor0 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>   4) Thread[id=20, name=qtp613975815-20 Acceptor3 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]
>>        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>>        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>>        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>        at java.lang.Thread.run(Thread.java:679)
>>        at __randomizedtesting.SeedInfo.seed([1DF0D6034A499321]:0)
>> 
>> 
>> 
>> 
>> Build Log:
>> [...truncated 8454 lines...]
>> 
>> 
>> 
>> 
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message