lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dawid Weiss <dawid.we...@cs.put.poznan.pl>
Subject Re: [JENKINS-MAVEN] Lucene-Solr-Maven-4.x #157: POMs out of sync
Date Sat, 17 Nov 2012 20:32:02 GMT
These are multiple failures related to the NIO sockets (I think).
Interesting why this gets reported as a single failure from
DistributedClusteringComponentTest -- if you look at the log file and
grep for "NOTE: reproduce with" you'll see this test is neither first
nor last to fail.

D.

On Sat, Nov 17, 2012 at 4:00 PM, Apache Jenkins Server
<jenkins@builds.apache.org> wrote:
> Build: https://builds.apache.org/job/Lucene-Solr-Maven-4.x/157/
>
> 8 tests failed.
> FAILED:  org.apache.solr.handler.clustering.DistributedClusteringComponentTest.org.apache.solr.handler.clustering.DistributedClusteringComponentTest
>
> Error Message:
> 36 threads leaked from SUITE scope at org.apache.solr.handler.clustering.DistributedClusteringComponentTest:     1) Thread[id=100, name=qtp1220321112-100 Acceptor2 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    2) Thread[id=136, name=qtp20576595-136 Acceptor1 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    3) Thread[id=135, name=qtp20576595-135 Acceptor0 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    4) Thread[id=66, name=qtp815877764-66 Acceptor2 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    5) Thread[id=112, name=qtp676274569-112 Acceptor3 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    6) Thread[id=37, name=qtp125462150-37 Acceptor3 SelectChannelConnector@0.0.0.0:11891, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    7) Thread[id=64, name=qtp815877764-64 Acceptor0 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    8) Thread[id=137, name=qtp20576595-137 Acceptor2 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    9) Thread[id=138, name=qtp20576595-138 Acceptor3 SelectChannelConnector@0.0.0.0:48885, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   10) Thread[id=35, name=qtp125462150-35 Acceptor1 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   11) Thread[id=120, name=qtp959180162-120 Acceptor0 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   12) Thread[id=122, name=qtp959180162-122 Acceptor2 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   13) Thread[id=56, name=qtp2141245713-56 Acceptor3 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   14) Thread[id=99, name=qtp1220321112-99 Acceptor1 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   15) Thread[id=53, name=qtp2141245713-53 Acceptor0 SelectChannelConnector@0.0.0.0:12350, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   16) Thread[id=75, name=qtp126139945-75 Acceptor0 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   17) Thread[id=26, name=qtp196620025-26 Acceptor3 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   18) Thread[id=121, name=qtp959180162-121 Acceptor1 SelectChannelConnector@0.0.0.0:51626, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   19) Thread[id=65, name=qtp815877764-65 Acceptor1 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   20) Thread[id=78, name=qtp126139945-78 Acceptor3 SelectChannelConnector@0.0.0.0:39401, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   21) Thread[id=123, name=qtp959180162-123 Acceptor3 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   22) Thread[id=77, name=qtp126139945-77 Acceptor2 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   23) Thread[id=23, name=qtp196620025-23 Acceptor0 SelectChannelConnector@0.0.0.0:15510, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   24) Thread[id=98, name=qtp1220321112-98 Acceptor0 SelectChannelConnector@0.0.0.0:23057, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   25) Thread[id=36, name=qtp125462150-36 Acceptor2 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   26) Thread[id=34, name=qtp125462150-34 Acceptor0 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   27) Thread[id=110, name=qtp676274569-110 Acceptor1 SelectChannelConnector@0.0.0.0:32790, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   28) Thread[id=76, name=qtp126139945-76 Acceptor1 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   29) Thread[id=24, name=qtp196620025-24 Acceptor1 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   30) Thread[id=67, name=qtp815877764-67 Acceptor3 SelectChannelConnector@0.0.0.0:16879, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   31) Thread[id=25, name=qtp196620025-25 Acceptor2 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   32) Thread[id=55, name=qtp2141245713-55 Acceptor2 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   33) Thread[id=111, name=qtp676274569-111 Acceptor2 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   34) Thread[id=101, name=qtp1220321112-101 Acceptor3 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   35) Thread[id=54, name=qtp2141245713-54 Acceptor1 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   36) Thread[id=109, name=qtp676274569-109 Acceptor0 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)
>
> Stack Trace:
> com.carrotsearch.randomizedtesting.ThreadLeakError: 36 threads leaked from SUITE scope at org.apache.solr.handler.clustering.DistributedClusteringComponentTest:
>    1) Thread[id=100, name=qtp1220321112-100 Acceptor2 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    2) Thread[id=136, name=qtp20576595-136 Acceptor1 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    3) Thread[id=135, name=qtp20576595-135 Acceptor0 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    4) Thread[id=66, name=qtp815877764-66 Acceptor2 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    5) Thread[id=112, name=qtp676274569-112 Acceptor3 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    6) Thread[id=37, name=qtp125462150-37 Acceptor3 SelectChannelConnector@0.0.0.0:11891, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    7) Thread[id=64, name=qtp815877764-64 Acceptor0 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    8) Thread[id=137, name=qtp20576595-137 Acceptor2 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    9) Thread[id=138, name=qtp20576595-138 Acceptor3 SelectChannelConnector@0.0.0.0:48885, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   10) Thread[id=35, name=qtp125462150-35 Acceptor1 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   11) Thread[id=120, name=qtp959180162-120 Acceptor0 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   12) Thread[id=122, name=qtp959180162-122 Acceptor2 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   13) Thread[id=56, name=qtp2141245713-56 Acceptor3 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   14) Thread[id=99, name=qtp1220321112-99 Acceptor1 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   15) Thread[id=53, name=qtp2141245713-53 Acceptor0 SelectChannelConnector@0.0.0.0:12350, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   16) Thread[id=75, name=qtp126139945-75 Acceptor0 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   17) Thread[id=26, name=qtp196620025-26 Acceptor3 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   18) Thread[id=121, name=qtp959180162-121 Acceptor1 SelectChannelConnector@0.0.0.0:51626, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   19) Thread[id=65, name=qtp815877764-65 Acceptor1 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   20) Thread[id=78, name=qtp126139945-78 Acceptor3 SelectChannelConnector@0.0.0.0:39401, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   21) Thread[id=123, name=qtp959180162-123 Acceptor3 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   22) Thread[id=77, name=qtp126139945-77 Acceptor2 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   23) Thread[id=23, name=qtp196620025-23 Acceptor0 SelectChannelConnector@0.0.0.0:15510, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   24) Thread[id=98, name=qtp1220321112-98 Acceptor0 SelectChannelConnector@0.0.0.0:23057, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   25) Thread[id=36, name=qtp125462150-36 Acceptor2 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   26) Thread[id=34, name=qtp125462150-34 Acceptor0 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   27) Thread[id=110, name=qtp676274569-110 Acceptor1 SelectChannelConnector@0.0.0.0:32790, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   28) Thread[id=76, name=qtp126139945-76 Acceptor1 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   29) Thread[id=24, name=qtp196620025-24 Acceptor1 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   30) Thread[id=67, name=qtp815877764-67 Acceptor3 SelectChannelConnector@0.0.0.0:16879, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   31) Thread[id=25, name=qtp196620025-25 Acceptor2 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   32) Thread[id=55, name=qtp2141245713-55 Acceptor2 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   33) Thread[id=111, name=qtp676274569-111 Acceptor2 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   34) Thread[id=101, name=qtp1220321112-101 Acceptor3 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   35) Thread[id=54, name=qtp2141245713-54 Acceptor1 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   36) Thread[id=109, name=qtp676274569-109 Acceptor0 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>         at __randomizedtesting.SeedInfo.seed([DFE0AA4498F9B30C]:0)
>
>
> FAILED:  org.apache.solr.handler.clustering.DistributedClusteringComponentTest.org.apache.solr.handler.clustering.DistributedClusteringComponentTest
>
> Error Message:
> There are still zombie threads that couldn't be terminated:    1) Thread[id=100, name=qtp1220321112-100 Acceptor2 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    2) Thread[id=136, name=qtp20576595-136 Acceptor1 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    3) Thread[id=135, name=qtp20576595-135 Acceptor0 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    4) Thread[id=66, name=qtp815877764-66 Acceptor2 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    5) Thread[id=112, name=qtp676274569-112 Acceptor3 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    6) Thread[id=37, name=qtp125462150-37 Acceptor3 SelectChannelConnector@0.0.0.0:11891, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    7) Thread[id=64, name=qtp815877764-64 Acceptor0 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    8) Thread[id=137, name=qtp20576595-137 Acceptor2 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    9) Thread[id=138, name=qtp20576595-138 Acceptor3 SelectChannelConnector@0.0.0.0:48885, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   10) Thread[id=35, name=qtp125462150-35 Acceptor1 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   11) Thread[id=120, name=qtp959180162-120 Acceptor0 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   12) Thread[id=122, name=qtp959180162-122 Acceptor2 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   13) Thread[id=56, name=qtp2141245713-56 Acceptor3 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   14) Thread[id=53, name=qtp2141245713-53 Acceptor0 SelectChannelConnector@0.0.0.0:12350, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   15) Thread[id=99, name=qtp1220321112-99 Acceptor1 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   16) Thread[id=26, name=qtp196620025-26 Acceptor3 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   17) Thread[id=75, name=qtp126139945-75 Acceptor0 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   18) Thread[id=121, name=qtp959180162-121 Acceptor1 SelectChannelConnector@0.0.0.0:51626, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   19) Thread[id=65, name=qtp815877764-65 Acceptor1 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   20) Thread[id=78, name=qtp126139945-78 Acceptor3 SelectChannelConnector@0.0.0.0:39401, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   21) Thread[id=123, name=qtp959180162-123 Acceptor3 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   22) Thread[id=77, name=qtp126139945-77 Acceptor2 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   23) Thread[id=36, name=qtp125462150-36 Acceptor2 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   24) Thread[id=98, name=qtp1220321112-98 Acceptor0 SelectChannelConnector@0.0.0.0:23057, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   25) Thread[id=23, name=qtp196620025-23 Acceptor0 SelectChannelConnector@0.0.0.0:15510, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   26) Thread[id=34, name=qtp125462150-34 Acceptor0 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   27) Thread[id=110, name=qtp676274569-110 Acceptor1 SelectChannelConnector@0.0.0.0:32790, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   28) Thread[id=76, name=qtp126139945-76 Acceptor1 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   29) Thread[id=24, name=qtp196620025-24 Acceptor1 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   30) Thread[id=67, name=qtp815877764-67 Acceptor3 SelectChannelConnector@0.0.0.0:16879, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   31) Thread[id=25, name=qtp196620025-25 Acceptor2 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   32) Thread[id=55, name=qtp2141245713-55 Acceptor2 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   33) Thread[id=111, name=qtp676274569-111 Acceptor2 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   34) Thread[id=101, name=qtp1220321112-101 Acceptor3 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   35) Thread[id=54, name=qtp2141245713-54 Acceptor1 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)   36) Thread[id=109, name=qtp676274569-109 Acceptor0 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)
>
> Stack Trace:
> com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
>    1) Thread[id=100, name=qtp1220321112-100 Acceptor2 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    2) Thread[id=136, name=qtp20576595-136 Acceptor1 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    3) Thread[id=135, name=qtp20576595-135 Acceptor0 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    4) Thread[id=66, name=qtp815877764-66 Acceptor2 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    5) Thread[id=112, name=qtp676274569-112 Acceptor3 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    6) Thread[id=37, name=qtp125462150-37 Acceptor3 SelectChannelConnector@0.0.0.0:11891, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    7) Thread[id=64, name=qtp815877764-64 Acceptor0 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    8) Thread[id=137, name=qtp20576595-137 Acceptor2 SelectChannelConnector@0.0.0.0:48885, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    9) Thread[id=138, name=qtp20576595-138 Acceptor3 SelectChannelConnector@0.0.0.0:48885, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   10) Thread[id=35, name=qtp125462150-35 Acceptor1 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   11) Thread[id=120, name=qtp959180162-120 Acceptor0 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   12) Thread[id=122, name=qtp959180162-122 Acceptor2 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   13) Thread[id=56, name=qtp2141245713-56 Acceptor3 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   14) Thread[id=53, name=qtp2141245713-53 Acceptor0 SelectChannelConnector@0.0.0.0:12350, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   15) Thread[id=99, name=qtp1220321112-99 Acceptor1 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   16) Thread[id=26, name=qtp196620025-26 Acceptor3 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   17) Thread[id=75, name=qtp126139945-75 Acceptor0 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   18) Thread[id=121, name=qtp959180162-121 Acceptor1 SelectChannelConnector@0.0.0.0:51626, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   19) Thread[id=65, name=qtp815877764-65 Acceptor1 SelectChannelConnector@0.0.0.0:16879, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   20) Thread[id=78, name=qtp126139945-78 Acceptor3 SelectChannelConnector@0.0.0.0:39401, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   21) Thread[id=123, name=qtp959180162-123 Acceptor3 SelectChannelConnector@0.0.0.0:51626, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   22) Thread[id=77, name=qtp126139945-77 Acceptor2 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   23) Thread[id=36, name=qtp125462150-36 Acceptor2 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   24) Thread[id=98, name=qtp1220321112-98 Acceptor0 SelectChannelConnector@0.0.0.0:23057, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   25) Thread[id=23, name=qtp196620025-23 Acceptor0 SelectChannelConnector@0.0.0.0:15510, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   26) Thread[id=34, name=qtp125462150-34 Acceptor0 SelectChannelConnector@0.0.0.0:11891, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   27) Thread[id=110, name=qtp676274569-110 Acceptor1 SelectChannelConnector@0.0.0.0:32790, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   28) Thread[id=76, name=qtp126139945-76 Acceptor1 SelectChannelConnector@0.0.0.0:39401, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   29) Thread[id=24, name=qtp196620025-24 Acceptor1 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   30) Thread[id=67, name=qtp815877764-67 Acceptor3 SelectChannelConnector@0.0.0.0:16879, state=RUNNABLE, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   31) Thread[id=25, name=qtp196620025-25 Acceptor2 SelectChannelConnector@0.0.0.0:15510, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   32) Thread[id=55, name=qtp2141245713-55 Acceptor2 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   33) Thread[id=111, name=qtp676274569-111 Acceptor2 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   34) Thread[id=101, name=qtp1220321112-101 Acceptor3 SelectChannelConnector@0.0.0.0:23057, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   35) Thread[id=54, name=qtp2141245713-54 Acceptor1 SelectChannelConnector@0.0.0.0:12350, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>   36) Thread[id=109, name=qtp676274569-109 Acceptor0 SelectChannelConnector@0.0.0.0:32790, state=BLOCKED, group=TGRP-DistributedClusteringComponentTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>         at __randomizedtesting.SeedInfo.seed([DFE0AA4498F9B30C]:0)
>
>
> FAILED:  org.apache.solr.handler.dataimport.TestSolrEntityProcessorEndToEnd.testFullImportWrongSolrUrl
>
> Error Message:
> Test abandoned because suite timeout was reached.
>
> Stack Trace:
> java.lang.Exception: Test abandoned because suite timeout was reached.
>         at __randomizedtesting.SeedInfo.seed([8A42C2EABF0FA3F8]:0)
>
>
> FAILED:  org.apache.solr.handler.dataimport.TestSolrEntityProcessorEndToEnd.org.apache.solr.handler.dataimport.TestSolrEntityProcessorEndToEnd
>
> Error Message:
> Suite timeout exceeded (>= 7200000 msec).
>
> Stack Trace:
> java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
>         at __randomizedtesting.SeedInfo.seed([8A42C2EABF0FA3F8]:0)
>
>
> FAILED:  org.apache.solr.TestDistributedSearch.testDistribSearch
>
> Error Message:
> Test abandoned because suite timeout was reached.
>
> Stack Trace:
> java.lang.Exception: Test abandoned because suite timeout was reached.
>         at __randomizedtesting.SeedInfo.seed([E141DDF432EF958A]:0)
>
>
> FAILED:  org.apache.solr.TestDistributedSearch.org.apache.solr.TestDistributedSearch
>
> Error Message:
> Suite timeout exceeded (>= 7200000 msec).
>
> Stack Trace:
> java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
>         at __randomizedtesting.SeedInfo.seed([E141DDF432EF958A]:0)
>
>
> FAILED:  org.apache.solr.client.solrj.embedded.SolrExampleStreamingBinaryTest.org.apache.solr.client.solrj.embedded.SolrExampleStreamingBinaryTest
>
> Error Message:
> 4 threads leaked from SUITE scope at org.apache.solr.client.solrj.embedded.SolrExampleStreamingBinaryTest:     1) Thread[id=16, name=qtp613975815-16 Acceptor1 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    2) Thread[id=18, name=qtp613975815-18 Acceptor2 SelectChannelConnector@0.0.0.0:58978, state=RUNNABLE, group=TGRP-SolrExampleStreamingBinaryTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    3) Thread[id=17, name=qtp613975815-17 Acceptor0 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    4) Thread[id=20, name=qtp613975815-20 Acceptor3 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)
>
> Stack Trace:
> com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE scope at org.apache.solr.client.solrj.embedded.SolrExampleStreamingBinaryTest:
>    1) Thread[id=16, name=qtp613975815-16 Acceptor1 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    2) Thread[id=18, name=qtp613975815-18 Acceptor2 SelectChannelConnector@0.0.0.0:58978, state=RUNNABLE, group=TGRP-SolrExampleStreamingBinaryTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    3) Thread[id=17, name=qtp613975815-17 Acceptor0 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    4) Thread[id=20, name=qtp613975815-20 Acceptor3 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>         at __randomizedtesting.SeedInfo.seed([1DF0D6034A499321]:0)
>
>
> FAILED:  org.apache.solr.client.solrj.embedded.SolrExampleStreamingBinaryTest.org.apache.solr.client.solrj.embedded.SolrExampleStreamingBinaryTest
>
> Error Message:
> There are still zombie threads that couldn't be terminated:    1) Thread[id=16, name=qtp613975815-16 Acceptor1 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    2) Thread[id=18, name=qtp613975815-18 Acceptor2 SelectChannelConnector@0.0.0.0:58978, state=RUNNABLE, group=TGRP-SolrExampleStreamingBinaryTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    3) Thread[id=17, name=qtp613975815-17 Acceptor0 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)    4) Thread[id=20, name=qtp613975815-20 Acceptor3 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:679)
>
> Stack Trace:
> com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
>    1) Thread[id=16, name=qtp613975815-16 Acceptor1 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    2) Thread[id=18, name=qtp613975815-18 Acceptor2 SelectChannelConnector@0.0.0.0:58978, state=RUNNABLE, group=TGRP-SolrExampleStreamingBinaryTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:163)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    3) Thread[id=17, name=qtp613975815-17 Acceptor0 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>    4) Thread[id=20, name=qtp613975815-20 Acceptor3 SelectChannelConnector@0.0.0.0:58978, state=BLOCKED, group=TGRP-SolrExampleStreamingBinaryTest]
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:147)
>         at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:679)
>         at __randomizedtesting.SeedInfo.seed([1DF0D6034A499321]:0)
>
>
>
>
> Build Log:
> [...truncated 8454 lines...]
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message