lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-NightlyTests-5.4 - Build # 16 - Still Failing
Date Wed, 13 Jan 2016 18:29:29 GMT
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.4/16/

3 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Error from server at http://127.0.0.1:35181/awholynewcollection_2: non ok status: 500, message:Server Error

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35181/awholynewcollection_2: non ok status: 500, message:Server Error
	at __randomizedtesting.SeedInfo.seed([D38CC17F34E6FDAA:5BD8FEA59A1A9052]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:508)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForNon403or404or503(AbstractFullDistribZkTestBase.java:1754)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:658)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:160)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:964)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:939)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
6 threads leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest:     1) Thread[id=53620, name=zkCallback-675-thread-3, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:745)    2) Thread[id=53621, name=zkCallback-675-thread-4, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:745)    3) Thread[id=52355, name=zkCallback-675-thread-1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:745)    4) Thread[id=52353, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]-SendThread(127.0.0.1:33845), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)    5) Thread[id=52354, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]-EventThread, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)    6) Thread[id=53619, name=zkCallback-675-thread-2, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 6 threads leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest: 
   1) Thread[id=53620, name=zkCallback-675-thread-3, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
   2) Thread[id=53621, name=zkCallback-675-thread-4, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
   3) Thread[id=52355, name=zkCallback-675-thread-1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
   4) Thread[id=52353, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]-SendThread(127.0.0.1:33845), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
        at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
   5) Thread[id=52354, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]-EventThread, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
   6) Thread[id=53619, name=zkCallback-675-thread-2, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([D38CC17F34E6FDAA]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=52353, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]-SendThread(127.0.0.1:33845), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)    2) Thread[id=52355, name=zkCallback-675-thread-1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:745)    3) Thread[id=53619, name=zkCallback-675-thread-2, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:745)    4) Thread[id=53620, name=zkCallback-675-thread-3, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:745)    5) Thread[id=53621, name=zkCallback-675-thread-4, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=52353, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]-SendThread(127.0.0.1:33845), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
        at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
   2) Thread[id=52355, name=zkCallback-675-thread-1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
   3) Thread[id=53619, name=zkCallback-675-thread-2, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
   4) Thread[id=53620, name=zkCallback-675-thread-3, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
   5) Thread[id=53621, name=zkCallback-675-thread-4, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([D38CC17F34E6FDAA]:0)




Build Log:
[...truncated 10929 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/init-core-data-001
   [junit4]   2> 1752331 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[D38CC17F34E6FDAA]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1752331 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[D38CC17F34E6FDAA]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 1752336 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1752341 INFO  (Thread-48508) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1752341 INFO  (Thread-48508) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1752443 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.ZkTestServer start zk server on port:33845
   [junit4]   2> 1752443 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1752460 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1752489 INFO  (zkCallback-642-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6162d55f name:ZooKeeperConnection Watcher:127.0.0.1:33845 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1752489 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1752489 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1752489 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1752532 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1752532 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1752534 INFO  (zkCallback-643-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6bd7a2cc name:ZooKeeperConnection Watcher:127.0.0.1:33845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1752534 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1752534 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1752535 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 1752536 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 1752537 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 1752538 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 1752540 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1752540 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1752542 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1752542 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 1752544 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1752544 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1752545 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1752546 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1752547 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1752547 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1752548 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1752548 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 1752549 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1752550 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1752551 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1752551 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1752564 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1752564 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1752566 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1752566 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1752567 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1752567 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1752579 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1752585 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1752608 INFO  (zkCallback-644-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@e6cb061 name:ZooKeeperConnection Watcher:127.0.0.1:33845 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1752608 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1752608 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1752608 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1752611 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1752613 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1752616 INFO  (zkCallback-645-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@24425aa1 name:ZooKeeperConnection Watcher:127.0.0.1:33845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1752616 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1752616 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1752616 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
   [junit4]   2> 1752617 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 1752618 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
   [junit4]   2> 1752618 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
   [junit4]   2> 1752620 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
   [junit4]   2> 1752620 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
   [junit4]   2> 1752621 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1752622 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1752623 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
   [junit4]   2> 1752623 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 1752624 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
   [junit4]   2> 1752624 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
   [junit4]   2> 1752626 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
   [junit4]   2> 1752626 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
   [junit4]   2> 1752627 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1752627 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1752629 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1752629 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1752631 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
   [junit4]   2> 1752631 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 1752638 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
   [junit4]   2> 1752639 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 1752641 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
   [junit4]   2> 1752641 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
   [junit4]   2> 1752774 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/control-001/cores/collection1
   [junit4]   2> 1752777 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1752785 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2a5567db{/,null,AVAILABLE}
   [junit4]   2> 1752787 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.e.j.s.ServerConnector Started ServerConnector@4d157093{HTTP/1.1}{127.0.0.1:46789}
   [junit4]   2> 1752787 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.e.j.s.Server Started @1755837ms
   [junit4]   2> 1752787 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/control-001/cores, hostPort=46789, hostContext=/, solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/tempDir-001/control/data}
   [junit4]   2> 1752787 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@7b3cb2c6
   [junit4]   2> 1752787 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/control-001'
   [junit4]   2> 1752787 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1752787 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1752788 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1752788 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1752796 INFO  (zkCallback-646-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@677d8e12 name:ZooKeeperConnection Watcher:127.0.0.1:33845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1752796 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1752797 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1752799 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1752799 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/control-001/solr.xml
   [junit4]   2> 1752814 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/control-001/cores
   [junit4]   2> 1752814 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.CoreContainer New CoreContainer 1395666871
   [junit4]   2> 1752814 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/control-001]
   [junit4]   2> 1752814 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/control-001/lib
   [junit4]   2> 1752814 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1752815 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1752816 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1752816 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1752816 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33845/solr
   [junit4]   2> 1752816 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1752816 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1752823 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1752823 INFO  (zkCallback-648-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@333924d4 name:ZooKeeperConnection Watcher:127.0.0.1:33845 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1752823 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1752824 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1752827 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1752836 INFO  (zkCallback-649-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@76293883 name:ZooKeeperConnection Watcher:127.0.0.1:33845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1752836 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1752837 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1752839 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1752841 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1752842 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1752844 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1752845 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1752846 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1752847 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1752848 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1752849 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46789_
   [junit4]   2> 1752850 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:46789_
   [junit4]   2> 1752851 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1752852 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1752853 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1752853 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95204748547850246-127.0.0.1:46789_-n_0000000000
   [junit4]   2> 1752854 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:46789_
   [junit4]   2> 1752854 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1752855 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.Overseer Overseer (id=95204748547850246-127.0.0.1:46789_-n_0000000000) starting
   [junit4]   2> 1752856 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1752861 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1752873 INFO  (OverseerStateUpdate-95204748547850246-127.0.0.1:46789_-n_0000000000) [n:127.0.0.1:46789_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1752873 INFO  (OverseerStateUpdate-95204748547850246-127.0.0.1:46789_-n_0000000000) [n:127.0.0.1:46789_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1752880 INFO  (OverseerCollectionConfigSetProcessor-95204748547850246-127.0.0.1:46789_-n_0000000000) [n:127.0.0.1:46789_    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 1752881 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1752912 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1752912 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1752913 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/control-001/cores
   [junit4]   2> 1752914 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {transient=false, name=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/control-001/cores/collection1/, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/control-001/cores/collection1, schema=schema.xml, configSetProperties=configsetprops.json, collection=control_collection, dataDir=data/, coreNodeName=, config=solrconfig.xml, loadOnStartup=true, shard=}
   [junit4]   2> 1752914 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/control-001/cores/collection1/
   [junit4]   2> 1752915 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 1752916 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1
   [junit4]   2> 1752916 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]) [n:127.0.0.1:46789_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1752916 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1752916 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1752918 INFO  (OverseerStateUpdate-95204748547850246-127.0.0.1:46789_-n_0000000000) [n:127.0.0.1:46789_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "base_url":"http://127.0.0.1:46789",
   [junit4]   2>   "node_name":"127.0.0.1:46789_",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "state":"down",
   [junit4]   2>   "roles":null} current state version: 0
   [junit4]   2> 1752919 INFO  (OverseerStateUpdate-95204748547850246-127.0.0.1:46789_-n_0000000000) [n:127.0.0.1:46789_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "base_url":"http://127.0.0.1:46789",
   [junit4]   2>   "node_name":"127.0.0.1:46789_",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "state":"down",
   [junit4]   2>   "roles":null}
   [junit4]   2> 1752919 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1752919 INFO  (OverseerStateUpdate-95204748547850246-127.0.0.1:46789_-n_0000000000) [n:127.0.0.1:46789_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 1752920 INFO  (OverseerStateUpdate-95204748547850246-127.0.0.1:46789_-n_0000000000) [n:127.0.0.1:46789_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1752921 INFO  (zkCallback-649-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1752921 INFO  (zkCallback-649-thread-2-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1753920 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1753920 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 1753920 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1753920 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 1753921 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1753921 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/control-001/cores/collection1'
   [junit4]   2> 1753921 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1753921 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1753923 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1753931 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1753952 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 5.4.1
   [junit4]   2> 1754024 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1754033 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1754331 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1754363 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1754365 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1754399 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1754404 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1754407 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1754408 WARN  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1754408 WARN  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1754408 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1754408 WARN  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1754408 WARN  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1754409 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1
   [junit4]   2> 1754409 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1754409 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1754410 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/control-001/cores/collection1], dataDir=[null]
   [junit4]   2> 1754410 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@65f1db28
   [junit4]   2> 1754410 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/control-001/cores/collection1/data
   [junit4]   2> 1754411 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/control-001/cores/collection1/data/index/
   [junit4]   2> 1754411 WARN  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1754411 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/control-001/cores/collection1/data/index
   [junit4]   2> 1754411 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@2118e99d
   [junit4]   2> 1754412 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@6a915364 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6afa00e4),segFN=segments_1,generation=1}
   [junit4]   2> 1754412 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1754416 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1754416 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1754416 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1754416 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1754417 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1754417 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1754417 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1754417 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1754417 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1754417 WARN  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 1754420 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1754422 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1754423 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1754424 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/control-001/cores/collection1/data/
   [junit4]   2> 1754424 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D38CC17F34E6FDAA-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1754426 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1754430 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/file,/admin/plugins,/admin/threads,/replication,/dump,/admin/properties,/schema,/admin/mbeans,/admin/luke,/update,/update/csv,/admin/system,/get,/update/json,/admin/segments,/admin/logging,/admin/ping,/update/json/docs,standard,/config
   [junit4]   2> 1754432 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1754444 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1754444 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1754446 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1754446 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1754446 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=318640695, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1754447 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@6a915364 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6afa00e4),segFN=segments_1,generation=1}
   [junit4]   2> 1754447 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1754447 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@54786794[collection1] main
   [junit4]   2> 1754447 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 1754449 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1754449 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1754449 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1754449 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 1754450 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1754450 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1754450 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1754451 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1754451 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1754451 INFO  (searcherExecutor-2487-thread-1-processing-n:127.0.0.1:46789_ r:core_node1 c:control_collection x:collection1 s:shard1) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@54786794[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1754452 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 1754452 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 1754452 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 1754452 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1523275978978099200
   [junit4]   2> 1754454 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1523275978978099200
   [junit4]   2> 1754455 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 1754455 INFO  (coreLoadExecutor-2486-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1754456 INFO  (coreZkRegister-2480-thread-1-processing-n:127.0.0.1:46789_ r:core_node1 c:control_collection x:collection1 s:shard1) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:46789 collection:control_collection shard:shard1
   [junit4]   2> 1754457 INFO  (coreZkRegister-2480-thread-1-processing-n:127.0.0.1:46789_ r:core_node1 c:control_collection x:collection1 s:shard1) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1754461 INFO  (coreZkRegister-2480-thread-1-processing-n:127.0.0.1:46789_ r:core_node1 c:control_collection x:collection1 s:shard1) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95204748547850246-core_node1-n_0000000000
   [junit4]   2> 1754461 INFO  (coreZkRegister-2480-thread-1-processing-n:127.0.0.1:46789_ r:core_node1 c:control_collection x:collection1 s:shard1) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 1754463 INFO  (OverseerStateUpdate-95204748547850246-127.0.0.1:46789_-n_0000000000) [n:127.0.0.1:46789_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 1754464 INFO  (zkCallback-649-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1754464 INFO  (zkCallback-649-thread-2-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1754468 INFO  (coreZkRegister-2480-thread-1-processing-n:127.0.0.1:46789_ r:core_node1 c:control_collection x:collection1 s:shard1) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1754468 INFO  (coreZkRegister-2480-thread-1-processing-n:127.0.0.1:46789_ r:core_node1 c:control_collection x:collection1 s:shard1) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1754468 INFO  (coreZkRegister-2480-thread-1-processing-n:127.0.0.1:46789_ r:core_node1 c:control_collection x:collection1 s:shard1) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46789/collection1/
   [junit4]   2> 1754468 INFO  (coreZkRegister-2480-thread-1-processing-n:127.0.0.1:46789_ r:core_node1 c:control_collection x:collection1 s:shard1) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1754468 INFO  (coreZkRegister-2480-thread-1-processing-n:127.0.0.1:46789_ r:core_node1 c:control_collection x:collection1 s:shard1) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:46789/collection1/ has no replicas
   [junit4]   2> 1754469 INFO  (coreZkRegister-2480-thread-1-processing-n:127.0.0.1:46789_ r:core_node1 c:control_collection x:collection1 s:shard1) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1754471 INFO  (coreZkRegister-2480-thread-1-processing-n:127.0.0.1:46789_ r:core_node1 c:control_collection x:collection1 s:shard1) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 1754473 INFO  (OverseerStateUpdate-95204748547850246-127.0.0.1:46789_-n_0000000000) [n:127.0.0.1:46789_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:46789",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 1754474 INFO  (coreZkRegister-2480-thread-1-processing-n:127.0.0.1:46789_ r:core_node1 c:control_collection x:collection1 s:shard1) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46789/collection1/ shard1
   [junit4]   2> 1754575 INFO  (zkCallback-649-thread-2-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1754575 INFO  (zkCallback-649-thread-1-processing-n:127.0.0.1:46789_) [n:127.0.0.1:46789_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1754578 INFO  (coreZkRegister-2480-thread-1-processing-n:127.0.0.1:46789_ r:core_node1 c:control_collection x:collection1 s:shard1) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:46789/collection1/ and leader is http://127.0.0.1:46789/collection1/
   [junit4]   2> 1754579 INFO  (coreZkRegister-2480-thread-1-processing-n:127.0.0.1:46789_ r:core_node1 c:control_collection x:collection1 s:shard1) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46789
   [junit4]   2> 1754579 INFO  (coreZkRegister-2480-thread-1-processing-n:127.0.0.1:46789_ r:core_node1 c:control_collection x:collection1 s:shard1) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1754579 INFO  (coreZkRegister-2480-thread-1-processing-n:127.0.0.1:46789_ r:core_node1 c:control_collection x:collection1 s:shard1) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 1754579 INFO  (coreZkRegister-2480-thread-1-processing-n:127.0.0.1:46789_ r:core_node1 c:control_collection x:collection1 s:shard1) [n:127.0.0.1:46789_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1754585 INFO  (OverseerStateUpdate-95204748547850246-127.0.0.1:46789_-n_0000000000) [n:127.0.0.1:46789_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "base_url":"http://127.0.0.1:46789",
   [junit4]   2>   "node_name":"127.0.0.1:46789_",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "core":"co

[...truncated too long message...]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    3) Thread[id=52355, name=zkCallback-675-thread-1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    4) Thread[id=52353, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]-SendThread(127.0.0.1:33845), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
   [junit4]    >    5) Thread[id=52354, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]-EventThread, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
   [junit4]    >    6) Thread[id=53619, name=zkCallback-675-thread-2, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([D38CC17F34E6FDAA]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=52353, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[D38CC17F34E6FDAA]-SendThread(127.0.0.1:33845), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
   [junit4]    >    2) Thread[id=52355, name=zkCallback-675-thread-1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    3) Thread[id=53619, name=zkCallback-675-thread-2, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    4) Thread[id=53620, name=zkCallback-675-thread-3, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    5) Thread[id=53621, name=zkCallback-675-thread-4, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([D38CC17F34E6FDAA]:0)
   [junit4] Completed [256/551] on J1 in 116.28s, 1 test, 3 errors <<< FAILURES!

[...truncated 896 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/build.xml:799: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/build.xml:736: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/common-build.xml:526: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/lucene/common-build.xml:1452: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/lucene/common-build.xml:1006: There were test failures: 551 suites (7 ignored), 2179 tests, 2 suite-level errors, 1 error, 1024 ignored (16 assumptions) [seed: D38CC17F34E6FDAA]

Total time: 191 minutes 38 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



Mime
View raw message