lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-NightlyTests-7.x - Build # 155 - Still Unstable
Date Thu, 22 Feb 2018 05:28:34 GMT
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-7.x/155/

6 tests failed.
FAILED:  org.apache.lucene.analysis.core.TestRandomChains.testRandomChains

Error Message:
startOffset must be non-negative, and endOffset must be >= startOffset, and offsets must not go backwards startOffset=6,endOffset=15,lastStartOffset=7 for field 'dummy'

Stack Trace:
java.lang.IllegalArgumentException: startOffset must be non-negative, and endOffset must be >= startOffset, and offsets must not go backwards startOffset=6,endOffset=15,lastStartOffset=7 for field 'dummy'
	at __randomizedtesting.SeedInfo.seed([540F1928645813E:38A1D8F3C1579CFE]:0)
	at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:767)
	at org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:430)
	at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:392)
	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:240)
	at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:497)
	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1729)
	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1464)
	at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:171)
	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:672)
	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:562)
	at org.apache.lucene.analysis.core.TestRandomChains.testRandomChains(TestRandomChains.java:856)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsBasicDistributedZkTest

Error Message:
3 threads leaked from SUITE scope at org.apache.solr.cloud.hdfs.HdfsBasicDistributedZkTest:     1) Thread[id=48716, name=Connection evictor, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZkTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)    2) Thread[id=48724, name=Connection evictor, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZkTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)    3) Thread[id=48734, name=Connection evictor, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZkTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.hdfs.HdfsBasicDistributedZkTest: 
   1) Thread[id=48716, name=Connection evictor, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZkTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
   2) Thread[id=48724, name=Connection evictor, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZkTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
   3) Thread[id=48734, name=Connection evictor, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZkTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
	at __randomizedtesting.SeedInfo.seed([F982B7BEA7225924]:0)


FAILED:  org.apache.solr.cloud.TestUtilizeNode.test

Error Message:
no replica should be present in  127.0.0.1:44848_solr

Stack Trace:
java.lang.AssertionError: no replica should be present in  127.0.0.1:44848_solr
	at __randomizedtesting.SeedInfo.seed([F982B7BEA7225924:71D6886409DE34DC]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.TestUtilizeNode.test(TestUtilizeNode.java:99)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testEventQueue

Error Message:
action wasn't interrupted

Stack Trace:
java.lang.AssertionError: action wasn't interrupted
	at __randomizedtesting.SeedInfo.seed([F982B7BEA7225924:3037F510AE459FD1]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testEventQueue(TriggerIntegrationTest.java:726)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.hdfs.HdfsBasicDistributedZkTest.test

Error Message:
Error from server at http://127.0.0.1:47288/_v/y: ADDREPLICA failed to create replica

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:47288/_v/y: ADDREPLICA failed to create replica
	at __randomizedtesting.SeedInfo.seed([F982B7BEA7225924:71D6886409DE34DC]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.BasicDistributedZkTest.testANewCollectionInOneInstanceWithManualShardAssignement(BasicDistributedZkTest.java:802)
	at org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:375)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload

Error Message:
expected:<[{indexVersion=1519274070041,generation=2,filelist=[_0.cfe, _0.cfs, _0.si, _1.cfe, _1.cfs, _1.si, _2.cfe, _2.cfs, _2.si, _3.cfe, _3.cfs, _3.si, _4.cfe, _4.cfs, _4.si, _5.cfe, _5.cfs, _5.si, segments_2]}]> but was:<[{indexVersion=1519274070041,generation=2,filelist=[_0.cfe, _0.cfs, _0.si, _1.cfe, _1.cfs, _1.si, _2.cfe, _2.cfs, _2.si, _3.cfe, _3.cfs, _3.si, _4.cfe, _4.cfs, _4.si, _5.cfe, _5.cfs, _5.si, segments_2]}, {indexVersion=1519274070041,generation=3,filelist=[_6.cfe, _6.cfs, _6.si, segments_3]}]>

Stack Trace:
java.lang.AssertionError: expected:<[{indexVersion=1519274070041,generation=2,filelist=[_0.cfe, _0.cfs, _0.si, _1.cfe, _1.cfs, _1.si, _2.cfe, _2.cfs, _2.si, _3.cfe, _3.cfs, _3.si, _4.cfe, _4.cfs, _4.si, _5.cfe, _5.cfs, _5.si, segments_2]}]> but was:<[{indexVersion=1519274070041,generation=2,filelist=[_0.cfe, _0.cfs, _0.si, _1.cfe, _1.cfs, _1.si, _2.cfe, _2.cfs, _2.si, _3.cfe, _3.cfs, _3.si, _4.cfe, _4.cfs, _4.si, _5.cfe, _5.cfs, _5.si, segments_2]}, {indexVersion=1519274070041,generation=3,filelist=[_6.cfe, _6.cfs, _6.si, segments_3]}]>
	at __randomizedtesting.SeedInfo.seed([F982B7BEA7225924:DC55AC8ED76A5727]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1277)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 3306 lines...]
   [junit4] Suite: org.apache.lucene.analysis.core.TestRandomChains
   [junit4]   2> TEST FAIL: useCharFilter=false text=''P\u2e2b\u03cb'
   [junit4]   2> Exception from random analyzer: 
   [junit4]   2> charfilters=
   [junit4]   2>   org.apache.lucene.analysis.pattern.PatternReplaceCharFilter(a, <SOUTHEAST_ASIAN>, java.io.StringReader@7395911)
   [junit4]   2> tokenizer=
   [junit4]   2>   org.apache.lucene.analysis.standard.UAX29URLEmailTokenizer(org.apache.lucene.util.AttributeFactory$DefaultAttributeFactory@30a9d9d4)
   [junit4]   2> filters=
   [junit4]   2>   org.apache.lucene.analysis.miscellaneous.SetKeywordMarkerFilter(ValidatingTokenFilter@22fbb52c term=,bytes=[],startOffset=0,endOffset=0,positionIncrement=1,type=word,keyword=false, [gnk])
   [junit4]   2>   org.apache.lucene.analysis.shingle.ShingleFilter(ValidatingTokenFilter@15c81f91 term=,bytes=[],startOffset=0,endOffset=0,positionIncrement=1,type=word,keyword=false,positionLength=1, )
   [junit4]   2>   org.apache.lucene.analysis.cjk.CJKBigramFilter(ValidatingTokenFilter@760925d4 term=,bytes=[],startOffset=0,endOffset=0,positionIncrement=1,type=word,keyword=false,positionLength=1)
   [junit4]   2> offsetsAreCorrect=false
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestRandomChains -Dtests.method=testRandomChains -Dtests.seed=540F1928645813E -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/test-data/enwiki.random.lines.txt -Dtests.locale=es-BO -Dtests.timezone=Asia/Karachi -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   82.1s J1 | TestRandomChains.testRandomChains <<<
   [junit4]    > Throwable #1: java.lang.IllegalArgumentException: startOffset must be non-negative, and endOffset must be >= startOffset, and offsets must not go backwards startOffset=6,endOffset=15,lastStartOffset=7 for field 'dummy'
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([540F1928645813E:38A1D8F3C1579CFE]:0)
   [junit4]    > 	at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:767)
   [junit4]    > 	at org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:430)
   [junit4]    > 	at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:392)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:240)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:497)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1729)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1464)
   [junit4]    > 	at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:171)
   [junit4]    > 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:672)
   [junit4]    > 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:562)
   [junit4]    > 	at org.apache.lucene.analysis.core.TestRandomChains.testRandomChains(TestRandomChains.java:856)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/analysis/common/test/J1/temp/lucene.analysis.core.TestRandomChains_540F1928645813E-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {dummy=PostingsFormat(name=Direct)}, docValues:{}, maxPointsInLeafNode=1208, maxMBSortInHeap=6.933392510734363, sim=RandomSimilarity(queryNorm=true): {dummy=DFR I(ne)L3(800.0)}, locale=es-BO, timezone=Asia/Karachi
   [junit4]   2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=89327176,total=269484032
   [junit4]   2> NOTE: All tests run in this JVM: [TestGermanMinimalStemFilterFactory, TestPortugueseMinimalStemFilter, TestUAX29URLEmailAnalyzer, TestRomanianAnalyzer, TestLithuanianStemming, TestIrishAnalyzer, TestFingerprintFilter, TestASCIIFoldingFilter, TestOptionalCondition, TestSynonymMapFilter, TestGermanNormalizationFilter, TestTypeTokenFilter, TestScandinavianFoldingFilter, TestCzechAnalyzer, TestKeywordRepeatFilter, TestRemoveDuplicatesTokenFilter, TestDanishAnalyzer, TestEmptyTokenStream, TestZeroAffix, TestTurkishLowerCaseFilter, CommonGramsFilterTest, TestDictionaryCompoundWordTokenFilterFactory, TestDictionary, TestPatternCaptureGroupTokenFilter, TestLengthFilter, TestSnowball, TestGermanLightStemFilterFactory, TestStemmerOverrideFilterFactory, TestBulgarianAnalyzer, TestApostropheFilterFactory, TestCommonGramsQueryFilterFactory, TestGermanLightStemFilter, TestItalianLightStemFilterFactory, TestEnglishMinimalStemFilterFactory, TestDecimalDigitFilter, TestAlternateCasing, TestPatternTokenizerFactory, TestPersianCharFilter, TestSwedishLightStemFilter, TestLimitTokenCountAnalyzer, TestSoraniNormalizationFilterFactory, TestWikipediaTokenizerFactory, TestTypeTokenFilterFactory, TestPatternReplaceFilterFactory, TestCompoundWordTokenFilter, TestHyphenatedWordsFilter, TestKeepCase, TestFlagLong, TestRandomChains]
   [junit4] Completed [153/285 (1!)] on J1 in 118.91s, 2 tests, 1 error <<< FAILURES!

[...truncated 9741 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_F982B7BEA7225924-001/init-core-data-001
   [junit4]   2> 294565 WARN  (SUITE-TriggerIntegrationTest-seed#[F982B7BEA7225924]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 294565 INFO  (SUITE-TriggerIntegrationTest-seed#[F982B7BEA7225924]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 294566 INFO  (SUITE-TriggerIntegrationTest-seed#[F982B7BEA7225924]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 294567 INFO  (SUITE-TriggerIntegrationTest-seed#[F982B7BEA7225924]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 294567 INFO  (SUITE-TriggerIntegrationTest-seed#[F982B7BEA7225924]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_F982B7BEA7225924-001/tempDir-001
   [junit4]   2> 294568 INFO  (SUITE-TriggerIntegrationTest-seed#[F982B7BEA7225924]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 294568 INFO  (Thread-850) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 294568 INFO  (Thread-850) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 294575 ERROR (Thread-850) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 294668 INFO  (SUITE-TriggerIntegrationTest-seed#[F982B7BEA7225924]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:55487
   [junit4]   2> 294672 INFO  (zkConnectionManagerCallback-887-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 294678 INFO  (jetty-launcher-884-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 294688 INFO  (jetty-launcher-884-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 294688 INFO  (jetty-launcher-884-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 294688 INFO  (jetty-launcher-884-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 294688 INFO  (jetty-launcher-884-thread-2) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 294688 INFO  (jetty-launcher-884-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 294688 INFO  (jetty-launcher-884-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 294688 INFO  (jetty-launcher-884-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1c4deccd{/solr,null,AVAILABLE}
   [junit4]   2> 294688 INFO  (jetty-launcher-884-thread-1) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 294689 INFO  (jetty-launcher-884-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5f789514{/solr,null,AVAILABLE}
   [junit4]   2> 294694 INFO  (jetty-launcher-884-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@10208b4e{SSL,[ssl, http/1.1]}{127.0.0.1:50137}
   [junit4]   2> 294694 INFO  (jetty-launcher-884-thread-2) [    ] o.e.j.s.Server Started @297153ms
   [junit4]   2> 294695 INFO  (jetty-launcher-884-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=50137}
   [junit4]   2> 294695 ERROR (jetty-launcher-884-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 294695 INFO  (jetty-launcher-884-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 294695 INFO  (jetty-launcher-884-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 294695 INFO  (jetty-launcher-884-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 294695 INFO  (jetty-launcher-884-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-22T03:49:32.227Z
   [junit4]   2> 294695 INFO  (jetty-launcher-884-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@202e7f96{SSL,[ssl, http/1.1]}{127.0.0.1:48012}
   [junit4]   2> 294696 INFO  (jetty-launcher-884-thread-1) [    ] o.e.j.s.Server Started @297155ms
   [junit4]   2> 294696 INFO  (jetty-launcher-884-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=48012}
   [junit4]   2> 294696 ERROR (jetty-launcher-884-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 294696 INFO  (jetty-launcher-884-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 294696 INFO  (jetty-launcher-884-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 294696 INFO  (jetty-launcher-884-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 294696 INFO  (jetty-launcher-884-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-22T03:49:32.228Z
   [junit4]   2> 294712 INFO  (zkConnectionManagerCallback-889-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 294713 INFO  (jetty-launcher-884-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 294720 INFO  (zkConnectionManagerCallback-891-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 294721 INFO  (jetty-launcher-884-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 294738 INFO  (jetty-launcher-884-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55487/solr
   [junit4]   2> 294741 INFO  (jetty-launcher-884-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55487/solr
   [junit4]   2> 294751 INFO  (zkConnectionManagerCallback-896-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 294751 INFO  (zkConnectionManagerCallback-899-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 294764 INFO  (zkConnectionManagerCallback-901-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 294768 INFO  (zkConnectionManagerCallback-903-thread-1-processing-n:127.0.0.1:48012_solr) [n:127.0.0.1:48012_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 294854 INFO  (jetty-launcher-884-thread-1) [n:127.0.0.1:48012_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 294854 INFO  (jetty-launcher-884-thread-2) [n:127.0.0.1:50137_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 294854 INFO  (jetty-launcher-884-thread-1) [n:127.0.0.1:48012_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:48012_solr
   [junit4]   2> 294855 INFO  (jetty-launcher-884-thread-2) [n:127.0.0.1:50137_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50137_solr
   [junit4]   2> 294855 INFO  (jetty-launcher-884-thread-1) [n:127.0.0.1:48012_solr    ] o.a.s.c.Overseer Overseer (id=73337071671443462-127.0.0.1:48012_solr-n_0000000000) starting
   [junit4]   2> 294868 INFO  (zkCallback-902-thread-1-processing-n:127.0.0.1:48012_solr) [n:127.0.0.1:48012_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 294872 INFO  (zkCallback-900-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 294901 INFO  (jetty-launcher-884-thread-1) [n:127.0.0.1:48012_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48012_solr
   [junit4]   2> 294902 DEBUG (OverseerAutoScalingTriggerThread-73337071671443462-127.0.0.1:48012_solr-n_0000000000) [n:127.0.0.1:48012_solr    ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 294903 INFO  (zkCallback-900-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 294903 INFO  (zkCallback-902-thread-1-processing-n:127.0.0.1:48012_solr) [n:127.0.0.1:48012_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 294904 DEBUG (OverseerAutoScalingTriggerThread-73337071671443462-127.0.0.1:48012_solr-n_0000000000) [n:127.0.0.1:48012_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 294904 DEBUG (OverseerAutoScalingTriggerThread-73337071671443462-127.0.0.1:48012_solr-n_0000000000) [n:127.0.0.1:48012_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:48012_solr, 127.0.0.1:50137_solr]
   [junit4]   2> 294905 DEBUG (OverseerAutoScalingTriggerThread-73337071671443462-127.0.0.1:48012_solr-n_0000000000) [n:127.0.0.1:48012_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 294905 DEBUG (OverseerAutoScalingTriggerThread-73337071671443462-127.0.0.1:48012_solr-n_0000000000) [n:127.0.0.1:48012_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 294912 DEBUG (OverseerAutoScalingTriggerThread-73337071671443462-127.0.0.1:48012_solr-n_0000000000) [n:127.0.0.1:48012_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 294912 DEBUG (OverseerAutoScalingTriggerThread-73337071671443462-127.0.0.1:48012_solr-n_0000000000) [n:127.0.0.1:48012_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 294916 DEBUG (ScheduledTrigger-1246-thread-1) [n:127.0.0.1:48012_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 294986 INFO  (jetty-launcher-884-thread-2) [n:127.0.0.1:50137_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50137.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@51d6ce35
   [junit4]   2> 294989 INFO  (jetty-launcher-884-thread-1) [n:127.0.0.1:48012_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48012.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@51d6ce35
   [junit4]   2> 294996 INFO  (jetty-launcher-884-thread-2) [n:127.0.0.1:50137_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50137.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@51d6ce35
   [junit4]   2> 294996 INFO  (jetty-launcher-884-thread-2) [n:127.0.0.1:50137_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50137.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@51d6ce35
   [junit4]   2> 294997 INFO  (jetty-launcher-884-thread-1) [n:127.0.0.1:48012_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48012.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@51d6ce35
   [junit4]   2> 294997 INFO  (jetty-launcher-884-thread-2) [n:127.0.0.1:50137_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_F982B7BEA7225924-001/tempDir-001/node2/.
   [junit4]   2> 294999 INFO  (jetty-launcher-884-thread-1) [n:127.0.0.1:48012_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48012.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@51d6ce35
   [junit4]   2> 295000 INFO  (jetty-launcher-884-thread-1) [n:127.0.0.1:48012_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_F982B7BEA7225924-001/tempDir-001/node1/.
   [junit4]   2> 295047 INFO  (zkConnectionManagerCallback-909-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 295051 INFO  (zkConnectionManagerCallback-913-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 295052 INFO  (SUITE-TriggerIntegrationTest-seed#[F982B7BEA7225924]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 295052 INFO  (SUITE-TriggerIntegrationTest-seed#[F982B7BEA7225924]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:55487/solr ready
   [junit4]   2> 295069 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testNodeAddedTrigger
   [junit4]   2> 295102 INFO  (qtp326589519-3548) [n:127.0.0.1:48012_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 295109 INFO  (qtp326589519-3548) [n:127.0.0.1:48012_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=7
   [junit4]   2> 295113 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.c.a.ScheduledTriggers -- removing trigger: .auto_add_replicas
   [junit4]   2> 295114 DEBUG (zkCallback-902-thread-1-processing-n:127.0.0.1:48012_solr) [n:127.0.0.1:48012_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
   [junit4]   2> 295114 DEBUG (OverseerAutoScalingTriggerThread-73337071671443462-127.0.0.1:48012_solr-n_0000000000) [n:127.0.0.1:48012_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 295115 DEBUG (OverseerAutoScalingTriggerThread-73337071671443462-127.0.0.1:48012_solr-n_0000000000) [n:127.0.0.1:48012_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 295115 DEBUG (OverseerAutoScalingTriggerThread-73337071671443462-127.0.0.1:48012_solr-n_0000000000) [n:127.0.0.1:48012_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 295115 DEBUG (OverseerAutoScalingTriggerThread-73337071671443462-127.0.0.1:48012_solr-n_0000000000) [n:127.0.0.1:48012_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 295115 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 2
   [junit4]   2> 295116 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 295117 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@202e7f96{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 295117 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1052138497
   [junit4]   2> 295117 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 295118 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4c0cb1: rootName = solr_48012, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@20e3969b
   [junit4]   2> 295123 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 295123 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@20590504: rootName = solr_48012, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@67ee75a1
   [junit4]   2> 295127 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 295127 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6b95a740: rootName = solr_48012, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@c7cf966
   [junit4]   2> 295128 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:48012_solr
   [junit4]   2> 295129 INFO  (zkCallback-902-thread-1-processing-n:127.0.0.1:48012_solr) [n:127.0.0.1:48012_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 295130 INFO  (zkCallback-900-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 295130 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 295130 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 295140 INFO  (zkCallback-912-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 295140 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.c.Overseer Overseer (id=73337071671443462-127.0.0.1:48012_solr-n_0000000000) closing
   [junit4]   2> 295141 INFO  (OverseerStateUpdate-73337071671443462-127.0.0.1:48012_solr-n_0000000000) [n:127.0.0.1:48012_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:48012_solr
   [junit4]   2> 295141 WARN  (OverseerAutoScalingTriggerThread-73337071671443462-127.0.0.1:48012_solr-n_0000000000) [n:127.0.0.1:48012_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 295147 DEBUG (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 295148 INFO  (zkCallback-900-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:50137_solr
   [junit4]   2> 295148 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5f789514{/solr,null,UNAVAILABLE}
   [junit4]   2> 295148 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 295149 INFO  (zkCallback-900-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.Overseer Overseer (id=73337071671443461-127.0.0.1:50137_solr-n_0000000001) starting
   [junit4]   2> 295159 INFO  (zkCallback-912-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 295159 DEBUG (OverseerAutoScalingTriggerThread-73337071671443461-127.0.0.1:50137_solr-n_0000000001) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 295160 DEBUG (OverseerAutoScalingTriggerThread-73337071671443461-127.0.0.1:50137_solr-n_0000000001) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
   [junit4]   2> 295160 DEBUG (OverseerAutoScalingTriggerThread-73337071671443461-127.0.0.1:50137_solr-n_0000000001) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:50137_solr]
   [junit4]   2> 295160 DEBUG (OverseerAutoScalingTriggerThread-73337071671443461-127.0.0.1:50137_solr-n_0000000001) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion -1
   [junit4]   2> 295160 DEBUG (OverseerAutoScalingTriggerThread-73337071671443461-127.0.0.1:50137_solr-n_0000000001) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 295162 DEBUG (OverseerAutoScalingTriggerThread-73337071671443461-127.0.0.1:50137_solr-n_0000000001) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 295162 DEBUG (OverseerAutoScalingTriggerThread-73337071671443461-127.0.0.1:50137_solr-n_0000000001) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 295163 DEBUG (ScheduledTrigger-1255-thread-1) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 296163 DEBUG (ScheduledTrigger-1255-thread-1) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 297164 DEBUG (ScheduledTrigger-1255-thread-2) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 298164 DEBUG (ScheduledTrigger-1255-thread-1) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 299164 DEBUG (ScheduledTrigger-1255-thread-1) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 300151 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 300151 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 300151 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 300151 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 300152 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6aa46f6{/solr,null,AVAILABLE}
   [junit4]   2> 300152 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6b8410bb{SSL,[ssl, http/1.1]}{127.0.0.1:58479}
   [junit4]   2> 300152 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.e.j.s.Server Started @302612ms
   [junit4]   2> 300152 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=58479}
   [junit4]   2> 300153 ERROR (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 300153 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 300153 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 300153 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 300153 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-22T03:49:37.685Z
   [junit4]   2> 300162 INFO  (zkConnectionManagerCallback-916-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 300162 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 300165 DEBUG (ScheduledTrigger-1255-thread-1) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 300169 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55487/solr
   [junit4]   2> 300171 INFO  (zkConnectionManagerCallback-920-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 300196 INFO  (zkConnectionManagerCallback-922-thread-1-processing-n:127.0.0.1:58479_solr) [n:127.0.0.1:58479_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 300202 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [n:127.0.0.1:58479_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 300204 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [n:127.0.0.1:58479_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 300205 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [n:127.0.0.1:58479_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58479_solr
   [junit4]   2> 300212 INFO  (zkCallback-900-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 300212 INFO  (zkCallback-921-thread-1-processing-n:127.0.0.1:58479_solr) [n:127.0.0.1:58479_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 300212 INFO  (zkCallback-912-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 300212 INFO  (zkCallback-912-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 300288 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [n:127.0.0.1:58479_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_58479.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@51d6ce35
   [junit4]   2> 300296 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [n:127.0.0.1:58479_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_58479.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@51d6ce35
   [junit4]   2> 300296 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [n:127.0.0.1:58479_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_58479.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@51d6ce35
   [junit4]   2> 300297 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [n:127.0.0.1:58479_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_F982B7BEA7225924-001/tempDir-001/node3/.
   [junit4]   2> 300386 INFO  (qtp1077474312-3543) [n:127.0.0.1:50137_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=8
   [junit4]   2> 300416 INFO  (qtp1332162489-3615) [n:127.0.0.1:58479_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 300418 DEBUG (qtp1077474312-3540) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 300419 INFO  (qtp1077474312-3540) [n:127.0.0.1:50137_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=59
   [junit4]   2> 300419 DEBUG (zkCallback-900-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
   [junit4]   2> 300424 DEBUG (zkCallback-900-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:50137_solr, 127.0.0.1:58479_solr]
   [junit4]   2> 300426 DEBUG (zkCallback-900-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:50137_solr, 127.0.0.1:58479_solr]
   [junit4]   2> 300426 DEBUG (zkCallback-900-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=2, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
   [junit4]   2> 300426 DEBUG (OverseerAutoScalingTriggerThread-73337071671443461-127.0.0.1:50137_solr-n_0000000001) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> 300428 INFO  (OverseerAutoScalingTriggerThread-73337071671443461-127.0.0.1:50137_solr-n_0000000001) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
   [junit4]   2> 300429 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 300430 DEBUG (OverseerAutoScalingTriggerThread-73337071671443461-127.0.0.1:50137_solr-n_0000000001) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 300431 DEBUG (ScheduledTrigger-1255-thread-3) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 300431 DEBUG (ScheduledTrigger-1255-thread-3) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 300432 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 300432 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 300432 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 300433 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2359b2a6{/solr,null,AVAILABLE}
   [junit4]   2> 300433 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2aa70b20{SSL,[ssl, http/1.1]}{127.0.0.1:33393}
   [junit4]   2> 300433 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.e.j.s.Server Started @302893ms
   [junit4]   2> 300433 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33393}
   [junit4]   2> 300434 ERROR (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 300434 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 300434 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 300434 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 300434 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-22T03:49:37.966Z
   [junit4]   2> 300440 INFO  (zkConnectionManagerCallback-926-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 300441 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 300465 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55487/solr
   [junit4]   2> 300468 INFO  (zkConnectionManagerCallback-930-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 300473 INFO  (zkConnectionManagerCallback-932-thread-1-processing-n:127.0.0.1:33393_solr) [n:127.0.0.1:33393_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 300478 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [n:127.0.0.1:33393_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 300480 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [n:127.0.0.1:33393_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 300482 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [n:127.0.0.1:33393_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33393_solr
   [junit4]   2> 300483 INFO  (zkCallback-921-thread-1-processing-n:127.0.0.1:58479_solr) [n:127.0.0.1:58479_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 300483 INFO  (zkCallback-912-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 300483 INFO  (zkCallback-912-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 300488 INFO  (zkCallback-900-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 300496 INFO  (zkCallback-931-thread-1-processing-n:127.0.0.1:33393_solr) [n:127.0.0.1:33393_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 300558 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [n:127.0.0.1:33393_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33393.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@51d6ce35
   [junit4]   2> 300567 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [n:127.0.0.1:33393_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33393.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@51d6ce35
   [junit4]   2> 300567 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [n:127.0.0.1:33393_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33393.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@51d6ce35
   [junit4]   2> 300569 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [n:127.0.0.1:33393_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_F982B7BEA7225924-001/tempDir-001/node4/.
   [junit4]   2> 301165 DEBUG (ScheduledTrigger-1255-thread-2) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 301433 DEBUG (ScheduledTrigger-1255-thread-1) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 301433 DEBUG (ScheduledTrigger-1255-thread-1) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 301433 DEBUG (ScheduledTrigger-1255-thread-1) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:33393_solr at time 19523286184971025
   [junit4]   2> 302166 DEBUG (ScheduledTrigger-1255-thread-4) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 302435 DEBUG (ScheduledTrigger-1255-thread-4) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 302435 DEBUG (ScheduledTrigger-1255-thread-4) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 303166 DEBUG (ScheduledTrigger-1255-thread-2) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 303435 DEBUG (ScheduledTrigger-1255-thread-2) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 303435 DEBUG (ScheduledTrigger-1255-thread-2) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 303435 DEBUG (ScheduledTrigger-1255-thread-2) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger firing registered processor for nodes: [127.0.0.1:33393_solr] added at times [19523286184971025], now=19523288187573179
   [junit4]   2> 303438 DEBUG (ScheduledTrigger-1255-thread-2) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"455c5349e74b11Tbgvr7hdentdifvxkzuxq6x2l4",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":19523286184971025,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[19523286184971025],
   [junit4]   2>     "nodeNames":["127.0.0.1:33393_solr"]}}
   [junit4]   2> 303444 DEBUG (ScheduledTrigger-1255-thread-2) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, node_added_trigger]
   [junit4]   2> 303447 INFO  (ScheduledTrigger-1255-thread-2) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
   [junit4]   2> 303453 DEBUG (AutoscalingActionExecutor-1256-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"455c5349e74b11Tbgvr7hdentdifvxkzuxq6x2l4",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":19523286184971025,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[19523286184971025],
   [junit4]   2>     "_enqueue_time_":19523288197241165,
   [junit4]   2>     "nodeNames":["127.0.0.1:33393_solr"]}}
   [junit4]   2> 303474 DEBUG (AutoscalingActionExecutor-1256-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 5000ms
   [junit4]   2> 303475 DEBUG (AutoscalingActionExecutor-1256-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger after 5000ms
   [junit4]   2> 303475 DEBUG (AutoscalingActionExecutor-1256-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 22 ms for event id=455c5349e74b11Tbgvr7hdentdifvxkzuxq6x2l4
   [junit4]   2> 303495 INFO  (qtp2134324161-3636) [n:127.0.0.1:33393_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 303497 INFO  (qtp1077474312-3540) [n:127.0.0.1:50137_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 303506 INFO  (qtp1332162489-3616) [n:127.0.0.1:58479_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 303507 DEBUG (qtp2134324161-3639) [n:127.0.0.1:33393_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 303507 INFO  (qtp2134324161-3639) [n:127.0.0.1:33393_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=16
   [junit4]   2> 303508 DEBUG (zkCallback-900-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
   [junit4]   2> 303508 DEBUG (zkCallback-900-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33393_solr, 127.0.0.1:50137_solr, 127.0.0.1:58479_solr]
   [junit4]   2> 303508 DEBUG (zkCallback-900-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:33393_solr, 127.0.0.1:50137_solr, 127.0.0.1:58479_solr]
   [junit4]   2> 303508 DEBUG (zkCallback-900-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=2, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
   [junit4]   2> 303508 DEBUG (OverseerAutoScalingTriggerThread-73337071671443461-127.0.0.1:50137_solr-n_0000000001) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
   [junit4]   2> 303509 DEBUG (OverseerAutoScalingTriggerThread-73337071671443461-127.0.0.1:50137_solr-n_0000000001) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
   [junit4]   2> 305508 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F982B7BEA7225924]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testNodeAddedTrigger
   [junit4]   2> 305531 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[F982B7BEA7225924]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testEventFromRestoredState
   [junit4]   2> 305532 INFO  (qtp2134324161-3641) [n:127.0.0.1:33393_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 305543 INFO  (qtp2134324161-3641) [n:127.0.0.1:33393_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=10
   [junit4]   2> 305548 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[F982B7BEA7225924]) [    ] o.a.s.c.a.ScheduledTriggers -- removing trigger: .auto_add_replicas
   [junit4]   2> 305549 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[F982B7BEA7225924]) [    ] o.a.s.c.a.ScheduledTriggers -- removing trigger: node_added_trigger
   [junit4]   2> 305549 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[F982B7BEA7225924]) [    ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 6
   [junit4]   2> 305550 DEBUG (zkCallback-900-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
   [junit4]   2> 305550 DEBUG (OverseerAutoScalingTriggerThread-73337071671443461-127.0.0.1:50137_solr-n_0000000001) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
   [junit4]   2> 305550 DEBUG (OverseerAutoScalingTriggerThread-73337071671443461-127.0.0.1:50137_solr-n_0000000001) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 305550 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[F982B7BEA7225924]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 305550 DEBUG (OverseerAutoScalingTriggerThread-73337071671443461-127.0.0.1:50137_solr-n_0000000001) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 305551 DEBUG (OverseerAutoScalingTriggerThread-73337071671443461-127.0.0.1:50137_solr-n_0000000001) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
   [junit4]   2> 305556 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[F982B7BEA7225924]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@10208b4e{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 305559 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[F982B7BEA7225924]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1669602204
   [junit4]   2> 305559 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[F982B7BEA7225924]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 305560 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[F982B7BEA7225924]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6d0e1636: rootName = solr_50137, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@47b256bd
   [junit4]   2> 305566 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[F982B7BEA7225924]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 305566 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[F982B7BEA7225924]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@21e73b99: rootName = solr_50137, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@67ee75a1
   [junit4]   2> 305570 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[F982B7BEA7225924]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 305570 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[F982B7BEA7225924]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5eb67dd7: rootName = solr_50137, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@c7cf966
   [junit4]   2> 305571 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[F982B7BEA7225924]) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:50137_solr
   [junit4]   2> 305572 INFO  (zkCallback-931-thread-1-processing-n:127.0.0.1:33393_solr) [n:127.0.0.1:33393_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 305572 INFO  (zkCallback-921-thread-1-processing-n:127.0.0.1:58479_solr) [n:127.0.0.1:58479_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 305572 INFO  (zkCallback-912-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 305573 INFO  (zkCallback-912-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 305573 INFO  (zkCallback-900-thread-1-processing-n:127.0.0.1:50137_solr) [n:127.0.0.1:50137_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 305573 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[F982B7BEA7225924]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 305573 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[F982B7BEA7225924]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 305573 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[F982B7BEA7225924]) [    ] o.a.s.c.Overseer Overseer (id=73337071671443461-127.0.0.1:50137_solr-n_0000000001) closing
   [junit4]   2> 305573 INFO  (OverseerStateUpdate-73337071671443461-127.0.0.1:50137_solr-n_0000000001) [n:127.0.0.1:50137_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:50137_solr
   [junit4]   2> 305574 WARN  (OverseerAutoScalingTriggerThread-73337071671443461-127.0.0.1:50137_solr-n_0000000001) [n:127.0.0.1:50137_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 305574 DEBUG (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[F982B7BEA7225924]) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 305582 INFO  (zkCallback-921-thread-1-processing-n:127.0.0.1:58479_solr) [n:127.0.0.1:58479_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:58479_solr
   [junit4]   2> 305583 INFO  (zkCallback-921-thread-1-processing-n:127.0.0.1:58479_solr) [n:127.0.0.1:58479_solr    ] o.a.s.c.Overseer Overseer (id=73337071671443467-127.0.0.1:58479_solr-n_0000000002) starting
   [junit4]   2> 305585 INFO  (zkCallback-912-thread-3) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 305593 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[F982B7BEA7225924]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1c4deccd{/solr,null,UNAVAILABLE}
   [junit4]   2> 305593 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[F982B7BEA7225924]) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 305594 DEBUG (OverseerAutoScalingTriggerThread-73337071671443467-127.0.0.1:58479_solr-n_0000000002) [n:127.0.0.1:58479_solr    ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 305594 DEBUG (OverseerAutoScalingTriggerThread-73337071671443467-127.0.0.1:58479_solr-n_0000000002) [n:127.0.0.1:58479_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7
   [junit4]   2> 305595 DEBUG (OverseerAutoScalingTriggerThread-73337071671443467-127.0.0.1:58479_solr-n_0000000002) [n:127.0.0.1:58479_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33393_solr, 127.0.0.1:58479_solr]
   [junit4]   2> 305595 DEBUG (OverseerAutoScalingTriggerThread-73337071671443467-127.0.0.1:58479_solr-n_0000000002) [n:127.0.0.1:58479_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion -1
   [junit4]   2> 305595 DEBUG (OverseerAutoScalingTriggerThread-73337071671443467-127.0.0.1:58479_solr-n_0000000002) [n:127.0.0.1:58479_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
   [junit4]   2> 305600 DEBUG (OverseerAutoScalingTriggerThread-73337071671443467-127.0.0.1:58479_solr-n_0000000002) [n:127.0.0.1:58479_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 305600 DEBUG (OverseerAutoScalingTriggerThread-73337071671443467-127.0.0.1:58479_solr-n_0000000002) [n:127.0.0.1:58479_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
   [junit4]   2> 305600 DEBUG (ScheduledTrigger-1272-thread-1) [n:127.0.0.1:58479_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 306601 DEBUG (ScheduledTrigger-1272-thread-1) [n:127.0.0.1:58479_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 307602 DEBUG (ScheduledTrigger-1272-thread-2) [n:127.0.0.1:58479_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 308602 DEBUG (ScheduledTrigger-1272-thread-1) [n:127.0.0.1:58479_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 309602 DEBUG (ScheduledTrigger-1272-thread-1) [n:127.0.0.1:58479_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 310602 INFO  (qtp2134324161-3643) [n:127.0.0.1:33393_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
   [junit4]   2> 310603 DEBUG (ScheduledTrigger-1272-thread-1) [n:127.0.0.1:58479_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 310607 INFO  (qtp1332162489-3615) [n:127.0.0.1:58479_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 310608 DEBUG (qtp2134324161-3639) [n:127.0.0.1:33393_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 310610 INFO  (qtp2134324161-3639) [n:127.0.0.1:33393_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=11
   [junit4]   2> 310610 DEBUG (zkCallback-921-thread-1-processing-n:127.0.0.1:58479_solr) [n:127.0.0.1:58479_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 8
   [junit4]   2> 310611 DEBUG (zkCallback-921-thread-1-processing-n:127.0.0.1:58479_solr) [n:127.0.0.1:58479_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:33393_solr, 127.0.0.1:58479_solr]
   [junit4]   2> 310611 DEBUG (zkCallback-921-thread-1-processing-n:127.0.0.1:58479_solr) [n:127.0.0.1:58479_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerEFRS instantiated with properties: {event=nodeAdded, waitFor=10, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
   [junit4]   2> 310611 DEBUG (zkCallback-921-thread-1-processing-n:127.0.0.1:58479_solr) [n:127.0.0.1:58479_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33393_solr, 127.0.0.1:58479_solr]
   [junit4]   2> 310611 DEBUG (OverseerAutoScalingTriggerThread-73337071671443467-127.0.0.1:58479_solr-n_0000000002) [n:127.0.0.1:58479_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 8
   [junit4]   2> 310614 INFO  (OverseerAutoScalingTriggerThread-73337071671443467-127.0.0.1:58479_solr-n_0000000002) [n:127.0.0.1:58479_solr    ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
   [junit4]   2> 310614

[...truncated too long message...]

Tests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_F982B7BEA7225924-001/tempDir-001/hdfsBaseDir/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_F982B7BEA7225924-001/tempDir-001/hdfsBaseDir/data/data2/]]  heartbeating to localhost/127.0.0.1:41537) [    ] o.a.h.h.s.d.IncrementalBlockReportManager IncrementalBlockReportManager interrupted
   [junit4]   2> 4543399 WARN  (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_F982B7BEA7225924-001/tempDir-001/hdfsBaseDir/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_F982B7BEA7225924-001/tempDir-001/hdfsBaseDir/data/data2/]]  heartbeating to localhost/127.0.0.1:41537) [    ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool BP-104772299-10.41.0.5-1519275540093 (Datanode Uuid b3ddc592-a7e2-4cbf-b240-42c510692582) service to localhost/127.0.0.1:41537
   [junit4]   2> 4543408 INFO  (SUITE-HdfsBasicDistributedZkTest-seed#[F982B7BEA7225924]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_F982B7BEA7225924-001
   [junit4]   2> Feb 22, 2018 5:00:20 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 21 leaked thread(s).
   [junit4]   2> Feb 22, 2018 5:00:41 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 3 threads leaked from SUITE scope at org.apache.solr.cloud.hdfs.HdfsBasicDistributedZkTest: 
   [junit4]   2>    1) Thread[id=48716, name=Connection evictor, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZkTest]
   [junit4]   2>         at java.lang.Thread.sleep(Native Method)
   [junit4]   2>         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2>    2) Thread[id=48724, name=Connection evictor, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZkTest]
   [junit4]   2>         at java.lang.Thread.sleep(Native Method)
   [junit4]   2>         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2>    3) Thread[id=48734, name=Connection evictor, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZkTest]
   [junit4]   2>         at java.lang.Thread.sleep(Native Method)
   [junit4]   2>         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Feb 22, 2018 5:00:41 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=48716, name=Connection evictor, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZkTest]
   [junit4]   2>    2) Thread[id=48724, name=Connection evictor, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZkTest]
   [junit4]   2>    3) Thread[id=48734, name=Connection evictor, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZkTest]
   [junit4]   2> Feb 22, 2018 5:00:41 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: All leaked threads terminated.
   [junit4]   2> NOTE: test params are: codec=Lucene70, sim=RandomSimilarity(queryNorm=true): {}, locale=en-GB, timezone=America/Indiana/Marengo
   [junit4]   2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=2,free=226443792,total=516423680
   [junit4]   2> NOTE: All tests run in this JVM: [SOLR749Test, BasicZkTest, ShardRoutingCustomTest, TestSystemIdResolver, TestLRUCache, DistributedFacetPivotLargeTest, TestNumericRangeQuery64, QueryParsingTest, SystemInfoHandlerTest, TestRestManager, BadCopyFieldTest, TestXIncludeConfig, AsyncCallRequestStatusResponseTest, PathHierarchyTokenizerFactoryTest, HdfsDirectoryFactoryTest, ComputePlanActionTest, HdfsCollectionsAPIDistributedZkTest, SaslZkACLProviderTest, TestDynamicFieldCollectionResource, ZkStateReaderTest, TestJavabinTupleStreamParser, InfixSuggestersTest, TestSystemCollAutoCreate, SuggesterFSTTest, RestartWhileUpdatingTest, CurrencyFieldTypeTest, TestSchemaManager, TestFieldCache, TestTrie, FastVectorHighlighterTest, SolrCoreTest, SpatialHeatmapFacetsTest, ZkControllerTest, SampleTest, AutoAddReplicasIntegrationTest, DistributedFacetPivotSmallTest, TestPivotHelperCode, TestSearchPerf, SolrIndexMetricsTest, TestStressVersions, TestRTGBase, TestZkChroot, TestInfoStreamLogging, DirectUpdateHandlerOptimizeTest, SolrJmxReporterTest, TestJettySolrRunner, TestCoreBackup, TestDistribIDF, TestCloudDeleteByQuery, PrimitiveFieldTypeTest, BlockCacheTest, TestSurroundQueryParser, HdfsRecoveryZkTest, CSVRequestHandlerTest, JvmMetricsTest, TestPolicyCloud, ZkFailoverTest, MetricUtilsTest, HdfsThreadLeakTest, TestReloadAndDeleteDocs, TestMacroExpander, BitVectorTest, CdcrUpdateLogTest, HLLSerializationTest, TestSchemaVersionResource, HdfsWriteToMultipleCollectionsTest, SyncSliceTest, TestImpersonationWithHadoopAuth, TestSubQueryTransformerDistrib, SignatureUpdateProcessorFactoryTest, HighlighterTest, TestDistributedStatsComponentCardinality, DOMUtilTest, TestConfigSets, ResourceLoaderTest, PreAnalyzedUpdateProcessorTest, DocValuesNotIndexedTest, TestRecovery, TestRuleBasedAuthorizationPlugin, TestUninvertingReader, TestFieldSortValues, BlockJoinFacetSimpleTest, DistribJoinFromCollectionTest, AutoscalingHistoryHandlerTest, SolrMetricManagerTest, TestCollationFieldDocValues, UpdateLogTest, TestSolrFieldCacheBean, TestRandomRequestDistribution, JsonLoaderTest, DocumentBuilderTest, SolrCloudExampleTest, TestPartialUpdateDeduplication, FileUtilsTest, BJQParserTest, TestLRUStatsCache, LegacyCloudClusterPropTest, TestClassicSimilarityFactory, DistributedQueryComponentOptimizationTest, TestMiniSolrCloudClusterSSL, TestEmbeddedSolrServerAdminHandler, QueryEqualityTest, TlogReplayBufferedWhileIndexingTest, TestStressInPlaceUpdates, LoggingHandlerTest, TestCollectionAPI, TestLeaderElectionZkExpiry, TestSolrCLIRunExample, TestDownShardTolerantSearch, SchemaVersionSpecificBehaviorTest, AtomicUpdateProcessorFactoryTest, DistributedIntervalFacetingTest, TestComplexPhraseLeadingWildcard, TestSolrCoreSnapshots, TestMaxScoreQueryParser, OverriddenZkACLAndCredentialsProvidersTest, TestLegacyTerms, TestComputePlanAction, AddReplicaTest, TestManagedSchemaAPI, SmileWriterTest, TestHashQParserPlugin, StatsReloadRaceTest, AlternateDirectoryTest, TestFieldResource, TestManagedStopFilterFactory, DeleteStatusTest, CdcrBootstrapTest, BasicDistributedZkTest, MigrateRouteKeyTest, MoveReplicaHDFSTest, SolrXmlInZkTest, TestAuthenticationFramework, TestCloudPivotFacet, TestClusterProperties, TestConfigSetsAPI, TestConfigSetsAPIZkFailure, TestDistribDocBasedVersion, TestLockTree, TestOnReconnectListenerSupport, TestPullReplicaErrorHandling, TestSSLRandomization, TestSegmentSorting, TestSolrCloudWithKerberosAlt, TestTolerantUpdateProcessorCloud, TestUtilizeNode, AssignTest, CollectionReloadTest, CollectionsAPIDistributedZkTest, TestHdfsCloudBackupRestore, AutoAddReplicasPlanActionTest, NodeLostTriggerTest, TestTriggerIntegration, CdcrReplicationHandlerTest, HdfsBasicDistributedZkTest]
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HdfsBasicDistributedZkTest -Dtests.seed=F982B7BEA7225924 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/test-data/enwiki.random.lines.txt -Dtests.locale=en-GB -Dtests.timezone=America/Indiana/Marengo -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J1 | HdfsBasicDistributedZkTest (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.hdfs.HdfsBasicDistributedZkTest: 
   [junit4]    >    1) Thread[id=48716, name=Connection evictor, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZkTest]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    >    2) Thread[id=48724, name=Connection evictor, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZkTest]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    >    3) Thread[id=48734, name=Connection evictor, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZkTest]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([F982B7BEA7225924]:0)
   [junit4] Completed [615/777 (4!)] on J1 in 101.08s, 1 test, 2 errors <<< FAILURES!

[...truncated 49010 lines...]

Mime
View raw message