lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Smiley <david.w.smi...@gmail.com>
Subject Re: [JENKINS] Lucene-Solr-NightlyTests-7.x - Build # 10 - Still unstable
Date Sat, 15 Jul 2017 19:11:44 GMT
Alan, I suspect this is related the changes you did?

On Sat, Jul 15, 2017 at 6:07 AM Apache Jenkins Server <
jenkins@builds.apache.org> wrote:

> Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-7.x/10/
>
> 3 tests failed.
> FAILED:  org.apache.lucene.spatial.DistanceStrategyTest.testRecipScore
> {strategy=serialized}
>
> Error Message:
>
>
> Stack Trace:
> java.lang.NullPointerException
>         at
> __randomizedtesting.SeedInfo.seed([B1FC2FB143140AF1:29D25F48109F000A]:0)
>         at
> org.apache.lucene.spatial.serialized.SerializedDVStrategy$ShapeDocValueSource$1.advanceExact(SerializedDVStrategy.java:186)
>         at
> org.apache.lucene.spatial.util.DistanceToShapeValueSource$1.advanceExact(DistanceToShapeValueSource.java:73)
>         at
> org.apache.lucene.search.DoubleValues$1.advanceExact(DoubleValues.java:53)
>         at
> org.apache.lucene.spatial.util.ReciprocalDoubleValuesSource$1.advanceExact(ReciprocalDoubleValuesSource.java:57)
>         at
> org.apache.lucene.spatial.StrategyTestCase.checkValueSource(StrategyTestCase.java:219)
>         at
> org.apache.lucene.spatial.DistanceStrategyTest.testRecipScore(DistanceStrategyTest.java:104)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:498)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
>         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>         at java.lang.Thread.run(Thread.java:748)
>
>
> FAILED:  org.apache.solr.update.AutoCommitTest.testMaxDocs
>
> Error Message:
> Exception during query
>
> Stack Trace:
> java.lang.RuntimeException: Exception during query
>         at
> __randomizedtesting.SeedInfo.seed([793723D4943B9E3D:C0B6F50BB8D19AB7]:0)
>         at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:878)
>         at
> org.apache.solr.update.AutoCommitTest.testMaxDocs(AutoCommitTest.java:225)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:498)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
>         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>         at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.RuntimeException: REQUEST FAILED:
> xpath=//result[@numFound=1]
>         xml response was: <?xml version="1.0" encoding="UTF-8"?>
> <response>
> <lst name="responseHeader"><int name="status">0</int><int
> name="QTime">0</int></lst><result name="response" numFound="0"
> start="0"></result>
> </response>
>
>         request was:q=id:14&qt=&start=0&rows=20&version=2.2
>         at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:871)
>         ... 40 more
>
>
> FAILED:  org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test
>
> Error Message:
> Timeout waiting for all live and active
>
> Stack Trace:
> java.lang.AssertionError: Timeout waiting for all live and active
>         at
> __randomizedtesting.SeedInfo.seed([793723D4943B9E3D:F1631C0E3AC7F3C5]:0)
>         at org.junit.Assert.fail(Assert.java:93)
>         at org.junit.Assert.assertTrue(Assert.java:43)
>         at
> org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.testBasics(SharedFSAutoReplicaFailoverTest.java:246)
>         at
> org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test(SharedFSAutoReplicaFailoverTest.java:136)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:498)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
>         at
> org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:985)
>         at
> org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
>         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>         at java.lang.Thread.run(Thread.java:748)
>
>
>
>
> Build Log:
> [...truncated 9261 lines...]
>    [junit4] Suite: org.apache.lucene.spatial.DistanceStrategyTest
>    [junit4]   2> NOTE: download the large Jenkins line-docs file by
> running 'ant get-jenkins-line-docs' in the lucene directory.
>    [junit4]   2> NOTE: reproduce with: ant test
> -Dtestcase=DistanceStrategyTest -Dtests.method=testRecipScore
> -Dtests.seed=B1FC2FB143140AF1 -Dtests.multiplier=2 -Dtests.nightly=true
> -Dtests.slow=true
> -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/test-data/enwiki.random.lines.txt
> -Dtests.locale=ar-AE -Dtests.timezone=Pacific/Chatham -Dtests.asserts=true
> -Dtests.file.encoding=US-ASCII
>    [junit4] ERROR   0.03s J0 | DistanceStrategyTest.testRecipScore
> {strategy=serialized} <<<
>    [junit4]    > Throwable #1: java.lang.NullPointerException
>    [junit4]    >        at
> __randomizedtesting.SeedInfo.seed([B1FC2FB143140AF1:29D25F48109F000A]:0)
>    [junit4]    >        at
> org.apache.lucene.spatial.serialized.SerializedDVStrategy$ShapeDocValueSource$1.advanceExact(SerializedDVStrategy.java:186)
>    [junit4]    >        at
> org.apache.lucene.spatial.util.DistanceToShapeValueSource$1.advanceExact(DistanceToShapeValueSource.java:73)
>    [junit4]    >        at
> org.apache.lucene.search.DoubleValues$1.advanceExact(DoubleValues.java:53)
>    [junit4]    >        at
> org.apache.lucene.spatial.util.ReciprocalDoubleValuesSource$1.advanceExact(ReciprocalDoubleValuesSource.java:57)
>    [junit4]    >        at
> org.apache.lucene.spatial.StrategyTestCase.checkValueSource(StrategyTestCase.java:219)
>    [junit4]    >        at
> org.apache.lucene.spatial.DistanceStrategyTest.testRecipScore(DistanceStrategyTest.java:104)
>    [junit4]    >        at java.lang.Thread.run(Thread.java:748)
>    [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70):
> {recursive_packedquad=PostingsFormat(name=MockRandom),
> recursive_quad=PostingsFormat(name=MockRandom),
> bbox__xdl=BlockTreeOrds(blocksize=128),
> termquery_geohash=PostingsFormat(name=MockRandom),
> id=BlockTreeOrds(blocksize=128)},
> docValues:{bbox__maxX=DocValuesFormat(name=Direct),
> bbox__maxY=DocValuesFormat(name=Lucene70),
> bbox__minX=DocValuesFormat(name=Asserting),
> bbox__minY=DocValuesFormat(name=Memory),
> pointvector__y=DocValuesFormat(name=Lucene70),
> pointvector__x=DocValuesFormat(name=Direct),
> serialized=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=1913,
> maxMBSortInHeap=5.545002168373545, sim=RandomSimilarity(queryNorm=true):
> {}, locale=ar-AE, timezone=Pacific/Chatham
>    [junit4]   2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation
> 1.8.0_131 (64-bit)/cpus=4,threads=1,free=291830768,total=324534272
>    [junit4]   2> NOTE: All tests run in this JVM: [SpatialPrefixTreeTest,
> NumberRangeFacetsTest, TestTermQueryPrefixGridStrategy,
> TestRecursivePrefixTreeStrategy, Geo3dShapeSphereModelRectRelationTest,
> DistanceStrategyTest]
>    [junit4] Completed [12/23 (1!)] on J0 in 0.69s, 12 tests, 1 error <<<
> FAILURES!
>
> [...truncated 2297 lines...]
>    [junit4] Suite: org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest
>    [junit4]   2> Creating dataDir:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_793723D4943B9E3D-001/init-core-data-001
>    [junit4]   2> 548632 WARN
> (SUITE-SharedFSAutoReplicaFailoverTest-seed#[793723D4943B9E3D]-worker) [
> ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=38 numCloses=38
>    [junit4]   2> 548632 INFO
> (SUITE-SharedFSAutoReplicaFailoverTest-seed#[793723D4943B9E3D]-worker) [
> ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true)
> w/NUMERIC_DOCVALUES_SYSPROP=true
>    [junit4]   2> 548634 INFO
> (SUITE-SharedFSAutoReplicaFailoverTest-seed#[793723D4943B9E3D]-worker) [
> ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via:
> @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
>    [junit4]   2> 548634 INFO
> (SUITE-SharedFSAutoReplicaFailoverTest-seed#[793723D4943B9E3D]-worker) [
> ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property:
> /ov/cn
>    [junit4]   1> Formatting using clusterid: testClusterID
>    [junit4]   2> 548849 WARN
> (SUITE-SharedFSAutoReplicaFailoverTest-seed#[793723D4943B9E3D]-worker) [
> ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried
> hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
>    [junit4]   2> 548855 WARN
> (SUITE-SharedFSAutoReplicaFailoverTest-seed#[793723D4943B9E3D]-worker) [
> ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
>    [junit4]   2> 548857 INFO
> (SUITE-SharedFSAutoReplicaFailoverTest-seed#[793723D4943B9E3D]-worker) [
> ] o.m.log jetty-6.1.26
>    [junit4]   2> 548870 INFO
> (SUITE-SharedFSAutoReplicaFailoverTest-seed#[793723D4943B9E3D]-worker) [
> ] o.m.log Extract
> jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/hdfs
> to ./temp/Jetty_localhost_56321_hdfs____.206o6d/webapp
>    [junit4]   2> 549299 INFO
> (SUITE-SharedFSAutoReplicaFailoverTest-seed#[793723D4943B9E3D]-worker) [
> ] o.m.log Started
> HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:56321
>    [junit4]   2> 549422 WARN
> (SUITE-SharedFSAutoReplicaFailoverTest-seed#[793723D4943B9E3D]-worker) [
> ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
>    [junit4]   2> 549423 INFO
> (SUITE-SharedFSAutoReplicaFailoverTest-seed#[793723D4943B9E3D]-worker) [
> ] o.m.log jetty-6.1.26
>    [junit4]   2> 549436 INFO
> (SUITE-SharedFSAutoReplicaFailoverTest-seed#[793723D4943B9E3D]-worker) [
> ] o.m.log Extract
> jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode
> to ./temp/Jetty_localhost_59355_datanode____.vqlzu2/webapp
>    [junit4]   2> 549878 INFO
> (SUITE-SharedFSAutoReplicaFailoverTest-seed#[793723D4943B9E3D]-worker) [
> ] o.m.log Started
> HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:59355
>    [junit4]   2> 549915 WARN
> (SUITE-SharedFSAutoReplicaFailoverTest-seed#[793723D4943B9E3D]-worker) [
> ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
>    [junit4]   2> 549916 INFO
> (SUITE-SharedFSAutoReplicaFailoverTest-seed#[793723D4943B9E3D]-worker) [
> ] o.m.log jetty-6.1.26
>    [junit4]   2> 549934 INFO
> (SUITE-SharedFSAutoReplicaFailoverTest-seed#[793723D4943B9E3D]-worker) [
> ] o.m.log Extract
> jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode
> to ./temp/Jetty_localhost_54759_datanode____jrk8hv/webapp
>    [junit4]   2> 550164 INFO  (IPC Server handler 4 on 49971) [    ]
> BlockStateChange BLOCK* processReport: from storage
> DS-e9ea3dbc-9113-4645-b893-130c3730ec1a node DatanodeRegistration(
> 127.0.0.1:50603, datanodeUuid=527ac2ae-b401-4d84-86e3-6f935dee3843,
> infoPort=54653, infoSecurePort=0, ipcPort=36188,
> storageInfo=lv=-56;cid=testClusterID;nsid=451575161;c=0), blocks: 0,
> hasStaleStorage: true, processing time: 0 msecs
>    [junit4]   2> 550164 INFO  (IPC Server handler 4 on 49971) [    ]
> BlockStateChange BLOCK* processReport: from storage
> DS-ada032ef-beb3-4321-b044-13278d645633 node DatanodeRegistration(
> 127.0.0.1:50603, datanodeUuid=527ac2ae-b401-4d84-86e3-6f935dee3843,
> infoPort=54653, infoSecurePort=0, ipcPort=36188,
> storageInfo=lv=-56;cid=testClusterID;nsid=451575161;c=0), blocks: 0,
> hasStaleStorage: false, processing time: 0 msecs
>    [junit4]   2> 550420 INFO
> (SUITE-SharedFSAutoReplicaFailoverTest-seed#[793723D4943B9E3D]-worker) [
> ] o.m.log Started
> HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:54759
>    [junit4]   2> 550918 INFO  (IPC Server handler 9 on 49971) [    ]
> BlockStateChange BLOCK* processReport: from storage
> DS-7b441025-265d-40cb-ac06-5e2d91c89e3b node DatanodeRegistration(
> 127.0.0.1:60224, datanodeUuid=48e239a8-7fb1-4b7a-bad7-3965b9821989,
> infoPort=45761, infoSecurePort=0, ipcPort=36307,
> storageInfo=lv=-56;cid=testClusterID;nsid=451575161;c=0), blocks: 0,
> hasStaleStorage: true, processing time: 0 msecs
>    [junit4]   2> 550918 INFO  (IPC Server handler 9 on 49971) [    ]
> BlockStateChange BLOCK* processReport: from storage
> DS-4f0f9719-f907-44eb-a680-fe795758da6b node DatanodeRegistration(
> 127.0.0.1:60224, datanodeUuid=48e239a8-7fb1-4b7a-bad7-3965b9821989,
> infoPort=45761, infoSecurePort=0, ipcPort=36307,
> storageInfo=lv=-56;cid=testClusterID;nsid=451575161;c=0), blocks: 0,
> hasStaleStorage: false, processing time: 0 msecs
>    [junit4]   2> 551053 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
>    [junit4]   2> 551060 INFO  (Thread-2097) [    ] o.a.s.c.ZkTestServer
> client port:0.0.0.0/0.0.0.0:0
>    [junit4]   2> 551060 INFO  (Thread-2097) [    ] o.a.s.c.ZkTestServer
> Starting server
>    [junit4]   2> 551075 ERROR (Thread-2097) [    ] o.a.z.s.ZooKeeperServer
> ZKShutdownHandler is not registered, so ZooKeeper server won't take any
> action on ERROR or SHUTDOWN server state changes
>    [junit4]   2> 551160 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.ZkTestServer start zk server on port:52694
>    [junit4]   2> 551179 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.AbstractZkTestCase put
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
> to /configs/conf1/solrconfig.xml
>    [junit4]   2> 551181 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.AbstractZkTestCase put
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema15.xml
> to /configs/conf1/schema.xml
>    [junit4]   2> 551183 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.AbstractZkTestCase put
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
> to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
>    [junit4]   2> 551185 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.AbstractZkTestCase put
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
> to /configs/conf1/stopwords.txt
>    [junit4]   2> 551187 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.AbstractZkTestCase put
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt
> to /configs/conf1/protwords.txt
>    [junit4]   2> 551189 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.AbstractZkTestCase put
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml
> to /configs/conf1/currency.xml
>    [junit4]   2> 551191 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.AbstractZkTestCase put
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
> to /configs/conf1/enumsConfig.xml
>    [junit4]   2> 551192 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.AbstractZkTestCase put
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
> to /configs/conf1/open-exchange-rates.json
>    [junit4]   2> 551194 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.AbstractZkTestCase put
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
> to /configs/conf1/mapping-ISOLatin1Accent.txt
>    [junit4]   2> 551196 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.AbstractZkTestCase put
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
> to /configs/conf1/old_synonyms.txt
>    [junit4]   2> 551198 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.AbstractZkTestCase put
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
> to /configs/conf1/synonyms.txt
>    [junit4]   2> 551201 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless
> explicitly asked otherwise
>    [junit4]   2> 551336 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.e.j.s.Server jetty-9.3.14.v20161028
>    [junit4]   2> 551338 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@16cae510
> {/ov/cn,null,AVAILABLE}
>    [junit4]   2> 551338 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.e.j.s.AbstractConnector Started ServerConnector@597fe4f4
> {HTTP/1.1,[http/1.1]}{127.0.0.1:41805}
>    [junit4]   2> 551338 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.e.j.s.Server Started @554231ms
>    [junit4]   2> 551338 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/ov/cn,
> hostPort=41805,
> coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_793723D4943B9E3D-001/control-001/cores}
>    [junit4]   2> 551338 ERROR
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may
> be missing or incomplete.
>    [junit4]   2> 551340 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr?
> version 7.1.0
>    [junit4]   2> 551340 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port
> null
>    [junit4]   2> 551340 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default
> config dir: null
>    [junit4]   2> 551340 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time:
> 2017-07-15T08:38:42.901Z
>    [junit4]   2> 551346 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
> ZooKeeper)
>    [junit4]   2> 551346 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.SolrXmlConfig Loading container configuration from
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_793723D4943B9E3D-001/control-001/solr.xml
>    [junit4]   2> 551352 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.SolrXmlConfig MBean server found:
> com.sun.jmx.mbeanserver.JmxMBeanServer@152e00de, but no JMX reporters
> were configured - adding default JMX reporter.
>    [junit4]   2> 551355 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52694/solr
>    [junit4]   2> 551468 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:41805_ov%2Fcn    ] o.a.s.c.Overseer Overseer (id=null)
> closing
>    [junit4]   2> 551469 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:41805_ov%2Fcn    ] o.a.s.c.OverseerElectionContext I am
> going to be the leader 127.0.0.1:41805_ov%2Fcn
>    [junit4]   2> 551470 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:41805_ov%2Fcn    ] o.a.s.c.Overseer Overseer
> (id=98311072817348612-127.0.0.1:41805_ov%2Fcn-n_0000000000) starting
>    [junit4]   2> 551480 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:41805_ov%2Fcn    ] o.a.s.c.ZkController Register node as
> live in ZooKeeper:/live_nodes/127.0.0.1:41805_ov%2Fcn
>    [junit4]   2> 551482 INFO
> (zkCallback-337-thread-1-processing-n:127.0.0.1:41805_ov%2Fcn)
> [n:127.0.0.1:41805_ov%2Fcn    ] o.a.s.c.c.ZkStateReader Updated live
> nodes from ZooKeeper... (0) -> (1)
>    [junit4]   2> 551605 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:41805_ov%2Fcn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring
> for 'solr.node' (registry 'solr.node') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@152e00de
>    [junit4]   2> 551613 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:41805_ov%2Fcn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring
> for 'solr.jvm' (registry 'solr.jvm') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@152e00de
>    [junit4]   2> 551613 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:41805_ov%2Fcn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring
> for 'solr.jetty' (registry 'solr.jetty') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@152e00de
>    [junit4]   2> 551615 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:41805_ov%2Fcn    ] o.a.s.c.CorePropertiesLocator Found 0
> core definitions underneath
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_793723D4943B9E3D-001/control-001/cores
>    [junit4]   2> 551639 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
>    [junit4]   2> 551640 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:52694/solr
> ready
>    [junit4]   2> 551642 INFO  (qtp1213643546-4367) [n:127.0.0.1:41805_ov%2Fcn
>   ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with
> params
> replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:41805_ov%252Fcn&wt=javabin&version=2
> and sendToOCPQueue=true
>    [junit4]   2> 551645 INFO
> (OverseerThreadFactory-758-thread-1-processing-n:127.0.0.1:41805_ov%2Fcn)
> [n:127.0.0.1:41805_ov%2Fcn    ] o.a.s.c.CreateCollectionCmd Create
> collection control_collection
>    [junit4]   2> 551750 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
>   ] o.a.s.h.a.CoreAdminOperation core create command
> qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
>    [junit4]   2> 551751 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
>   ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4
> transient cores
>    [junit4]   2> 551858 INFO
> (zkCallback-337-thread-1-processing-n:127.0.0.1:41805_ov%2Fcn)
> [n:127.0.0.1:41805_ov%2Fcn    ] o.a.s.c.c.ZkStateReader A cluster state
> change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/control_collection/state.json] for collection
> [control_collection] has occurred - updating... (live nodes size: [1])
>    [junit4]   2> 552773 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
>    [junit4]   2> 552787 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
>    [junit4]   2> 552875 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
>    [junit4]   2> 552895 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.CoreContainer Creating SolrCore
> 'control_collection_shard1_replica_n1' using configuration from collection
> control_collection, trusted=true
>    [junit4]   2> 552895 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for
> 'solr.core.control_collection.shard1.replica_n1' (registry
> 'solr.core.control_collection.shard1.replica_n1') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@152e00de
>    [junit4]   2> 552895 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.HdfsDirectoryFactory
> solr.hdfs.home=hdfs://localhost:49971/solr_hdfs_home
>    [junit4]   2> 552895 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
>    [junit4]   2> 552895 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
>    [junit4]   2> 552896 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new
> SolrCore at
> [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_793723D4943B9E3D-001/control-001/cores/control_collection_shard1_replica_n1],
> dataDir=[hdfs://localhost:49971/solr_hdfs_home/control_collection/core_node1/data/]
>    [junit4]   2> 552907 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.HdfsDirectoryFactory creating directory factory for path
> hdfs://localhost:49971/solr_hdfs_home/control_collection/core_node1/data/snapshot_metadata
>    [junit4]   2> 552916 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct
> memory allocation set to [true]
>    [junit4]   2> 552916 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of
> [4194304] will allocate [1] slabs and use ~[4194304] bytes
>    [junit4]   2> 552917 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.HdfsDirectoryFactory Creating new global HDFS BlockCache
>    [junit4]   2> 552925 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.s.b.BlockDirectory Block cache on write is disabled
>    [junit4]   2> 552926 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.HdfsDirectoryFactory creating directory factory for path
> hdfs://localhost:49971/solr_hdfs_home/control_collection/core_node1/data
>    [junit4]   2> 552951 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.HdfsDirectoryFactory creating directory factory for path
> hdfs://localhost:49971/solr_hdfs_home/control_collection/core_node1/data/index
>    [junit4]   2> 552958 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct
> memory allocation set to [true]
>    [junit4]   2> 552958 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of
> [4194304] will allocate [1] slabs and use ~[4194304] bytes
>    [junit4]   2> 552963 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.s.b.BlockDirectory Block cache on write is disabled
>    [junit4]   2> 552964 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
> maxMergeAtOnce=7, maxMergeAtOnceExplicit=2,
> maxMergedSegmentMB=54.2822265625, floorSegmentMB=1.00390625,
> forceMergeDeletesPctAllowed=4.833164813857602, segmentsPerTier=10.0,
> maxCFSSegmentSizeMB=0.6904296875, noCFSRatio=0.0
>    [junit4]   2> 553000 INFO  (IPC Server handler 9 on 49971) [    ]
> BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60224
> is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION,
> truncateBlock=null, primaryNodeIndex=-1,
> replicas=[ReplicaUC[[DISK]DS-e9ea3dbc-9113-4645-b893-130c3730ec1a:NORMAL:
> 127.0.0.1:50603|RBW],
> ReplicaUC[[DISK]DS-7b441025-265d-40cb-ac06-5e2d91c89e3b:NORMAL:127.0.0.1:60224|FINALIZED]]}
> size 0
>    [junit4]   2> 553007 INFO  (IPC Server handler 3 on 49971) [    ]
> BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50603
> is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION,
> truncateBlock=null, primaryNodeIndex=-1,
> replicas=[ReplicaUC[[DISK]DS-7b441025-265d-40cb-ac06-5e2d91c89e3b:NORMAL:
> 127.0.0.1:60224|FINALIZED],
> ReplicaUC[[DISK]DS-ada032ef-beb3-4321-b044-13278d645633:NORMAL:127.0.0.1:50603|FINALIZED]]}
> size 0
>    [junit4]   2> 553015 WARN  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
> requestHandler,name = /dump,class = DumpRequestHandler,attributes =
> {initParams=a, name=/dump, class=DumpRequestHandler},args =
> {defaults={a=A,b=B}}}
>    [junit4]   2> 553071 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.u.UpdateHandler Using UpdateLog implementation:
> org.apache.solr.update.HdfsUpdateLog
>    [junit4]   2> 553071 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH
> numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
>    [junit4]   2> 553071 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
>    [junit4]   2> 553096 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.u.CommitTracker Hard AutoCommit: disabled
>    [junit4]   2> 553096 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.u.CommitTracker Soft AutoCommit: disabled
>    [junit4]   2> 553103 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
> maxMergeAtOnce=13, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=10.5625,
> floorSegmentMB=0.54296875, forceMergeDeletesPctAllowed=17.113764658263925,
> segmentsPerTier=33.0, maxCFSSegmentSizeMB=2.0732421875, noCFSRatio=1.0
>    [junit4]   2> 553112 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.s.SolrIndexSearcher Opening [Searcher@144f5f33[control_collection_shard1_replica_n1]
> main]
>    [junit4]   2> 553123 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with
> znodeBase: /configs/conf1
>    [junit4]   2> 553124 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
> ZooKeeperStorageIO:path=/configs/conf1
>    [junit4]   2> 553125 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.h.ReplicationHandler Commits will be reserved for  10000
>    [junit4]   2> 553127 INFO  (searcherExecutor-761-thread-1-processing-n:
> 127.0.0.1:41805_ov%2Fcn x:control_collection_shard1_replica_n1 s:shard1
> c:control_collection) [n:127.0.0.1:41805_ov%2Fcn c:control_collection
> s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore
> [control_collection_shard1_replica_n1] Registered new searcher
> Searcher@144f5f33[control_collection_shard1_replica_n1]
> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>    [junit4]   2> 553136 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.u.UpdateLog Could not find max version in index or recent updates,
> using new clock 1572977167247081472
>    [junit4]   2> 553144 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
>    [junit4]   2> 553144 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
>    [junit4]   2> 553144 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.SyncStrategy Sync replicas to
> http://127.0.0.1:41805/ov/cn/control_collection_shard1_replica_n1/
>    [junit4]   2> 553144 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
>    [junit4]   2> 553144 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.SyncStrategy
> http://127.0.0.1:41805/ov/cn/control_collection_shard1_replica_n1/ has no
> replicas
>    [junit4]   2> 553144 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.ShardLeaderElectionContext Found all replicas participating in
> election, clear LIR
>    [junit4]   2> 553172 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.ShardLeaderElectionContext I am the new leader:
> http://127.0.0.1:41805/ov/cn/control_collection_shard1_replica_n1/ shard1
>    [junit4]   2> 553274 INFO
> (zkCallback-337-thread-1-processing-n:127.0.0.1:41805_ov%2Fcn)
> [n:127.0.0.1:41805_ov%2Fcn    ] o.a.s.c.c.ZkStateReader A cluster state
> change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/control_collection/state.json] for collection
> [control_collection] has occurred - updating... (live nodes size: [1])
>    [junit4]   2> 553324 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.ZkController I am the leader, no recovery necessary
>    [junit4]   2> 553326 INFO  (qtp1213643546-4365) [n:127.0.0.1:41805_ov%2Fcn
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores
> params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT}
> status=0 QTime=1575
>    [junit4]   2> 553333 INFO  (qtp1213643546-4367) [n:127.0.0.1:41805_ov%2Fcn
>   ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for
> at most 30 seconds. Check all shard replicas
>    [junit4]   2> 553435 INFO
> (zkCallback-337-thread-1-processing-n:127.0.0.1:41805_ov%2Fcn)
> [n:127.0.0.1:41805_ov%2Fcn    ] o.a.s.c.c.ZkStateReader A cluster state
> change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/control_collection/state.json] for collection
> [control_collection] has occurred - updating... (live nodes size: [1])
>    [junit4]   2> 553649 INFO
> (OverseerCollectionConfigSetProcessor-98311072817348612-127.0.0.1:41805_ov%2Fcn-n_0000000000)
> [n:127.0.0.1:41805_ov%2Fcn    ] o.a.s.c.OverseerTaskQueue Response ZK
> path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.
> Requestor may have disconnected from ZooKeeper
>    [junit4]   2> 554333 INFO  (qtp1213643546-4367) [n:127.0.0.1:41805_ov%2Fcn
>   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
> params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:41805_ov%252Fcn&wt=javabin&version=2}
> status=0 QTime=2691
>    [junit4]   2> 554341 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
>    [junit4]   2> 554342 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:52694/solr
> ready
>    [junit4]   2> 554342 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection
> loss:false
>    [junit4]   2> 554343 INFO  (qtp1213643546-4368) [n:127.0.0.1:41805_ov%2Fcn
>   ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with
> params
> replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2
> and sendToOCPQueue=true
>    [junit4]   2> 554345 INFO
> (OverseerThreadFactory-758-thread-2-processing-n:127.0.0.1:41805_ov%2Fcn)
> [n:127.0.0.1:41805_ov%2Fcn    ] o.a.s.c.CreateCollectionCmd Create
> collection collection1
>    [junit4]   2> 554347 WARN
> (OverseerThreadFactory-758-thread-2-processing-n:127.0.0.1:41805_ov%2Fcn)
> [n:127.0.0.1:41805_ov%2Fcn    ] o.a.s.c.CreateCollectionCmd It is unusual
> to create a collection (collection1) without cores.
>    [junit4]   2> 554558 INFO  (qtp1213643546-4368) [n:127.0.0.1:41805_ov%2Fcn
>   ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for
> at most 30 seconds. Check all shard replicas
>    [junit4]   2> 554558 INFO  (qtp1213643546-4368) [n:127.0.0.1:41805_ov%2Fcn
>   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
> params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2}
> status=0 QTime=214
>    [junit4]   2> 554704 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_793723D4943B9E3D-001/shard-1-001
> of type NRT
>    [junit4]   2> 554705 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.e.j.s.Server jetty-9.3.14.v20161028
>    [junit4]   2> 554707 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1ee5d6f8
> {/ov/cn,null,AVAILABLE}
>    [junit4]   2> 554708 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.e.j.s.AbstractConnector Started ServerConnector@2bdfb805
> {HTTP/1.1,[http/1.1]}{127.0.0.1:32870}
>    [junit4]   2> 554708 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.e.j.s.Server Started @557601ms
>    [junit4]   2> 554708 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.s.e.JettySolrRunner Jetty properties: {solrconfig=solrconfig.xml,
> hostContext=/ov/cn, hostPort=32870,
> coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_793723D4943B9E3D-001/shard-1-001/cores}
>    [junit4]   2> 554708 ERROR
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may
> be missing or incomplete.
>    [junit4]   2> 554708 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr?
> version 7.1.0
>    [junit4]   2> 554708 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port
> null
>    [junit4]   2> 554708 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default
> config dir: null
>    [junit4]   2> 554708 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time:
> 2017-07-15T08:38:46.269Z
>    [junit4]   2> 554722 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
> ZooKeeper)
>    [junit4]   2> 554722 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.SolrXmlConfig Loading container configuration from
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_793723D4943B9E3D-001/shard-1-001/solr.xml
>    [junit4]   2> 554729 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.SolrXmlConfig MBean server found:
> com.sun.jmx.mbeanserver.JmxMBeanServer@152e00de, but no JMX reporters
> were configured - adding default JMX reporter.
>    [junit4]   2> 554732 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52694/solr
>    [junit4]   2> 554746 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:32870_ov%2Fcn    ] o.a.s.c.c.ZkStateReader Updated live
> nodes from ZooKeeper... (0) -> (1)
>    [junit4]   2> 554749 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:32870_ov%2Fcn    ] o.a.s.c.Overseer Overseer (id=null)
> closing
>    [junit4]   2> 554752 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:32870_ov%2Fcn    ] o.a.s.c.ZkController Register node as
> live in ZooKeeper:/live_nodes/127.0.0.1:32870_ov%2Fcn
>    [junit4]   2> 554753 INFO  (zkCallback-344-thread-1) [    ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
>    [junit4]   2> 554755 INFO
> (zkCallback-337-thread-1-processing-n:127.0.0.1:41805_ov%2Fcn)
> [n:127.0.0.1:41805_ov%2Fcn    ] o.a.s.c.c.ZkStateReader Updated live
> nodes from ZooKeeper... (1) -> (2)
>    [junit4]   2> 554760 INFO
> (zkCallback-349-thread-1-processing-n:127.0.0.1:32870_ov%2Fcn)
> [n:127.0.0.1:32870_ov%2Fcn    ] o.a.s.c.c.ZkStateReader Updated live
> nodes from ZooKeeper... (1) -> (2)
>    [junit4]   2> 554850 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:32870_ov%2Fcn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring
> for 'solr.node' (registry 'solr.node') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@152e00de
>    [junit4]   2> 554856 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:32870_ov%2Fcn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring
> for 'solr.jvm' (registry 'solr.jvm') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@152e00de
>    [junit4]   2> 554856 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:32870_ov%2Fcn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring
> for 'solr.jetty' (registry 'solr.jetty') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@152e00de
>    [junit4]   2> 554857 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:32870_ov%2Fcn    ] o.a.s.c.CorePropertiesLocator Found 0
> core definitions underneath
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_793723D4943B9E3D-001/shard-1-001/cores
>    [junit4]   2> 554887 INFO  (qtp379993423-4422) [n:127.0.0.1:32870_ov%2Fcn
>   ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with
> params node=127.0.0.1:32870_ov%252Fcn&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2
> and sendToOCPQueue=true
>    [junit4]   2> 554890 INFO
> (OverseerThreadFactory-758-thread-3-processing-n:127.0.0.1:41805_ov%2Fcn)
> [n:127.0.0.1:41805_ov%2Fcn    ] o.a.s.c.AddReplicaCmd Node Identified
> 127.0.0.1:32870_ov%2Fcn for creating new replica
>    [junit4]   2> 554890 INFO
> (OverseerCollectionConfigSetProcessor-98311072817348612-127.0.0.1:41805_ov%2Fcn-n_0000000000)
> [n:127.0.0.1:41805_ov%2Fcn    ] o.a.s.c.OverseerTaskQueue Response ZK
> path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.
> Requestor may have disconnected from ZooKeeper
>    [junit4]   2> 554893 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
>   ] o.a.s.h.a.CoreAdminOperation core create command
> qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n0&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
>    [junit4]   2> 554893 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
>   ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4
> transient cores
>    [junit4]   2> 555915 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0] o.a.s.c.SolrConfig
> Using Lucene MatchVersion: 7.1.0
>    [junit4]   2> 555932 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.s.IndexSchema [collection1_shard2_replica_n0] Schema name=test
>    [junit4]   2> 556029 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
>    [junit4]   2> 556051 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n0'
> using configuration from collection collection1, trusted=true
>    [junit4]   2> 556052 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for
> 'solr.core.collection1.shard2.replica_n0' (registry
> 'solr.core.collection1.shard2.replica_n0') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@152e00de
>    [junit4]   2> 556052 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.c.HdfsDirectoryFactory
> solr.hdfs.home=hdfs://localhost:49971/solr_hdfs_home
>    [junit4]   2> 556052 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
>    [junit4]   2> 556052 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0] o.a.s.c.SolrCore
> solr.RecoveryStrategy.Builder
>    [junit4]   2> 556052 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0] o.a.s.c.SolrCore
> [[collection1_shard2_replica_n0] ] Opening new SolrCore at
> [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_793723D4943B9E3D-001/shard-1-001/cores/collection1_shard2_replica_n0],
> dataDir=[hdfs://localhost:49971/solr_hdfs_home/collection1/core_node1/data/]
>    [junit4]   2> 556054 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.c.HdfsDirectoryFactory creating directory factory for path
> hdfs://localhost:49971/solr_hdfs_home/collection1/core_node1/data/snapshot_metadata
>    [junit4]   2> 556064 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct
> memory allocation set to [true]
>    [junit4]   2> 556064 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of
> [4194304] will allocate [1] slabs and use ~[4194304] bytes
>    [junit4]   2> 556075 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.s.b.BlockDirectory Block cache on write is disabled
>    [junit4]   2> 556083 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.c.HdfsDirectoryFactory creating directory factory for path
> hdfs://localhost:49971/solr_hdfs_home/collection1/core_node1/data
>    [junit4]   2> 556115 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.c.HdfsDirectoryFactory creating directory factory for path
> hdfs://localhost:49971/solr_hdfs_home/collection1/core_node1/data/index
>    [junit4]   2> 556138 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct
> memory allocation set to [true]
>    [junit4]   2> 556138 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of
> [4194304] will allocate [1] slabs and use ~[4194304] bytes
>    [junit4]   2> 556171 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.s.b.BlockDirectory Block cache on write is disabled
>    [junit4]   2> 556172 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
> maxMergeAtOnce=7, maxMergeAtOnceExplicit=2,
> maxMergedSegmentMB=54.2822265625, floorSegmentMB=1.00390625,
> forceMergeDeletesPctAllowed=4.833164813857602, segmentsPerTier=10.0,
> maxCFSSegmentSizeMB=0.6904296875, noCFSRatio=0.0
>    [junit4]   2> 556225 INFO  (IPC Server handler 2 on 49971) [    ]
> BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60224
> is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION,
> truncateBlock=null, primaryNodeIndex=-1,
> replicas=[ReplicaUC[[DISK]DS-ada032ef-beb3-4321-b044-13278d645633:NORMAL:
> 127.0.0.1:50603|RBW],
> ReplicaUC[[DISK]DS-4f0f9719-f907-44eb-a680-fe795758da6b:NORMAL:127.0.0.1:60224|RBW]]}
> size 0
>    [junit4]   2> 556226 INFO  (IPC Server handler 4 on 49971) [    ]
> BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50603
> is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION,
> truncateBlock=null, primaryNodeIndex=-1,
> replicas=[ReplicaUC[[DISK]DS-4f0f9719-f907-44eb-a680-fe795758da6b:NORMAL:
> 127.0.0.1:60224|RBW],
> ReplicaUC[[DISK]DS-e9ea3dbc-9113-4645-b893-130c3730ec1a:NORMAL:127.0.0.1:50603|FINALIZED]]}
> size 0
>    [junit4]   2> 556233 WARN  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
> requestHandler,name = /dump,class = DumpRequestHandler,attributes =
> {initParams=a, name=/dump, class=DumpRequestHandler},args =
> {defaults={a=A,b=B}}}
>    [junit4]   2> 556294 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.u.UpdateHandler Using UpdateLog implementation:
> org.apache.solr.update.HdfsUpdateLog
>    [junit4]   2> 556295 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0] o.a.s.u.UpdateLog
> Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH
> numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
>    [junit4]   2> 556295 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
>    [junit4]   2> 556307 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.u.CommitTracker Hard AutoCommit: disabled
>    [junit4]   2> 556307 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.u.CommitTracker Soft AutoCommit: disabled
>    [junit4]   2> 556310 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
> maxMergeAtOnce=13, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=10.5625,
> floorSegmentMB=0.54296875, forceMergeDeletesPctAllowed=17.113764658263925,
> segmentsPerTier=33.0, maxCFSSegmentSizeMB=2.0732421875, noCFSRatio=1.0
>    [junit4]   2> 556316 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.s.SolrIndexSearcher Opening [Searcher@595bc441[collection1_shard2_replica_n0]
> main]
>    [junit4]   2> 556318 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with
> znodeBase: /configs/conf1
>    [junit4]   2> 556318 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
> ZooKeeperStorageIO:path=/configs/conf1
>    [junit4]   2> 556319 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.h.ReplicationHandler Commits will be reserved for  10000
>    [junit4]   2> 556322 INFO  (searcherExecutor-772-thread-1-processing-n:
> 127.0.0.1:32870_ov%2Fcn x:collection1_shard2_replica_n0 s:shard2
> c:collection1) [n:127.0.0.1:32870_ov%2Fcn c:collection1 s:shard2
> x:collection1_shard2_replica_n0] o.a.s.c.SolrCore
> [collection1_shard2_replica_n0] Registered new searcher Searcher@595bc441[collection1_shard2_replica_n0]
> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>    [junit4]   2> 556322 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0] o.a.s.u.UpdateLog
> Could not find max version in index or recent updates, using new clock
> 1572977170587844608
>    [junit4]   2> 556330 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
>    [junit4]   2> 556330 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
>    [junit4]   2> 556330 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.c.SyncStrategy Sync replicas to
> http://127.0.0.1:32870/ov/cn/collection1_shard2_replica_n0/
>    [junit4]   2> 556330 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
>    [junit4]   2> 556330 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.c.SyncStrategy
> http://127.0.0.1:32870/ov/cn/collection1_shard2_replica_n0/ has no
> replicas
>    [junit4]   2> 556330 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.c.ShardLeaderElectionContext Found all replicas participating in
> election, clear LIR
>    [junit4]   2> 556340 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.c.ShardLeaderElectionContext I am the new leader:
> http://127.0.0.1:32870/ov/cn/collection1_shard2_replica_n0/ shard2
>    [junit4]   2> 556492 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.c.ZkController I am the leader, no recovery necessary
>    [junit4]   2> 556494 INFO  (qtp379993423-4418) [n:127.0.0.1:32870_ov%2Fcn
> c:collection1 s:shard2  x:collection1_shard2_replica_n0]
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores
> params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n0&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT}
> status=0 QTime=1601
>    [junit4]   2> 556498 INFO  (qtp379993423-4422) [n:127.0.0.1:32870_ov%2Fcn
>   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
> params={node=127.0.0.1:32870_ov%252Fcn&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2}
> status=0 QTime=1611
>    [junit4]   2> 556650 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_793723D4943B9E3D-001/shard-2-001
> of type NRT
>    [junit4]   2> 556650 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.e.j.s.Server jetty-9.3.14.v20161028
>    [junit4]   2> 556652 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@29097158
> {/ov/cn,null,AVAILABLE}
>    [junit4]   2> 556652 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.e.j.s.AbstractConnector Started ServerConnector@d40fb8b
> {HTTP/1.1,[http/1.1]}{127.0.0.1:46799}
>    [junit4]   2> 556653 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.e.j.s.Server Started @559546ms
>    [junit4]   2> 556653 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.s.e.JettySolrRunner Jetty properties: {solrconfig=solrconfig.xml,
> hostContext=/ov/cn, hostPort=46799,
> coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_793723D4943B9E3D-001/shard-2-001/cores}
>    [junit4]   2> 556653 ERROR
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may
> be missing or incomplete.
>    [junit4]   2> 556654 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr?
> version 7.1.0
>    [junit4]   2> 556654 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port
> null
>    [junit4]   2> 556654 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default
> config dir: null
>    [junit4]   2> 556654 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time:
> 2017-07-15T08:38:48.215Z
>    [junit4]   2> 556658 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
> ZooKeeper)
>    [junit4]   2> 556658 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.SolrXmlConfig Loading container configuration from
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_793723D4943B9E3D-001/shard-2-001/solr.xml
>    [junit4]   2> 556664 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.SolrXmlConfig MBean server found:
> com.sun.jmx.mbeanserver.JmxMBeanServer@152e00de, but no JMX reporters
> were configured - adding default JMX reporter.
>    [junit4]   2> 556668 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D]) [    ]
> o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52694/solr
>    [junit4]   2> 556685 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:46799_ov%2Fcn    ] o.a.s.c.c.ZkStateReader Updated live
> nodes from ZooKeeper... (0) -> (2)
>    [junit4]   2> 556687 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:46799_ov%2Fcn    ] o.a.s.c.Overseer Overseer (id=null)
> closing
>    [junit4]   2> 556690 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:46799_ov%2Fcn    ] o.a.s.c.ZkController Register node as
> live in ZooKeeper:/live_nodes/127.0.0.1:46799_ov%2Fcn
>    [junit4]   2> 556691 INFO  (zkCallback-344-thread-1) [    ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
>    [junit4]   2> 556692 INFO
> (zkCallback-349-thread-1-processing-n:127.0.0.1:32870_ov%2Fcn)
> [n:127.0.0.1:32870_ov%2Fcn    ] o.a.s.c.c.ZkStateReader Updated live
> nodes from ZooKeeper... (2) -> (3)
>    [junit4]   2> 556692 INFO
> (zkCallback-337-thread-2-processing-n:127.0.0.1:41805_ov%2Fcn)
> [n:127.0.0.1:41805_ov%2Fcn    ] o.a.s.c.c.ZkStateReader Updated live
> nodes from ZooKeeper... (2) -> (3)
>    [junit4]   2> 556708 INFO
> (zkCallback-355-thread-1-processing-n:127.0.0.1:46799_ov%2Fcn)
> [n:127.0.0.1:46799_ov%2Fcn    ] o.a.s.c.c.ZkStateReader Updated live
> nodes from ZooKeeper... (2) -> (3)
>    [junit4]   2> 556788 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:46799_ov%2Fcn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring
> for 'solr.node' (registry 'solr.node') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@152e00de
>    [junit4]   2> 556794 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:46799_ov%2Fcn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring
> for 'solr.jvm' (registry 'solr.jvm') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@152e00de
>    [junit4]   2> 556794 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:46799_ov%2Fcn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring
> for 'solr.jetty' (registry 'solr.jetty') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@152e00de
>    [junit4]   2> 556796 INFO
> (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[793723D4943B9E3D])
> [n:127.0.0.1:46799_ov%2Fcn    ] o.a.s.c.CorePropertiesLocator Found 0
> core definitions underneath
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_793723D4943B9E3D-001/shard-2-001/cores
>    [junit4]   2> 556830 INFO  (qtp556104417-4455) [n:127.0.0.1:46799_ov%2Fcn
>   ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with
> params node=127.0.0.1:46799_ov%252Fcn&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2
> and sendToOCPQueue=true
>    [junit4]   2> 556833 INFO
> (OverseerThreadFactory-758-thread-4-processing-n:127.0.0.1:41805_ov%2Fcn)
> [n:127.0.0.1:41805_ov%2Fcn    ] o.a.s.c.AddReplicaCmd Node Identified
> 127.0.0.1:46799_ov%2Fcn for creating new replica
>    [junit4]

-- 
Lucene/Solr Search Committer, Consultant, Developer, Author, Speaker
LinkedIn: http://linkedin.com/in/davidwsmiley | Book:
http://www.solrenterprisesearchserver.com

Mime
View raw message