lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-NightlyTests-5.5 - Build # 4 - Still Failing
Date Wed, 27 Apr 2016 03:03:53 GMT
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.5/4/

3 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Error from server at http://127.0.0.1:51865: Could not load collection from ZK: halfcollectionblocker

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:51865: Could not load collection from ZK: halfcollectionblocker
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:400)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:516)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:179)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:996)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:971)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest

Error Message:
ObjectTracker found 1 object(s) that were not released!!! [HdfsTransactionLog]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [HdfsTransactionLog]
	at __randomizedtesting.SeedInfo.seed([65ED4E6690CA05AE]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:228)
	at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.update.DirectUpdateHandlerTest.testExpungeDeletes

Error Message:
expected:<5> but was:<4>

Stack Trace:
java.lang.AssertionError: expected:<5> but was:<4>
	at __randomizedtesting.SeedInfo.seed([65ED4E6690CA05AE:49940AE3E573CD0B]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.update.DirectUpdateHandlerTest.testExpungeDeletes(DirectUpdateHandlerTest.java:299)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11295 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/init-core-data-001
   [junit4]   2> 665111 INFO  (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 665111 INFO  (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 665512 WARN  (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 665966 WARN  (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 666086 INFO  (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
   [junit4]   2> 666093 WARN  (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 666151 INFO  (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 666188 INFO  (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_45424_hdfs____ndof7j/webapp
   [junit4]   2> 666318 INFO  (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 666979 INFO  (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45424
   [junit4]   2> 667585 WARN  (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 667590 INFO  (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 667599 INFO  (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_41083_datanode____.5pug7f/webapp
   [junit4]   2> 667707 INFO  (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 667945 INFO  (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41083
   [junit4]   2> 668059 WARN  (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 668060 INFO  (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 668069 INFO  (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_45659_datanode____z1fkww/webapp
   [junit4]   2> 668168 INFO  (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 668469 INFO  (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45659
   [junit4]   2> 668773 INFO  (IPC Server handler 7 on 42039) [    ] BlockStateChange BLOCK* processReport: from storage DS-f7d9e805-10ce-4707-93b3-79fcf72f75aa node DatanodeRegistration(127.0.0.1, datanodeUuid=f55062c8-206b-4206-906a-d1dab3ad64dc, infoPort=45659, ipcPort=60229, storageInfo=lv=-56;cid=testClusterID;nsid=1856959388;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 668773 INFO  (IPC Server handler 7 on 42039) [    ] BlockStateChange BLOCK* processReport: from storage DS-3713a927-1132-4473-b54e-1b9bd55f75e1 node DatanodeRegistration(127.0.0.1, datanodeUuid=f55062c8-206b-4206-906a-d1dab3ad64dc, infoPort=45659, ipcPort=60229, storageInfo=lv=-56;cid=testClusterID;nsid=1856959388;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 668776 INFO  (IPC Server handler 5 on 42039) [    ] BlockStateChange BLOCK* processReport: from storage DS-b8904166-079e-4896-b468-93232dbc15d0 node DatanodeRegistration(127.0.0.1, datanodeUuid=0459d0c8-44a0-4204-ac7d-c27b6691a05e, infoPort=41083, ipcPort=57341, storageInfo=lv=-56;cid=testClusterID;nsid=1856959388;c=0), blocks: 0, hasStaleStorages: true, processing time: 2 msecs
   [junit4]   2> 668777 INFO  (IPC Server handler 5 on 42039) [    ] BlockStateChange BLOCK* processReport: from storage DS-962b23fe-4150-4195-9bc3-7ec495b4eb62 node DatanodeRegistration(127.0.0.1, datanodeUuid=0459d0c8-44a0-4204-ac7d-c27b6691a05e, infoPort=41083, ipcPort=57341, storageInfo=lv=-56;cid=testClusterID;nsid=1856959388;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 669081 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 669082 INFO  (Thread-2230) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 669082 INFO  (Thread-2230) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 669182 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.ZkTestServer start zk server on port:37869
   [junit4]   2> 669182 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 669182 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 669189 INFO  (zkCallback-662-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3f98d12f name:ZooKeeperConnection Watcher:127.0.0.1:37869 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 669189 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 669189 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 669189 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 669191 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 669192 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 669194 INFO  (zkCallback-663-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7104284e name:ZooKeeperConnection Watcher:127.0.0.1:37869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 669194 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 669194 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 669194 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 669196 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 669197 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 669197 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 669198 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 669198 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 669200 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 669200 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 669201 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 669201 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 669202 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 669202 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 669203 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 669203 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 669204 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 669204 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 669205 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 669205 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 669206 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 669206 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 669207 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 669207 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 669208 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 669208 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 669208 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 669209 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 669210 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x1545574b72a0001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 669261 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001/cores/collection1
   [junit4]   2> 669262 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 669264 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3d76e4bb{/,null,AVAILABLE}
   [junit4]   2> 669264 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.e.j.s.ServerConnector Started ServerConnector@39276db6{HTTP/1.1}{127.0.0.1:58104}
   [junit4]   2> 669264 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.e.j.s.Server Started @671250ms
   [junit4]   2> 669264 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001/cores, solr.data.dir=hdfs://localhost:42039/hdfs__localhost_42039__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-5.5_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001_tempDir-002_control_data, hostPort=58104}
   [junit4]   2> 669264 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4f6de641
   [junit4]   2> 669264 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001'
   [junit4]   2> 669264 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 669264 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 669265 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 669265 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 669266 INFO  (zkCallback-664-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@526b638c name:ZooKeeperConnection Watcher:127.0.0.1:37869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 669266 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 669267 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 669267 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 669267 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001/solr.xml
   [junit4]   2> 669277 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001/cores
   [junit4]   2> 669278 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.CoreContainer New CoreContainer 60570546
   [junit4]   2> 669278 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001]
   [junit4]   2> 669278 WARN  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001/lib
   [junit4]   2> 669278 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 669279 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 669279 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 669279 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 669279 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37869/solr
   [junit4]   2> 669279 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 669279 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 669280 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 669281 INFO  (zkCallback-667-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@769b5d63 name:ZooKeeperConnection Watcher:127.0.0.1:37869 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 669281 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 669281 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 669282 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$6@27d4653f
   [junit4]   2> 669282 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 669284 INFO  (zkCallback-668-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@13e9dc27 name:ZooKeeperConnection Watcher:127.0.0.1:37869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 669284 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 669286 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 669289 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 669292 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 669293 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 669293 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 669294 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 669295 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 669295 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 669296 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 669296 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58104_
   [junit4]   2> 669296 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:58104_
   [junit4]   2> 669297 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 669297 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 669298 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 669298 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95795451859173380-127.0.0.1:58104_-n_0000000000
   [junit4]   2> 669298 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:58104_
   [junit4]   2> 669298 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 669299 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.Overseer Overseer (id=95795451859173380-127.0.0.1:58104_-n_0000000000) starting
   [junit4]   2> 669300 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 669302 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 669302 INFO  (OverseerCollectionConfigSetProcessor-95795451859173380-127.0.0.1:58104_-n_0000000000) [n:127.0.0.1:58104_    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 669303 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 669303 INFO  (OverseerStateUpdate-95795451859173380-127.0.0.1:58104_-n_0000000000) [n:127.0.0.1:58104_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 669314 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 669314 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 669314 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001/cores
   [junit4]   2> 669315 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {collection=control_collection, dataDir=data/, loadOnStartup=true, coreNodeName=, schema=schema.xml, configSetProperties=configsetprops.json, name=collection1, shard=, transient=false, config=solrconfig.xml}
   [junit4]   2> 669315 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001/cores/collection1
   [junit4]   2> 669315 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 669316 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 669316 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 669317 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection control_collection not visible yet, but flagging it so a watch is registered when it becomes visible
   [junit4]   2> 669317 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader addZkWatch [control_collection]
   [junit4]   2> 669318 INFO  (OverseerStateUpdate-95795451859173380-127.0.0.1:58104_-n_0000000000) [n:127.0.0.1:58104_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "shard":null,
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "node_name":"127.0.0.1:58104_",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "state":"down",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "base_url":"http://127.0.0.1:58104"} current state version: 0
   [junit4]   2> 669318 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2
   [junit4]   2> 669318 INFO  (OverseerStateUpdate-95795451859173380-127.0.0.1:58104_-n_0000000000) [n:127.0.0.1:58104_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "shard":null,
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "node_name":"127.0.0.1:58104_",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "state":"down",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "base_url":"http://127.0.0.1:58104"}
   [junit4]   2> 669318 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Deleting data for [control_collection]
   [junit4]   2> 669318 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:58104_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 669318 INFO  (OverseerStateUpdate-95795451859173380-127.0.0.1:58104_-n_0000000000) [n:127.0.0.1:58104_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 669319 INFO  (OverseerStateUpdate-95795451859173380-127.0.0.1:58104_-n_0000000000) [n:127.0.0.1:58104_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 669319 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 669320 INFO  (zkCallback-668-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 670319 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 670319 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 670320 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 670320 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 670320 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 670320 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001/cores/collection1'
   [junit4]   2> 670320 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 670320 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 670322 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 670327 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 670336 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 5.5.0
   [junit4]   2> 670375 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 670389 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 670540 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 670541 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 670542 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 670544 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 670556 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2
   [junit4]   2> 670556 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 670556 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 670562 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:42039/solr_hdfs_home
   [junit4]   2> 670562 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 670562 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001/cores/collection1], dataDir=[hdfs://localhost:42039/solr_hdfs_home/control_collection/core_node1/data/]
   [junit4]   2> 670562 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@111a3ce4
   [junit4]   2> 670562 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:42039/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 670594 WARN  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsDirectory The NameNode is in SafeMode - Solr will wait 5 seconds and try again.
   [junit4]   2> 675756 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:42039/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 675757 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:42039/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 675773 WARN  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:42039/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 675774 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:42039/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 675782 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 675782 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 675782 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 675795 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 675795 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:42039/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 675795 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=15, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 676062 INFO  (IPC Server handler 8 on 42039) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39729 is added to blk_1073741825_1001{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-962b23fe-4150-4195-9bc3-7ec495b4eb62:NORMAL:127.0.0.1:39729|RBW], ReplicaUnderConstruction[[DISK]DS-3713a927-1132-4473-b54e-1b9bd55f75e1:NORMAL:127.0.0.1:40379|RBW]]} size 71
   [junit4]   2> 676063 INFO  (IPC Server handler 0 on 42039) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40379 is added to blk_1073741825_1001 size 71
   [junit4]   2> 676472 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:42039/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7ae3cb74); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 676472 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 676474 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:42039/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 676478 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 676478 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 676478 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 676478 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 676478 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 676478 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 676478 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 676478 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 676478 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 676478 WARN  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 676480 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 676481 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 676482 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 676483 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 676486 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/ping,/admin/mbeans,/admin/logging,standard,/schema,/admin/segments,/admin/file,/get,/admin/threads,/dump,/admin/plugins,/update/json,/admin/system,/config,/update/csv,/update,/admin/properties,/update/json/docs,/admin/luke,/replication
   [junit4]   2> 676487 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 676490 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 676490 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
   [junit4]   2> 676508 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms; 
   [junit4]   2> 676508 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 676509 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=20.3798828125, floorSegmentMB=1.7177734375, forceMergeDeletesPctAllowed=8.77114800030406, segmentsPerTier=21.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.26048406662050977
   [junit4]   2> 676565 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:42039/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7ae3cb74); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 676565 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 676565 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@34991081[collection1] main
   [junit4]   2> 676565 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 676566 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 676566 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 676566 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 676566 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 676566 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 676567 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 676567 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 676567 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 676568 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 676570 INFO  (searcherExecutor-2252-thread-1-processing-s:shard1 r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@34991081[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 676570 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 676570 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index
   [junit4]   2> 676570 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 676570 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1532727237595365376
   [junit4]   2> 676570 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 0.0ms to seed version buckets with highest version 1532727237595365376
   [junit4]   2> 676570 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 676571 INFO  (coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 676571 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:58104 collection:control_collection shard:shard1
   [junit4]   2> 676572 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 676575 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95795451859173380-core_node1-n_0000000000
   [junit4]   2> 676575 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=10000
   [junit4]   2> 676576 INFO  (OverseerStateUpdate-95795451859173380-127.0.0.1:58104_-n_0000000000) [n:127.0.0.1:58104_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 676577 INFO  (zkCallback-668-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 676579 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 676579 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 676579 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:58104/collection1/
   [junit4]   2> 676579 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 676579 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:58104/collection1/ has no replicas
   [junit4]   2> 676579 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 676580 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/95795451859173380-core_node1-n_0000000000
   [junit4]   2> 676582 INFO  (OverseerStateUpdate-95795451859173380-127.0.0.1:58104_-n_0000000000) [n:127.0.0.1:58104_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:58104",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 676583 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:58104/collection1/ shard1
   [junit4]   2> 676683 INFO  (zkCallback-668-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 676684 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:58104/collection1/ and leader is http://127.0.0.1:58104/collection1/
   [junit4]   2> 676685 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58104
   [junit4]   2> 676685 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 676685 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 676685 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) [n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 676690 INFO  (OverseerStateUpdate-95795451859173380-127.0.0.1:58104_-n_0000000000) [n:127.0.0.1:58104_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "node_name":"127.0.0.1:58104_",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "state":"active",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "base_url":"http://127.0.0.1:58104"} current state version: 3
   [junit4]   2> 676690 INFO  (OverseerStateUpdate-95795451859173380-127.0.0.1:58104_-n_0000000000) [n:127.0.0.1:58104_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "node_name":"127.0.0.1:58104_",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "state":"active",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "base_url":"http://127.0.0.1:58104"}
   [junit4]   2> 676792 INFO  (zkCallback-668-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 676821 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 676821 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 676823 INFO  (zkCallback-670-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@66359e2f name:ZooKeeperConnection Watcher:127.0.0.1:37869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 676823 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 676823 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 676824 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 676826 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 676883 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/shard-1-001/cores/collection1
   [junit4]   2> 676883 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/shard-1-001
   [junit4]   2> 676884 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 676890 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6f653c16{/,null,AVAILABLE}
   [junit4]   2> 676891 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.e.j.s.ServerConnector Started ServerConnector@76f5a4c4{HTTP/1.1}{127.0.0.1:38297}
   [junit4]   2> 676891 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.e.j.s.Server Started @678877ms
   [junit4]   2> 676891 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=38297, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/shard-1-001/cores, solr.data.dir=hdfs://localhost:42039/hdfs__localhost_42039__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-5.5_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001_tempDir-002_jetty1, solrconfig=solrconfig.xml}
   [junit4]   2> 676891 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4f6de641
   [junit4]   2> 676891 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/shard-1-001'
   [junit4]   2> 676891 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 676891 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 676892 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 676892 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 676893 INFO  (zkCallback-671-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3f9bf9cb name:ZooKeeperConnection Watcher:127.0.0.1:37869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 676894 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 676894 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 676895 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 676895 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/shard-1-001/solr.xml
   [junit4]   2> 676905 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/shard-1-001/cores
   [junit4]   2> 676905 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.CoreContainer New CoreContainer 582200905
   [junit4]   2> 676905 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/shard-1-001]
   [junit4]   2> 676905 WARN  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/shard-1-001/lib
   [junit4]   2> 676905 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 676906 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 676906 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 676906 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 676906 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37869/solr
   [junit4]   2> 676906 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 676906 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 676909 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 676913 INFO  (zkCallback-674-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@781db53a name:ZooKeeperConnection Watcher:127.0.0.1:37869 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 676913 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 676913 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 676914 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:38297_    ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$6@6e2a3ac2
   [junit4]   2> 676917 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:38297_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 676923 INFO  (zkCallback-675-thread-1-processing-n:127.0.0.1:38297_) [n:127.0.0.1:38297_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2cfbad8c name:ZooKeeperConnection Watcher:127.0.0.1:37869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 676923 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:38297_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 676927 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:38297_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 677930 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:38297_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38297_
   [junit4]   2> 677930 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:38297_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:38297_
   [junit4]   2> 677931 INFO  (zkCallback-675-thread-1-processing-n:127.0.0.1:38297_) [n:127.0.0.1:38297_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 677931 INFO  (zkCallback-668-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 677931 INFO  (zkCallback-670-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 677933 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:38297_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 677933 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:38297_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95795451859173384-127.0.0.1:38297_-n_0000000001
   [junit4]   2> 677933 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:38297_    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95795451859173380-127.0.0.1:58104_-n_0000000000 to know if I could be the leader
   [junit4]   2> 677966 INFO  (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [n:127.0.0.1:38297_    ] o.a.s.c.CoreContainer Security conf doesn't exist.

[...truncated too long message...]

p/solr.update.DirectUpdateHandlerTest_65ED4E6690CA05AE-001/init-core-data-001/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2465c40e),segFN=segments_i,generation=18}
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(NIOFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.update.DirectUpdateHandlerTest_65ED4E6690CA05AE-001/init-core-data-001/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2465c40e),segFN=segments_j,generation=19}
   [junit4]   2> 2834329 INFO  (TEST-DirectUpdateHandlerTest.testDeleteRollback-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.SolrDeletionPolicy newest commit generation = 19
   [junit4]   2> 2834330 INFO  (TEST-DirectUpdateHandlerTest.testDeleteRollback-seed#[65ED4E6690CA05AE]) [    ] o.a.s.s.SolrIndexSearcher Opening Searcher@3fbd4681[collection1] main
   [junit4]   2> 2834331 INFO  (searcherExecutor-10700-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3fbd4681[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_a(5.5.0):c2) Uninverting(_b(5.5.0):c1)))}
   [junit4]   2> 2834332 INFO  (TEST-DirectUpdateHandlerTest.testDeleteRollback-seed#[65ED4E6690CA05AE]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2834332 INFO  (TEST-DirectUpdateHandlerTest.testDeleteRollback-seed#[65ED4E6690CA05AE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 15
   [junit4]   2> 2834333 INFO  (TEST-DirectUpdateHandlerTest.testDeleteRollback-seed#[65ED4E6690CA05AE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=xml&q=id:ZZZ} hits=1 status=0 QTime=0
   [junit4]   2> 2834334 INFO  (TEST-DirectUpdateHandlerTest.testDeleteRollback-seed#[65ED4E6690CA05AE]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testDeleteRollback
   [junit4]   2> 2834334 INFO  (SUITE-DirectUpdateHandlerTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 2834334 INFO  (SUITE-DirectUpdateHandlerTest-seed#[65ED4E6690CA05AE]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2104271494
   [junit4]   2> 2834334 INFO  (coreCloseExecutor-10704-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@5f931286
   [junit4]   2> 2834334 INFO  (coreCloseExecutor-10704-thread-1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 closing DirectUpdateHandler2{commits=2,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=1,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=3,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 2834334 INFO  (coreCloseExecutor-10704-thread-1) [    x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 2834334 INFO  (coreCloseExecutor-10704-thread-1) [    x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 2834334 INFO  (coreCloseExecutor-10704-thread-1) [    x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
   [junit4]   2> 2834335 INFO  (coreCloseExecutor-10704-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
   [junit4]   2> 2834343 INFO  (coreCloseExecutor-10704-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockFSDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 2834343 INFO  (coreCloseExecutor-10704-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.update.DirectUpdateHandlerTest_65ED4E6690CA05AE-001/init-core-data-001/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.update.DirectUpdateHandlerTest_65ED4E6690CA05AE-001/init-core-data-001/index;done=false>>]
   [junit4]   2> 2834343 INFO  (coreCloseExecutor-10704-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.update.DirectUpdateHandlerTest_65ED4E6690CA05AE-001/init-core-data-001/index
   [junit4]   2> 2834346 INFO  (coreCloseExecutor-10704-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.update.DirectUpdateHandlerTest_65ED4E6690CA05AE-001/init-core-data-001 [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.update.DirectUpdateHandlerTest_65ED4E6690CA05AE-001/init-core-data-001;done=false>>]
   [junit4]   2> 2834346 INFO  (coreCloseExecutor-10704-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.update.DirectUpdateHandlerTest_65ED4E6690CA05AE-001/init-core-data-001
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.update.DirectUpdateHandlerTest_65ED4E6690CA05AE-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene54): {id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128)))}, docValues:{}, sim=RandomSimilarity(queryNorm=false,coord=crazy): {}, locale=lv-LV, timezone=Eire
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.7.0_80 (64-bit)/cpus=4,threads=1,free=96008288,total=533200896
   [junit4]   2> NOTE: All tests run in this JVM: [ConfigSetsAPITest, TestMiniSolrCloudCluster, HardAutoCommitTest, XmlUpdateRequestHandlerTest, TestChildDocTransformer, TestZkChroot, TestMaxScoreQueryParser, TestBulkSchemaAPI, BlockDirectoryTest, SolrTestCaseJ4Test, TestPerFieldSimilarity, TestRequestStatusCollectionAPI, PrimitiveFieldTypeTest, TestCollationField, TestCollapseQParserPlugin, SpatialHeatmapFacetsTest, RecoveryAfterSoftCommitTest, TestDefaultSearchFieldResource, LeaderInitiatedRecoveryOnShardRestartTest, TestIndexSearcher, SuggesterWFSTTest, HttpPartitionTest, CircularListTest, StatelessScriptUpdateProcessorFactoryTest, TestJmxIntegration, TestCoreDiscovery, SolrCoreCheckLockOnStartupTest, CustomCollectionTest, TestXIncludeConfig, TestTrackingShardHandlerFactory, DateMathParserTest, DistributedQueueTest, TestSolrDeletionPolicy1, RegexBoostProcessorTest, TestSearchPerf, ZkStateReaderTest, HdfsChaosMonkeySafeLeaderTest, TestUniqueKeyFieldResource, TestGroupingSearch, TestSchemaResource, DeleteReplicaTest, TestSweetSpotSimilarityFactory, TestCharFilters, CurrencyFieldXmlFileTest, TestWriterPerf, HdfsSyncSliceTest, DataDrivenBlockJoinTest, TestFieldCollectionResource, HdfsWriteToMultipleCollectionsTest, SearchHandlerTest, UnloadDistributedZkTest, TestDistribIDF, HdfsLockFactoryTest, TestNamedUpdateProcessors, TestAnalyzeInfixSuggestions, NoCacheHeaderTest, TestJmxMonitoredMap, TestInfoStreamLogging, TestJettySolrRunner, TestSolr4Spatial2, ShowFileRequestHandlerTest, TestDistributedMissingSort, BitVectorTest, FullSolrCloudDistribCmdsTest, CoreAdminHandlerTest, HdfsBasicDistributedZk2Test, PluginInfoTest, TestCloudSchemaless, TestExclusionRuleCollectionAccess, TestIndexingPerformance, TestReload, SegmentsInfoRequestHandlerTest, RequestHandlersTest, AtomicUpdatesTest, SaslZkACLProviderTest, LukeRequestHandlerTest, RestartWhileUpdatingTest, CursorMarkTest, CoreMergeIndexesAdminHandlerTest, TestMiniSolrCloudClusterSSL, TestStressLiveNodes, RulesTest, TestFieldSortValues, TestClassicSimilarityFactory, TestTrieFacet, TestDistributedStatsComponentCardinality, TestBulkSchemaConcurrent, DistribCursorPagingTest, DistributedFacetPivotSmallTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestLRUStatsCache, TermVectorComponentDistributedTest, TestTolerantSearch, BasicDistributedZk2Test, OverseerTest, RecoveryZkTest, ZkSolrClientTest, AutoCommitTest, TestDistributedGrouping, TestHashPartitioner, TestJoin, SolrCoreTest, SpellCheckComponentTest, SolrCmdDistributorTest, PeerSyncTest, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestFunctionQuery, DirectUpdateHandlerTest]
   [junit4] Completed [327/572 (3!)] on J2 in 14.12s, 7 tests, 1 failure <<< FAILURES!

[...truncated 791 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/build.xml:757: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/build.xml:694: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/common-build.xml:534: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/lucene/common-build.xml:1477: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/lucene/common-build.xml:1033: There were test failures: 572 suites (7 ignored), 2290 tests, 1 suite-level error, 1 error, 1 failure, 34 ignored (18 assumptions) [seed: 65ED4E6690CA05AE]

Total time: 176 minutes 23 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




Mime
View raw message