lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-4.10-Linux (32bit/jdk1.7.0_67) - Build # 66 - Failure!
Date Sat, 08 Nov 2014 19:09:07 GMT
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.10-Linux/66/
Java: 32bit/jdk1.7.0_67 -server -XX:+UseG1GC (asserts: false)

1 tests failed.
REGRESSION:  org.apache.solr.cloud.OverseerTest.testOverseerFailure

Error Message:
Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed

Stack Trace:
org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
	at __randomizedtesting.SeedInfo.seed([A4A87ADA429D0299:A0A0F5295038EDB8]:0)
	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:150)
	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:155)
	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:314)
	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
	at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:157)
	at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:662)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
	at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:137)
	... 48 more
Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
	at org.apache.solr.common.cloud.SolrZkClient$11.execute(SolrZkClient.java:462)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:459)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:416)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:403)
	at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:142)
	at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
	... 49 more




Build Log:
[...truncated 11813 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerTest
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerTest-A4A87ADA429D0299-001/init-core-data-001
   [junit4]   2> 1797207 T5038 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 1797207 T5038 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> 1797207 T5038 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 1797210 T5038 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
   [junit4]   2> 1797210 T5038 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1797211 T5039 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1797311 T5038 oasc.ZkTestServer.run start zk server on port:44553
   [junit4]   2> 1797312 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797314 T5045 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c3db2c name:ZooKeeperConnection Watcher:127.0.0.1:44553 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797314 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797315 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797316 T5047 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fbd8e4 name:ZooKeeperConnection Watcher:127.0.0.1:44553 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797316 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797316 T5038 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1797319 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797320 T5049 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e2db2b name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797320 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797320 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1797321 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797322 T5051 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a4dda0 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797322 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797323 T5038 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: retry=false
   [junit4]   2> 1797324 T5038 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1797326 T5038 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1797327 T5038 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1797328 T5038 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:44553_solr
   [junit4]   2> 1797328 T5038 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1797329 T5038 oasc.Overseer.start Overseer (id=92764408568020995-127.0.0.1:44553_solr-n_0000000000) starting
   [junit4]   2> 1797331 T5038 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1797332 T5038 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1797334 T5038 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 1797335 T5038 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 1797337 T5038 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 1797339 T5038 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1797342 T5038 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1797342 T5053 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1797343 T5052 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1797343 T5038 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1797345 T5038 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1797345 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797348 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797349 T5056 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@515bac name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797349 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797350 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797351 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node0
   [junit4]   2> 1797353 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797354 T5060 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@56b2f5 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797354 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797355 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797356 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
   [junit4]   2> 1797358 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797359 T5063 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a1c369 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797360 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797360 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797362 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
   [junit4]   2> 1797364 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797365 T5066 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19d7cbb name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797365 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797366 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797367 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node3
   [junit4]   2> 1797370 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797370 T5069 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1012e6b name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797371 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797371 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797373 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node4
   [junit4]   2> 1797375 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797376 T5072 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fe8a79 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797376 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797377 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797378 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node5
   [junit4]   2> 1797381 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797383 T5075 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1629428 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797383 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797384 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797385 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node6
   [junit4]   2> 1797388 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797389 T5078 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d7dd65 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797389 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797389 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797391 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node7
   [junit4]   2> 1797393 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797394 T5081 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bf14f3 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797394 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797395 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797396 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node8
   [junit4]   2> 1797399 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797400 T5084 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12d2629 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797400 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797407 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797409 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node9
   [junit4]   2> 1797415 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797416 T5087 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e72211 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797416 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797417 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797419 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node10
   [junit4]   2> 1797432 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797433 T5090 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6eb218 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797433 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797434 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797436 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node11
   [junit4]   2> 1797442 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797446 T5093 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19de902 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797446 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797447 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797449 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node12
   [junit4]   2> 1797463 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797471 T5096 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@171306d name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797472 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797473 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797474 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node13
   [junit4]   2> 1797479 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797480 T5099 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b6e9b1 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797481 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797481 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797483 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node14
   [junit4]   2> 1797491 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797493 T5102 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1664be1 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797493 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797494 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797495 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node15
   [junit4]   2> 1797519 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797519 T5105 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e84b5e name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797520 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797520 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797522 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node16
   [junit4]   2> 1797536 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797539 T5108 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ec295c name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797539 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797540 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797541 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node17
   [junit4]   2> 1797545 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797546 T5111 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18d104f name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797546 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797547 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797548 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node18
   [junit4]   2> 1797551 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797552 T5114 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fe4125 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797552 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797553 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797554 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node19
   [junit4]   2> 1797558 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797560 T5117 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f0adc3 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797560 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797561 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797562 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node20
   [junit4]   2> 1797574 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797576 T5120 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1da28fe name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797577 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797577 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797579 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node21
   [junit4]   2> 1797583 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797584 T5123 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1091d30 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797584 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797585 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797587 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node22
   [junit4]   2> 1797591 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797592 T5126 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@181cdfd name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797592 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797593 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797595 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node23
   [junit4]   2> 1797598 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797599 T5129 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c8049 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797599 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797600 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797602 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node24
   [junit4]   2> 1797605 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797606 T5132 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ac558a name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797606 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797607 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797609 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node25
   [junit4]   2> 1797613 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797614 T5135 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e5beca name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797614 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797615 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797617 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node26
   [junit4]   2> 1797621 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797622 T5138 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b57269 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797622 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797623 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797624 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node27
   [junit4]   2> 1797628 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797629 T5141 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@128296a name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797629 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797630 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797631 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node28
   [junit4]   2> 1797635 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797636 T5144 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9578a6 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797637 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797637 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797639 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node29
   [junit4]   2> 1797643 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797644 T5147 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ed239f name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797645 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797646 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797647 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node30
   [junit4]   2> 1797651 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797652 T5150 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d8e471 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797653 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797653 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797655 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node31
   [junit4]   2> 1797660 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797661 T5153 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@109a5c4 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797661 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797662 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797663 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node32
   [junit4]   2> 1797668 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797668 T5156 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1711c78 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797669 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797669 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797671 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node33
   [junit4]   2> 1797676 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797676 T5159 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9956d6 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797677 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797677 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797679 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node34
   [junit4]   2> 1797683 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797684 T5162 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@db3779 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797685 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797685 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797687 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node35
   [junit4]   2> 1797693 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797694 T5165 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c15abf name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797694 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797695 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797696 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node36
   [junit4]   2> 1797702 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797703 T5168 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16a50a5 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797703 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797704 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797705 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node37
   [junit4]   2> 1797710 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797711 T5171 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14b7092 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797711 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797712 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797713 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node38
   [junit4]   2> 1797718 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797719 T5173 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d73d27 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797719 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797720 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797721 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node39
   [junit4]   2> 1797726 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797728 T5177 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16a817c name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797728 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797729 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797730 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node40
   [junit4]   2> 1797735 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797737 T5180 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f72005 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797737 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797738 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797740 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node41
   [junit4]   2> 1797745 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797746 T5183 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1da8965 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797746 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797747 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797748 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node42
   [junit4]   2> 1797752 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797754 T5186 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e7f903 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797754 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797754 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797756 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node43
   [junit4]   2> 1797762 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797763 T5189 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17b5297 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797763 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797764 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797765 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node44
   [junit4]   2> 1797769 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797771 T5192 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fd423e name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797771 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797772 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797773 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node45
   [junit4]   2> 1797778 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797779 T5195 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d96a25 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797779 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797780 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797781 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node46
   [junit4]   2> 1797788 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797789 T5198 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2dc7ea name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797789 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797790 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797792 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node47
   [junit4]   2> 1797798 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797799 T5201 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@166f55a name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797799 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797800 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797801 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node48
   [junit4]   2> 1797807 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797808 T5204 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a9d665 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797808 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797808 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797809 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node49
   [junit4]   2> 1797815 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797815 T5207 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@180af06 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797816 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797816 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797817 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node50
   [junit4]   2> 1797825 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797826 T5210 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@85d7a4 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797826 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797827 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797829 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node51
   [junit4]   2> 1797837 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797839 T5213 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@df5ff4 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797839 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797840 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797841 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node52
   [junit4]   2> 1797850 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797851 T5216 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fc9165 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797851 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797852 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797854 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node53
   [junit4]   2> 1797860 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797861 T5219 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d777fa name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797862 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797862 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797864 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node54
   [junit4]   2> 1797872 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797873 T5222 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f07965 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797873 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797874 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797876 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node55
   [junit4]   2> 1797882 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797884 T5225 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@194aa14 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797884 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797884 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797886 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node56
   [junit4]   2> 1797893 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797894 T5228 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19a4f78 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797894 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797895 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797896 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node57
   [junit4]   2> 1797904 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797905 T5231 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a04536 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797905 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797906 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797907 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node58
   [junit4]   2> 1797925 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797925 T5234 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ec37eb name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797926 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797926 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797928 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node59
   [junit4]   2> 1797935 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797936 T5237 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c769a7 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797939 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797941 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797943 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node60
   [junit4]   2> 1797950 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797951 T5240 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8288c1 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797951 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797952 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797953 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node61
   [junit4]   2> 1797961 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797961 T5243 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1391927 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797962 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797962 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797964 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node62
   [junit4]   2> 1797969 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797971 T5245 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f5e126 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797972 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797973 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797974 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node63
   [junit4]   2> 1797982 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797983 T5249 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1930d07 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797983 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797984 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797985 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node64
   [junit4]   2> 1797994 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1797995 T5252 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13ae22c name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1797995 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1797996 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1797997 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node65
   [junit4]   2> 1798005 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1798006 T5255 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2bd371 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1798006 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1798007 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1798008 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node66
   [junit4]   2> 1798016 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1798016 T5258 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7fbe0a name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1798017 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1798017 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1798019 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node67
   [junit4]   2> 1798026 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1798027 T5261 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11c414e name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1798027 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1798028 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1798030 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node68
   [junit4]   2> 1798036 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1798038 T5264 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14dd93d name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1798038 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1798039 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1798040 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node69
   [junit4]   2> 1798049 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1798050 T5267 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c7b9c6 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1798050 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1798051 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1798052 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node70
   [junit4]   2> 1798060 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1798061 T5270 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@78529c name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1798061 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1798062 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1798063 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node71
   [junit4]   2> 1798072 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1798073 T5273 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1abbc8e name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1798073 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1798074 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1798075 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node72
   [junit4]   2> 1798087 T5038 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1798088 T5276 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7123b7 name:ZooKeeperConnection Watcher:127.0.0.1:44553/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1798088 T5038 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1798089 T5038 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1798090 T5038 oascc.SolrZkClient.makePath makePath: /live_nodes/node73
   [junit4]   2> 1798107 T5290 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1798108 T5052 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=20 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"20",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 1798108 T5052 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3, shard4, shard5, shard6, shard7, shard8, shard9, shard10, shard11, shard12, shard13, shard14, shard15, shard16, shard17, shard18, shard19, shard20]
   [junit4]   2> 1798109 T5052 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard8
   [junit4]   2> 1798112 T5277 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798112 T5174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798112 T5103 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5169 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5250 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5124 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5246 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798114 T5187 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798112 T5238 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798114 T5202 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798114 T5226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798115 T5118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798112 T5199 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798112 T5154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798112 T5232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798112 T5247 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798115 T5079 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798115 T5073 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798115 T5148 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798115 T5136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798115 T5064 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798115 T5133 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798115 T5229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798115 T5205 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798115 T5085 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798115 T5070 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798114 T5088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798114 T5097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798114 T5211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798114 T5157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798114 T5112 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798114 T5127 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798114 T5151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798114 T5145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798114 T5109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798114 T5193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798114 T5067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798114 T5178 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798114 T5181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798114 T5274 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798114 T5100 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798114 T5160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798114 T5259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5268 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5061 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5184 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5163 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5142 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5115 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5241 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5139 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5223 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5208 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5256 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5262 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5217 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5253 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5166 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5082 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5091 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798113 T5235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798112 T5057 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798112 T5220 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798112 T5058 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798134 T5265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 74)
   [junit4]   2> 1798136 T5290 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1798137 T5052 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=20 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node6",
   [junit4]   2> 	  "core":"core6",
   [junit4]   2> 	  "core_node_name":"node6",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"20",
   [junit4]   2> 	  "base_url":"http://node6/solr/"}
   [junit4]   2> 1798137 T5052 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=20
   [junit4]   2> 1798137 T5052 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1798139 T5052 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=20 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node0",
   [junit4]   2> 	  "core":"core0",
   [junit4]   2> 	  "core_node_name":"node0",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"20",
   [junit4]   2> 	  "base_url":"http://node0/solr/"}
   [junit4]   2> 1798139 T5052 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=20
   [junit4]   2> 1798139 T5052 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard5
   [junit4]   2> 1798140 T5290 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1798141 T5052 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=20 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node2",
   [junit4]   2> 	  "core":"core2",
   [junit4]   2> 	  "core_node_name":"node2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"20",
   [junit4]   2> 	  "base_url":"http://node2/solr/"}
   [junit4]   2> 1798141 T5052 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=20
   [junit4]   2> 1798141 T5052 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
   [junit4]   2> 1798143 T5052 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=20 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node4",
   [junit4]   2> 	  "core":"core4",
   [junit4]   2> 	  "core_node_name":"node4",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"20",
   [junit4]   2> 	  "base_url":"http://node4/solr/"}
   [junit4]   2> 1798143 T5052 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=20
   [junit4]   2> 1798144 T5052 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard11
   [junit4]   2> 1798145 T5290 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1798145 T5052 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=20 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node7",
   [junit4]   2> 	  "core":"core7",
   [junit4]   2> 	  "core_node_name":"node7",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"20",
   [junit4]   2> 	  "base_url":"http://node7/solr/"}
   [junit4]   2> 1798146 T5052 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=20
   [junit4]   2> 1798146 T5052 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard13
   [junit4]   2> 1798148 T5052 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=20 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node5",
   [junit4]   2> 	  "core":"core5",
   [junit4]   2> 	  "core_node_name":"node5",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"20",
   [junit4]   2> 	  "base_url":"http://node5/solr/"}
   [junit4]   2> 1798148 T5052 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=20
   [junit4]   2> 1798148 T5052 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard15
   [junit4]   2> 1798150 T5290 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1798150 T5052 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=20 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node8",
   [junit4]   2> 	  "core":"core8",
   [junit4]   2> 	  "core_node_name":"node8",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"20",
   [junit4]   2> 	  "base_url":"http://node8/solr/"}
   [junit4]   2> 1798151 T5052 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=20
   [junit4]   2> 1798151 T5052 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard20
   [junit4]   2> 1798153 T5052 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=20 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node10",
   [junit4]   2> 	  "core":"core10",
   [junit4]   2> 	  "core_node_name":"node10",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"20",
   [junit4]   2> 	  "base_url":"http://node10/solr/"}
   [junit4]   2> 1798153 T5052 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=20
   [junit4]   2> 1798153 T5052 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard19
   [junit4]   2> 1798155 T5290 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1798156 T5052 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=20 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node3",
   [junit4]   2> 	  "core":"core3",
   [junit4]   2> 	  "core_node_name":"node3",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"20",
   [junit4]   2> 	  "base_url":"http://node3/solr/"}
   [junit4]   2> 1798156 T5052 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=20
   [junit4]   2> 1798156 T5052 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard6
   [junit4]   2> 1798158 T5052 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=20 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node11",
   [junit4]   2> 	  "core":"core11",
   [junit4]   2> 	  "core_node_name":"node11",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"20",
   [junit4]   2> 	  "base_url":"http://node11/solr/"}
   [junit4]   2> 1798158 T5052 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=20
   [junit4]   2> 1798159 T5052 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard7
   [junit4]   2> 1798160 T5290 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1798160 T5052 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=20 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node9",
   [junit4]   2> 	  "core":"core9",
   [junit4]   2> 	  "core_node_name":"node9",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"20",
   [junit4]   2> 	  "base_url":"http://node9/solr/"}
   [junit4]   2> 1798161 T5052 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=20
   [junit4]   2> 1798161 T5052 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard18
   [junit4]   2> 1798163 T5052 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=20 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node13",
   [junit4]   2> 	  "core":"core13",
   [junit4]   2> 	  "core_node_name":"node13",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"20",
   [junit4]   2> 	  "base_url":"http://node13/solr/"}
   [junit4]   2> 1798163 T5052 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=20
   [junit4]   2> 1798163 T5052 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard14
   [junit4]   2> 1798165 T5290 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1798165 T

[...truncated too long message...]

38 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1880688 T5038 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1880689 T5038 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:33514_solr
   [junit4]   2> 1880690 T5038 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1880691 T5038 oasc.Overseer.start Overseer (id=92764414030577667-127.0.0.1:33514_solr-n_0000000000) starting
   [junit4]   2> 1880693 T5038 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1880695 T5038 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 1880697 T5038 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 1880698 T5038 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 1880700 T5038 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1880703 T5038 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1880703 T5808 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1880705 T5807 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
   [junit4]   2> 1880705 T5807 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "shard":"s1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "roles":"",
   [junit4]   2> 	  "state":"recovering"}
   [junit4]   2> 1880706 T5810 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
   [junit4]   2> 1880707 T5807 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "shard":"s1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "core":"core2",
   [junit4]   2> 	  "roles":"",
   [junit4]   2> 	  "state":"recovering"}
   [junit4]   2> 1880707 T5810 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
   [junit4]   2> 1880708 T5807 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1880709 T5807 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "shard":"s1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "core":"core3",
   [junit4]   2> 	  "roles":"",
   [junit4]   2> 	  "state":"recovering"}
   [junit4]   2> 1880710 T5811 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1880710 T5810 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
   [junit4]   2> 1880806 T5038 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:33514 33514
   [junit4]   2> 1881511 T5794 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:33514 33514
   [junit4]   2> 1881512 T5038 oas.SolrTestCaseJ4.tearDown ###Ending testReplay
   [junit4]   2> 1881512 T5038 oasc.Overseer.close Overseer (id=92764414030577667-127.0.0.1:33514_solr-n_0000000000) closing
   [junit4]   2> 1881513 T5807 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:33514_solr
   [junit4]   2> 1881514 T5812 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:307)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:320)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:89)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:292)
   [junit4]   2> 
   [junit4]   2> 1884515 T5038 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerTest-A4A87ADA429D0299-001
   [junit4]   2> NOTE: test params are: codec=Lucene45, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=pt_BR, timezone=America/Blanc-Sablon
   [junit4]   2> NOTE: Linux 3.13.0-39-generic i386/Oracle Corporation 1.7.0_67 (32-bit)/cpus=8,threads=1,free=354691784,total=534773760
   [junit4]   2> NOTE: All tests run in this JVM: [TestCollapseQParserPlugin, PathHierarchyTokenizerFactoryTest, MBeansHandlerTest, SolrIndexSplitterTest, TestRemoteStreaming, TestStressRecovery, TestManagedStopFilterFactory, IndexSchemaTest, CustomCollectionTest, DocumentAnalysisRequestHandlerTest, AnalyticsMergeStrategyTest, TestConfig, TermsComponentTest, TestFaceting, JSONWriterTest, SuggesterWFSTTest, TestRandomDVFaceting, HdfsBasicDistributedZk2Test, TestMissingGroups, ClusterStateUpdateTest, SimpleFacetsTest, TestManagedSynonymFilterFactory, DistribCursorPagingTest, PrimitiveFieldTypeTest, PingRequestHandlerTest, DirectSolrSpellCheckerTest, TestRTGBase, TestDocBasedVersionConstraints, TestJmxMonitoredMap, TestExceedMaxTermLength, TestSolr4Spatial2, DistributedIntervalFacetingTest, DateMathParserTest, UnloadDistributedZkTest, InfoHandlerTest, SignatureUpdateProcessorFactoryTest, TestFieldCollectionResource, TestSurroundQueryParser, TestInitQParser, BasicFunctionalityTest, DocumentBuilderTest, TestInfoStreamLogging, MoreLikeThisHandlerTest, TestSchemaSimilarityResource, ZkCLITest, SuggesterTSTTest, WordBreakSolrSpellCheckerTest, PeerSyncTest, TestSort, BadIndexSchemaTest, TestIntervalFaceting, DistributedSpellCheckComponentTest, DistributedSuggestComponentTest, TestReplicationHandler, HighlighterMaxOffsetTest, QueryResultKeyTest, TestCursorMarkWithoutUniqueKey, ResourceLoaderTest, PreAnalyzedFieldTest, TestMiniSolrCloudCluster, HighlighterTest, XmlUpdateRequestHandlerTest, TestDefaultSimilarityFactory, TestSimpleQParserPlugin, CoreAdminRequestStatusTest, SolrCoreCheckLockOnStartupTest, TestLeaderElectionZkExpiry, SuggestComponentTest, DocValuesMultiTest, TestDynamicFieldResource, DirectUpdateHandlerTest, TestSchemaResource, EchoParamsTest, JsonLoaderTest, TestAnalyzedSuggestions, NoCacheHeaderTest, TestFoldingMultitermQuery, DisMaxRequestHandlerTest, TestReloadAndDeleteDocs, XsltUpdateRequestHandlerTest, TestLuceneMatchVersion, TestSolrJ, TestTrie, AliasIntegrationTest, TestOverriddenPrefixQueryForCustomFieldType, TestCopyFieldCollectionResource, TestSolrDeletionPolicy2, SyncSliceTest, TestComponentsName, TestSolrXmlPersistor, RequiredFieldsTest, IndexBasedSpellCheckerTest, CoreAdminHandlerTest, RegexBoostProcessorTest, SpellPossibilityIteratorTest, DocExpirationUpdateProcessorFactoryTest, DeleteReplicaTest, TestNumberUtils, TestStressVersions, BadCopyFieldTest, FileUtilsTest, CursorPagingTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, OverseerTest]
   [junit4] Completed on J0 in 87.33s, 9 tests, 1 error <<< FAILURES!

[...truncated 644 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/build.xml:474: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/build.xml:454: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/common-build.xml:494: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/lucene/common-build.xml:1350: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/lucene/common-build.xml:970: There were test failures: 421 suites, 1742 tests, 1 error, 38 ignored (17 assumptions)

Total time: 98 minutes 9 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.7.0_67 -server -XX:+UseG1GC (asserts: false)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



Mime
View raw message