lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@sd-datasolutions.de>
Subject [JENKINS] Lucene-Solr-4.x-Windows (64bit/jdk1.7.0_07) - Build # 1399 - Failure!
Date Fri, 02 Nov 2012 04:25:48 GMT
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Windows/1399/
Java: 64bit/jdk1.7.0_07 -XX:+UseParallelGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.OverseerTest.testShardLeaderChange

Error Message:
Unexpected shard leader coll:collection1 shard:shard1 expected:<core[4]> but was:<core[1]>

Stack Trace:
org.junit.ComparisonFailure: Unexpected shard leader coll:collection1 shard:shard1 expected:<core[4]> but was:<core[1]>
	at __randomizedtesting.SeedInfo.seed([E5082382E1BED85D:3B5BA475FB262DAC]:0)
	at org.junit.Assert.assertEquals(Assert.java:125)
	at org.apache.solr.cloud.OverseerTest.verifyShardLeader(OverseerTest.java:493)
	at org.apache.solr.cloud.OverseerTest.testShardLeaderChange(OverseerTest.java:652)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8422 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4:junit4]   2> 0 T286 oas.SolrTestCaseJ4.initCore ####initCore
[junit4:junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerTest-1351829231101
[junit4:junit4]   2> 1 T286 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4:junit4]   2> 3 T286 oas.SolrTestCaseJ4.setUp ###Starting testReplay
[junit4:junit4]   2> 3 T286 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 6 T287 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 7 T287 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 9 T287 oazsp.FileTxnSnapLog.save Snapshotting: 0
[junit4:junit4]   2> 106 T286 oasc.ZkTestServer.run start zk server on port:58883
[junit4:junit4]   2> 106 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58883/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@6e8c7e0a
[junit4:junit4]   2> 108 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 108 T292 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58883
[junit4:junit4]   2> 109 T292 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58883, initiating session
[junit4:junit4]   2> 109 T288 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58886
[junit4:junit4]   2> 109 T288 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58886
[junit4:junit4]   2> 109 T290 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 117 T290 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d16080000 with negotiated timeout 10000 for client /127.0.0.1:58886
[junit4:junit4]   2> 117 T292 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58883, sessionid = 0x13abf4d16080000, negotiated timeout = 10000
[junit4:junit4]   2> 117 T293 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e8c7e0a name:ZooKeeperConnection Watcher:127.0.0.1:58883/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 117 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 118 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58883 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7782121f
[junit4:junit4]   2> 120 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 120 T294 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58883
[junit4:junit4]   2> 122 T294 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58883, initiating session
[junit4:junit4]   2> 122 T288 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58889
[junit4:junit4]   2> 123 T288 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58889
[junit4:junit4]   2> 125 T290 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d16080001 with negotiated timeout 10000 for client /127.0.0.1:58889
[junit4:junit4]   2> 125 T294 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58883, sessionid = 0x13abf4d16080001, negotiated timeout = 10000
[junit4:junit4]   2> 125 T295 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7782121f name:ZooKeeperConnection Watcher:127.0.0.1:58883 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 126 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 127 T291 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13abf4d16080001
[junit4:junit4]   2> 130 T288 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:58889 which had sessionid 0x13abf4d16080001
[junit4:junit4]   2> 131 T286 oaz.ZooKeeper.close Session: 0x13abf4d16080001 closed
[junit4:junit4]   2> 131 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58883 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2d8657f9
[junit4:junit4]   2> 132 T295 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 132 T296 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58883
[junit4:junit4]   2> 133 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 138 T288 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58892
[junit4:junit4]   2> 138 T296 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58883, initiating session
[junit4:junit4]   2> 139 T288 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58892
[junit4:junit4]   2> 142 T290 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d16080002 with negotiated timeout 10000 for client /127.0.0.1:58892
[junit4:junit4]   2> 142 T296 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58883, sessionid = 0x13abf4d16080002, negotiated timeout = 10000
[junit4:junit4]   2> 142 T297 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d8657f9 name:ZooKeeperConnection Watcher:127.0.0.1:58883 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 142 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 143 T286 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 147 T291 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13abf4d16080002
[junit4:junit4]   2> 149 T288 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:58892 which had sessionid 0x13abf4d16080002
[junit4:junit4]   2> 149 T286 oaz.ZooKeeper.close Session: 0x13abf4d16080002 closed
[junit4:junit4]   2> 150 T286 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 150 T297 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 155 T286 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 157 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 161 T291 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13abf4d16080000 type:create cxid:0xc zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 168 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58883/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7e178b48
[junit4:junit4]   2> 169 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 169 T298 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58883
[junit4:junit4]   2> 171 T298 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58883, initiating session
[junit4:junit4]   2> 171 T288 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58895
[junit4:junit4]   2> 171 T288 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58895
[junit4:junit4]   2> 173 T290 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d16080003 with negotiated timeout 10000 for client /127.0.0.1:58895
[junit4:junit4]   2> 173 T298 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58883, sessionid = 0x13abf4d16080003, negotiated timeout = 10000
[junit4:junit4]   2> 173 T299 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e178b48 name:ZooKeeperConnection Watcher:127.0.0.1:58883/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 174 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 175 T286 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 183 T291 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13abf4d16080003 type:delete cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 185 T286 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 188 T286 oasc.Overseer.start Overseer (id=88593480490156035-127.0.0.1:58883_solr-n_0000000000) starting
[junit4:junit4]   2> 189 T291 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13abf4d16080003 type:create cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 191 T291 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13abf4d16080003 type:create cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 193 T291 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13abf4d16080003 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 194 T291 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13abf4d16080003 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 196 T301 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 196 T291 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13abf4d16080000 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 198 T291 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13abf4d16080000 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 203 T300 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 205 T300 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4:junit4]   2> 206 T300 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":"s1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
[junit4:junit4]   2> 	  "roles":""}
[junit4:junit4]   2> 208 T293 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 215 T300 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":"s1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
[junit4:junit4]   2> 	  "roles":""}
[junit4:junit4]   2> 217 T293 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 226 T300 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 231 T300 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 233 T300 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core3",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":"s1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
[junit4:junit4]   2> 	  "roles":""}
[junit4:junit4]   2> 254 T293 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 308 T291 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13abf4d16080003
[junit4:junit4]   2> 310 T288 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13abf4d16080003, likely client has closed socket
[junit4:junit4]   2> 310 T286 oaz.ZooKeeper.close Session: 0x13abf4d16080003 closed
[junit4:junit4]   2> 312 T288 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:58895 which had sessionid 0x13abf4d16080003
[junit4:junit4]   2> 312 T299 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 312 T291 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13abf4d16080000
[junit4:junit4]   2> 314 T286 oaz.ZooKeeper.close Session: 0x13abf4d16080000 closed
[junit4:junit4]   2> 315 T293 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 315 T288 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13abf4d16080000, likely client has closed socket
[junit4:junit4]   2> 315 T291 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 315 T290 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 317 T288 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:58886 which had sessionid 0x13abf4d16080000
[junit4:junit4]   2> 318 T286 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 764 T300 oasc.Overseer$ClusterStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:244)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:192)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:116)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 2605 T300 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88593480490156035-127.0.0.1:58883_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 913 T289 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 2607 T288 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 2609 T286 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 2609 T286 oas.SolrTestCaseJ4.tearDown ###Ending testReplay
[junit4:junit4]   2> 2612 T286 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
[junit4:junit4]   2> 2613 T286 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 2614 T302 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 2615 T302 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 2616 T302 oazsp.FileSnap.deserialize Reading snapshot C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerTest-1351829231101\zookeeper\server1\data\version-2\snapshot.0
[junit4:junit4]   2> 2618 T302 oazsp.FileTxnSnapLog.save Snapshotting: 26
[junit4:junit4]   2> 2715 T286 oasc.ZkTestServer.run start zk server on port:58898
[junit4:junit4]   2> 2715 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1adb996b
[junit4:junit4]   2> 2716 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2716 T307 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 2718 T307 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 2718 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58901
[junit4:junit4]   2> 2719 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58901
[junit4:junit4]   2> 2719 T305 oazsp.FileTxnLog.append Creating new log file: log.27
[junit4:junit4]   2> 2725 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390000 with negotiated timeout 10000 for client /127.0.0.1:58901
[junit4:junit4]   2> 2725 T307 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390000, negotiated timeout = 10000
[junit4:junit4]   2> 2725 T308 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1adb996b name:ZooKeeperConnection Watcher:127.0.0.1:58898 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2725 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2746 T306 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13abf4d20390000
[junit4:junit4]   2> 2747 T303 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13abf4d20390000, likely client has closed socket
[junit4:junit4]   2> 2747 T286 oaz.ZooKeeper.close Session: 0x13abf4d20390000 closed
[junit4:junit4]   2> 2747 T303 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:58901 which had sessionid 0x13abf4d20390000
[junit4:junit4]   2> 2747 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@10124918
[junit4:junit4]   2> 2748 T308 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2750 T309 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 2750 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2752 T309 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 2752 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58904
[junit4:junit4]   2> 2752 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58904
[junit4:junit4]   2> 2754 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390001 with negotiated timeout 10000 for client /127.0.0.1:58904
[junit4:junit4]   2> 2754 T309 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390001, negotiated timeout = 10000
[junit4:junit4]   2> 2754 T310 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10124918 name:ZooKeeperConnection Watcher:127.0.0.1:58898 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2755 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2756 T286 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 2760 T306 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13abf4d20390001
[junit4:junit4]   2> 2761 T286 oaz.ZooKeeper.close Session: 0x13abf4d20390001 closed
[junit4:junit4]   2> 2761 T310 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2761 T303 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13abf4d20390001, likely client has closed socket
[junit4:junit4]   2> 2762 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@5554f0a0
[junit4:junit4]   2> 2762 T303 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:58904 which had sessionid 0x13abf4d20390001
[junit4:junit4]   2> 2764 T311 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 2763 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2764 T311 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 2764 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58907
[junit4:junit4]   2> 2765 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58907
[junit4:junit4]   2> 2767 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390002 with negotiated timeout 10000 for client /127.0.0.1:58907
[junit4:junit4]   2> 2767 T311 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390002, negotiated timeout = 10000
[junit4:junit4]   2> 2767 T312 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5554f0a0 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2769 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2769 T286 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 2772 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@19e4c53a
[junit4:junit4]   2> 2774 T313 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 2774 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2775 T313 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 2775 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58910
[junit4:junit4]   2> 2776 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58910
[junit4:junit4]   2> 2778 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390003 with negotiated timeout 10000 for client /127.0.0.1:58910
[junit4:junit4]   2> 2778 T313 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390003, negotiated timeout = 10000
[junit4:junit4]   2> 2778 T314 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19e4c53a name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2779 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2780 T286 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 2789 T306 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13abf4d20390003 type:delete cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 2791 T286 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 2802 T286 oasc.Overseer.start Overseer (id=88593480661139459-127.0.0.1:58898_solr-n_0000000000) starting
[junit4:junit4]   2> 2805 T306 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13abf4d20390003 type:create cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2808 T306 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13abf4d20390003 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2810 T306 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13abf4d20390003 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2813 T316 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 2815 T286 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 2816 T315 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 2824 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2827 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@32a00cd4
[junit4:junit4]   2> 2830 T317 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 2830 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2832 T317 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 2833 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58913
[junit4:junit4]   2> 2833 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58913
[junit4:junit4]   2> 2836 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390004 with negotiated timeout 10000 for client /127.0.0.1:58913
[junit4:junit4]   2> 2836 T317 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390004, negotiated timeout = 10000
[junit4:junit4]   2> 2837 T318 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32a00cd4 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2837 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2839 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2842 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node0
[junit4:junit4]   2> 2849 T318 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 2849 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4eff8fc8
[junit4:junit4]   2> 2851 T312 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 2852 T319 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 2852 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2854 T319 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 2854 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58916
[junit4:junit4]   2> 2855 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58916
[junit4:junit4]   2> 2858 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390005 with negotiated timeout 10000 for client /127.0.0.1:58916
[junit4:junit4]   2> 2858 T319 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390005, negotiated timeout = 10000
[junit4:junit4]   2> 2859 T320 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4eff8fc8 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2859 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2861 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2863 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4:junit4]   2> 2869 T312 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2869 T318 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2870 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1070bc26
[junit4:junit4]   2> 2870 T320 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2871 T321 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 2871 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2873 T321 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 2873 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58919
[junit4:junit4]   2> 2874 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58919
[junit4:junit4]   2> 2877 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390006 with negotiated timeout 10000 for client /127.0.0.1:58919
[junit4:junit4]   2> 2877 T321 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390006, negotiated timeout = 10000
[junit4:junit4]   2> 2877 T322 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1070bc26 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2877 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2878 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2881 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4:junit4]   2> 2887 T312 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 2887 T320 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 2888 T322 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 2888 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@653844a7
[junit4:junit4]   2> 2889 T318 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 2889 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2889 T323 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 2892 T323 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 2892 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58922
[junit4:junit4]   2> 2893 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58922
[junit4:junit4]   2> 2895 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390007 with negotiated timeout 10000 for client /127.0.0.1:58922
[junit4:junit4]   2> 2895 T323 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390007, negotiated timeout = 10000
[junit4:junit4]   2> 2896 T324 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@653844a7 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2896 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2898 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2900 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node3
[junit4:junit4]   2> 2905 T312 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 2907 T320 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 2908 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7850a3db
[junit4:junit4]   2> 2908 T324 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 2908 T322 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 2908 T318 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 2909 T325 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 2909 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2911 T325 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 2912 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58925
[junit4:junit4]   2> 2912 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58925
[junit4:junit4]   2> 2915 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390008 with negotiated timeout 10000 for client /127.0.0.1:58925
[junit4:junit4]   2> 2915 T325 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390008, negotiated timeout = 10000
[junit4:junit4]   2> 2916 T326 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7850a3db name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2916 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2918 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2921 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node4
[junit4:junit4]   2> 2927 T312 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 2927 T326 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 2927 T320 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 2928 T324 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 2928 T318 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 2928 T322 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 2928 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@33bcfb09
[junit4:junit4]   2> 2931 T327 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 2931 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2933 T327 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 2933 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58928
[junit4:junit4]   2> 2934 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58928
[junit4:junit4]   2> 2937 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390009 with negotiated timeout 10000 for client /127.0.0.1:58928
[junit4:junit4]   2> 2937 T327 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390009, negotiated timeout = 10000
[junit4:junit4]   2> 2937 T328 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33bcfb09 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2938 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2939 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2942 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node5
[junit4:junit4]   2> 2948 T312 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 2949 T318 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 2949 T322 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 2949 T326 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 2949 T324 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 2950 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@680b42ee
[junit4:junit4]   2> 2950 T328 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 2950 T320 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 2951 T329 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 2951 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2954 T329 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 2954 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58931
[junit4:junit4]   2> 2955 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58931
[junit4:junit4]   2> 2957 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d2039000a with negotiated timeout 10000 for client /127.0.0.1:58931
[junit4:junit4]   2> 2957 T329 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d2039000a, negotiated timeout = 10000
[junit4:junit4]   2> 2958 T330 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@680b42ee name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2958 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2960 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2963 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node6
[junit4:junit4]   2> 2968 T324 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 2969 T326 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 2969 T328 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 2970 T320 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 2971 T322 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 2971 T312 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 2971 T330 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 2971 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@6e2669c1
[junit4:junit4]   2> 2972 T318 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 2973 T331 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 2973 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2975 T331 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 2976 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58934
[junit4:junit4]   2> 2977 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58934
[junit4:junit4]   2> 2980 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d2039000b with negotiated timeout 10000 for client /127.0.0.1:58934
[junit4:junit4]   2> 2980 T331 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d2039000b, negotiated timeout = 10000
[junit4:junit4]   2> 2980 T332 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e2669c1 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2980 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2982 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2985 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node7
[junit4:junit4]   2> 2990 T322 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 2991 T324 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 2991 T326 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 2991 T320 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 2992 T312 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 2992 T328 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 2992 T318 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 2992 T330 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 2993 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@512d94a7
[junit4:junit4]   2> 2993 T332 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 2995 T333 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 2995 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3007 T333 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3007 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58937
[junit4:junit4]   2> 3008 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58937
[junit4:junit4]   2> 3011 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d2039000c with negotiated timeout 10000 for client /127.0.0.1:58937
[junit4:junit4]   2> 3011 T333 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d2039000c, negotiated timeout = 10000
[junit4:junit4]   2> 3011 T334 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@512d94a7 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3012 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3013 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3016 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node8
[junit4:junit4]   2> 3023 T334 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 3024 T326 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 3026 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1381d8f4
[junit4:junit4]   2> 3026 T324 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 3027 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3027 T322 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 3028 T318 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 3028 T332 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 3028 T312 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 3028 T320 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 3028 T328 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 3030 T330 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 3030 T335 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3032 T335 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3033 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58940
[junit4:junit4]   2> 3033 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58940
[junit4:junit4]   2> 3036 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d2039000d with negotiated timeout 10000 for client /127.0.0.1:58940
[junit4:junit4]   2> 3036 T335 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d2039000d, negotiated timeout = 10000
[junit4:junit4]   2> 3036 T336 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1381d8f4 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3037 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3038 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3042 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node9
[junit4:junit4]   2> 3049 T326 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 3050 T336 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 3051 T324 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 3051 T334 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 3052 T322 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 3054 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@540bcdc1
[junit4:junit4]   2> 3053 T328 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 3053 T320 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 3054 T312 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 3054 T332 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 3056 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3054 T330 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 3053 T318 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 3057 T337 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3059 T337 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3060 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58943
[junit4:junit4]   2> 3060 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58943
[junit4:junit4]   2> 3065 T337 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d2039000e, negotiated timeout = 10000
[junit4:junit4]   2> 3065 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d2039000e with negotiated timeout 10000 for client /127.0.0.1:58943
[junit4:junit4]   2> 3065 T338 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@540bcdc1 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3065 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3068 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3194 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node10
[junit4:junit4]   2> 3210 T336 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 3211 T322 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 3212 T324 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 3212 T320 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 3212 T330 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 3213 T334 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 3213 T338 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 3214 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4b8c746d
[junit4:junit4]   2> 3214 T312 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 3214 T328 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 3214 T318 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 3214 T332 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 3214 T326 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 3215 T339 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3215 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3218 T339 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3219 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58946
[junit4:junit4]   2> 3219 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58946
[junit4:junit4]   2> 3226 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d2039000f with negotiated timeout 10000 for client /127.0.0.1:58946
[junit4:junit4]   2> 3226 T339 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d2039000f, negotiated timeout = 10000
[junit4:junit4]   2> 3227 T340 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b8c746d name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3227 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3229 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3233 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node11
[junit4:junit4]   2> 3239 T334 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 3240 T324 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 3242 T322 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 3242 T326 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 3243 T312 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 3243 T336 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 3243 T338 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 3243 T318 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 3244 T332 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 3244 T330 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 3244 T320 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 3244 T340 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 3244 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@187885c2
[junit4:junit4]   2> 3244 T328 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 3247 T341 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3247 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3249 T341 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3249 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58949
[junit4:junit4]   2> 3250 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58949
[junit4:junit4]   2> 3253 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390010 with negotiated timeout 10000 for client /127.0.0.1:58949
[junit4:junit4]   2> 3253 T341 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390010, negotiated timeout = 10000
[junit4:junit4]   2> 3254 T342 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@187885c2 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3254 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3256 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3259 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node12
[junit4:junit4]   2> 3266 T334 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 3268 T324 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 3270 T326 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 3270 T338 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 3270 T320 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 3272 T336 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 3272 T312 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 3272 T322 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 3272 T318 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 3272 T342 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 3273 T328 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 3273 T330 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 3273 T332 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 3273 T340 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 3273 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@9fed767
[junit4:junit4]   2> 3275 T343 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3275 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3277 T343 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3278 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58952
[junit4:junit4]   2> 3278 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58952
[junit4:junit4]   2> 3281 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390011 with negotiated timeout 10000 for client /127.0.0.1:58952
[junit4:junit4]   2> 3281 T343 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390011, negotiated timeout = 10000
[junit4:junit4]   2> 3284 T344 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9fed767 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3284 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3286 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3289 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node13
[junit4:junit4]   2> 3297 T344 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 3298 T334 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 3298 T324 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 3299 T312 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 3300 T336 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 3300 T318 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 3300 T330 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 3302 T332 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 3302 T326 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 3302 T322 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 3302 T320 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 3304 T328 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 3302 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@44dd73b7
[junit4:junit4]   2> 3304 T342 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 3304 T338 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 3304 T340 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 3306 T345 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3306 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3308 T345 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3308 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58955
[junit4:junit4]   2> 3309 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58955
[junit4:junit4]   2> 3312 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390012 with negotiated timeout 10000 for client /127.0.0.1:58955
[junit4:junit4]   2> 3312 T345 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390012, negotiated timeout = 10000
[junit4:junit4]   2> 3313 T346 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@44dd73b7 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3313 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3315 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3318 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node14
[junit4:junit4]   2> 3326 T334 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 3326 T324 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 3328 T338 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 3328 T312 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 3329 T344 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 3329 T318 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 3329 T330 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 3330 T346 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 3330 T328 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 3330 T332 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 3330 T342 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 3331 T340 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 3331 T320 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 3331 T322 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 3332 T326 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 3333 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4062b578
[junit4:junit4]   2> 3333 T336 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 3334 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3345 T347 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3348 T347 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3348 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58958
[junit4:junit4]   2> 3349 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58958
[junit4:junit4]   2> 3353 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390013 with negotiated timeout 10000 for client /127.0.0.1:58958
[junit4:junit4]   2> 3353 T347 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390013, negotiated timeout = 10000
[junit4:junit4]   2> 3353 T348 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4062b578 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3354 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3355 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3358 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node15
[junit4:junit4]   2> 3366 T334 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 3369 T324 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 3369 T344 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 3371 T328 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 3372 T342 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 3372 T336 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 3372 T322 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 3372 T326 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 3373 T332 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 3373 T338 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 3373 T346 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 3373 T348 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 3373 T318 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 3373 T312 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 3373 T330 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 3373 T340 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 3373 T320 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 3373 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@79406807
[junit4:junit4]   2> 3377 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3377 T349 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3380 T349 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3380 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58961
[junit4:junit4]   2> 3382 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58961
[junit4:junit4]   2> 3384 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390014 with negotiated timeout 10000 for client /127.0.0.1:58961
[junit4:junit4]   2> 3384 T349 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390014, negotiated timeout = 10000
[junit4:junit4]   2> 3385 T350 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@79406807 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3385 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3386 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3389 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node16
[junit4:junit4]   2> 3397 T324 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 3397 T344 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 3398 T334 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 3400 T312 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 3401 T336 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 3401 T342 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 3401 T326 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 3401 T338 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 3402 T346 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 3402 T322 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 3402 T340 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 3403 T318 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 3404 T330 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 3404 T332 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 3404 T350 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 3405 T348 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 3405 T320 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 3405 T328 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 3405 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4936f59e
[junit4:junit4]   2> 3408 T351 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3408 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3410 T351 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3410 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58964
[junit4:junit4]   2> 3411 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58964
[junit4:junit4]   2> 3414 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390015 with negotiated timeout 10000 for client /127.0.0.1:58964
[junit4:junit4]   2> 3414 T351 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390015, negotiated timeout = 10000
[junit4:junit4]   2> 3415 T352 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4936f59e name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3415 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3417 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3420 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node17
[junit4:junit4]   2> 3430 T334 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 3431 T352 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 3431 T324 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 3431 T344 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 3431 T312 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 3432 T338 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 3432 T336 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 3432 T328 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 3434 T332 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 3434 T322 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 3435 T318 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 3435 T348 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 3435 T340 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 3436 T320 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 3436 T342 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 3436 T346 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 3436 T326 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 3436 T330 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 3436 T350 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 3436 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@191bb6e9
[junit4:junit4]   2> 3439 T353 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3439 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3440 T353 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3440 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58967
[junit4:junit4]   2> 3441 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58967
[junit4:junit4]   2> 3443 T353 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390016, negotiated timeout = 10000
[junit4:junit4]   2> 3443 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390016 with negotiated timeout 10000 for client /127.0.0.1:58967
[junit4:junit4]   2> 3444 T354 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@191bb6e9 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3444 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3446 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3449 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node18
[junit4:junit4]   2> 3483 T352 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 3484 T334 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 3484 T324 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 3484 T344 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 3484 T312 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 3484 T338 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 3484 T346 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 3484 T336 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 3485 T326 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 3485 T350 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 3486 T322 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 3486 T342 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 3486 T340 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 3486 T328 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 3486 T320 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 3486 T330 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 3487 T332 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 3487 T318 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 3487 T348 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 3487 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@cf9005c
[junit4:junit4]   2> 3489 T355 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3491 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3491 T354 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 3493 T355 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3493 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58970
[junit4:junit4]   2> 3494 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58970
[junit4:junit4]   2> 3496 T355 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390017, negotiated timeout = 10000
[junit4:junit4]   2> 3496 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390017 with negotiated timeout 10000 for client /127.0.0.1:58970
[junit4:junit4]   2> 3496 T356 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cf9005c name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3496 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3497 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3499 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node19
[junit4:junit4]   2> 3517 T352 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 3517 T334 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 3517 T324 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 3519 T344 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 3520 T312 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 3520 T338 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 3520 T346 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 3520 T336 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 3521 T326 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 3521 T350 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 3521 T322 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 3521 T342 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 3521 T328 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 3521 T340 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 3521 T354 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 3522 T320 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 3522 T330 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 3522 T332 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 3522 T348 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 3522 T318 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 3522 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@3c5cfc25
[junit4:junit4]   2> 3523 T356 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 3524 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3524 T357 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3525 T357 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3525 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58973
[junit4:junit4]   2> 3526 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58973
[junit4:junit4]   2> 3528 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390018 with negotiated timeout 10000 for client /127.0.0.1:58973
[junit4:junit4]   2> 3528 T357 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390018, negotiated timeout = 10000
[junit4:junit4]   2> 3529 T358 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c5cfc25 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3529 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3530 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3532 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node20
[junit4:junit4]   2> 3537 T356 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3537 T334 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3537 T352 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3540 T350 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3540 T322 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3542 T326 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3542 T336 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3543 T338 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3544 T324 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3544 T342 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3544 T344 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3545 T348 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3546 T318 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3546 T330 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3544 T346 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3546 T358 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3546 T354 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3546 T328 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3546 T320 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3546 T332 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3545 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@3af22a46
[junit4:junit4]   2> 3544 T340 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3544 T312 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 3548 T359 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3548 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3550 T359 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3550 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58976
[junit4:junit4]   2> 3550 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58976
[junit4:junit4]   2> 3552 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390019 with negotiated timeout 10000 for client /127.0.0.1:58976
[junit4:junit4]   2> 3552 T359 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390019, negotiated timeout = 10000
[junit4:junit4]   2> 3552 T360 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3af22a46 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3552 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3553 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3556 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node21
[junit4:junit4]   2> 3564 T352 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3565 T334 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3565 T340 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3566 T358 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3566 T326 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3566 T342 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3567 T348 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3567 T354 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3567 T312 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3569 T338 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3569 T332 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3569 T320 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3570 T336 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3570 T350 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3570 T346 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3570 T328 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3570 T344 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3570 T360 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3570 T322 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3570 T330 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3570 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@15c839c4
[junit4:junit4]   2> 3570 T356 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3570 T318 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3570 T324 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 3573 T361 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3572 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3574 T361 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3575 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58979
[junit4:junit4]   2> 3575 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58979
[junit4:junit4]   2> 3577 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d2039001a with negotiated timeout 10000 for client /127.0.0.1:58979
[junit4:junit4]   2> 3577 T361 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d2039001a, negotiated timeout = 10000
[junit4:junit4]   2> 3578 T362 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15c839c4 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3578 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3579 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3581 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node22
[junit4:junit4]   2> 3589 T360 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3591 T352 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3591 T356 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3591 T350 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3594 T332 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3595 T346 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3595 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@6a2cc795
[junit4:junit4]   2> 3596 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3598 T336 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3598 T324 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3598 T334 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3598 T358 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3598 T318 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3598 T312 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3599 T362 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3599 T330 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3599 T320 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3598 T338 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3599 T363 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3599 T328 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3599 T340 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3599 T354 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3599 T342 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3599 T322 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3599 T348 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3599 T326 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3599 T344 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 3601 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58982
[junit4:junit4]   2> 3601 T363 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3603 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58982
[junit4:junit4]   2> 3605 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d2039001b with negotiated timeout 10000 for client /127.0.0.1:58982
[junit4:junit4]   2> 3605 T363 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d2039001b, negotiated timeout = 10000
[junit4:junit4]   2> 3606 T364 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6a2cc795 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3606 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3608 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3611 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node23
[junit4:junit4]   2> 3625 T322 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3625 T342 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3627 T346 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3627 T356 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3627 T338 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3627 T330 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3627 T324 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3627 T336 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3628 T350 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3628 T340 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3628 T312 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3628 T362 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3629 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7f59ccdd
[junit4:junit4]   2> 3630 T326 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3631 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3631 T320 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3632 T352 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3632 T358 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3632 T334 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3636 T360 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3636 T328 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3636 T344 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3637 T318 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3638 T364 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3638 T348 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3638 T332 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3638 T354 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 3640 T365 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3643 T365 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3643 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58985
[junit4:junit4]   2> 3643 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58985
[junit4:junit4]   2> 3646 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d2039001c with negotiated timeout 10000 for client /127.0.0.1:58985
[junit4:junit4]   2> 3647 T365 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d2039001c, negotiated timeout = 10000
[junit4:junit4]   2> 3647 T366 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f59ccdd name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3647 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3649 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3654 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node24
[junit4:junit4]   2> 3668 T342 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3669 T348 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3669 T320 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3669 T330 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3669 T324 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3669 T334 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3676 T340 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3677 T318 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3677 T322 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3677 T312 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3678 T364 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3678 T362 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3678 T350 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3678 T336 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3679 T344 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3679 T358 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3679 T356 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3679 T360 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3680 T352 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3686 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7d15f126
[junit4:junit4]   2> 3689 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3690 T338 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3691 T346 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3691 T326 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3691 T328 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3692 T354 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3692 T332 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3692 T366 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 3692 T367 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3694 T367 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3694 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58988
[junit4:junit4]   2> 3695 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58988
[junit4:junit4]   2> 3698 T367 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d2039001d, negotiated timeout = 10000
[junit4:junit4]   2> 3698 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d2039001d with negotiated timeout 10000 for client /127.0.0.1:58988
[junit4:junit4]   2> 3698 T368 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d15f126 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3698 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3699 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3702 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node25
[junit4:junit4]   2> 3722 T362 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3722 T320 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3723 T312 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3723 T364 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3723 T330 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3724 T358 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3724 T336 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3724 T322 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3726 T360 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3726 T350 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3726 T354 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3726 T332 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3726 T328 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3726 T326 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3727 T346 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3727 T338 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3727 T366 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3727 T334 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3727 T348 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3727 T342 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3727 T318 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3727 T324 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3727 T340 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3728 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4699a510
[junit4:junit4]   2> 3727 T344 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3729 T368 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3727 T352 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3727 T356 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4:junit4]   2> 3730 T369 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3730 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3733 T369 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3733 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58991
[junit4:junit4]   2> 3733 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58991
[junit4:junit4]   2> 3736 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d2039001e with negotiated timeout 10000 for client /127.0.0.1:58991
[junit4:junit4]   2> 3736 T369 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d2039001e, negotiated timeout = 10000
[junit4:junit4]   2> 3736 T370 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4699a510 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3736 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3737 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3740 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node26
[junit4:junit4]   2> 3755 T348 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3755 T334 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3755 T320 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3755 T330 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3756 T360 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3756 T356 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3756 T344 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3757 T352 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3757 T340 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3757 T318 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3758 T358 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3758 T332 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3761 T328 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3762 T354 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3762 T326 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3763 T346 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3763 T338 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3763 T366 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3763 T370 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3764 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@79a8c065
[junit4:junit4]   2> 3765 T324 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3765 T364 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3765 T362 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3766 T312 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3765 T336 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3765 T368 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3766 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3766 T322 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3766 T342 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3766 T350 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4:junit4]   2> 3766 T371 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3769 T371 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3769 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58994
[junit4:junit4]   2> 3770 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58994
[junit4:junit4]   2> 3772 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d2039001f with negotiated timeout 10000 for client /127.0.0.1:58994
[junit4:junit4]   2> 3772 T371 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d2039001f, negotiated timeout = 10000
[junit4:junit4]   2> 3772 T372 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@79a8c065 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3772 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3773 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3776 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node27
[junit4:junit4]   2> 3785 T372 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3785 T352 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3785 T360 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3785 T356 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3786 T358 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3786 T344 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3786 T370 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3788 T364 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3788 T354 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3789 T326 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3789 T330 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3789 T320 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3790 T340 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3794 T348 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3794 T328 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3794 T368 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3794 T366 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3795 T346 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3795 T332 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3795 T324 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3795 T362 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3795 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@19986cd
[junit4:junit4]   2> 3798 T334 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3798 T318 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3798 T322 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3799 T350 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3799 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3800 T336 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3801 T338 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3801 T342 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3801 T312 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4:junit4]   2> 3801 T373 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3804 T373 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3804 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:58997
[junit4:junit4]   2> 3805 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:58997
[junit4:junit4]   2> 3807 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390020 with negotiated timeout 10000 for client /127.0.0.1:58997
[junit4:junit4]   2> 3807 T373 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390020, negotiated timeout = 10000
[junit4:junit4]   2> 3807 T374 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19986cd name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3807 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3809 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3812 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node28
[junit4:junit4]   2> 3822 T372 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3824 T352 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3825 T360 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3825 T356 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3825 T358 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3825 T344 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3825 T370 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3826 T312 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3826 T364 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3828 T362 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3830 T322 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3830 T336 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3831 T342 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3838 T332 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3839 T338 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3839 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@23aa358e
[junit4:junit4]   2> 3841 T374 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3841 T354 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3842 T366 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3842 T328 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3842 T334 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3842 T326 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3843 T346 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3843 T324 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3843 T318 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3843 T348 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3843 T368 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3844 T330 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3844 T320 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3844 T340 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3845 T350 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4:junit4]   2> 3846 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3846 T375 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3848 T375 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3848 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:59000
[junit4:junit4]   2> 3850 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:59000
[junit4:junit4]   2> 3852 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390021 with negotiated timeout 10000 for client /127.0.0.1:59000
[junit4:junit4]   2> 3853 T375 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390021, negotiated timeout = 10000
[junit4:junit4]   2> 3853 T376 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23aa358e name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3854 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3855 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3858 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node29
[junit4:junit4]   2> 3869 T352 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3870 T372 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3870 T360 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3870 T364 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3871 T318 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3871 T368 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3871 T354 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3871 T344 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3872 T348 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3875 T326 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3875 T330 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3875 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@587ac955
[junit4:junit4]   2> 3876 T332 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3877 T320 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3877 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3878 T346 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3878 T336 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3879 T334 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3879 T356 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3879 T370 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3879 T374 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3879 T362 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3879 T376 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3879 T377 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3879 T328 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3879 T324 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3879 T340 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3879 T338 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3879 T358 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3879 T342 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3879 T350 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3879 T312 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3879 T322 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3879 T366 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4:junit4]   2> 3882 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:59003
[junit4:junit4]   2> 3882 T377 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3884 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:59003
[junit4:junit4]   2> 3885 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390022 with negotiated timeout 10000 for client /127.0.0.1:59003
[junit4:junit4]   2> 3885 T377 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390022, negotiated timeout = 10000
[junit4:junit4]   2> 3886 T378 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@587ac955 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3886 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3887 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3889 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node30
[junit4:junit4]   2> 3897 T372 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3903 T360 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3903 T352 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3904 T356 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3904 T368 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3904 T346 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3905 T370 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3905 T358 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3905 T344 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3905 T342 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3906 T350 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3906 T364 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3906 T326 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3906 T334 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3906 T376 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3909 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@583b6a09
[junit4:junit4]   2> 3911 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3910 T374 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3911 T336 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3911 T312 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3911 T330 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3911 T378 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3911 T318 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3911 T379 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3911 T366 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3911 T322 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3911 T332 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3911 T354 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3911 T328 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3911 T338 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3911 T320 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3911 T348 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3911 T340 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3911 T362 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3911 T324 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4:junit4]   2> 3912 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:59006
[junit4:junit4]   2> 3912 T379 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3915 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:59006
[junit4:junit4]   2> 3918 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390023 with negotiated timeout 10000 for client /127.0.0.1:59006
[junit4:junit4]   2> 3918 T379 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390023, negotiated timeout = 10000
[junit4:junit4]   2> 3919 T380 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@583b6a09 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3919 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3920 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3923 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node31
[junit4:junit4]   2> 3941 T380 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3942 T352 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3942 T372 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3942 T360 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3942 T356 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3942 T344 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3942 T358 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3943 T370 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3943 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@66c35460
[junit4:junit4]   2> 3945 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3945 T312 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3945 T322 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3945 T376 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3945 T378 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3945 T318 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3946 T338 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3947 T362 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3947 T334 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3947 T364 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3947 T346 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3947 T348 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3947 T330 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3947 T366 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3948 T336 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3948 T342 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3948 T324 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3948 T340 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3948 T332 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3947 T381 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3948 T374 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3948 T328 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3948 T350 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3948 T354 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3948 T368 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3948 T320 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3948 T326 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4:junit4]   2> 3951 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:59009
[junit4:junit4]   2> 3951 T381 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3953 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:59009
[junit4:junit4]   2> 3956 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390024 with negotiated timeout 10000 for client /127.0.0.1:59009
[junit4:junit4]   2> 3956 T381 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390024, negotiated timeout = 10000
[junit4:junit4]   2> 3959 T382 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@66c35460 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3959 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3963 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3967 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node32
[junit4:junit4]   2> 3982 T372 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3983 T352 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3983 T360 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3983 T380 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3983 T356 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3984 T358 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3984 T344 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3985 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@39f270a
[junit4:junit4]   2> 3985 T370 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3985 T362 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3985 T322 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3985 T350 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3987 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3988 T364 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3988 T312 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3988 T336 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3988 T342 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3988 T340 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3990 T382 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3990 T332 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3990 T366 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3990 T334 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3990 T318 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3990 T348 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3991 T374 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3991 T376 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3990 T320 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3990 T324 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3990 T328 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3991 T383 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 3991 T330 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3990 T354 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3990 T326 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3990 T378 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3990 T346 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3990 T368 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3990 T338 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4:junit4]   2> 3995 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:59012
[junit4:junit4]   2> 3994 T383 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 3996 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:59012
[junit4:junit4]   2> 3998 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390025 with negotiated timeout 10000 for client /127.0.0.1:59012
[junit4:junit4]   2> 3999 T383 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390025, negotiated timeout = 10000
[junit4:junit4]   2> 4000 T384 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@39f270a name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4000 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4001 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4001 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node33
[junit4:junit4]   2> 4028 T352 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4028 T372 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4028 T380 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4029 T360 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4029 T356 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4031 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@3f458056
[junit4:junit4]   2> 4032 T344 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4032 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4033 T358 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4033 T312 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4033 T370 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4033 T336 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4035 T350 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4035 T322 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4035 T362 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4035 T342 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4035 T364 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4036 T378 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4036 T320 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4036 T330 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4036 T368 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4036 T324 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4037 T374 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4038 T384 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4039 T338 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4039 T334 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4039 T348 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4039 T318 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4039 T382 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4041 T346 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4041 T385 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 4043 T376 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4045 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:59015
[junit4:junit4]   2> 4044 T340 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4044 T354 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4044 T332 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4044 T326 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4044 T328 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4044 T385 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 4044 T366 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4:junit4]   2> 4047 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:59015
[junit4:junit4]   2> 4061 T385 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390026, negotiated timeout = 10000
[junit4:junit4]   2> 4061 T386 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f458056 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4061 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4064 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390026 with negotiated timeout 10000 for client /127.0.0.1:59015
[junit4:junit4]   2> 4065 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4069 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node34
[junit4:junit4]   2> 4089 T352 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4089 T358 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4089 T320 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4089 T372 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4089 T380 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4089 T370 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4089 T336 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4089 T322 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4089 T350 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4089 T342 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4089 T356 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4089 T364 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4089 T368 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4097 T360 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4097 T362 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4098 T330 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4098 T312 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4098 T340 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4098 T378 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4098 T344 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4098 T318 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4100 T348 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4100 T382 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4100 T374 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4100 T376 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4101 T334 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4101 T386 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4101 T346 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4101 T326 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4101 T328 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4101 T366 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4101 T338 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4101 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@a24a25b
[junit4:junit4]   2> 4101 T354 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4101 T332 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4101 T324 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4101 T384 oascc.ZkStateReader$3.process Updating live nodes... (35)
[junit4:junit4]   2> 4104 T387 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 4104 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4106 T387 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 4106 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:59018
[junit4:junit4]   2> 4107 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:59018
[junit4:junit4]   2> 4110 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390027 with negotiated timeout 10000 for client /127.0.0.1:59018
[junit4:junit4]   2> 4110 T387 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390027, negotiated timeout = 10000
[junit4:junit4]   2> 4111 T388 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a24a25b name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4111 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4113 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4116 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node35
[junit4:junit4]   2> 4127 T352 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4127 T380 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4128 T372 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4128 T360 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4133 T356 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4133 T312 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4133 T340 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4133 T368 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4134 T350 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4134 T362 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4134 T374 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4134 T370 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4135 T384 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4135 T336 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4136 T364 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4136 T324 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4136 T342 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4136 T318 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4137 T358 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4137 T320 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4137 T378 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4137 T376 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4138 T366 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4138 T334 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4138 T330 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4138 T344 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4138 T388 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4139 T328 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4139 T354 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4138 T348 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4138 T322 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4139 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@78554f96
[junit4:junit4]   2> 4139 T386 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4139 T346 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4139 T382 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4139 T332 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4139 T338 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4139 T326 oascc.ZkStateReader$3.process Updating live nodes... (36)
[junit4:junit4]   2> 4142 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4143 T389 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 4144 T389 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 4145 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:59021
[junit4:junit4]   2> 4145 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:59021
[junit4:junit4]   2> 4148 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390028 with negotiated timeout 10000 for client /127.0.0.1:59021
[junit4:junit4]   2> 4148 T389 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390028, negotiated timeout = 10000
[junit4:junit4]   2> 4149 T390 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@78554f96 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4150 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4151 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4154 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node36
[junit4:junit4]   2> 4170 T390 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4172 T372 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4172 T352 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4172 T380 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4172 T360 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4173 T356 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4173 T344 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4173 T358 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4173 T370 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4177 T312 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4177 T364 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4177 T350 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4177 T336 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4177 T322 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4178 T340 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4178 T326 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4178 T386 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4178 T348 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4178 T330 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4178 T324 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4180 T346 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4178 T342 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4177 T362 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4180 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2d78c975
[junit4:junit4]   2> 4180 T354 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4180 T334 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4178 T328 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4178 T382 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4178 T368 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4178 T374 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4178 T332 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4182 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4178 T318 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4178 T388 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4178 T384 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4178 T338 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4178 T366 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4178 T376 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4178 T378 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4178 T320 oascc.ZkStateReader$3.process Updating live nodes... (37)
[junit4:junit4]   2> 4183 T391 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 4187 T391 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 4187 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:59024
[junit4:junit4]   2> 4188 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:59024
[junit4:junit4]   2> 4194 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d20390029 with negotiated timeout 10000 for client /127.0.0.1:59024
[junit4:junit4]   2> 4194 T391 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d20390029, negotiated timeout = 10000
[junit4:junit4]   2> 4196 T392 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d78c975 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4196 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4198 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4202 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node37
[junit4:junit4]   2> 4218 T392 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4219 T352 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4223 T334 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4223 T348 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4224 T382 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4225 T356 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4225 T312 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4225 T390 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4225 T380 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4225 T336 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4226 T366 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4226 T362 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4226 T378 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4226 T324 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4227 T350 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4227 T374 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4227 T368 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4227 T340 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4228 T342 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4228 T360 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4228 T372 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4228 T322 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4229 T370 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4229 T330 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4229 T358 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4229 T364 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4230 T318 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4230 T338 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4230 T376 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4230 T388 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4230 T344 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4231 T320 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4231 T384 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4231 T328 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4231 T386 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4232 T354 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4232 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2ceefbc5
[junit4:junit4]   2> 4237 T326 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4237 T332 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4238 T346 oascc.ZkStateReader$3.process Updating live nodes... (38)
[junit4:junit4]   2> 4238 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4239 T393 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 4242 T393 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 4243 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:59027
[junit4:junit4]   2> 4244 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:59027
[junit4:junit4]   2> 4247 T393 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d2039002a, negotiated timeout = 10000
[junit4:junit4]   2> 4248 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d2039002a with negotiated timeout 10000 for client /127.0.0.1:59027
[junit4:junit4]   2> 4249 T394 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ceefbc5 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4250 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4250 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4253 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node38
[junit4:junit4]   2> 4265 T352 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4265 T380 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4265 T372 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4266 T360 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4268 T356 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4268 T344 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4269 T358 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4272 T382 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4272 T324 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4273 T394 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4273 T330 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4273 T320 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4273 T364 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4273 T390 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4274 T326 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4274 T328 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4274 T312 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4274 T340 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4274 T332 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4273 T322 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4275 T354 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4274 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@47049007
[junit4:junit4]   2> 4274 T388 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4274 T336 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4274 T392 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4274 T348 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4274 T370 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4274 T366 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4274 T378 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4274 T334 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4277 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4274 T362 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4274 T386 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4273 T346 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4273 T350 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4273 T318 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4273 T368 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4273 T384 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4273 T338 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4273 T376 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4273 T342 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4273 T374 oascc.ZkStateReader$3.process Updating live nodes... (39)
[junit4:junit4]   2> 4277 T395 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 4283 T395 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 4284 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:59030
[junit4:junit4]   2> 4284 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:59030
[junit4:junit4]   2> 4287 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d2039002b with negotiated timeout 10000 for client /127.0.0.1:59030
[junit4:junit4]   2> 4287 T395 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d2039002b, negotiated timeout = 10000
[junit4:junit4]   2> 4287 T396 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@47049007 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4288 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4289 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4298 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node39
[junit4:junit4]   2> 4323 T372 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4323 T328 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4323 T396 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4324 T388 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4324 T390 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4324 T336 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4327 T318 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4327 T374 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4327 T384 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4327 T326 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4327 T386 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4329 T322 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4329 T350 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4329 T334 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4329 T382 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4329 T320 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4329 T394 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4329 T348 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4330 T312 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4330 T330 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4330 T364 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4330 T344 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4330 T362 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4330 T378 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4331 T356 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4331 T340 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4332 T358 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4332 T392 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4332 T324 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4333 T380 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4333 T338 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4334 T354 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4334 T376 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4335 T352 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4335 T368 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4335 T346 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4335 T360 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4335 T366 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4335 T370 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4335 T342 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4335 T332 oascc.ZkStateReader$3.process Updating live nodes... (40)
[junit4:junit4]   2> 4335 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@330ff4bd
[junit4:junit4]   2> 4338 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4338 T397 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 4340 T397 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 4341 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:59033
[junit4:junit4]   2> 4341 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:59033
[junit4:junit4]   2> 4343 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d2039002c with negotiated timeout 10000 for client /127.0.0.1:59033
[junit4:junit4]   2> 4343 T397 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d2039002c, negotiated timeout = 10000
[junit4:junit4]   2> 4344 T398 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@330ff4bd name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4345 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4346 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4348 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node40
[junit4:junit4]   2> 4356 T398 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4356 T352 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4356 T372 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4358 T360 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4359 T312 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4359 T336 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4359 T320 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4360 T318 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4360 T356 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4360 T378 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4360 T358 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4360 T370 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4360 T346 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4360 T396 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4360 T340 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4361 T334 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4361 T382 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4362 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@6f6dd489
[junit4:junit4]   2> 4362 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4362 T326 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4363 T342 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4363 T350 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4364 T386 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4364 T330 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4364 T354 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4364 T368 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4364 T364 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4365 T348 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4365 T338 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4365 T362 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4365 T374 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4365 T388 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4365 T394 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4365 T322 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4366 T392 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4366 T390 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4366 T376 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4366 T380 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4366 T366 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4367 T384 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4367 T324 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4367 T328 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4368 T332 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4368 T344 oascc.ZkStateReader$3.process Updating live nodes... (41)
[junit4:junit4]   2> 4368 T399 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:58898
[junit4:junit4]   2> 4370 T399 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:58898, initiating session
[junit4:junit4]   2> 4370 T303 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:59036
[junit4:junit4]   2> 4370 T303 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:59036
[junit4:junit4]   2> 4373 T305 oazs.NIOServerCnxn.finishSessionInit Established session 0x13abf4d2039002d with negotiated timeout 10000 for client /127.0.0.1:59036
[junit4:junit4]   2> 4373 T399 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:58898, sessionid = 0x13abf4d2039002d, negotiated timeout = 10000
[junit4:junit4]   2> 4373 T400 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6f6dd489 name:ZooKeeperConnection Watcher:127.0.0.1:58898/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4374 T286 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4375 T286 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4377 T286 oascc.SolrZkClient.makePath makePath: /live_nodes/node41
[junit4:junit4]   2> 4389 T400 oascc.ZkStateReader$3.process Updating live nodes... (42)
[junit4:junit4]   2> 4389 T372 oascc.ZkStateReader$3.process Updating live nodes... (42)
[junit4:junit4]   2> 4389 T352 oascc.ZkStateReader$3.process Updating live nodes... (42)
[junit4:junit4]   2> 4389 T380 oascc.ZkStateReader$3.process Updating live nodes... (42)
[junit4:junit4]   2> 4389 T398 oascc.ZkStateReader$3.process Updating live nodes... (42)
[junit4:junit4]   2> 4391 T360 oascc.ZkStateReader$3.process Updating live nodes... (42)
[junit4:junit4]   2> 4391 T396 oascc.ZkStateReader$3.process Updating live nodes... (42)
[junit4:junit4]   2> 4391 T356 oascc.ZkStateReader$3.process Updating live nodes... (42)
[junit4:junit4]   2> 4391 T286 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58898/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7a45f543
[junit4:junit4]   2> 4393 T358 oascc.ZkStateReader$3.process Updating live nodes... (42)
[junit4:junit4]   2> 4394 T286 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4395 T392 oascc.ZkStateReader$3.process Updating live nodes... (42)
[junit4:junit4]   2> 4395 T390 oascc.ZkStateReader$3.process Updating live nodes..

[...truncated too long message...]

T286 oaz.ZooKeeper.close Session: 0x13abf4ee3c90002 closed
[junit4:junit4]   2> 120862 T567 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13abf4ee3c90004
[junit4:junit4]   2> 120862 T579 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4]   2> 120863 T564 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:59177 which had sessionid 0x13abf4ee3c90004
[junit4:junit4]   2> 120863 T286 oaz.ZooKeeper.close Session: 0x13abf4ee3c90004 closed
[junit4:junit4]   2> 120863 T567 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13abf4ee3c90003
[junit4:junit4]   2> 120865 T286 oaz.ZooKeeper.close Session: 0x13abf4ee3c90003 closed
[junit4:junit4]   2> 120865 T575 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 120865 T564 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:59174 which had sessionid 0x13abf4ee3c90003
[junit4:junit4]   2> 120865 T566 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 120865 T567 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 120867 T286 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 120890 T565 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 121653 T579 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard3/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:227)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:83)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:128)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 122552 T564 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 121217 T576 oasc.Overseer$ClusterStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:244)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:192)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:116)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 122553 T576 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88593488237101059-127.0.0.1:59162_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 122553 T579 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:227)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:83)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:128)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 122555 T579 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:227)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:83)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:128)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 122556 T286 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 122556 T286 oas.SolrTestCaseJ4.tearDown ###Ending testShardAssignment
[junit4:junit4]   2> 122556 T579 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 122556 T286 oas.SolrTestCaseJ4.initCore ####initCore
[junit4:junit4]   2> 122557 T286 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4:junit4]   2> 124689 T286 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41: {}, sim=DefaultSimilarity, locale=is_IS, timezone=Pacific/Gambier
[junit4:junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_07 (64-bit)/cpus=2,threads=10,free=180709152,total=204144640
[junit4:junit4]   2> NOTE: All tests run in this JVM: [PreAnalyzedFieldTest, SoftAutoCommitTest, ClusterStateTest, ConvertedLegacyTest, DisMaxRequestHandlerTest, TestSort, TestLMDirichletSimilarityFactory, OpenExchangeRatesOrgProviderTest, TermVectorComponentTest, XmlUpdateRequestHandlerTest, BasicZkTest, TestMergePolicyConfig, TestJmxIntegration, UniqFieldsUpdateProcessorFactoryTest, FullSolrCloudDistribCmdsTest, TestReversedWildcardFilterFactory, WordBreakSolrSpellCheckerTest, TestCSVLoader, CoreContainerCoreInitFailuresTest, SpatialFilterTest, DistanceFunctionTest, TestSolr4Spatial, NoCacheHeaderTest, SimpleFacetsTest, TestPropInjectDefaults, TestRemoteStreaming, ResponseLogComponentTest, TestSolrDeletionPolicy2, RequestHandlersTest, TestGroupingSearch, TestBinaryField, TestSolrIndexConfig, TestConfig, SolrInfoMBeanTest, OverseerTest]
[junit4:junit4] Completed in 124.73s, 8 tests, 1 failure <<< FAILURES!

[...truncated 611 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:335: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:178: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\module-build.xml:61: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1163: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:827: There were test failures: 233 suites, 965 tests, 1 failure, 12 ignored (7 assumptions)

Total time: 41 minutes 1 second
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.7.0_07 -XX:+UseParallelGC
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message