lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@sd-datasolutions.de>
Subject [JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_07) - Build # 1402 - Failure!
Date Fri, 02 Nov 2012 09:50:29 GMT
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Windows/1402/
Java: 32bit/jdk1.7.0_07 -client -XX:+UseConcMarkSweepGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.OverseerTest.testShardLeaderChange

Error Message:
Unexpected shard leader coll:collection1 shard:shard1 expected:<core[4]> but was:<core[1]>

Stack Trace:
org.junit.ComparisonFailure: Unexpected shard leader coll:collection1 shard:shard1 expected:<core[4]> but was:<core[1]>
	at __randomizedtesting.SeedInfo.seed([7E7440F7C31648E7:A027C700D98EBD16]:0)
	at org.junit.Assert.assertEquals(Assert.java:125)
	at org.apache.solr.cloud.OverseerTest.verifyShardLeader(OverseerTest.java:493)
	at org.apache.solr.cloud.OverseerTest.testShardLeaderChange(OverseerTest.java:652)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8674 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4:junit4]   2> 0 T2132 oas.SolrTestCaseJ4.initCore ####initCore
[junit4:junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerTest-1351849241377
[junit4:junit4]   2> 3 T2132 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4:junit4]   2> 6 T2132 oas.SolrTestCaseJ4.setUp ###Starting testShardLeaderChange
[junit4:junit4]   2> 6 T2132 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 12 T2133 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 13 T2133 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 14 T2133 oazsp.FileTxnSnapLog.save Snapshotting: 0
[junit4:junit4]   2> 118 T2132 oasc.ZkTestServer.run start zk server on port:57273
[junit4:junit4]   2> 118 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57273/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@d00829
[junit4:junit4]   2> 120 T2138 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57273
[junit4:junit4]   2> 120 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 122 T2138 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57273, initiating session
[junit4:junit4]   2> 122 T2134 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57276
[junit4:junit4]   2> 123 T2134 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57276
[junit4:junit4]   2> 123 T2136 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 137 T2136 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07e6b300000 with negotiated timeout 10000 for client /127.0.0.1:57276
[junit4:junit4]   2> 137 T2138 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57273, sessionid = 0x13ac07e6b300000, negotiated timeout = 10000
[junit4:junit4]   2> 138 T2139 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d00829 name:ZooKeeperConnection Watcher:127.0.0.1:57273/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 140 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 140 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57273 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@b76d94
[junit4:junit4]   2> 141 T2140 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57273
[junit4:junit4]   2> 141 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 144 T2140 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57273, initiating session
[junit4:junit4]   2> 144 T2134 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57279
[junit4:junit4]   2> 144 T2134 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57279
[junit4:junit4]   2> 146 T2136 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07e6b300001 with negotiated timeout 10000 for client /127.0.0.1:57279
[junit4:junit4]   2> 147 T2140 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57273, sessionid = 0x13ac07e6b300001, negotiated timeout = 10000
[junit4:junit4]   2> 147 T2141 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b76d94 name:ZooKeeperConnection Watcher:127.0.0.1:57273 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 147 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 149 T2137 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ac07e6b300001
[junit4:junit4]   2> 150 T2132 oaz.ZooKeeper.close Session: 0x13ac07e6b300001 closed
[junit4:junit4]   2> 150 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57273 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@158586c
[junit4:junit4]   2> 150 T2134 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ac07e6b300001, likely client has closed socket
[junit4:junit4]   2> 151 T2134 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57279 which had sessionid 0x13ac07e6b300001
[junit4:junit4]   2> 151 T2141 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 153 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 153 T2142 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57273
[junit4:junit4]   2> 156 T2142 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57273, initiating session
[junit4:junit4]   2> 156 T2134 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57282
[junit4:junit4]   2> 156 T2134 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57282
[junit4:junit4]   2> 158 T2136 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07e6b300002 with negotiated timeout 10000 for client /127.0.0.1:57282
[junit4:junit4]   2> 158 T2142 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57273, sessionid = 0x13ac07e6b300002, negotiated timeout = 10000
[junit4:junit4]   2> 159 T2143 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@158586c name:ZooKeeperConnection Watcher:127.0.0.1:57273 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 159 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 159 T2132 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 163 T2137 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ac07e6b300002
[junit4:junit4]   2> 165 T2132 oaz.ZooKeeper.close Session: 0x13ac07e6b300002 closed
[junit4:junit4]   2> 166 T2134 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ac07e6b300002, likely client has closed socket
[junit4:junit4]   2> 166 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 166 T2134 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57282 which had sessionid 0x13ac07e6b300002
[junit4:junit4]   2> 166 T2143 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 172 T2144 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57273/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1e3020d
[junit4:junit4]   2> 172 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57273/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@9bbc0a
[junit4:junit4]   2> 173 T2144 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 173 T2145 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57273
[junit4:junit4]   2> 174 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 174 T2146 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57273
[junit4:junit4]   2> 175 T2145 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57273, initiating session
[junit4:junit4]   2> 176 T2134 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57287
[junit4:junit4]   2> 176 T2146 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57273, initiating session
[junit4:junit4]   2> 176 T2134 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57288
[junit4:junit4]   2> 176 T2134 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57287
[junit4:junit4]   2> 178 T2134 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57288
[junit4:junit4]   2> 179 T2136 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07e6b300003 with negotiated timeout 10000 for client /127.0.0.1:57287
[junit4:junit4]   2> 179 T2145 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57273, sessionid = 0x13ac07e6b300003, negotiated timeout = 10000
[junit4:junit4]   2> 179 T2147 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e3020d name:ZooKeeperConnection Watcher:127.0.0.1:57273/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 180 T2144 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 181 T2136 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07e6b300004 with negotiated timeout 10000 for client /127.0.0.1:57288
[junit4:junit4]   2> 181 T2146 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57273, sessionid = 0x13ac07e6b300004, negotiated timeout = 10000
[junit4:junit4]   2> 181 T2148 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9bbc0a name:ZooKeeperConnection Watcher:127.0.0.1:57273/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 181 T2144 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 181 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 184 T2132 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 189 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 192 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4:junit4]   2> 193 T2137 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07e6b300003 type:delete cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 194 T2144 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 200 T2148 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 201 T2144 oasc.Overseer.start Overseer (id=88594791883866115-127.0.0.1:57273_solr-n_0000000000) starting
[junit4:junit4]   2> 201 T2137 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07e6b300004 type:create cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 201 T2137 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07e6b300003 type:create cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 204 T2137 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07e6b300003 type:create cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 208 T2137 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07e6b300003 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 211 T2137 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07e6b300003 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 215 T2144 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
[junit4:junit4]   2> 215 T2150 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 216 T2137 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ac07e6b300003
[junit4:junit4]   2> 219 T2134 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57287 which had sessionid 0x13ac07e6b300003
[junit4:junit4]   2> 219 T2144 oaz.ZooKeeper.close Session: 0x13ac07e6b300003 closed
[junit4:junit4]   2> 219 T2147 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 219 T2144 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57273/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@117c436
[junit4:junit4]   2> 220 T2151 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57273
[junit4:junit4]   2> 220 T2144 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 222 T2151 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57273, initiating session
[junit4:junit4]   2> 222 T2134 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57291
[junit4:junit4]   2> 222 T2134 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57291
[junit4:junit4]   2> 224 T2136 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07e6b300005 with negotiated timeout 10000 for client /127.0.0.1:57291
[junit4:junit4]   2> 224 T2151 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57273, sessionid = 0x13ac07e6b300005, negotiated timeout = 10000
[junit4:junit4]   2> 225 T2152 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@117c436 name:ZooKeeperConnection Watcher:127.0.0.1:57273/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 225 T2144 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 229 T2137 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07e6b300005 type:delete cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 231 T2144 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 234 T2144 oasc.Overseer.start Overseer (id=88594791883866117-127.0.0.1:57273_solr-n_0000000002) starting
[junit4:junit4]   2> 235 T2137 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07e6b300005 type:create cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 237 T2137 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07e6b300005 type:create cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 239 T2137 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07e6b300005 type:create cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 244 T2137 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07e6b300005 type:create cxid:0xc zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 248 T2154 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 251 T2153 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 259 T2153 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 261 T2153 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "state":"state1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://node1/solr/"}
[junit4:junit4]   2> 261 T2153 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 261 T2137 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07e6b300005 type:create cxid:0x18 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 273 T2148 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 759 T2132 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 788 T2137 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07e6b300004 type:delete cxid:0x1f zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 792 T2132 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 808 T2137 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07e6b300004 type:create cxid:0x27 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 837 T2137 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07e6b300004 type:create cxid:0x29 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 840 T2132 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 840 T2153 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 844 T2137 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07e6b300004 type:create cxid:0x30 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 850 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57273/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1fe2af2
[junit4:junit4]   2> 850 T2153 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "state":"state2",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://node1/solr/"}
[junit4:junit4]   2> 851 T2155 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57273
[junit4:junit4]   2> 851 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 853 T2155 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57273, initiating session
[junit4:junit4]   2> 853 T2134 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57294
[junit4:junit4]   2> 854 T2134 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57294
[junit4:junit4]   2> 856 T2155 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57273, sessionid = 0x13ac07e6b300006, negotiated timeout = 10000
[junit4:junit4]   2> 856 T2136 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07e6b300006 with negotiated timeout 10000 for client /127.0.0.1:57294
[junit4:junit4]   2> 857 T2156 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fe2af2 name:ZooKeeperConnection Watcher:127.0.0.1:57273/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 857 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 860 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 861 T2148 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 862 T2156 oaz.ClientCnxn$EventThread.processEvent SEVERE Error while calling watcher  java.lang.NullPointerException
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$2.process(ZkStateReader.java:189)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 862 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4:junit4]   2> 867 T2148 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 867 T2156 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 867 T2137 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07e6b300004 type:create cxid:0x36 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 872 T2132 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 876 T2137 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07e6b300004 type:create cxid:0x3d zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 883 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 885 T2137 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07e6b300006 type:create cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1317 T2149 oasc.Overseer$ClusterStateUpdater.run WARNING Solr cannot talk to ZK
[junit4:junit4]   2> 1318 T2150 oasc.OverseerCollectionProcessor.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:244)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionProcessor.amILeader(OverseerCollectionProcessor.java:129)
[junit4:junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:84)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 1321 T2150 oasc.OverseerCollectionProcessor.amILeader According to ZK I (id=88594791883866115-127.0.0.1:57273_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 1427 T2153 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1429 T2153 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "state":"state1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://node1/solr/"}
[junit4:junit4]   2> 1441 T2153 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "state":"state2",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core4",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node2",
[junit4:junit4]   2> 	  "base_url":"http://node2/solr/"}
[junit4:junit4]   2> 1456 T2148 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 60958 T2137 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ac07e6b300004
[junit4:junit4]   2> 60958 T2148 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 60960 T2148 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:227)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:83)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:128)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 60960 T2132 oaz.ZooKeeper.close Session: 0x13ac07e6b300004 closed
[junit4:junit4]   2> 60960 T2156 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 60960 T2134 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ac07e6b300004, likely client has closed socket
[junit4:junit4]   2> 60961 T2148 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:227)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:83)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:128)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 60961 T2134 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57288 which had sessionid 0x13ac07e6b300004
[junit4:junit4]   2> 60962 T2148 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 60963 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 61054 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 61146 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 61236 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 61328 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 61419 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 61509 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 61601 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 61692 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 61783 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 61875 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 61965 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 62057 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 62147 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 62239 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 62329 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 62420 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 62520 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 62619 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 62720 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 62819 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 62919 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 63019 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 63120 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 63220 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 63321 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 63421 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 63522 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 63621 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 63722 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 63822 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 63923 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 64022 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 64124 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 64224 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 64325 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 64425 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 64526 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 64626 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 64728 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 64827 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 64929 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 65030 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 65131 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 65231 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 65332 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 65432 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 65532 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 65632 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 65733 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 65834 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 65935 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 66035 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 66136 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 66236 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 66337 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 66437 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 66538 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 66638 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 66739 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 66839 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 66940 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 67040 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 67141 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 67241 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 67342 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 67441 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 67543 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 67643 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 67743 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 67844 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 67944 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 68045 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 68145 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 68244 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 68345 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 68445 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 68547 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 68647 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 68748 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 68848 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 68949 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 69048 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 69149 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 69249 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 69350 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 69450 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 69551 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 69652 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 69752 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 69852 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 69952 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 70052 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 70154 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 70253 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 70354 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 70454 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 70555 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 70654 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 70754 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 70926 T2137 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ac07e6b300005
[junit4:junit4]   2> 70928 T2134 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57291 which had sessionid 0x13ac07e6b300005
[junit4:junit4]   2> 70928 T2144 oaz.ZooKeeper.close Session: 0x13ac07e6b300005 closed
[junit4:junit4]   2> 70929 T2152 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 70935 T2137 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ac07e6b300006
[junit4:junit4]   2> 70935 T2156 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4]   2> 70936 T2134 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57294 which had sessionid 0x13ac07e6b300006
[junit4:junit4]   2> 70936 T2156 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 70936 T2132 oaz.ZooKeeper.close Session: 0x13ac07e6b300006 closed
[junit4:junit4]   2> 70938 T2137 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ac07e6b300000
[junit4:junit4]   2> 70940 T2134 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57276 which had sessionid 0x13ac07e6b300000
[junit4:junit4]   2> 70940 T2139 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 70940 T2132 oaz.ZooKeeper.close Session: 0x13ac07e6b300000 closed
[junit4:junit4]   2> 70942 T2137 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 70942 T2136 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 70943 T2132 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 71359 T2153 oasc.Overseer$ClusterStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:244)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:192)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:116)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 73245 T2134 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 71605 T2135 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 73245 T2153 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88594791883866117-127.0.0.1:57273_solr-n_0000000002) am no longer a leader.
[junit4:junit4]   2> 73248 T2132 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 73248 T2132 oas.SolrTestCaseJ4.tearDown ###Ending testShardLeaderChange
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=OverseerTest -Dtests.method=testShardLeaderChange -Dtests.seed=7E7440F7C31648E7 -Dtests.slow=true -Dtests.locale=th_TH -Dtests.timezone=Africa/Bangui -Dtests.file.encoding=Cp1252
[junit4:junit4] FAILURE 73.3s | OverseerTest.testShardLeaderChange <<<
[junit4:junit4]    > Throwable #1: org.junit.ComparisonFailure: Unexpected shard leader coll:collection1 shard:shard1 expected:<core[4]> but was:<core[1]>
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([7E7440F7C31648E7:A027C700D98EBD16]:0)
[junit4:junit4]    > 	at org.junit.Assert.assertEquals(Assert.java:125)
[junit4:junit4]    > 	at org.apache.solr.cloud.OverseerTest.verifyShardLeader(OverseerTest.java:493)
[junit4:junit4]    > 	at org.apache.solr.cloud.OverseerTest.testShardLeaderChange(OverseerTest.java:652)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 73278 T2132 oas.SolrTestCaseJ4.setUp ###Starting testOverseerFailure
[junit4:junit4]   2> 73278 T2132 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 73279 T2157 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 73282 T2157 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 73285 T2157 oazsp.FileSnap.deserialize Reading snapshot C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerTest-1351849241377\zookeeper\server1\data\version-2\snapshot.0
[junit4:junit4]   2> 73287 T2157 oazsp.FileTxnSnapLog.save Snapshotting: 53
[junit4:junit4]   2> 73388 T2132 oasc.ZkTestServer.run start zk server on port:57297
[junit4:junit4]   2> 73388 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57297/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7a88d9
[junit4:junit4]   2> 73390 T2162 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57297
[junit4:junit4]   2> 73390 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 73392 T2162 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57297, initiating session
[junit4:junit4]   2> 73392 T2158 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57300
[junit4:junit4]   2> 73393 T2158 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57300
[junit4:junit4]   2> 73394 T2160 oazsp.FileTxnLog.append Creating new log file: log.54
[junit4:junit4]   2> 73397 T2160 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07f89670000 with negotiated timeout 10000 for client /127.0.0.1:57300
[junit4:junit4]   2> 73397 T2162 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57297, sessionid = 0x13ac07f89670000, negotiated timeout = 10000
[junit4:junit4]   2> 73398 T2163 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7a88d9 name:ZooKeeperConnection Watcher:127.0.0.1:57297/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 73400 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 73400 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57297 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@f9c6c9
[junit4:junit4]   2> 73401 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 73401 T2164 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57297
[junit4:junit4]   2> 73403 T2164 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57297, initiating session
[junit4:junit4]   2> 73403 T2158 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57303
[junit4:junit4]   2> 73404 T2158 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57303
[junit4:junit4]   2> 73406 T2160 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07f89670001 with negotiated timeout 10000 for client /127.0.0.1:57303
[junit4:junit4]   2> 73406 T2164 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57297, sessionid = 0x13ac07f89670001, negotiated timeout = 10000
[junit4:junit4]   2> 73406 T2165 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f9c6c9 name:ZooKeeperConnection Watcher:127.0.0.1:57297 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 73407 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 73448 T2161 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ac07f89670001
[junit4:junit4]   2> 73450 T2158 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57303 which had sessionid 0x13ac07f89670001
[junit4:junit4]   2> 73450 T2165 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 73450 T2132 oaz.ZooKeeper.close Session: 0x13ac07f89670001 closed
[junit4:junit4]   2> 73451 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57297 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b3f563
[junit4:junit4]   2> 73453 T2166 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57297
[junit4:junit4]   2> 73453 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 73455 T2166 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57297, initiating session
[junit4:junit4]   2> 73455 T2158 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57306
[junit4:junit4]   2> 73456 T2158 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57306
[junit4:junit4]   2> 73458 T2160 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07f89670002 with negotiated timeout 10000 for client /127.0.0.1:57306
[junit4:junit4]   2> 73458 T2166 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57297, sessionid = 0x13ac07f89670002, negotiated timeout = 10000
[junit4:junit4]   2> 73460 T2167 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b3f563 name:ZooKeeperConnection Watcher:127.0.0.1:57297 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 73461 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 73461 T2132 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 73466 T2161 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ac07f89670002
[junit4:junit4]   2> 73468 T2167 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 73468 T2132 oaz.ZooKeeper.close Session: 0x13ac07f89670002 closed
[junit4:junit4]   2> 73469 T2158 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ac07f89670002, likely client has closed socket
[junit4:junit4]   2> 73469 T2158 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57306 which had sessionid 0x13ac07f89670002
[junit4:junit4]   2> 73470 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 73476 T2132 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 73480 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 73482 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57297/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@413af2
[junit4:junit4]   2> 73484 T2168 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57297
[junit4:junit4]   2> 73484 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 73486 T2168 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57297, initiating session
[junit4:junit4]   2> 73486 T2158 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57309
[junit4:junit4]   2> 73486 T2158 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57309
[junit4:junit4]   2> 73489 T2160 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07f89670003 with negotiated timeout 10000 for client /127.0.0.1:57309
[junit4:junit4]   2> 73489 T2168 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57297, sessionid = 0x13ac07f89670003, negotiated timeout = 10000
[junit4:junit4]   2> 73490 T2169 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@413af2 name:ZooKeeperConnection Watcher:127.0.0.1:57297/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 73490 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 73492 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 73494 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4:junit4]   2> 73498 T2169 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 73498 T2163 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 73500 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57297/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ff41b0
[junit4:junit4]   2> 73502 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 73502 T2170 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57297
[junit4:junit4]   2> 73504 T2170 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57297, initiating session
[junit4:junit4]   2> 73504 T2158 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57312
[junit4:junit4]   2> 73504 T2158 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57312
[junit4:junit4]   2> 73506 T2160 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07f89670004 with negotiated timeout 10000 for client /127.0.0.1:57312
[junit4:junit4]   2> 73507 T2170 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57297, sessionid = 0x13ac07f89670004, negotiated timeout = 10000
[junit4:junit4]   2> 73507 T2171 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ff41b0 name:ZooKeeperConnection Watcher:127.0.0.1:57297/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 73507 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 73509 T2132 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 73518 T2161 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07f89670004 type:delete cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 73520 T2132 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 73524 T2132 oasc.Overseer.start Overseer (id=88594796685754372-127.0.0.1:57297_solr-n_0000000000) starting
[junit4:junit4]   2> 73527 T2161 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07f89670004 type:create cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 73529 T2161 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07f89670004 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 73531 T2161 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07f89670004 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 73533 T2173 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 73534 T2172 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 74611 T2161 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07f89670003 type:create cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 74614 T2161 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07f89670003 type:create cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 74622 T2172 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 74623 T2172 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://node1/solr/"}
[junit4:junit4]   2> 74623 T2172 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 74624 T2161 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07f89670004 type:create cxid:0x23 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 74635 T2169 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 74637 T2163 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 75159 T2132 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 75216 T2161 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07f89670003 type:delete cxid:0x1c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 75218 T2132 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 75226 T2161 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07f89670003 type:create cxid:0x24 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 75231 T2132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 75233 T2161 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07f89670003 type:create cxid:0x26 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 75237 T2132 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 75241 T2161 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07f89670003 type:create cxid:0x2d zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 75727 T2172 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 75738 T2172 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://node1/solr/"}
[junit4:junit4]   2> 75747 T2163 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 75748 T2169 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 75753 T2161 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ac07f89670004
[junit4:junit4]   2> 75755 T2158 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57312 which had sessionid 0x13ac07f89670004
[junit4:junit4]   2> 75755 T2132 oaz.ZooKeeper.close Session: 0x13ac07f89670004 closed
[junit4:junit4]   2> 75756 T2171 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 76831 T2172 oasc.Overseer$ClusterStateUpdater.run WARNING Overseer cannot talk to ZK
[junit4:junit4]   2> 76835 T2161 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07f89670003 type:create cxid:0x32 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 76840 T2132 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 76845 T2161 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07f89670003 type:create cxid:0x39 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 76853 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57297/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f5f862
[junit4:junit4]   2> 76855 T2174 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57297
[junit4:junit4]   2> 76855 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 76857 T2174 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57297, initiating session
[junit4:junit4]   2> 76857 T2158 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57315
[junit4:junit4]   2> 76857 T2158 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57315
[junit4:junit4]   2> 76871 T2160 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07f89670005 with negotiated timeout 10000 for client /127.0.0.1:57315
[junit4:junit4]   2> 76871 T2174 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57297, sessionid = 0x13ac07f89670005, negotiated timeout = 10000
[junit4:junit4]   2> 76871 T2175 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f5f862 name:ZooKeeperConnection Watcher:127.0.0.1:57297/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 76872 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 76880 T2161 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07f89670005 type:delete cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 76888 T2132 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 76915 T2132 oasc.Overseer.start Overseer (id=88594796685754373-127.0.0.1:57297_solr-n_0000000002) starting
[junit4:junit4]   2> 76916 T2161 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07f89670005 type:create cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 76918 T2161 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07f89670005 type:create cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 76922 T2161 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07f89670005 type:create cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 76924 T2161 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07f89670005 type:create cxid:0xc zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 76927 T2177 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 76932 T2176 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 76933 T2176 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4:junit4]   2> 76936 T2169 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 76936 T2163 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 76944 T2176 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://node1/solr/"}
[junit4:junit4]   2> 76946 T2169 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 76947 T2163 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 76953 T2176 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 76956 T2176 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 76958 T2176 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://node1/solr/"}
[junit4:junit4]   2> 76968 T2169 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 76970 T2163 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 76993 T2161 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07f89670003 type:create cxid:0x40 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 76998 T2132 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 77003 T2161 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07f89670003 type:create cxid:0x47 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 77516 T2176 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 77526 T2169 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 77535 T2161 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07f89670003 type:create cxid:0x53 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 77541 T2169 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:102)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:227)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:83)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:128)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 77543 T2169 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:102)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:227)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:83)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:128)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 77558 T2176 oasc.Overseer$ClusterStateUpdater.setShardLeader SEVERE Could not mark shard leader for non existing collection:collection1
[junit4:junit4]   2> 77565 T2169 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 77565 T2163 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 78109 T2163 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4]   2> 78110 T2169 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4]   2> 78111 T2161 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ac07f89670003
[junit4:junit4]   2> 78114 T2158 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57309 which had sessionid 0x13ac07f89670003
[junit4:junit4]   2> 78115 T2169 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 78114 T2132 oaz.ZooKeeper.close Session: 0x13ac07f89670003 closed
[junit4:junit4]   2> 78115 T2161 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ac07f89670005
[junit4:junit4]   2> 78117 T2158 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57315 which had sessionid 0x13ac07f89670005
[junit4:junit4]   2> 78117 T2175 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 78117 T2132 oaz.ZooKeeper.close Session: 0x13ac07f89670005 closed
[junit4:junit4]   2> 78119 T2161 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ac07f89670000
[junit4:junit4]   2> 78121 T2158 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57300 which had sessionid 0x13ac07f89670000
[junit4:junit4]   2> 78122 T2163 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 78121 T2132 oaz.ZooKeeper.close Session: 0x13ac07f89670000 closed
[junit4:junit4]   2> 78123 T2161 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 78123 T2160 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 78124 T2132 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 78698 T2159 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 79194 T2176 oasc.Overseer$ClusterStateUpdater.run WARNING Overseer cannot talk to ZK
[junit4:junit4]   2> 80554 T2158 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 80556 T2132 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 80556 T2132 oas.SolrTestCaseJ4.tearDown ###Ending testOverseerFailure
[junit4:junit4]   2> 80561 T2132 oas.SolrTestCaseJ4.setUp ###Starting testReplay
[junit4:junit4]   2> 80562 T2132 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 80562 T2178 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 80563 T2178 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 80564 T2178 oazsp.FileSnap.deserialize Reading snapshot C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerTest-1351849241377\zookeeper\server1\data\version-2\snapshot.53
[junit4:junit4]   2> 80568 T2178 oazsp.FileTxnSnapLog.save Snapshotting: c7
[junit4:junit4]   2> 80670 T2132 oasc.ZkTestServer.run start zk server on port:57318
[junit4:junit4]   2> 80670 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57318/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@10b8b87
[junit4:junit4]   2> 80673 T2183 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57318
[junit4:junit4]   2> 80673 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 80675 T2183 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57318, initiating session
[junit4:junit4]   2> 80675 T2179 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57321
[junit4:junit4]   2> 80675 T2179 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57321
[junit4:junit4]   2> 80676 T2181 oazsp.FileTxnLog.append Creating new log file: log.c8
[junit4:junit4]   2> 80679 T2181 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fa5d80000 with negotiated timeout 10000 for client /127.0.0.1:57321
[junit4:junit4]   2> 80681 T2183 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57318, sessionid = 0x13ac07fa5d80000, negotiated timeout = 10000
[junit4:junit4]   2> 80681 T2184 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10b8b87 name:ZooKeeperConnection Watcher:127.0.0.1:57318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 80682 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 80682 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57318 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@174e808
[junit4:junit4]   2> 80684 T2185 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57318
[junit4:junit4]   2> 80684 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 80686 T2185 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57318, initiating session
[junit4:junit4]   2> 80686 T2179 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57324
[junit4:junit4]   2> 80687 T2179 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57324
[junit4:junit4]   2> 80690 T2181 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fa5d80001 with negotiated timeout 10000 for client /127.0.0.1:57324
[junit4:junit4]   2> 80690 T2185 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57318, sessionid = 0x13ac07fa5d80001, negotiated timeout = 10000
[junit4:junit4]   2> 80690 T2186 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@174e808 name:ZooKeeperConnection Watcher:127.0.0.1:57318 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 80690 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 80719 T2182 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ac07fa5d80001
[junit4:junit4]   2> 80721 T2132 oaz.ZooKeeper.close Session: 0x13ac07fa5d80001 closed
[junit4:junit4]   2> 80721 T2179 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ac07fa5d80001, likely client has closed socket
[junit4:junit4]   2> 80721 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57318 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@265db2
[junit4:junit4]   2> 80722 T2179 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57324 which had sessionid 0x13ac07fa5d80001
[junit4:junit4]   2> 80722 T2186 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 80725 T2187 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57318
[junit4:junit4]   2> 80725 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 80728 T2187 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57318, initiating session
[junit4:junit4]   2> 80728 T2179 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57327
[junit4:junit4]   2> 80729 T2179 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57327
[junit4:junit4]   2> 80731 T2181 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fa5d80002 with negotiated timeout 10000 for client /127.0.0.1:57327
[junit4:junit4]   2> 80731 T2187 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57318, sessionid = 0x13ac07fa5d80002, negotiated timeout = 10000
[junit4:junit4]   2> 80732 T2188 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@265db2 name:ZooKeeperConnection Watcher:127.0.0.1:57318 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 80732 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 80733 T2132 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 80736 T2182 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ac07fa5d80002
[junit4:junit4]   2> 80739 T2132 oaz.ZooKeeper.close Session: 0x13ac07fa5d80002 closed
[junit4:junit4]   2> 80739 T2188 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 80739 T2179 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ac07fa5d80002, likely client has closed socket
[junit4:junit4]   2> 80739 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 80739 T2179 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57327 which had sessionid 0x13ac07fa5d80002
[junit4:junit4]   2> 80747 T2132 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 80750 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 80754 T2182 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07fa5d80000 type:create cxid:0xc zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 80761 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57318/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c5f321
[junit4:junit4]   2> 80762 T2189 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57318
[junit4:junit4]   2> 80762 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 80764 T2189 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57318, initiating session
[junit4:junit4]   2> 80765 T2179 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57330
[junit4:junit4]   2> 80765 T2179 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57330
[junit4:junit4]   2> 80767 T2181 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fa5d80003 with negotiated timeout 10000 for client /127.0.0.1:57330
[junit4:junit4]   2> 80767 T2189 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57318, sessionid = 0x13ac07fa5d80003, negotiated timeout = 10000
[junit4:junit4]   2> 80767 T2190 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c5f321 name:ZooKeeperConnection Watcher:127.0.0.1:57318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 80768 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 80769 T2132 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 80778 T2182 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07fa5d80003 type:delete cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 80779 T2132 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 80783 T2132 oasc.Overseer.start Overseer (id=88594797162921987-127.0.0.1:57318_solr-n_0000000000) starting
[junit4:junit4]   2> 80783 T2182 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07fa5d80003 type:create cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 80785 T2182 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07fa5d80003 type:create cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 80787 T2182 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07fa5d80003 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 80789 T2182 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07fa5d80003 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 80791 T2182 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07fa5d80000 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 80791 T2192 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 80793 T2182 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07fa5d80000 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 80800 T2191 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 80800 T2191 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4:junit4]   2> 80801 T2191 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":"s1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
[junit4:junit4]   2> 	  "roles":""}
[junit4:junit4]   2> 80803 T2184 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 80808 T2191 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":"s1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
[junit4:junit4]   2> 	  "roles":""}
[junit4:junit4]   2> 80810 T2184 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 80813 T2191 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 80816 T2191 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 80818 T2191 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core3",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":"s1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
[junit4:junit4]   2> 	  "roles":""}
[junit4:junit4]   2> 80824 T2184 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 80907 T2182 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ac07fa5d80003
[junit4:junit4]   2> 80913 T2179 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57330 which had sessionid 0x13ac07fa5d80003
[junit4:junit4]   2> 80914 T2132 oaz.ZooKeeper.close Session: 0x13ac07fa5d80003 closed
[junit4:junit4]   2> 80914 T2190 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 80914 T2182 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ac07fa5d80000
[junit4:junit4]   2> 80941 T2132 oaz.ZooKeeper.close Session: 0x13ac07fa5d80000 closed
[junit4:junit4]   2> 80941 T2179 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ac07fa5d80000, likely client has closed socket
[junit4:junit4]   2> 80942 T2182 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 80943 T2179 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57321 which had sessionid 0x13ac07fa5d80000
[junit4:junit4]   2> 80941 T2184 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 80943 T2181 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 80944 T2132 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 81366 T2191 oasc.Overseer$ClusterStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:244)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:192)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:116)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 81703 T2180 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 83412 T2191 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88594797162921987-127.0.0.1:57318_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 83414 T2179 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 83416 T2132 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 83417 T2132 oas.SolrTestCaseJ4.tearDown ###Ending testReplay
[junit4:junit4]   2> 83422 T2132 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
[junit4:junit4]   2> 83423 T2132 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 83425 T2193 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 83427 T2193 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 83429 T2193 oazsp.FileSnap.deserialize Reading snapshot C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerTest-1351849241377\zookeeper\server1\data\version-2\snapshot.c7
[junit4:junit4]   2> 83436 T2193 oazsp.FileTxnSnapLog.save Snapshotting: f7
[junit4:junit4]   2> 83545 T2132 oasc.ZkTestServer.run start zk server on port:57333
[junit4:junit4]   2> 83545 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@76c56
[junit4:junit4]   2> 83547 T2198 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 83547 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 83549 T2198 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 83549 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57336
[junit4:junit4]   2> 83549 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57336
[junit4:junit4]   2> 83551 T2196 oazsp.FileTxnLog.append Creating new log file: log.f8
[junit4:junit4]   2> 83555 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c0000 with negotiated timeout 10000 for client /127.0.0.1:57336
[junit4:junit4]   2> 83555 T2198 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c0000, negotiated timeout = 10000
[junit4:junit4]   2> 83556 T2199 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76c56 name:ZooKeeperConnection Watcher:127.0.0.1:57333 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 83556 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 83584 T2197 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ac07fb10c0000
[junit4:junit4]   2> 83585 T2199 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 83585 T2194 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ac07fb10c0000, likely client has closed socket
[junit4:junit4]   2> 83585 T2132 oaz.ZooKeeper.close Session: 0x13ac07fb10c0000 closed
[junit4:junit4]   2> 83586 T2194 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57336 which had sessionid 0x13ac07fb10c0000
[junit4:junit4]   2> 83586 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@14d9370
[junit4:junit4]   2> 83590 T2200 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 83590 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 83593 T2200 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 83593 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57339
[junit4:junit4]   2> 83593 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57339
[junit4:junit4]   2> 83596 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c0001 with negotiated timeout 10000 for client /127.0.0.1:57339
[junit4:junit4]   2> 83597 T2200 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c0001, negotiated timeout = 10000
[junit4:junit4]   2> 83597 T2201 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14d9370 name:ZooKeeperConnection Watcher:127.0.0.1:57333 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 83597 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 83598 T2132 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 83603 T2197 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ac07fb10c0001
[junit4:junit4]   2> 83606 T2201 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 83606 T2132 oaz.ZooKeeper.close Session: 0x13ac07fb10c0001 closed
[junit4:junit4]   2> 83607 T2194 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ac07fb10c0001, likely client has closed socket
[junit4:junit4]   2> 83607 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7e5236
[junit4:junit4]   2> 83607 T2194 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57339 which had sessionid 0x13ac07fb10c0001
[junit4:junit4]   2> 83610 T2202 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 83610 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 83612 T2202 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 83612 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57342
[junit4:junit4]   2> 83612 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57342
[junit4:junit4]   2> 83617 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c0002 with negotiated timeout 10000 for client /127.0.0.1:57342
[junit4:junit4]   2> 83618 T2202 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c0002, negotiated timeout = 10000
[junit4:junit4]   2> 83618 T2203 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e5236 name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 83618 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 83619 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 83623 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1d35ae
[junit4:junit4]   2> 83626 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 83626 T2204 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 83628 T2204 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 83628 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57345
[junit4:junit4]   2> 83628 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57345
[junit4:junit4]   2> 83630 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c0003 with negotiated timeout 10000 for client /127.0.0.1:57345
[junit4:junit4]   2> 83630 T2204 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c0003, negotiated timeout = 10000
[junit4:junit4]   2> 83632 T2205 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d35ae name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 83632 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 83634 T2132 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 83644 T2197 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07fb10c0003 type:delete cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 83647 T2132 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 83651 T2132 oasc.Overseer.start Overseer (id=88594797350879235-127.0.0.1:57333_solr-n_0000000000) starting
[junit4:junit4]   2> 83655 T2197 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07fb10c0003 type:create cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 83657 T2197 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07fb10c0003 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 83661 T2197 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ac07fb10c0003 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 83665 T2207 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 83666 T2132 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 83667 T2206 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 83673 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 83679 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@154bb75
[junit4:junit4]   2> 83683 T2208 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 83683 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 83685 T2208 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 83685 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57348
[junit4:junit4]   2> 83686 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57348
[junit4:junit4]   2> 83689 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c0004 with negotiated timeout 10000 for client /127.0.0.1:57348
[junit4:junit4]   2> 83691 T2208 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c0004, negotiated timeout = 10000
[junit4:junit4]   2> 83691 T2209 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@154bb75 name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 83692 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 83693 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 83693 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node0
[junit4:junit4]   2> 83702 T2203 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 83702 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@19eafb3
[junit4:junit4]   2> 83702 T2209 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 83705 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 83705 T2210 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 83707 T2210 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 83707 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57351
[junit4:junit4]   2> 83708 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57351
[junit4:junit4]   2> 83710 T2210 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c0005, negotiated timeout = 10000
[junit4:junit4]   2> 83710 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c0005 with negotiated timeout 10000 for client /127.0.0.1:57351
[junit4:junit4]   2> 83711 T2211 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19eafb3 name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 83713 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 83715 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 83723 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4:junit4]   2> 83747 T2209 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 83747 T2203 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 83750 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@96644f
[junit4:junit4]   2> 83752 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 83753 T2212 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 83754 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57354
[junit4:junit4]   2> 83755 T2212 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 83755 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57354
[junit4:junit4]   2> 83755 T2211 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 83758 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c0006 with negotiated timeout 10000 for client /127.0.0.1:57354
[junit4:junit4]   2> 83758 T2212 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c0006, negotiated timeout = 10000
[junit4:junit4]   2> 83759 T2213 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@96644f name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 83760 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 83761 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 83765 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4:junit4]   2> 83771 T2213 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 83771 T2209 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 83771 T2211 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 83772 T2203 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 83772 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@13e8c68
[junit4:junit4]   2> 83773 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 83773 T2214 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 83775 T2214 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 83775 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57357
[junit4:junit4]   2> 83776 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57357
[junit4:junit4]   2> 83779 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c0007 with negotiated timeout 10000 for client /127.0.0.1:57357
[junit4:junit4]   2> 83780 T2214 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c0007, negotiated timeout = 10000
[junit4:junit4]   2> 83780 T2215 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13e8c68 name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 83781 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 83782 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 83784 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node3
[junit4:junit4]   2> 83795 T2209 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 83796 T2203 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 83796 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@21e292
[junit4:junit4]   2> 83796 T2215 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 83796 T2213 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 83796 T2211 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 83798 T2216 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 83798 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 83801 T2216 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 83801 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57360
[junit4:junit4]   2> 83803 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57360
[junit4:junit4]   2> 83805 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c0008 with negotiated timeout 10000 for client /127.0.0.1:57360
[junit4:junit4]   2> 83805 T2216 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c0008, negotiated timeout = 10000
[junit4:junit4]   2> 83806 T2217 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@21e292 name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 83806 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 83809 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 83811 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node4
[junit4:junit4]   2> 83817 T2209 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 83818 T2213 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 83818 T2211 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 83818 T2203 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 83819 T2215 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 83819 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@d969e8
[junit4:junit4]   2> 83819 T2217 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 83820 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 83822 T2218 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 83824 T2218 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 83824 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57363
[junit4:junit4]   2> 83825 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57363
[junit4:junit4]   2> 83826 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c0009 with negotiated timeout 10000 for client /127.0.0.1:57363
[junit4:junit4]   2> 83828 T2218 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c0009, negotiated timeout = 10000
[junit4:junit4]   2> 83828 T2219 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d969e8 name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 83830 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 83831 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 83833 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node5
[junit4:junit4]   2> 83839 T2213 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 83839 T2217 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 83839 T2209 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 83840 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@dd9cc8
[junit4:junit4]   2> 83840 T2211 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 83841 T2219 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 83841 T2203 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 83841 T2215 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 83842 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 83842 T2220 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 83846 T2220 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 83846 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57366
[junit4:junit4]   2> 83846 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57366
[junit4:junit4]   2> 83848 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c000a with negotiated timeout 10000 for client /127.0.0.1:57366
[junit4:junit4]   2> 83849 T2220 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c000a, negotiated timeout = 10000
[junit4:junit4]   2> 83849 T2221 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@dd9cc8 name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 83850 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 83853 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 83855 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node6
[junit4:junit4]   2> 83861 T2209 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 83861 T2217 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 83863 T2211 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 83862 T2215 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 83861 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@18967d4
[junit4:junit4]   2> 83861 T2219 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 83861 T2221 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 83863 T2203 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 83863 T2213 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 83866 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 83866 T2222 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 83869 T2222 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 83869 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57369
[junit4:junit4]   2> 83869 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57369
[junit4:junit4]   2> 83872 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c000b with negotiated timeout 10000 for client /127.0.0.1:57369
[junit4:junit4]   2> 83872 T2222 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c000b, negotiated timeout = 10000
[junit4:junit4]   2> 83874 T2223 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18967d4 name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 83874 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 83876 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 83879 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node7
[junit4:junit4]   2> 83886 T2221 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 83888 T2209 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 83888 T2211 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 83888 T2217 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 83888 T2213 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 83888 T2223 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 83889 T2219 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 83890 T2203 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 83890 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@d2b948
[junit4:junit4]   2> 83891 T2215 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 83892 T2224 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 83893 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 83894 T2224 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 83894 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57372
[junit4:junit4]   2> 83896 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57372
[junit4:junit4]   2> 83898 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c000c with negotiated timeout 10000 for client /127.0.0.1:57372
[junit4:junit4]   2> 83898 T2224 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c000c, negotiated timeout = 10000
[junit4:junit4]   2> 83899 T2225 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d2b948 name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 83899 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 83900 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 83904 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node8
[junit4:junit4]   2> 83908 T2225 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 83908 T2209 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 83908 T2217 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 83908 T2221 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 83908 T2219 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 83911 T2211 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 83911 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4fb23f
[junit4:junit4]   2> 83911 T2223 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 83911 T2215 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 83911 T2203 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 83911 T2213 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 83912 T2226 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 83912 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 83914 T2226 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 83914 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57375
[junit4:junit4]   2> 83914 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57375
[junit4:junit4]   2> 83916 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c000d with negotiated timeout 10000 for client /127.0.0.1:57375
[junit4:junit4]   2> 83916 T2226 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c000d, negotiated timeout = 10000
[junit4:junit4]   2> 83918 T2227 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4fb23f name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 83918 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 83919 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 83921 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node9
[junit4:junit4]   2> 83926 T2209 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 83927 T2225 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 83927 T2217 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 83927 T2221 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 83928 T2203 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 83928 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1df38d8
[junit4:junit4]   2> 83929 T2219 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 83929 T2213 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 83929 T2227 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 83929 T2211 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 83929 T2223 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 83929 T2215 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 83930 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 83930 T2228 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 83933 T2228 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 83933 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57378
[junit4:junit4]   2> 83934 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57378
[junit4:junit4]   2> 83936 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c000e with negotiated timeout 10000 for client /127.0.0.1:57378
[junit4:junit4]   2> 83936 T2228 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c000e, negotiated timeout = 10000
[junit4:junit4]   2> 83936 T2229 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1df38d8 name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 83937 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 83938 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 83941 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node10
[junit4:junit4]   2> 83947 T2209 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 83947 T2225 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 83948 T2229 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 83948 T2219 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 83948 T2227 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 83948 T2221 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 83948 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@15abe6
[junit4:junit4]   2> 83949 T2223 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 83949 T2211 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 83948 T2203 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 83948 T2213 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 83948 T2215 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 83948 T2217 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 83950 T2230 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 83950 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 83951 T2230 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 83951 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57381
[junit4:junit4]   2> 83951 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57381
[junit4:junit4]   2> 83955 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c000f with negotiated timeout 10000 for client /127.0.0.1:57381
[junit4:junit4]   2> 83955 T2230 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c000f, negotiated timeout = 10000
[junit4:junit4]   2> 83956 T2231 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15abe6 name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 83956 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 83957 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 83959 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node11
[junit4:junit4]   2> 83964 T2209 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 83965 T2225 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 83965 T2219 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 83965 T2221 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 83967 T2229 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 83967 T2231 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 83967 T2217 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 83967 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1376a7b
[junit4:junit4]   2> 83967 T2203 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 83967 T2223 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 83967 T2215 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 83967 T2213 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 83967 T2227 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 83969 T2211 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 83969 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 83970 T2232 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 83972 T2232 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 83972 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57384
[junit4:junit4]   2> 83973 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57384
[junit4:junit4]   2> 83976 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c0010 with negotiated timeout 10000 for client /127.0.0.1:57384
[junit4:junit4]   2> 83976 T2232 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c0010, negotiated timeout = 10000
[junit4:junit4]   2> 83977 T2233 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1376a7b name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 83977 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 83978 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 83981 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node12
[junit4:junit4]   2> 83988 T2213 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 83988 T2229 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 83988 T2227 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 83989 T2217 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 83989 T2231 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 83989 T2219 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 83989 T2221 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 83989 T2233 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 83992 T2225 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 83992 T2209 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 83992 T2203 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 83992 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1795573
[junit4:junit4]   2> 83992 T2223 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 83993 T2215 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 83993 T2211 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 83994 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 83994 T2234 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 83996 T2234 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 83996 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57387
[junit4:junit4]   2> 83998 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57387
[junit4:junit4]   2> 84000 T2234 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c0011, negotiated timeout = 10000
[junit4:junit4]   2> 84001 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c0011 with negotiated timeout 10000 for client /127.0.0.1:57387
[junit4:junit4]   2> 84001 T2235 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1795573 name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 84001 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 84003 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 84006 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node13
[junit4:junit4]   2> 84013 T2217 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 84013 T2229 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 84014 T2227 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 84014 T2209 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 84014 T2235 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 84015 T2203 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 84015 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@325099
[junit4:junit4]   2> 84015 T2223 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 84017 T2213 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 84017 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 84017 T2215 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 84018 T2211 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 84018 T2231 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 84018 T2219 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 84018 T2225 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 84018 T2233 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 84018 T2221 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 84018 T2236 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 84022 T2236 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 84022 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57390
[junit4:junit4]   2> 84023 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57390
[junit4:junit4]   2> 84025 T2236 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c0012, negotiated timeout = 10000
[junit4:junit4]   2> 84025 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c0012 with negotiated timeout 10000 for client /127.0.0.1:57390
[junit4:junit4]   2> 84026 T2237 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@325099 name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 84026 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 84028 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 84030 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node14
[junit4:junit4]   2> 84040 T2217 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 84040 T2227 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 84042 T2213 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 84042 T2229 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 84042 T2223 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 84042 T2203 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 84043 T2209 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 84043 T2225 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 84043 T2235 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 84044 T2221 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 84044 T2219 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 84044 T2231 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 84044 T2215 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 84044 T2237 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 84046 T2233 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 84046 T2211 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 84046 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7f4ae0
[junit4:junit4]   2> 84047 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 84050 T2238 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 84051 T2238 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 84052 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57393
[junit4:junit4]   2> 84052 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57393
[junit4:junit4]   2> 84055 T2238 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c0013, negotiated timeout = 10000
[junit4:junit4]   2> 84055 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c0013 with negotiated timeout 10000 for client /127.0.0.1:57393
[junit4:junit4]   2> 84055 T2239 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f4ae0 name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 84057 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 84058 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 84060 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node15
[junit4:junit4]   2> 84072 T2239 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 84072 T2217 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 84072 T2227 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 84072 T2229 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 84072 T2213 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 84074 T2209 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 84074 T2235 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 84074 T2219 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 84074 T2231 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 84074 T2225 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 84075 T2237 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 84074 T2223 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 84075 T2233 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 84075 T2211 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 84074 T2221 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 84074 T2203 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 84076 T2215 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 84075 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@9fb0bc
[junit4:junit4]   2> 84079 T2240 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 84079 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 84080 T2240 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 84080 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57396
[junit4:junit4]   2> 84081 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57396
[junit4:junit4]   2> 84083 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c0014 with negotiated timeout 10000 for client /127.0.0.1:57396
[junit4:junit4]   2> 84083 T2240 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c0014, negotiated timeout = 10000
[junit4:junit4]   2> 84084 T2241 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9fb0bc name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 84086 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 84087 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 84089 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node16
[junit4:junit4]   2> 84099 T2217 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 84099 T2227 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 84099 T2229 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 84101 T2213 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 84101 T2239 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 84101 T2223 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 84101 T2203 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 84102 T2209 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 84102 T2225 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 84102 T2235 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 84102 T2221 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 84102 T2219 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 84103 T2231 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 84103 T2241 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 84103 T2233 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 84103 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ed8373
[junit4:junit4]   2> 84103 T2211 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 84105 T2215 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 84103 T2237 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 84106 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 84106 T2242 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 84109 T2242 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 84109 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57399
[junit4:junit4]   2> 84110 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57399
[junit4:junit4]   2> 84112 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c0015 with negotiated timeout 10000 for client /127.0.0.1:57399
[junit4:junit4]   2> 84112 T2242 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c0015, negotiated timeout = 10000
[junit4:junit4]   2> 84113 T2243 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ed8373 name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 84113 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 84115 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 84118 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node17
[junit4:junit4]   2> 84125 T2229 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 84125 T2227 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 84125 T2219 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 84125 T2217 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 84125 T2235 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 84126 T2221 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 84126 T2225 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 84126 T2209 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 84126 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@176ef5d
[junit4:junit4]   2> 84130 T2203 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 84130 T2239 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 84130 T2223 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 84130 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 84131 T2211 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 84131 T2233 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 84131 T2215 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 84131 T2243 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 84131 T2213 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 84131 T2244 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 84131 T2241 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 84131 T2231 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 84131 T2237 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 84134 T2244 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 84134 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57402
[junit4:junit4]   2> 84135 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57402
[junit4:junit4]   2> 84138 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c0016 with negotiated timeout 10000 for client /127.0.0.1:57402
[junit4:junit4]   2> 84138 T2244 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c0016, negotiated timeout = 10000
[junit4:junit4]   2> 84138 T2245 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@176ef5d name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 84139 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 84140 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 84142 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node18
[junit4:junit4]   2> 84149 T2229 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 84149 T2227 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 84149 T2217 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 84150 T2239 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 84153 T2223 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 84153 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@328381
[junit4:junit4]   2> 84153 T2245 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 84154 T2211 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 84154 T2215 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 84154 T2233 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 84154 T2241 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 84153 T2213 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 84155 T2237 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 84155 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 84155 T2243 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 84155 T2219 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 84155 T2231 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 84156 T2221 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 84156 T2203 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 84156 T2246 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 84156 T2209 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 84156 T2225 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 84156 T2235 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 84159 T2246 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 84159 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57405
[junit4:junit4]   2> 84159 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57405
[junit4:junit4]   2> 84161 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c0017 with negotiated timeout 10000 for client /127.0.0.1:57405
[junit4:junit4]   2> 84161 T2246 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c0017, negotiated timeout = 10000
[junit4:junit4]   2> 84162 T2247 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@328381 name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 84163 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 84164 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 84167 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node19
[junit4:junit4]   2> 84172 T2227 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 84172 T2217 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 84172 T2229 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 84175 T2209 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 84177 T2223 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 84177 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@187d938
[junit4:junit4]   2> 84177 T2203 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 84177 T2239 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 84177 T2245 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 84178 T2247 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 84178 T2211 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 84178 T2233 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 84179 T2215 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 84179 T2237 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 84177 T2213 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 84178 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 84179 T2235 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 84179 T2243 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 84179 T2241 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 84182 T2221 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 84179 T2219 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 84182 T2225 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 84182 T2231 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4:junit4]   2> 84182 T2248 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 84184 T2248 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 84184 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57408
[junit4:junit4]   2> 84187 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57408
[junit4:junit4]   2> 84190 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c0018 with negotiated timeout 10000 for client /127.0.0.1:57408
[junit4:junit4]   2> 84190 T2248 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c0018, negotiated timeout = 10000
[junit4:junit4]   2> 84191 T2249 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@187d938 name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 84191 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 84193 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 84196 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node20
[junit4:junit4]   2> 84203 T2227 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84204 T2217 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84205 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@698bbe
[junit4:junit4]   2> 84206 T2209 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84206 T2245 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84207 T2249 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84207 T2203 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84207 T2239 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84207 T2223 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84208 T2213 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84208 T2229 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84208 T2215 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84208 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 84208 T2221 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84211 T2231 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84208 T2241 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84208 T2237 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84208 T2211 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84208 T2233 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84211 T2250 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 84211 T2247 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84211 T2225 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84211 T2243 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84211 T2219 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84211 T2235 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4:junit4]   2> 84214 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57411
[junit4:junit4]   2> 84213 T2250 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 84215 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57411
[junit4:junit4]   2> 84223 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c0019 with negotiated timeout 10000 for client /127.0.0.1:57411
[junit4:junit4]   2> 84225 T2250 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c0019, negotiated timeout = 10000
[junit4:junit4]   2> 84225 T2251 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@698bbe name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 84226 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 84227 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 84228 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node21
[junit4:junit4]   2> 84235 T2217 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84236 T2227 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84236 T2229 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84238 T2251 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84238 T2241 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84238 T2237 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84238 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1fbcfb7
[junit4:junit4]   2> 84240 T2235 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84240 T2225 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84241 T2249 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84241 T2247 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84241 T2203 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84242 T2209 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84242 T2245 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84242 T2223 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84242 T2239 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84240 T2243 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84240 T2221 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84240 T2219 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84240 T2231 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84243 T2252 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 84243 T2233 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84243 T2211 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84243 T2215 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84243 T2213 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4:junit4]   2> 84241 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 84247 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57414
[junit4:junit4]   2> 84247 T2252 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 84248 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57414
[junit4:junit4]   2> 84250 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c001a with negotiated timeout 10000 for client /127.0.0.1:57414
[junit4:junit4]   2> 84250 T2252 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c001a, negotiated timeout = 10000
[junit4:junit4]   2> 84251 T2253 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fbcfb7 name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 84251 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 84253 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 84256 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node22
[junit4:junit4]   2> 84262 T2217 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84262 T2227 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84266 T2213 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84266 T2229 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84267 T2215 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84267 T2211 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84267 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@356ec0
[junit4:junit4]   2> 84267 T2231 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84267 T2243 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84267 T2249 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84269 T2221 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84269 T2219 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84269 T2225 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84270 T2235 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84270 T2209 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84270 T2223 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84267 T2237 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84267 T2241 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84267 T2251 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84267 T2233 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84270 T2254 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 84270 T2253 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84270 T2239 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84270 T2245 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84270 T2203 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84270 T2247 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4:junit4]   2> 84274 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57417
[junit4:junit4]   2> 84269 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 84274 T2254 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 84275 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57417
[junit4:junit4]   2> 84278 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c001b with negotiated timeout 10000 for client /127.0.0.1:57417
[junit4:junit4]   2> 84278 T2254 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c001b, negotiated timeout = 10000
[junit4:junit4]   2> 84279 T2255 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@356ec0 name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 84280 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 84281 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 84284 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node23
[junit4:junit4]   2> 84293 T2217 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84293 T2227 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84294 T2132 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57333/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@afe7d4
[junit4:junit4]   2> 84294 T2219 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84294 T2255 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84295 T2247 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84295 T2249 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84295 T2209 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84295 T2203 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84295 T2253 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84295 T2213 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84297 T2211 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84297 T2231 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84297 T2245 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84294 T2239 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84297 T2256 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:57333
[junit4:junit4]   2> 84297 T2243 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84297 T2233 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84297 T2225 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84297 T2235 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84297 T2221 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84297 T2237 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84297 T2241 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84297 T2251 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84297 T2229 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84295 T2215 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84295 T2223 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4:junit4]   2> 84295 T2132 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 84303 T2256 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57333, initiating session
[junit4:junit4]   2> 84303 T2194 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:57420
[junit4:junit4]   2> 84304 T2194 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:57420
[junit4:junit4]   2> 84307 T2196 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ac07fb10c001c with negotiated timeout 10000 for client /127.0.0.1:57420
[junit4:junit4]   2> 84307 T2256 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:57333, sessionid = 0x13ac07fb10c001c, negotiated timeout = 10000
[junit4:junit4]   2> 84308 T2257 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@afe7d4 name:ZooKeeperConnection Watcher:127.0.0.1:57333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 84308 T2132 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 84309 T2132 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 84313 T2132 oascc.SolrZkClient.makePath makePath: /live_nodes/node24
[junit4:junit4]   2> 84318 T2239 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 84319 T2227 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 84319 T2217 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 84323 T2231 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 84323 T2251 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 84324 T2221 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4:junit4]   2> 84324 T2215 oascc.ZkStateReader$3.process Updating live nodes..

[...truncated too long message...]

:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:227)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:83)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:128)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 108759 T2422 oasc.Overseer$ClusterStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:244)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:192)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:116)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 110499 T2410 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 110501 T2422 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88594798763376643-127.0.0.1:57552_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 110500 T2425 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:227)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:83)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:128)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 110504 T2425 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard3/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:227)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:83)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:128)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 110504 T2425 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 110504 T2132 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 110504 T2132 oas.SolrTestCaseJ4.tearDown ###Ending testShardAssignment
[junit4:junit4]   2> 110506 T2132 oas.SolrTestCaseJ4.initCore ####initCore
[junit4:junit4]   2> 110506 T2132 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4:junit4]   2> 113388 T2132 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41: {}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=th_TH, timezone=Africa/Bangui
[junit4:junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_07 (32-bit)/cpus=2,threads=10,free=136890336,total=387440640
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestBinaryField, ScriptEngineTest, TestIBSimilarityFactory, TestPropInject, WordBreakSolrSpellCheckerTest, TestFoldingMultitermQuery, TestCoreContainer, SpellCheckCollatorTest, TestMergePolicyConfig, TestMultiCoreConfBootstrap, SolrCmdDistributorTest, SimpleFacetsTest, SuggesterTest, CircularListTest, SpellingQueryConverterTest, DirectUpdateHandlerTest, DefaultValueUpdateProcessorTest, TestSolrDeletionPolicy2, TestFastLRUCache, TestLFUCache, NumericFieldsTest, TestSuggestSpellingConverter, OutputWriterTest, BasicDistributedZk2Test, TestSystemIdResolver, XsltUpdateRequestHandlerTest, TestDFRSimilarityFactory, TestBadConfig, TestUtils, EchoParamsTest, DistributedTermsComponentTest, TestRecovery, XmlUpdateRequestHandlerTest, TestStressLucene, LoggingHandlerTest, TestFastWriter, RecoveryZkTest, TestSolrCoreProperties, UniqFieldsUpdateProcessorFactoryTest, BasicZkTest, TestLMJelinekMercerSimilarityFactory, TestBM25SimilarityFactory, DirectUpdateHandlerOptimizeTest, CSVRequestHandlerTest, CoreContainerCoreInitFailuresTest, ResponseLogComponentTest, TestQuerySenderListener, LeaderElectionTest, PluginInfoTest, AnalysisAfterCoreReloadTest, TestPerFieldSimilarity, SuggesterTSTTest, FastVectorHighlighterTest, AlternateDirectoryTest, TestSolrIndexConfig, FieldMutatingUpdateProcessorTest, SolrIndexConfigTest, SearchHandlerTest, TestSolrXMLSerializer, NoCacheHeaderTest, AutoCommitTest, SolrInfoMBeanTest, TestTrie, IndexReaderFactoryTest, DistributedSpellCheckComponentTest, DOMUtilTest, BasicFunctionalityTest, TestStressRecovery, PreAnalyzedFieldTest, CopyFieldTest, ClusterStateUpdateTest, TestStressVersions, TestConfig, TimeZoneUtilsTest, TestQueryUtils, RequiredFieldsTest, ClusterStateTest, TestArbitraryIndexDir, ZkControllerTest, HighlighterConfigTest, TestLMDirichletSimilarityFactory, TestSurroundQueryParser, TestFaceting, QueryEqualityTest, MoreLikeThisHandlerTest, TestPseudoReturnFields, MultiTermTest, SortByFunctionTest, DocumentAnalysisRequestHandlerTest, BasicDistributedZkTest, TestDocumentBuilder, ZkSolrClientTest, TestFiltering, LeaderElectionIntegrationTest, PolyFieldTest, TestHashPartitioner, HighlighterTest, StatelessScriptUpdateProcessorFactoryTest, CacheHeaderTest, IndexSchemaRuntimeFieldTest, StatsComponentTest, JsonLoaderTest, ResourceLoaderTest, SoftAutoCommitTest, BinaryUpdateRequestHandlerTest, TestLRUCache, StandardRequestHandlerTest, JSONWriterTest, SyncSliceTest, OverseerTest]
[junit4:junit4] Completed in 113.44s, 8 tests, 1 failure <<< FAILURES!

[...truncated 360 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:335: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:178: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\module-build.xml:61: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1163: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:827: There were test failures: 233 suites, 965 tests, 1 failure, 13 ignored (8 assumptions)

Total time: 43 minutes 53 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.7.0_07 -client -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message