lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@sd-datasolutions.de>
Subject [JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.6.0_37) - Build # 1485 - Failure!
Date Thu, 08 Nov 2012 19:14:36 GMT
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Windows/1485/
Java: 32bit/jdk1.6.0_37 -client -XX:+UseParallelGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.OverseerTest.testShardLeaderChange

Error Message:
Unexpected shard leader coll:collection1 shard:shard1 expected:<core[4]> but was:<core[1]>

Stack Trace:
org.junit.ComparisonFailure: Unexpected shard leader coll:collection1 shard:shard1 expected:<core[4]> but was:<core[1]>
	at __randomizedtesting.SeedInfo.seed([CB1A5D790F594247:1549DA8E15C1B7B6]:0)
	at org.junit.Assert.assertEquals(Assert.java:125)
	at org.apache.solr.cloud.OverseerTest.verifyShardLeader(OverseerTest.java:493)
	at org.apache.solr.cloud.OverseerTest.testShardLeaderChange(OverseerTest.java:652)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)




Build Log:
[...truncated 8021 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4:junit4]   2> 0 T2441 oas.SolrTestCaseJ4.initCore ####initCore
[junit4:junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerTest-1352401510587
[junit4:junit4]   2> 2 T2441 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4:junit4]   2> 4 T2441 oas.SolrTestCaseJ4.setUp ###Starting testReplay
[junit4:junit4]   2> 4 T2441 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 7 T2442 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 7 T2442 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 8 T2442 oazsp.FileTxnSnapLog.save Snapshotting: 0
[junit4:junit4]   2> 84 T2441 oasc.ZkTestServer.run start zk server on port:60326
[junit4:junit4]   2> 84 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60326/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@26dffe
[junit4:junit4]   2> 86 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 86 T2447 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60326
[junit4:junit4]   2> 87 T2447 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60326, initiating session
[junit4:junit4]   2> 88 T2443 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60329
[junit4:junit4]   2> 88 T2443 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60329
[junit4:junit4]   2> 88 T2445 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 98 T2445 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16960c40000 with negotiated timeout 10000 for client /127.0.0.1:60329
[junit4:junit4]   2> 98 T2447 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60326, sessionid = 0x13ae16960c40000, negotiated timeout = 10000
[junit4:junit4]   2> 100 T2448 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@26dffe name:ZooKeeperConnection Watcher:127.0.0.1:60326/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 100 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 100 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60326 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@560e33
[junit4:junit4]   2> 101 T2449 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60326
[junit4:junit4]   2> 101 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 102 T2449 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60326, initiating session
[junit4:junit4]   2> 102 T2443 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60332
[junit4:junit4]   2> 102 T2443 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60332
[junit4:junit4]   2> 103 T2449 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60326, sessionid = 0x13ae16960c40001, negotiated timeout = 10000
[junit4:junit4]   2> 103 T2445 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16960c40001 with negotiated timeout 10000 for client /127.0.0.1:60332
[junit4:junit4]   2> 103 T2450 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@560e33 name:ZooKeeperConnection Watcher:127.0.0.1:60326 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 103 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 105 T2446 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16960c40001
[junit4:junit4]   2> 106 T2441 oaz.ZooKeeper.close Session: 0x13ae16960c40001 closed
[junit4:junit4]   2> 107 T2450 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 106 T2443 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae16960c40001, likely client has closed socket
[junit4:junit4]   2> 107 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60326 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@ea916a
[junit4:junit4]   2> 108 T2443 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60332 which had sessionid 0x13ae16960c40001
[junit4:junit4]   2> 109 T2451 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60326
[junit4:junit4]   2> 109 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 111 T2451 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60326, initiating session
[junit4:junit4]   2> 111 T2443 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60335
[junit4:junit4]   2> 111 T2443 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60335
[junit4:junit4]   2> 113 T2445 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16960c40002 with negotiated timeout 10000 for client /127.0.0.1:60335
[junit4:junit4]   2> 113 T2451 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60326, sessionid = 0x13ae16960c40002, negotiated timeout = 10000
[junit4:junit4]   2> 113 T2452 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ea916a name:ZooKeeperConnection Watcher:127.0.0.1:60326 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 114 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 114 T2441 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 117 T2446 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16960c40002
[junit4:junit4]   2> 118 T2452 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 118 T2441 oaz.ZooKeeper.close Session: 0x13ae16960c40002 closed
[junit4:junit4]   2> 119 T2443 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60335 which had sessionid 0x13ae16960c40002
[junit4:junit4]   2> 119 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 122 T2441 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 124 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 126 T2446 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16960c40000 type:create cxid:0xc zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 131 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60326/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@10e5285
[junit4:junit4]   2> 132 T2453 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60326
[junit4:junit4]   2> 132 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 133 T2453 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60326, initiating session
[junit4:junit4]   2> 133 T2443 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60338
[junit4:junit4]   2> 133 T2443 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60338
[junit4:junit4]   2> 135 T2445 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16960c40003 with negotiated timeout 10000 for client /127.0.0.1:60338
[junit4:junit4]   2> 135 T2453 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60326, sessionid = 0x13ae16960c40003, negotiated timeout = 10000
[junit4:junit4]   2> 135 T2454 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10e5285 name:ZooKeeperConnection Watcher:127.0.0.1:60326/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 136 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 137 T2441 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 144 T2446 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16960c40003 type:delete cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 145 T2441 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 148 T2441 oasc.Overseer.start Overseer (id=88630985398419459-127.0.0.1:60326_solr-n_0000000000) starting
[junit4:junit4]   2> 149 T2446 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16960c40003 type:create cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 151 T2446 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16960c40003 type:create cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 151 T2446 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16960c40003 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 153 T2446 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16960c40003 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 154 T2456 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 154 T2446 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16960c40000 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 156 T2446 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16960c40000 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 161 T2455 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 161 T2455 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4:junit4]   2> 161 T2455 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "shard":"s1",
[junit4:junit4]   2> 	  "roles":"",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr"}
[junit4:junit4]   2> 163 T2448 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 166 T2455 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "shard":"s1",
[junit4:junit4]   2> 	  "roles":"",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"core2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr"}
[junit4:junit4]   2> 168 T2448 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 171 T2455 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 172 T2455 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 173 T2455 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "shard":"s1",
[junit4:junit4]   2> 	  "roles":"",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"core3",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr"}
[junit4:junit4]   2> 179 T2448 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 240 T2446 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16960c40003
[junit4:junit4]   2> 242 T2454 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 242 T2443 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae16960c40003, likely client has closed socket
[junit4:junit4]   2> 242 T2441 oaz.ZooKeeper.close Session: 0x13ae16960c40003 closed
[junit4:junit4]   2> 242 T2443 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60338 which had sessionid 0x13ae16960c40003
[junit4:junit4]   2> 243 T2446 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16960c40000
[junit4:junit4]   2> 245 T2441 oaz.ZooKeeper.close Session: 0x13ae16960c40000 closed
[junit4:junit4]   2> 245 T2448 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 245 T2443 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60329 which had sessionid 0x13ae16960c40000
[junit4:junit4]   2> 245 T2445 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 245 T2446 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 246 T2441 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 331 T2444 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 579 T2455 oasc.Overseer$ClusterStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:244)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:192)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:116)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 
[junit4:junit4]   2> 2041 T2443 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 2042 T2455 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88630985398419459-127.0.0.1:60326_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 2042 T2441 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 2043 T2441 oas.SolrTestCaseJ4.tearDown ###Ending testReplay
[junit4:junit4]   2> 2046 T2441 oas.SolrTestCaseJ4.setUp ###Starting testPlaceholders
[junit4:junit4]   2> 2046 T2441 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 2046 T2457 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 2048 T2457 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 2049 T2457 oazsp.FileSnap.deserialize Reading snapshot C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerTest-1352401510587\zookeeper\server1\data\version-2\snapshot.0
[junit4:junit4]   2> 2049 T2457 oazsp.FileTxnSnapLog.save Snapshotting: 26
[junit4:junit4]   2> 2126 T2441 oasc.ZkTestServer.run start zk server on port:60341
[junit4:junit4]   2> 2126 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60341/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@fd70cd
[junit4:junit4]   2> 2128 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2128 T2462 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60341
[junit4:junit4]   2> 2129 T2462 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60341, initiating session
[junit4:junit4]   2> 2130 T2458 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60344
[junit4:junit4]   2> 2130 T2458 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60344
[junit4:junit4]   2> 2130 T2460 oazsp.FileTxnLog.append Creating new log file: log.27
[junit4:junit4]   2> 2137 T2462 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60341, sessionid = 0x13ae16968bf0000, negotiated timeout = 10000
[junit4:junit4]   2> 2137 T2460 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16968bf0000 with negotiated timeout 10000 for client /127.0.0.1:60344
[junit4:junit4]   2> 2138 T2463 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fd70cd name:ZooKeeperConnection Watcher:127.0.0.1:60341/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2138 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2138 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60341 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1621b4d
[junit4:junit4]   2> 2140 T2464 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60341
[junit4:junit4]   2> 2140 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2140 T2464 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60341, initiating session
[junit4:junit4]   2> 2140 T2458 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60347
[junit4:junit4]   2> 2141 T2458 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60347
[junit4:junit4]   2> 2143 T2460 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16968bf0001 with negotiated timeout 10000 for client /127.0.0.1:60347
[junit4:junit4]   2> 2143 T2464 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60341, sessionid = 0x13ae16968bf0001, negotiated timeout = 10000
[junit4:junit4]   2> 2144 T2465 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1621b4d name:ZooKeeperConnection Watcher:127.0.0.1:60341 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2144 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2158 T2461 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16968bf0001
[junit4:junit4]   2> 2158 T2441 oaz.ZooKeeper.close Session: 0x13ae16968bf0001 closed
[junit4:junit4]   2> 2158 T2458 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae16968bf0001, likely client has closed socket
[junit4:junit4]   2> 2158 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60341 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1785ab7
[junit4:junit4]   2> 2159 T2458 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60347 which had sessionid 0x13ae16968bf0001
[junit4:junit4]   2> 2159 T2465 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2160 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2160 T2466 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60341
[junit4:junit4]   2> 2161 T2466 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60341, initiating session
[junit4:junit4]   2> 2161 T2458 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60350
[junit4:junit4]   2> 2161 T2458 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60350
[junit4:junit4]   2> 2163 T2460 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16968bf0002 with negotiated timeout 10000 for client /127.0.0.1:60350
[junit4:junit4]   2> 2163 T2466 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60341, sessionid = 0x13ae16968bf0002, negotiated timeout = 10000
[junit4:junit4]   2> 2163 T2467 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1785ab7 name:ZooKeeperConnection Watcher:127.0.0.1:60341 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2164 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2164 T2441 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 2166 T2461 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16968bf0002
[junit4:junit4]   2> 2167 T2441 oaz.ZooKeeper.close Session: 0x13ae16968bf0002 closed
[junit4:junit4]   2> 2168 T2458 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae16968bf0002, likely client has closed socket
[junit4:junit4]   2> 2168 T2467 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2168 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 2168 T2458 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60350 which had sessionid 0x13ae16968bf0002
[junit4:junit4]   2> 2171 T2441 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 2172 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2174 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60341/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1bc4804
[junit4:junit4]   2> 2175 T2468 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60341
[junit4:junit4]   2> 2175 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2176 T2468 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60341, initiating session
[junit4:junit4]   2> 2176 T2458 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60353
[junit4:junit4]   2> 2177 T2458 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60353
[junit4:junit4]   2> 2178 T2460 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16968bf0003 with negotiated timeout 10000 for client /127.0.0.1:60353
[junit4:junit4]   2> 2178 T2468 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60341, sessionid = 0x13ae16968bf0003, negotiated timeout = 10000
[junit4:junit4]   2> 2179 T2469 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bc4804 name:ZooKeeperConnection Watcher:127.0.0.1:60341/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2179 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2180 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2183 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4:junit4]   2> 2187 T2463 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 2187 T2469 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 2187 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60341/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1dbd0a3
[junit4:junit4]   2> 2188 T2470 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60341
[junit4:junit4]   2> 2188 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2189 T2470 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60341, initiating session
[junit4:junit4]   2> 2189 T2458 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60356
[junit4:junit4]   2> 2189 T2458 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60356
[junit4:junit4]   2> 2191 T2460 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16968bf0004 with negotiated timeout 10000 for client /127.0.0.1:60356
[junit4:junit4]   2> 2191 T2470 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60341, sessionid = 0x13ae16968bf0004, negotiated timeout = 10000
[junit4:junit4]   2> 2191 T2471 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1dbd0a3 name:ZooKeeperConnection Watcher:127.0.0.1:60341/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2192 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2193 T2441 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 2198 T2461 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16968bf0004 type:delete cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 2199 T2441 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 2202 T2441 oasc.Overseer.start Overseer (id=88630985532309508-127.0.0.1:60341_solr-n_0000000000) starting
[junit4:junit4]   2> 2203 T2461 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16968bf0004 type:create cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2204 T2461 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16968bf0004 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2206 T2461 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16968bf0004 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2207 T2473 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 2207 T2461 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16968bf0003 type:create cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2209 T2461 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16968bf0003 type:create cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 2210 T2472 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 2214 T2472 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2214 T2472 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=12 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"12",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://node1/solr/"}
[junit4:junit4]   2> 2214 T2472 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 12
[junit4:junit4]   2> 2215 T2461 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16968bf0004 type:create cxid:0x1d zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 2222 T2469 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2222 T2463 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2611 T2441 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 2622 T2461 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16968bf0003 type:delete cxid:0x1c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 2623 T2441 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 2628 T2461 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16968bf0003 type:create cxid:0x24 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2631 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2632 T2461 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16968bf0004
[junit4:junit4]   2> 2633 T2441 oaz.ZooKeeper.close Session: 0x13ae16968bf0004 closed
[junit4:junit4]   2> 2633 T2458 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae16968bf0004, likely client has closed socket
[junit4:junit4]   2> 2633 T2471 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2634 T2458 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60356 which had sessionid 0x13ae16968bf0004
[junit4:junit4]   2> 2636 T2469 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4]   2> 2636 T2461 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16968bf0003
[junit4:junit4]   2> 2636 T2463 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4]   2> 2638 T2441 oaz.ZooKeeper.close Session: 0x13ae16968bf0003 closed
[junit4:junit4]   2> 2638 T2469 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2638 T2458 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae16968bf0003, likely client has closed socket
[junit4:junit4]   2> 2638 T2458 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60353 which had sessionid 0x13ae16968bf0003
[junit4:junit4]   2> 2638 T2461 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16968bf0000
[junit4:junit4]   2> 2640 T2441 oaz.ZooKeeper.close Session: 0x13ae16968bf0000 closed
[junit4:junit4]   2> 2640 T2463 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2640 T2458 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae16968bf0000, likely client has closed socket
[junit4:junit4]   2> 2641 T2460 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 2641 T2458 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60344 which had sessionid 0x13ae16968bf0000
[junit4:junit4]   2> 2641 T2461 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 2641 T2441 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 3023 T2472 oasc.Overseer$ClusterStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:244)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:192)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:116)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 
[junit4:junit4]   2> 4436 T2472 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88630985532309508-127.0.0.1:60341_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 3210 T2459 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 4438 T2458 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 4441 T2441 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 4441 T2441 oas.SolrTestCaseJ4.tearDown ###Ending testPlaceholders
[junit4:junit4]   2> 4448 T2441 oas.SolrTestCaseJ4.setUp ###Starting testOverseerFailure
[junit4:junit4]   2> 4449 T2441 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 4450 T2474 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 4451 T2474 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 4452 T2474 oazsp.FileSnap.deserialize Reading snapshot C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerTest-1352401510587\zookeeper\server1\data\version-2\snapshot.26
[junit4:junit4]   2> 4458 T2474 oazsp.FileTxnSnapLog.save Snapshotting: 5d
[junit4:junit4]   2> 4530 T2441 oasc.ZkTestServer.run start zk server on port:60359
[junit4:junit4]   2> 4530 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60359/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@ed932a
[junit4:junit4]   2> 4533 T2479 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60359
[junit4:junit4]   2> 4533 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4535 T2479 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60359, initiating session
[junit4:junit4]   2> 4535 T2475 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60362
[junit4:junit4]   2> 4536 T2475 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60362
[junit4:junit4]   2> 4537 T2477 oazsp.FileTxnLog.append Creating new log file: log.5e
[junit4:junit4]   2> 4545 T2477 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16972290000 with negotiated timeout 10000 for client /127.0.0.1:60362
[junit4:junit4]   2> 4545 T2479 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60359, sessionid = 0x13ae16972290000, negotiated timeout = 10000
[junit4:junit4]   2> 4546 T2480 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ed932a name:ZooKeeperConnection Watcher:127.0.0.1:60359/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4546 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4547 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60359 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1cfffc
[junit4:junit4]   2> 4549 T2481 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60359
[junit4:junit4]   2> 4549 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4551 T2481 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60359, initiating session
[junit4:junit4]   2> 4551 T2475 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60365
[junit4:junit4]   2> 4551 T2475 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60365
[junit4:junit4]   2> 4554 T2477 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16972290001 with negotiated timeout 10000 for client /127.0.0.1:60365
[junit4:junit4]   2> 4554 T2481 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60359, sessionid = 0x13ae16972290001, negotiated timeout = 10000
[junit4:junit4]   2> 4554 T2482 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cfffc name:ZooKeeperConnection Watcher:127.0.0.1:60359 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4556 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4609 T2478 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16972290001
[junit4:junit4]   2> 4611 T2441 oaz.ZooKeeper.close Session: 0x13ae16972290001 closed
[junit4:junit4]   2> 4611 T2475 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae16972290001, likely client has closed socket
[junit4:junit4]   2> 4612 T2482 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4611 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60359 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@6e5059
[junit4:junit4]   2> 4612 T2475 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60365 which had sessionid 0x13ae16972290001
[junit4:junit4]   2> 4614 T2483 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60359
[junit4:junit4]   2> 4614 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4617 T2483 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60359, initiating session
[junit4:junit4]   2> 4617 T2475 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60368
[junit4:junit4]   2> 4617 T2475 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60368
[junit4:junit4]   2> 4618 T2477 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16972290002 with negotiated timeout 10000 for client /127.0.0.1:60368
[junit4:junit4]   2> 4618 T2483 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60359, sessionid = 0x13ae16972290002, negotiated timeout = 10000
[junit4:junit4]   2> 4619 T2484 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e5059 name:ZooKeeperConnection Watcher:127.0.0.1:60359 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4619 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4619 T2441 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 4622 T2478 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16972290002
[junit4:junit4]   2> 4623 T2484 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4623 T2475 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae16972290002, likely client has closed socket
[junit4:junit4]   2> 4623 T2441 oaz.ZooKeeper.close Session: 0x13ae16972290002 closed
[junit4:junit4]   2> 4623 T2475 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60368 which had sessionid 0x13ae16972290002
[junit4:junit4]   2> 4623 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 4626 T2441 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 4628 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4629 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60359/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@135a11e
[junit4:junit4]   2> 4631 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4631 T2485 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60359
[junit4:junit4]   2> 4631 T2485 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60359, initiating session
[junit4:junit4]   2> 4631 T2475 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60371
[junit4:junit4]   2> 4632 T2475 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60371
[junit4:junit4]   2> 4634 T2477 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16972290003 with negotiated timeout 10000 for client /127.0.0.1:60371
[junit4:junit4]   2> 4634 T2485 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60359, sessionid = 0x13ae16972290003, negotiated timeout = 10000
[junit4:junit4]   2> 4634 T2486 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@135a11e name:ZooKeeperConnection Watcher:127.0.0.1:60359/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4634 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4635 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4636 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4:junit4]   2> 4639 T2486 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 4640 T2480 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 4640 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60359/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1778580
[junit4:junit4]   2> 4641 T2487 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60359
[junit4:junit4]   2> 4641 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4642 T2487 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60359, initiating session
[junit4:junit4]   2> 4642 T2475 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60374
[junit4:junit4]   2> 4642 T2475 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60374
[junit4:junit4]   2> 4644 T2477 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16972290004 with negotiated timeout 10000 for client /127.0.0.1:60374
[junit4:junit4]   2> 4644 T2487 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60359, sessionid = 0x13ae16972290004, negotiated timeout = 10000
[junit4:junit4]   2> 4644 T2488 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1778580 name:ZooKeeperConnection Watcher:127.0.0.1:60359/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4645 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4645 T2441 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 4650 T2478 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16972290004 type:delete cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 4651 T2441 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 4653 T2441 oasc.Overseer.start Overseer (id=88630985690251268-127.0.0.1:60359_solr-n_0000000000) starting
[junit4:junit4]   2> 4655 T2478 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16972290004 type:create cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4656 T2478 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16972290004 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4657 T2478 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16972290004 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4659 T2490 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 4659 T2489 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 5456 T2478 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16972290003 type:create cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5459 T2478 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16972290003 type:create cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 5866 T2489 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5866 T2489 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://node1/solr/"}
[junit4:junit4]   2> 5866 T2489 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 5867 T2478 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16972290004 type:create cxid:0x26 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 5875 T2486 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 5875 T2480 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 6263 T2441 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6282 T2478 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16972290003 type:delete cxid:0x1c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 6284 T2441 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 6294 T2478 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16972290003 type:create cxid:0x24 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6300 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6303 T2478 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16972290003 type:create cxid:0x26 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6308 T2441 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6312 T2478 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16972290003 type:create cxid:0x2d zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6660 T2489 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6665 T2489 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://node1/solr/"}
[junit4:junit4]   2> 6669 T2480 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 6669 T2486 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 6707 T2478 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16972290004
[junit4:junit4]   2> 6709 T2475 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae16972290004, likely client has closed socket
[junit4:junit4]   2> 6709 T2441 oaz.ZooKeeper.close Session: 0x13ae16972290004 closed
[junit4:junit4]   2> 6710 T2475 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60374 which had sessionid 0x13ae16972290004
[junit4:junit4]   2> 6710 T2488 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 7032 T2489 oasc.Overseer$ClusterStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:244)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:192)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:116)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 
[junit4:junit4]   2> 7032 T2489 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88630985690251268-127.0.0.1:60359_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 7427 T2478 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16972290003 type:create cxid:0x32 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7433 T2441 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 7437 T2478 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16972290003 type:create cxid:0x39 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 7445 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60359/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@51f7cc
[junit4:junit4]   2> 7447 T2491 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60359
[junit4:junit4]   2> 7447 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7449 T2491 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60359, initiating session
[junit4:junit4]   2> 7449 T2475 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60377
[junit4:junit4]   2> 7450 T2475 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60377
[junit4:junit4]   2> 7452 T2477 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16972290005 with negotiated timeout 10000 for client /127.0.0.1:60377
[junit4:junit4]   2> 7452 T2491 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60359, sessionid = 0x13ae16972290005, negotiated timeout = 10000
[junit4:junit4]   2> 7453 T2492 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@51f7cc name:ZooKeeperConnection Watcher:127.0.0.1:60359/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7453 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7458 T2478 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16972290005 type:delete cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 7460 T2441 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 7465 T2441 oasc.Overseer.start Overseer (id=88630985690251269-127.0.0.1:60359_solr-n_0000000002) starting
[junit4:junit4]   2> 7466 T2478 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16972290005 type:create cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7469 T2478 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16972290005 type:create cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7471 T2478 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16972290005 type:create cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7473 T2478 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16972290005 type:create cxid:0xc zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7476 T2494 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 7477 T2493 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 7482 T2493 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7483 T2493 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://node1/solr/"}
[junit4:junit4]   2> 7492 T2486 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 7493 T2480 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 7531 T2478 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16972290003 type:create cxid:0x3e zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7535 T2441 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 7539 T2478 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16972290003 type:create cxid:0x45 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 7857 T2493 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7863 T2486 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 7869 T2478 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16972290003 type:create cxid:0x53 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7872 T2486 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:102)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:227)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:83)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:128)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 7873 T2486 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:102)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:227)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:83)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:128)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 7879 T2493 oasc.Overseer$ClusterStateUpdater.setShardLeader SEVERE Could not mark shard leader for non existing collection:collection1
[junit4:junit4]   2> 7883 T2480 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 7883 T2486 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 8245 T2478 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16972290003
[junit4:junit4]   2> 8245 T2486 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4]   2> 8246 T2480 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4]   2> 8247 T2475 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60371 which had sessionid 0x13ae16972290003
[junit4:junit4]   2> 8247 T2441 oaz.ZooKeeper.close Session: 0x13ae16972290003 closed
[junit4:junit4]   2> 8248 T2486 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8248 T2478 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16972290005
[junit4:junit4]   2> 8251 T2441 oaz.ZooKeeper.close Session: 0x13ae16972290005 closed
[junit4:junit4]   2> 8251 T2475 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae16972290005, likely client has closed socket
[junit4:junit4]   2> 8251 T2492 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8253 T2475 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60377 which had sessionid 0x13ae16972290005
[junit4:junit4]   2> 8254 T2478 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16972290000
[junit4:junit4]   2> 8255 T2475 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae16972290000, likely client has closed socket
[junit4:junit4]   2> 8256 T2480 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8255 T2441 oaz.ZooKeeper.close Session: 0x13ae16972290000 closed
[junit4:junit4]   2> 8256 T2475 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60362 which had sessionid 0x13ae16972290000
[junit4:junit4]   2> 8257 T2478 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 8258 T2477 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 8259 T2441 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 8334 T2476 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 8967 T2493 oasc.Overseer$ClusterStateUpdater.run WARNING Overseer cannot talk to ZK
[junit4:junit4]   2> 9876 T2475 oazs.NIOServerCnxn$Factory.run WARNING Ignoring unexpected runtime exception java.nio.channels.CancelledKeyException
[junit4:junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:55)
[junit4:junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.readyOps(SelectionKeyImpl.java:69)
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn$Factory.run(NIOServerCnxn.java:241)
[junit4:junit4]   2> 
[junit4:junit4]   2> 9877 T2475 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 9877 T2441 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 9877 T2441 oas.SolrTestCaseJ4.tearDown ###Ending testOverseerFailure
[junit4:junit4]   2> 9879 T2441 oas.SolrTestCaseJ4.setUp ###Starting testDoubleAssignment
[junit4:junit4]   2> 9879 T2441 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 9880 T2495 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 9881 T2495 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 9882 T2495 oazsp.FileSnap.deserialize Reading snapshot C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerTest-1352401510587\zookeeper\server1\data\version-2\snapshot.5d
[junit4:junit4]   2> 9884 T2495 oazsp.FileTxnSnapLog.save Snapshotting: d0
[junit4:junit4]   2> 9952 T2441 oasc.ZkTestServer.run start zk server on port:60380
[junit4:junit4]   2> 9952 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60380/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@115b065
[junit4:junit4]   2> 9954 T2500 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60380
[junit4:junit4]   2> 9954 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9955 T2500 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60380, initiating session
[junit4:junit4]   2> 9955 T2496 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60383
[junit4:junit4]   2> 9955 T2496 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60383
[junit4:junit4]   2> 9956 T2498 oazsp.FileTxnLog.append Creating new log file: log.d1
[junit4:junit4]   2> 9959 T2498 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16987570000 with negotiated timeout 10000 for client /127.0.0.1:60383
[junit4:junit4]   2> 9959 T2500 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60380, sessionid = 0x13ae16987570000, negotiated timeout = 10000
[junit4:junit4]   2> 9960 T2501 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@115b065 name:ZooKeeperConnection Watcher:127.0.0.1:60380/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9960 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9960 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60380 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@16df100
[junit4:junit4]   2> 9961 T2502 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60380
[junit4:junit4]   2> 9961 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9962 T2502 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60380, initiating session
[junit4:junit4]   2> 9962 T2496 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60386
[junit4:junit4]   2> 9962 T2496 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60386
[junit4:junit4]   2> 9963 T2498 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16987570001 with negotiated timeout 10000 for client /127.0.0.1:60386
[junit4:junit4]   2> 9963 T2502 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60380, sessionid = 0x13ae16987570001, negotiated timeout = 10000
[junit4:junit4]   2> 9963 T2503 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16df100 name:ZooKeeperConnection Watcher:127.0.0.1:60380 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9964 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9980 T2499 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16987570001
[junit4:junit4]   2> 9980 T2441 oaz.ZooKeeper.close Session: 0x13ae16987570001 closed
[junit4:junit4]   2> 9980 T2496 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae16987570001, likely client has closed socket
[junit4:junit4]   2> 9980 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60380 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@24246
[junit4:junit4]   2> 9981 T2496 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60386 which had sessionid 0x13ae16987570001
[junit4:junit4]   2> 9981 T2503 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 9982 T2504 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60380
[junit4:junit4]   2> 9982 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9984 T2504 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60380, initiating session
[junit4:junit4]   2> 9984 T2496 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60389
[junit4:junit4]   2> 9984 T2496 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60389
[junit4:junit4]   2> 9985 T2498 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16987570002 with negotiated timeout 10000 for client /127.0.0.1:60389
[junit4:junit4]   2> 9985 T2504 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60380, sessionid = 0x13ae16987570002, negotiated timeout = 10000
[junit4:junit4]   2> 9985 T2505 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24246 name:ZooKeeperConnection Watcher:127.0.0.1:60380 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9986 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9986 T2441 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 9989 T2499 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16987570002
[junit4:junit4]   2> 9991 T2441 oaz.ZooKeeper.close Session: 0x13ae16987570002 closed
[junit4:junit4]   2> 9991 T2496 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae16987570002, likely client has closed socket
[junit4:junit4]   2> 9991 T2505 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 9991 T2496 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60389 which had sessionid 0x13ae16987570002
[junit4:junit4]   2> 9991 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 9994 T2441 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 9996 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 9999 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60380/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f4d017
[junit4:junit4]   2> 10000 T2506 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60380
[junit4:junit4]   2> 10001 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 10002 T2506 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60380, initiating session
[junit4:junit4]   2> 10002 T2496 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60392
[junit4:junit4]   2> 10002 T2496 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60392
[junit4:junit4]   2> 10003 T2498 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16987570003 with negotiated timeout 10000 for client /127.0.0.1:60392
[junit4:junit4]   2> 10004 T2506 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60380, sessionid = 0x13ae16987570003, negotiated timeout = 10000
[junit4:junit4]   2> 10004 T2507 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f4d017 name:ZooKeeperConnection Watcher:127.0.0.1:60380/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 10004 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 10005 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 10006 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4:junit4]   2> 10009 T2507 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 10009 T2501 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 10010 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60380/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@eabf5a
[junit4:junit4]   2> 10010 T2508 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60380
[junit4:junit4]   2> 10010 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 10011 T2508 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60380, initiating session
[junit4:junit4]   2> 10011 T2496 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60395
[junit4:junit4]   2> 10011 T2496 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60395
[junit4:junit4]   2> 10013 T2498 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16987570004 with negotiated timeout 10000 for client /127.0.0.1:60395
[junit4:junit4]   2> 10013 T2508 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60380, sessionid = 0x13ae16987570004, negotiated timeout = 10000
[junit4:junit4]   2> 10013 T2509 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@eabf5a name:ZooKeeperConnection Watcher:127.0.0.1:60380/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 10013 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 10014 T2441 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 10019 T2499 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16987570004 type:delete cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 10020 T2441 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 10023 T2441 oasc.Overseer.start Overseer (id=88630986045587460-127.0.0.1:60380_solr-n_0000000000) starting
[junit4:junit4]   2> 10024 T2499 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16987570004 type:create cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10027 T2499 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16987570004 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10028 T2499 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16987570004 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10029 T2511 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 10030 T2499 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16987570003 type:create cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10031 T2499 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16987570003 type:create cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 10034 T2510 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 10041 T2510 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10041 T2510 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://node1/solr/"}
[junit4:junit4]   2> 10041 T2510 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 10042 T2499 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16987570004 type:create cxid:0x1d zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 10052 T2507 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 10053 T2501 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 10398 T2441 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 10408 T2499 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16987570003 type:delete cxid:0x1c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 10409 T2441 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 10413 T2499 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16987570003 type:create cxid:0x24 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10415 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10418 T2507 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4]   2> 10418 T2499 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16987570003
[junit4:junit4]   2> 10419 T2501 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4]   2> 10419 T2441 oaz.ZooKeeper.close Session: 0x13ae16987570003 closed
[junit4:junit4]   2> 10419 T2496 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae16987570003, likely client has closed socket
[junit4:junit4]   2> 10419 T2507 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 10420 T2496 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60392 which had sessionid 0x13ae16987570003
[junit4:junit4]   2> 10420 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60380/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@14e9c41
[junit4:junit4]   2> 10422 T2510 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10422 T2512 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60380
[junit4:junit4]   2> 10422 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 10423 T2512 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60380, initiating session
[junit4:junit4]   2> 10424 T2496 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60398
[junit4:junit4]   2> 10424 T2496 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60398
[junit4:junit4]   2> 10424 T2498 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16987570005 with negotiated timeout 10000 for client /127.0.0.1:60398
[junit4:junit4]   2> 10424 T2512 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60380, sessionid = 0x13ae16987570005, negotiated timeout = 10000
[junit4:junit4]   2> 10425 T2513 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14e9c41 name:ZooKeeperConnection Watcher:127.0.0.1:60380/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 10425 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 10426 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 10431 T2513 oaz.ClientCnxn$EventThread.processEvent SEVERE Error while calling watcher  java.lang.NullPointerException
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$2.process(ZkStateReader.java:189)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 10431 T2501 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 10432 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4:junit4]   2> 10437 T2501 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 10437 T2513 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 10438 T2499 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16987570005 type:create cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10439 T2441 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 10441 T2499 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16987570005 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 10444 T2499 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16987570005 type:delete cxid:0x14 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4]   2> 10445 T2441 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 10448 T2499 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16987570005 type:create cxid:0x1b zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10450 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10452 T2499 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16987570004
[junit4:junit4]   2> 10452 T2441 oaz.ZooKeeper.close Session: 0x13ae16987570004 closed
[junit4:junit4]   2> 10452 T2509 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 10452 T2496 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae16987570004, likely client has closed socket
[junit4:junit4]   2> 10453 T2496 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60395 which had sessionid 0x13ae16987570004
[junit4:junit4]   2> 10455 T2513 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4]   2> 10456 T2499 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16987570005
[junit4:junit4]   2> 10456 T2501 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4]   2> 10457 T2441 oaz.ZooKeeper.close Session: 0x13ae16987570005 closed
[junit4:junit4]   2> 10457 T2513 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 10457 T2496 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae16987570005, likely client has closed socket
[junit4:junit4]   2> 10457 T2496 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60398 which had sessionid 0x13ae16987570005
[junit4:junit4]   2> 10458 T2499 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16987570000
[junit4:junit4]   2> 10459 T2441 oaz.ZooKeeper.close Session: 0x13ae16987570000 closed
[junit4:junit4]   2> 10459 T2496 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae16987570000, likely client has closed socket
[junit4:junit4]   2> 10459 T2501 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 10459 T2499 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 10459 T2498 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 10459 T2496 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60383 which had sessionid 0x13ae16987570000
[junit4:junit4]   2> 10461 T2441 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 10796 T2510 oasc.Overseer$ClusterStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:244)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:192)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:116)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 
[junit4:junit4]   2> 12077 T2510 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88630986045587460-127.0.0.1:60380_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 11130 T2497 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 12077 T2496 oazs.NIOServerCnxn$Factory.run WARNING Ignoring unexpected runtime exception java.nio.channels.CancelledKeyException
[junit4:junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:55)
[junit4:junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.readyOps(SelectionKeyImpl.java:69)
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn$Factory.run(NIOServerCnxn.java:241)
[junit4:junit4]   2> 
[junit4:junit4]   2> 12079 T2496 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 12081 T2441 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 12082 T2441 oas.SolrTestCaseJ4.tearDown ###Ending testDoubleAssignment
[junit4:junit4]   2> 12088 T2441 oas.SolrTestCaseJ4.setUp ###Starting testShardLeaderChange
[junit4:junit4]   2> 12089 T2441 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 12091 T2514 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 12091 T2514 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 12092 T2514 oazsp.FileSnap.deserialize Reading snapshot C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerTest-1352401510587\zookeeper\server1\data\version-2\snapshot.d0
[junit4:junit4]   2> 12094 T2514 oazsp.FileTxnSnapLog.save Snapshotting: 118
[junit4:junit4]   2> 12162 T2441 oasc.ZkTestServer.run start zk server on port:60401
[junit4:junit4]   2> 12162 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60401/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@12386b1
[junit4:junit4]   2> 12164 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12164 T2519 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60401
[junit4:junit4]   2> 12166 T2519 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60401, initiating session
[junit4:junit4]   2> 12166 T2515 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60404
[junit4:junit4]   2> 12166 T2515 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60404
[junit4:junit4]   2> 12166 T2517 oazsp.FileTxnLog.append Creating new log file: log.119
[junit4:junit4]   2> 12172 T2517 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae1698ffa0000 with negotiated timeout 10000 for client /127.0.0.1:60404
[junit4:junit4]   2> 12172 T2519 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60401, sessionid = 0x13ae1698ffa0000, negotiated timeout = 10000
[junit4:junit4]   2> 12172 T2520 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12386b1 name:ZooKeeperConnection Watcher:127.0.0.1:60401/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12172 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12173 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60401 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@bdc49c
[junit4:junit4]   2> 12173 T2521 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60401
[junit4:junit4]   2> 12174 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12175 T2521 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60401, initiating session
[junit4:junit4]   2> 12176 T2515 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60407
[junit4:junit4]   2> 12176 T2515 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60407
[junit4:junit4]   2> 12178 T2517 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae1698ffa0001 with negotiated timeout 10000 for client /127.0.0.1:60407
[junit4:junit4]   2> 12178 T2521 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60401, sessionid = 0x13ae1698ffa0001, negotiated timeout = 10000
[junit4:junit4]   2> 12179 T2522 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bdc49c name:ZooKeeperConnection Watcher:127.0.0.1:60401 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12179 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12201 T2518 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae1698ffa0001
[junit4:junit4]   2> 12202 T2441 oaz.ZooKeeper.close Session: 0x13ae1698ffa0001 closed
[junit4:junit4]   2> 12202 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60401 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@12ee42c
[junit4:junit4]   2> 12203 T2522 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 12202 T2515 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae1698ffa0001, likely client has closed socket
[junit4:junit4]   2> 12203 T2515 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60407 which had sessionid 0x13ae1698ffa0001
[junit4:junit4]   2> 12203 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12203 T2523 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60401
[junit4:junit4]   2> 12205 T2523 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60401, initiating session
[junit4:junit4]   2> 12205 T2515 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60410
[junit4:junit4]   2> 12205 T2515 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60410
[junit4:junit4]   2> 12206 T2517 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae1698ffa0002 with negotiated timeout 10000 for client /127.0.0.1:60410
[junit4:junit4]   2> 12206 T2523 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60401, sessionid = 0x13ae1698ffa0002, negotiated timeout = 10000
[junit4:junit4]   2> 12206 T2524 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12ee42c name:ZooKeeperConnection Watcher:127.0.0.1:60401 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12206 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12207 T2441 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 12209 T2518 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae1698ffa0002
[junit4:junit4]   2> 12210 T2441 oaz.ZooKeeper.close Session: 0x13ae1698ffa0002 closed
[junit4:junit4]   2> 12210 T2515 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae1698ffa0002, likely client has closed socket
[junit4:junit4]   2> 12210 T2524 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 12210 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 12210 T2515 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60410 which had sessionid 0x13ae1698ffa0002
[junit4:junit4]   2> 12213 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60401/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@129031c
[junit4:junit4]   2> 12214 T2525 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60401/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@18b6062
[junit4:junit4]   2> 12215 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12215 T2526 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60401
[junit4:junit4]   2> 12215 T2525 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12215 T2527 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60401
[junit4:junit4]   2> 12216 T2526 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60401, initiating session
[junit4:junit4]   2> 12216 T2515 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60415
[junit4:junit4]   2> 12216 T2527 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60401, initiating session
[junit4:junit4]   2> 12217 T2515 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60416
[junit4:junit4]   2> 12217 T2515 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60416
[junit4:junit4]   2> 12217 T2515 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60415
[junit4:junit4]   2> 12218 T2517 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae1698ffa0003 with negotiated timeout 10000 for client /127.0.0.1:60416
[junit4:junit4]   2> 12218 T2526 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60401, sessionid = 0x13ae1698ffa0003, negotiated timeout = 10000
[junit4:junit4]   2> 12218 T2528 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@129031c name:ZooKeeperConnection Watcher:127.0.0.1:60401/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12219 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12219 T2527 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60401, sessionid = 0x13ae1698ffa0004, negotiated timeout = 10000
[junit4:junit4]   2> 12219 T2529 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18b6062 name:ZooKeeperConnection Watcher:127.0.0.1:60401/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12219 T2517 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae1698ffa0004 with negotiated timeout 10000 for client /127.0.0.1:60415
[junit4:junit4]   2> 12219 T2525 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12220 T2441 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 12220 T2525 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 12223 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 12226 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4:junit4]   2> 12226 T2518 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae1698ffa0004 type:delete cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 12227 T2525 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 12231 T2528 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 12231 T2525 oasc.Overseer.start Overseer (id=88630986190487556-127.0.0.1:60401_solr-n_0000000000) starting
[junit4:junit4]   2> 12231 T2518 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae1698ffa0003 type:create cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 12231 T2518 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae1698ffa0004 type:create cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12233 T2518 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae1698ffa0004 type:create cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12235 T2518 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae1698ffa0004 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12236 T2518 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae1698ffa0004 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12238 T2525 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
[junit4:junit4]   2> 12238 T2531 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 12238 T2518 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae1698ffa0004
[junit4:junit4]   2> 12239 T2515 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60415 which had sessionid 0x13ae1698ffa0004
[junit4:junit4]   2> 12239 T2529 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 12239 T2525 oaz.ZooKeeper.close Session: 0x13ae1698ffa0004 closed
[junit4:junit4]   2> 12240 T2525 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60401/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@bf19cc
[junit4:junit4]   2> 12240 T2532 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60401
[junit4:junit4]   2> 12240 T2525 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12241 T2532 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60401, initiating session
[junit4:junit4]   2> 12241 T2515 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60419
[junit4:junit4]   2> 12242 T2515 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60419
[junit4:junit4]   2> 12243 T2517 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae1698ffa0005 with negotiated timeout 10000 for client /127.0.0.1:60419
[junit4:junit4]   2> 12243 T2532 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60401, sessionid = 0x13ae1698ffa0005, negotiated timeout = 10000
[junit4:junit4]   2> 12243 T2533 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bf19cc name:ZooKeeperConnection Watcher:127.0.0.1:60401/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12243 T2525 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12246 T2518 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae1698ffa0005 type:delete cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 12247 T2525 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 12249 T2525 oasc.Overseer.start Overseer (id=88630986190487557-127.0.0.1:60401_solr-n_0000000002) starting
[junit4:junit4]   2> 12250 T2518 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae1698ffa0005 type:create cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12251 T2518 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae1698ffa0005 type:create cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12252 T2518 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae1698ffa0005 type:create cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12254 T2518 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae1698ffa0005 type:create cxid:0xc zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12255 T2535 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 12256 T2534 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 12259 T2534 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12259 T2534 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "state":"state1",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://node1/solr/"}
[junit4:junit4]   2> 12259 T2534 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 12260 T2518 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae1698ffa0005 type:create cxid:0x18 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 12267 T2528 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 12594 T2441 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 12612 T2518 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae1698ffa0003 type:delete cxid:0x1f zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 12614 T2441 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 12623 T2518 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae1698ffa0003 type:create cxid:0x27 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12627 T2518 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae1698ffa0003 type:create cxid:0x29 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12631 T2441 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 12633 T2534 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12635 T2518 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae1698ffa0003 type:create cxid:0x30 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 12643 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60401/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f333fc
[junit4:junit4]   2> 12644 T2534 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "state":"state2",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://node1/solr/"}
[junit4:junit4]   2> 12645 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12645 T2536 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60401
[junit4:junit4]   2> 12647 T2536 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60401, initiating session
[junit4:junit4]   2> 12647 T2515 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60422
[junit4:junit4]   2> 12648 T2515 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60422
[junit4:junit4]   2> 12650 T2517 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae1698ffa0006 with negotiated timeout 10000 for client /127.0.0.1:60422
[junit4:junit4]   2> 12650 T2536 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60401, sessionid = 0x13ae1698ffa0006, negotiated timeout = 10000
[junit4:junit4]   2> 12651 T2537 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f333fc name:ZooKeeperConnection Watcher:127.0.0.1:60401/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12651 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12653 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 12657 T2537 oaz.ClientCnxn$EventThread.processEvent SEVERE Error while calling watcher  java.lang.NullPointerException
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$2.process(ZkStateReader.java:189)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 12657 T2528 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 12658 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4:junit4]   2> 12666 T2518 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae1698ffa0003 type:create cxid:0x36 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12666 T2537 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 12666 T2528 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 12670 T2441 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 12675 T2518 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae1698ffa0003 type:create cxid:0x3d zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 12681 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12682 T2518 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae1698ffa0006 type:create cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12956 T2531 oasc.OverseerCollectionProcessor.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:244)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionProcessor.amILeader(OverseerCollectionProcessor.java:129)
[junit4:junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:84)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 
[junit4:junit4]   2> 12956 T2531 oasc.OverseerCollectionProcessor.amILeader According to ZK I (id=88630986190487556-127.0.0.1:60401_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 12956 T2530 oasc.Overseer$ClusterStateUpdater.run WARNING Solr cannot talk to ZK
[junit4:junit4]   2> 13031 T2534 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13032 T2534 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "state":"state1",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://node1/solr/"}
[junit4:junit4]   2> 13039 T2534 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "state":"state2",
[junit4:junit4]   2> 	  "core":"core4",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node2",
[junit4:junit4]   2> 	  "base_url":"http://node2/solr/"}
[junit4:junit4]   2> 13047 T2528 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 62055 T2518 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae1698ffa0003
[junit4:junit4]   2> 62055 T2537 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 62055 T2515 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60416 which had sessionid 0x13ae1698ffa0003
[junit4:junit4]   2> 62055 T2441 oaz.ZooKeeper.close Session: 0x13ae1698ffa0003 closed
[junit4:junit4]   2> 62055 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 62169 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 62283 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 62396 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 62510 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 62624 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 62738 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 62851 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 62965 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 63079 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 63095 T2528 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 63095 T2528 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:227)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:83)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:128)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 63095 T2528 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:227)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:83)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:128)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 63095 T2528 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 63192 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 63306 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 63420 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 63537 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 63662 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 63787 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 63912 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 64037 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 64162 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 64287 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 64412 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 64537 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 64662 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 64787 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 64913 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 65038 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 65163 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 65288 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 65413 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 65538 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 65663 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 65788 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 65913 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 66038 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 66163 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 66288 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 66413 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 66538 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 66664 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 66789 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 66914 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 67039 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 67164 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 67289 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 67414 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 67539 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 67664 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 67789 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 67914 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 68039 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 68164 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 68289 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 68415 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 68540 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 68665 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 68790 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 68915 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 69040 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 69165 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 69290 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 69415 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 69540 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 69665 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 69790 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 69915 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 70040 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 70166 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 70291 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 70416 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 70541 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 70666 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 70791 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 70916 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 71041 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 71166 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 71291 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 71416 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 71541 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 71666 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 71791 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 71917 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 72042 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 72167 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 72292 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 72417 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 72542 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 72667 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 72792 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 72917 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 73042 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 73167 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 73292 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 73417 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 73542 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 73668 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 73793 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 73918 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 74043 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 74168 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 74293 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 74454 T2518 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae1698ffa0005
[junit4:junit4]   2> 74454 T2515 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60419 which had sessionid 0x13ae1698ffa0005
[junit4:junit4]   2> 74454 T2533 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 74454 T2525 oaz.ZooKeeper.close Session: 0x13ae1698ffa0005 closed
[junit4:junit4]   2> 74454 T2518 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae1698ffa0006
[junit4:junit4]   2> 74454 T2515 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60422 which had sessionid 0x13ae1698ffa0006
[junit4:junit4]   2> 74454 T2441 oaz.ZooKeeper.close Session: 0x13ae1698ffa0006 closed
[junit4:junit4]   2> 74454 T2518 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae1698ffa0000
[junit4:junit4]   2> 74454 T2520 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 74454 T2441 oaz.ZooKeeper.close Session: 0x13ae1698ffa0000 closed
[junit4:junit4]   2> 74454 T2515 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60404 which had sessionid 0x13ae1698ffa0000
[junit4:junit4]   2> 74454 T2517 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 74472 T2441 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 74454 T2518 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 74543 T2534 oasc.Overseer$ClusterStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:244)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:192)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:116)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 
[junit4:junit4]   2> 77255 T2534 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88630986190487557-127.0.0.1:60401_solr-n_0000000002) am no longer a leader.
[junit4:junit4]   2> 75663 T2537 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 74543 T2516 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 77255 T2515 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 77255 T2537 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 77255 T2441 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 77255 T2441 oas.SolrTestCaseJ4.tearDown ###Ending testShardLeaderChange
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=OverseerTest -Dtests.method=testShardLeaderChange -Dtests.seed=CB1A5D790F594247 -Dtests.slow=true -Dtests.locale=vi -Dtests.timezone=CST6CDT -Dtests.file.encoding=US-ASCII
[junit4:junit4] FAILURE 65.2s | OverseerTest.testShardLeaderChange <<<
[junit4:junit4]    > Throwable #1: org.junit.ComparisonFailure: Unexpected shard leader coll:collection1 shard:shard1 expected:<core[4]> but was:<core[1]>
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([CB1A5D790F594247:1549DA8E15C1B7B6]:0)
[junit4:junit4]    > 	at org.junit.Assert.assertEquals(Assert.java:125)
[junit4:junit4]    > 	at org.apache.solr.cloud.OverseerTest.verifyShardLeader(OverseerTest.java:493)
[junit4:junit4]    > 	at org.apache.solr.cloud.OverseerTest.testShardLeaderChange(OverseerTest.java:652)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:597)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 77295 T2441 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
[junit4:junit4]   2> 77314 T2441 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 77314 T2538 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 77314 T2538 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 77314 T2538 oazsp.FileSnap.deserialize Reading snapshot C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerTest-1352401510587\zookeeper\server1\data\version-2\snapshot.118
[junit4:junit4]   2> 77314 T2538 oazsp.FileTxnSnapLog.save Snapshotting: 17c
[junit4:junit4]   2> 77452 T2441 oasc.ZkTestServer.run start zk server on port:60425
[junit4:junit4]   2> 77452 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60425 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ad7885
[junit4:junit4]   2> 77452 T2543 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60425
[junit4:junit4]   2> 77452 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 77452 T2543 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60425, initiating session
[junit4:junit4]   2> 77452 T2539 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60428
[junit4:junit4]   2> 77452 T2539 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60428
[junit4:junit4]   2> 77452 T2541 oazsp.FileTxnLog.append Creating new log file: log.17d
[junit4:junit4]   2> 77452 T2541 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16a8ebd0000 with negotiated timeout 10000 for client /127.0.0.1:60428
[junit4:junit4]   2> 77452 T2543 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60425, sessionid = 0x13ae16a8ebd0000, negotiated timeout = 10000
[junit4:junit4]   2> 77452 T2544 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ad7885 name:ZooKeeperConnection Watcher:127.0.0.1:60425 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 77452 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 77491 T2542 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16a8ebd0000
[junit4:junit4]   2> 77491 T2539 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae16a8ebd0000, likely client has closed socket
[junit4:junit4]   2> 77491 T2441 oaz.ZooKeeper.close Session: 0x13ae16a8ebd0000 closed
[junit4:junit4]   2> 77491 T2544 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 77491 T2539 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60428 which had sessionid 0x13ae16a8ebd0000
[junit4:junit4]   2> 77491 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60425 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@879ac0
[junit4:junit4]   2> 77491 T2545 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60425
[junit4:junit4]   2> 77491 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 77491 T2545 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60425, initiating session
[junit4:junit4]   2> 77491 T2539 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60431
[junit4:junit4]   2> 77491 T2539 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60431
[junit4:junit4]   2> 77491 T2541 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16a8ebd0001 with negotiated timeout 10000 for client /127.0.0.1:60431
[junit4:junit4]   2> 77491 T2545 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60425, sessionid = 0x13ae16a8ebd0001, negotiated timeout = 10000
[junit4:junit4]   2> 77491 T2546 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@879ac0 name:ZooKeeperConnection Watcher:127.0.0.1:60425 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 77491 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 77491 T2441 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 77511 T2542 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16a8ebd0001
[junit4:junit4]   2> 77511 T2539 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60431 which had sessionid 0x13ae16a8ebd0001
[junit4:junit4]   2> 77511 T2441 oaz.ZooKeeper.close Session: 0x13ae16a8ebd0001 closed
[junit4:junit4]   2> 77511 T2546 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 77511 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60425/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1057706
[junit4:junit4]   2> 77511 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 77511 T2547 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60425
[junit4:junit4]   2> 77511 T2547 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60425, initiating session
[junit4:junit4]   2> 77511 T2539 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60434
[junit4:junit4]   2> 77511 T2539 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60434
[junit4:junit4]   2> 77511 T2541 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16a8ebd0002 with negotiated timeout 10000 for client /127.0.0.1:60434
[junit4:junit4]   2> 77511 T2547 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60425, sessionid = 0x13ae16a8ebd0002, negotiated timeout = 10000
[junit4:junit4]   2> 77511 T2548 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1057706 name:ZooKeeperConnection Watcher:127.0.0.1:60425/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 77511 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 77511 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 77530 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60425/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@68a91b
[junit4:junit4]   2> 77530 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 77530 T2549 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60425
[junit4:junit4]   2> 77530 T2549 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60425, initiating session
[junit4:junit4]   2> 77530 T2539 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60437
[junit4:junit4]   2> 77530 T2539 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60437
[junit4:junit4]   2> 77530 T2541 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16a8ebd0003 with negotiated timeout 10000 for client /127.0.0.1:60437
[junit4:junit4]   2> 77530 T2549 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60425, sessionid = 0x13ae16a8ebd0003, negotiated timeout = 10000
[junit4:junit4]   2> 77530 T2550 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68a91b name:ZooKeeperConnection Watcher:127.0.0.1:60425/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 77530 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 77530 T2441 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 77530 T2542 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16a8ebd0003 type:delete cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 77530 T2441 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 77550 T2441 oasc.Overseer.start Overseer (id=88630990464679939-127.0.0.1:60425_solr-n_0000000000) starting
[junit4:junit4]   2> 77550 T2542 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16a8ebd0003 type:create cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 77550 T2542 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16a8ebd0003 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 77550 T2542 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16a8ebd0003 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 77550 T2552 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 77550 T2441 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 77550 T2551 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 77570 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 77570 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60425/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b9ac78
[junit4:junit4]   2> 77570 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 77570 T2553 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60425
[junit4:junit4]   2> 77570 T2553 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60425, initiating session
[junit4:junit4]   2> 77570 T2539 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60440
[junit4:junit4]   2> 77570 T2539 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60440
[junit4:junit4]   2> 77570 T2541 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16a8ebd0004 with negotiated timeout 10000 for client /127.0.0.1:60440
[junit4:junit4]   2> 77570 T2553 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60425, sessionid = 0x13ae16a8ebd0004, negotiated timeout = 10000
[junit4:junit4]   2> 77570 T2554 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b9ac78 name:ZooKeeperConnection Watcher:127.0.0.1:60425/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 77570 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 77570 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 77570 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes/node0
[junit4:junit4]   2> 77589 T2554 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 77589 T2548 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 77589 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60425/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@3150df
[junit4:junit4]   2> 77589 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 77589 T2555 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60425
[junit4:junit4]   2> 77589 T2555 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60425, initiating session
[junit4:junit4]   2> 77589 T2539 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60443
[junit4:junit4]   2> 77589 T2539 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60443
[junit4:junit4]   2> 77589 T2541 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16a8ebd0005 with negotiated timeout 10000 for client /127.0.0.1:60443
[junit4:junit4]   2> 77589 T2555 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60425, sessionid = 0x13ae16a8ebd0005, negotiated timeout = 10000
[junit4:junit4]   2> 77589 T2556 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3150df name:ZooKeeperConnection Watcher:127.0.0.1:60425/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 77589 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 77589 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 77589 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4:junit4]   2> 77589 T2554 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 77589 T2548 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 77589 T2556 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 77589 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60425/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@5554a3
[junit4:junit4]   2> 77609 T2557 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60425
[junit4:junit4]   2> 77609 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 77609 T2557 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60425, initiating session
[junit4:junit4]   2> 77609 T2539 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60446
[junit4:junit4]   2> 77609 T2539 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60446
[junit4:junit4]   2> 77609 T2541 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16a8ebd0006 with negotiated timeout 10000 for client /127.0.0.1:60446
[junit4:junit4]   2> 77609 T2557 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60425, sessionid = 0x13ae16a8ebd0006, negotiated timeout = 10000
[junit4:junit4]   2> 77609 T2558 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5554a3 name:ZooKeeperConnection Watcher:127.0.0.1:60425/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 77609 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 77609 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 77609 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4:junit4]   2> 77609 T2548 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 77609 T2554 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 77609 T2556 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 77609 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60425/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1a80285
[junit4:junit4]   2> 77609 T2558 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 77609 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 77609 T2559 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60425
[junit4:junit4]   2> 77609 T2559 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60425, initiating session
[junit4:junit4]   2> 77609 T2539 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60449
[junit4:junit4]   2> 77609 T2539 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60449
[junit4:junit4]   2> 77629 T2541 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16a8ebd0007 with negotiated timeout 10000 for client /127.0.0.1:60449
[junit4:junit4]   2> 77629 T2559 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60425, sessionid = 0x13ae16a8ebd0007, negotiated timeout = 10000
[junit4:junit4]   2> 77629 T2560 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a80285 name:ZooKeeperConnection Watcher:127.0.0.1:60425/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 77629 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 77629 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 77629 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes/node3
[junit4:junit4]   2> 77629 T2560 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 77629 T2548 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 77629 T2556 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 77629 T2554 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 77629 T2558 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 77629 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60425/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@60829f
[junit4:junit4]   2> 77629 T2561 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60425
[junit4:junit4]   2> 77629 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 77629 T2561 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60425, initiating session
[junit4:junit4]   2> 77629 T2539 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60452
[junit4:junit4]   2> 77629 T2539 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60452
[junit4:junit4]   2> 77629 T2541 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16a8ebd0008 with negotiated timeout 10000 for client /127.0.0.1:60452
[junit4:junit4]   2> 77629 T2561 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60425, sessionid = 0x13ae16a8ebd0008, negotiated timeout = 10000
[junit4:junit4]   2> 77629 T2562 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@60829f name:ZooKeeperConnection Watcher:127.0.0.1:60425/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 77629 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 77648 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 77648 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes/node4
[junit4:junit4]   2> 77648 T2560 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 77648 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60425/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ecb641
[junit4:junit4]   2> 77648 T2563 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60425
[junit4:junit4]   2> 77648 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 77648 T2556 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 77648 T2548 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 77648 T2558 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 77648 T2554 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 77648 T2562 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 77668 T2539 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60455
[junit4:junit4]   2> 77668 T2563 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60425, initiating session
[junit4:junit4]   2> 77668 T2539 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60455
[junit4:junit4]   2> 77668 T2541 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16a8ebd0009 with negotiated timeout 10000 for client /127.0.0.1:60455
[junit4:junit4]   2> 77668 T2563 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60425, sessionid = 0x13ae16a8ebd0009, negotiated timeout = 10000
[junit4:junit4]   2> 77668 T2564 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ecb641 name:ZooKeeperConnection Watcher:127.0.0.1:60425/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 77668 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 77668 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 77668 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes/node5
[junit4:junit4]   2> 77668 T2548 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 77668 T2558 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 77668 T2554 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 77668 T2560 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 77668 T2564 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 77668 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60425/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@982b3b
[junit4:junit4]   2> 77668 T2556 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 77668 T2562 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 77668 T2565 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60425
[junit4:junit4]   2> 77668 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 77668 T2565 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60425, initiating session
[junit4:junit4]   2> 77668 T2539 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60458
[junit4:junit4]   2> 77668 T2539 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60458
[junit4:junit4]   2> 77688 T2541 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16a8ebd000a with negotiated timeout 10000 for client /127.0.0.1:60458
[junit4:junit4]   2> 77688 T2565 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60425, sessionid = 0x13ae16a8ebd000a, negotiated timeout = 10000
[junit4:junit4]   2> 77688 T2566 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@982b3b name:ZooKeeperConnection Watcher:127.0.0.1:60425/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 77688 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 77688 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 77688 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes/node6
[junit4:junit4]   2> 77688 T2554 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 77688 T2558 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 77688 T2548 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 77688 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60425/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@167d041
[junit4:junit4]   2> 77688 T2566 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 77688 T2564 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 77688 T2562 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 77688 T2560 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 77688 T2567 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60425
[junit4:junit4]   2> 77688 T2556 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 77688 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 77688 T2567 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60425, initiating session
[junit4:junit4]   2> 77688 T2539 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60461
[junit4:junit4]   2> 77688 T2539 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60461
[junit4:junit4]   2> 77707 T2541 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16a8ebd000b with negotiated timeout 10000 for client /127.0.0.1:60461
[junit4:junit4]   2> 77707 T2567 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60425, sessionid = 0x13ae16a8ebd000b, negotiated timeout = 10000
[junit4:junit4]   2> 77707 T2568 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@167d041 name:ZooKeeperConnection Watcher:127.0.0.1:60425/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 77707 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 77707 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 77707 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes/node7
[junit4:junit4]   2> 77707 T2564 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 77707 T2566 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 77707 T2548 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 77707 T2554 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 77707 T2558 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 77707 T2560 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 77707 T2568 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 77707 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60425/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@f9d6bd
[junit4:junit4]   2> 77707 T2562 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 77707 T2556 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 77707 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 77707 T2569 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60425
[junit4:junit4]   2> 77707 T2569 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60425, initiating session
[junit4:junit4]   2> 77707 T2539 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60464
[junit4:junit4]   2> 77707 T2539 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60464
[junit4:junit4]   2> 77727 T2541 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16a8ebd000c with negotiated timeout 10000 for client /127.0.0.1:60464
[junit4:junit4]   2> 77727 T2569 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60425, sessionid = 0x13ae16a8ebd000c, negotiated timeout = 10000
[junit4:junit4]   2> 77727 T2570 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f9d6bd name:ZooKeeperConnection Watcher:127.0.0.1:60425/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 77727 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 77727 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 77727 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes/node8
[junit4:junit4]   2> 77727 T2554 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 77727 T2558 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 77727 T2564 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 77727 T2566 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 77727 T2548 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 77727 T2562 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 77727 T2556 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 77727 T2568 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 77727 T2560 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 77727 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60425/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@12f8047
[junit4:junit4]   2> 77727 T2570 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 77727 T2571 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60425
[junit4:junit4]   2> 77727 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 77727 T2571 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60425, initiating session
[junit4:junit4]   2> 77727 T2539 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60467
[junit4:junit4]   2> 77727 T2539 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60467
[junit4:junit4]   2> 77747 T2541 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16a8ebd000d with negotiated timeout 10000 for client /127.0.0.1:60467
[junit4:junit4]   2> 77747 T2571 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60425, sessionid = 0x13ae16a8ebd000d, negotiated timeout = 10000
[junit4:junit4]   2> 77747 T2572 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12f8047 name:ZooKeeperConnection Watcher:127.0.0.1:60425/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 77747 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 77747 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 77747 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes/node9
[junit4:junit4]   2> 77747 T2558 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 77747 T2548 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 77747 T2554 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 77747 T2556 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 77747 T2564 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 77747 T2568 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 77747 T2570 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 77747 T2560 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 77747 T2572 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 77747 T2566 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 77747 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60425/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@177e61
[junit4:junit4]   2> 77747 T2562 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 77747 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 77747 T2573 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60425
[junit4:junit4]   2> 77766 T2573 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60425, initiating session
[junit4:junit4]   2> 77766 T2539 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60470
[junit4:junit4]   2> 77766 T2539 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60470
[junit4:junit4]   2> 77766 T2541 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16a8ebd000e with negotiated timeout 10000 for client /127.0.0.1:60470
[junit4:junit4]   2> 77766 T2573 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60425, sessionid = 0x13ae16a8ebd000e, negotiated timeout = 10000
[junit4:junit4]   2> 77766 T2574 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@177e61 name:ZooKeeperConnection Watcher:127.0.0.1:60425/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 77766 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 77766 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 77766 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes/node10
[junit4:junit4]   2> 77766 T2548 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 77766 T2562 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 77766 T2572 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 77766 T2570 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 77766 T2558 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 77766 T2560 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 77766 T2564 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 77766 T2574 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 77766 T2554 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 77766 T2566 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 77766 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60425/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@f0379f
[junit4:junit4]   2> 77766 T2568 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 77766 T2556 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 77786 T2575 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:60425
[junit4:junit4]   2> 77786 T2441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 77786 T2575 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:60425, initiating session
[junit4:junit4]   2> 77786 T2539 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:60473
[junit4:junit4]   2> 77786 T2539 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:60473
[junit4:junit4]   2> 77786 T2541 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ae16a8ebd000f with negotiated timeout 10000 for client /127.0.0.1:60473
[junit4:junit4]   2> 77786 T2575 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:60425, sessionid = 0x13ae16a8ebd000f, negotiated timeout = 10000
[junit4:junit4]   2> 77786 T2576 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f0379f name:ZooKeeperConnection Watcher:127.0.0.1:60425/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 77786 T2441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 77786 T2441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 77786 T2441 oascc.SolrZkClient.makePath makePath: /live_nodes/node11
[junit4:junit4]   2> 77786 T2554 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 77786 T2566 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 77786 T2574 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 77786 T2572 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 77786 T2556 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 77786 T2570 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 77786 T2568 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 77786 T2564 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 77806 T2558 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 77806 T2548 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 77806 T2560 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 77806 T2441 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60425/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c0aeec
[junit4:junit4]   2> 77806 T2576 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 77806 T2562 oascc.

[...truncated too long message...]

own reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 96163 T2751 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16ad75a0000 type:create cxid:0xc zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 96163 T2760 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 96163 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 96163 T2760 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 96163 T2760 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "roles":"",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr"}
[junit4:junit4]   2> 96163 T2751 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ae16ad75a0003 type:create cxid:0x1d zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 96184 T2753 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 96249 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 96876 T2760 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 96876 T2760 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "roles":"",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr"}
[junit4:junit4]   2> 96876 T2753 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 96941 T2751 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16ad75a0000
[junit4:junit4]   2> 96941 T2441 oaz.ZooKeeper.close Session: 0x13ae16ad75a0000 closed
[junit4:junit4]   2> 96941 T2753 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 96941 T2748 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae16ad75a0000, likely client has closed socket
[junit4:junit4]   2> 96941 T2748 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60638 which had sessionid 0x13ae16ad75a0000
[junit4:junit4]   2> 96941 T2751 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ae16ad75a0003
[junit4:junit4]   2> 96941 T2441 oaz.ZooKeeper.close Session: 0x13ae16ad75a0003 closed
[junit4:junit4]   2> 96941 T2759 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 96941 T2748 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ae16ad75a0003, likely client has closed socket
[junit4:junit4]   2> 96941 T2751 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 96941 T2750 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 96941 T2748 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60647 which had sessionid 0x13ae16ad75a0003
[junit4:junit4]   2> 96941 T2441 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 97568 T2760 oasc.Overseer$ClusterStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:244)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:192)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:116)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 
[junit4:junit4]   2> 100054 T2760 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88630991682928643-127.0.0.1:60635_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 97719 T2749 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 100054 T2748 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 100076 T2441 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 100076 T2441 oas.SolrTestCaseJ4.tearDown ###Ending testStateChange
[junit4:junit4]   2> 100076 T2441 oas.SolrTestCaseJ4.initCore ####initCore
[junit4:junit4]   2> 100076 T2441 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4:junit4]   2> 103939 T2441 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40, sim=DefaultSimilarity, locale=vi, timezone=CST6CDT
[junit4:junit4]   2> NOTE: Windows 7 6.1 x86/Sun Microsystems Inc. 1.6.0_37 (32-bit)/cpus=2,threads=10,free=148505432,total=255524864
[junit4:junit4]   2> NOTE: All tests run in this JVM: [SolrCmdDistributorTest, RecoveryZkTest, TestSolrDeletionPolicy2, ShowFileRequestHandlerTest, QueryParsingTest, SimpleFacetsTest, DefaultValueUpdateProcessorTest, TestAnalyzedSuggestions, TestDistributedGrouping, HighlighterConfigTest, TestDocSet, BinaryUpdateRequestHandlerTest, TestBM25SimilarityFactory, IndexSchemaRuntimeFieldTest, TestBadConfig, SuggesterWFSTTest, AlternateDirectoryTest, TestJmxIntegration, XmlUpdateRequestHandlerTest, IndexSchemaTest, SolrInfoMBeanTest, TestBinaryField, TestArbitraryIndexDir, PathHierarchyTokenizerFactoryTest, DistanceFunctionTest, TestIndexingPerformance, TermVectorComponentTest, TermsComponentTest, FullSolrCloudDistribCmdsTest, LegacyHTMLStripCharFilterTest, NotRequiredUniqueKeyTest, RequiredFieldsTest, TestFastOutputStream, TestSolrDeletionPolicy1, DistributedTermsComponentTest, FileUtilsTest, RAMDirectoryFactoryTest, TestPropInject, OpenExchangeRatesOrgProviderTest, TestPerFieldSimilarity, IndexReaderFactoryTest, CircularListTest, FieldMutatingUpdateProcessorTest, ResponseLogComponentTest, ClusterStateUpdateTest, OutputWriterTest, TestDistributedSearch, TestPluginEnable, SuggesterTSTTest, TestDefaultSimilarityFactory, AnalysisAfterCoreReloadTest, ScriptEngineTest, FastVectorHighlighterTest, TestDFRSimilarityFactory, TestStressRecovery, DateFieldTest, SolrCoreTest, TestLMJelinekMercerSimilarityFactory, EchoParamsTest, TestXIncludeConfig, TestFunctionQuery, TimeZoneUtilsTest, SortByFunctionTest, DebugComponentTest, SpellCheckComponentTest, DOMUtilTest, LeaderElectionTest, SoftAutoCommitTest, TestJoin, TestIBSimilarityFactory, NumericFieldsTest, BadIndexSchemaTest, SuggesterTest, DocumentBuilderTest, SOLR749Test, TestRandomFaceting, TestWriterPerf, ZkNodePropsTest, StatsComponentTest, DistributedQueryElevationComponentTest, PeerSyncTest, TestMergePolicyConfig, TestMultiCoreConfBootstrap, ClusterStateTest, CoreContainerCoreInitFailuresTest, BasicZkTest, TestStressReorder, QueryEqualityTest, TestSurroundQueryParser, PreAnalyzedFieldTest, LukeRequestHandlerTest, TestDocumentBuilder, WordBreakSolrSpellCheckerTest, TestPHPSerializedResponseWriter, HighlighterTest, TestUtils, ZkSolrClientTest, StandardRequestHandlerTest, PluginInfoTest, TestStressLucene, TestQueryTypes, PolyFieldTest, TestPhraseSuggestions, TestSuggestSpellingConverter, SyncSliceTest, TestCSVResponseWriter, TestReload, IndexBasedSpellCheckerTest, BasicDistributedZk2Test, ZkCLITest, BasicDistributedZkTest, OverseerTest]
[junit4:junit4] Completed in 103.99s, 8 tests, 1 failure <<< FAILURES!

[...truncated 354 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:335: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:178: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\module-build.xml:61: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1163: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:827: There were test failures: 233 suites, 970 tests, 1 failure, 12 ignored (7 assumptions)

Total time: 40 minutes 28 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.6.0_37 -client -XX:+UseParallelGC
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message