lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@sd-datasolutions.de>
Subject [JENKINS] Lucene-Solr-4.x-Windows (64bit/jdk1.6.0_35) - Build # 566 - Failure!
Date Sat, 01 Sep 2012 22:49:44 GMT
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Windows/566/
Java: 64bit/jdk1.6.0_35 -XX:+UseSerialGC

2 tests failed.
REGRESSION:  org.apache.solr.cloud.LeaderElectionTest.testStressElection

Error Message:
Could not get leader props

Stack Trace:
java.lang.RuntimeException: Could not get leader props
	at __randomizedtesting.SeedInfo.seed([C89F89B9944E2B69:37C95D17F3003A7A]:0)
	at org.apache.solr.cloud.LeaderElectionTest.getLeaderUrl(LeaderElectionTest.java:226)
	at org.apache.solr.cloud.LeaderElectionTest.getLeaderThread(LeaderElectionTest.java:326)
	at org.apache.solr.cloud.LeaderElectionTest.testStressElection(LeaderElectionTest.java:435)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:345)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:769)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:429)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:40)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:345)
	at java.lang.Thread.run(Thread.java:662)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.LeaderElectionTest

Error Message:
4 threads leaked from SUITE scope at org.apache.solr.cloud.LeaderElectionTest:     1) Thread[id=2151, name=Thread-724, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)    2) Thread[id=2150, name=Thread-723, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)    3) Thread[id=2153, name=Thread-726, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)    4) Thread[id=2152, name=Thread-725, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE scope at org.apache.solr.cloud.LeaderElectionTest: 
   1) Thread[id=2151, name=Thread-724, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
   2) Thread[id=2150, name=Thread-723, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
   3) Thread[id=2153, name=Thread-726, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
   4) Thread[id=2152, name=Thread-725, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
	at __randomizedtesting.SeedInfo.seed([C89F89B9944E2B69]:0)




Build Log:
[...truncated 6393 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.LeaderElectionTest
[junit4:junit4]   2> Creating dataDir: C:\Jenkins\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-LeaderElectionTest-1346539212303
[junit4:junit4]   2> 6 T2025 oas.SolrTestCaseJ4.setUp ###Starting testBasic
[junit4:junit4]   2> 6 T2025 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 10 T2026 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 12 T2026 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 14 T2026 oazsp.FileTxnSnapLog.save Snapshotting: 0
[junit4:junit4]   2> 146 T2025 oasc.ZkTestServer.run start zk server on port:53538
[junit4:junit4]   2> 146 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53538 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@270452d6
[junit4:junit4]   2> 147 T2031 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53538
[junit4:junit4]   2> 147 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 148 T2031 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53538, initiating session
[junit4:junit4]   2> 150 T2027 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53541
[junit4:junit4]   2> 150 T2027 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53541
[junit4:junit4]   2> 150 T2029 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 155 T2029 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdce1e0000 with negotiated timeout 10000 for client /127.0.0.1:53541
[junit4:junit4]   2> 155 T2031 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53538, sessionid = 0x13983fdce1e0000, negotiated timeout = 10000
[junit4:junit4]   2> 155 T2032 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@270452d6 name:ZooKeeperConnection Watcher:127.0.0.1:53538 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 155 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 156 T2030 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdce1e0000
[junit4:junit4]   2> 159 T2025 oaz.ZooKeeper.close Session: 0x13983fdce1e0000 closed
[junit4:junit4]   2> 159 T2027 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13983fdce1e0000, likely client has closed socket
[junit4:junit4]   2> 159 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53538 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7d28463a
[junit4:junit4]   2> 159 T2027 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53541 which had sessionid 0x13983fdce1e0000
[junit4:junit4]   2> 159 T2032 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 161 T2033 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53538
[junit4:junit4]   2> 161 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 162 T2033 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53538, initiating session
[junit4:junit4]   2> 162 T2027 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53544
[junit4:junit4]   2> 162 T2027 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53544
[junit4:junit4]   2> 165 T2029 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdce1e0001 with negotiated timeout 10000 for client /127.0.0.1:53544
[junit4:junit4]   2> 165 T2033 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53538, sessionid = 0x13983fdce1e0001, negotiated timeout = 10000
[junit4:junit4]   2> 165 T2034 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d28463a name:ZooKeeperConnection Watcher:127.0.0.1:53538 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 165 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 166 T2025 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 170 T2030 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdce1e0001
[junit4:junit4]   2> 171 T2025 oaz.ZooKeeper.close Session: 0x13983fdce1e0001 closed
[junit4:junit4]   2> 171 T2027 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53544 which had sessionid 0x13983fdce1e0001
[junit4:junit4]   2> 173 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53538/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@37ef277a
[junit4:junit4]   2> 173 T2034 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 174 T2035 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53538
[junit4:junit4]   2> 174 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 175 T2035 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53538, initiating session
[junit4:junit4]   2> 175 T2027 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53547
[junit4:junit4]   2> 175 T2027 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53547
[junit4:junit4]   2> 177 T2029 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdce1e0002 with negotiated timeout 20000 for client /127.0.0.1:53547
[junit4:junit4]   2> 178 T2035 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53538, sessionid = 0x13983fdce1e0002, negotiated timeout = 20000
[junit4:junit4]   2> 179 T2036 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@37ef277a name:ZooKeeperConnection Watcher:127.0.0.1:53538/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 179 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 181 T2025 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 196 T2030 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdce1e0002 type:delete cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 886 T2025 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 898 T2030 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdce1e0002 type:create cxid:0x18 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 905 T2030 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdce1e0002
[junit4:junit4]   2> 908 T2036 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 908 T2025 oaz.ZooKeeper.close Session: 0x13983fdce1e0002 closed
[junit4:junit4]   2> 908 T2027 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13983fdce1e0002, likely client has closed socket
[junit4:junit4]   2> 909 T2030 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 910 T2029 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 910 T2027 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53547 which had sessionid 0x13983fdce1e0002
[junit4:junit4]   2> 912 T2025 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 956 T2028 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 4002 T2027 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 4005 T2025 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 4005 T2025 oas.SolrTestCaseJ4.tearDown ###Ending testBasic
[junit4:junit4]   2> 4011 T2025 oas.SolrTestCaseJ4.setUp ###Starting testCancelElection
[junit4:junit4]   2> 4011 T2025 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 4012 T2037 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 4013 T2037 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 4014 T2037 oazsp.FileSnap.deserialize Reading snapshot C:\Jenkins\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-LeaderElectionTest-1346539212303\zookeeper\server1\data\version-2\snapshot.0
[junit4:junit4]   2> 4017 T2037 oazsp.FileTxnSnapLog.save Snapshotting: 14
[junit4:junit4]   2> 4137 T2025 oasc.ZkTestServer.run start zk server on port:53550
[junit4:junit4]   2> 4137 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53550 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@72b17119
[junit4:junit4]   2> 4139 T2042 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53550
[junit4:junit4]   2> 4139 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4140 T2042 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53550, initiating session
[junit4:junit4]   2> 4140 T2038 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53553
[junit4:junit4]   2> 4142 T2038 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53553
[junit4:junit4]   2> 4142 T2040 oazsp.FileTxnLog.append Creating new log file: log.15
[junit4:junit4]   2> 4148 T2040 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdddc20000 with negotiated timeout 10000 for client /127.0.0.1:53553
[junit4:junit4]   2> 4148 T2042 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53550, sessionid = 0x13983fdddc20000, negotiated timeout = 10000
[junit4:junit4]   2> 4149 T2043 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@72b17119 name:ZooKeeperConnection Watcher:127.0.0.1:53550 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4149 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4177 T2041 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdddc20000
[junit4:junit4]   2> 4178 T2025 oaz.ZooKeeper.close Session: 0x13983fdddc20000 closed
[junit4:junit4]   2> 4179 T2038 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13983fdddc20000, likely client has closed socket
[junit4:junit4]   2> 4179 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53550 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2ae95158
[junit4:junit4]   2> 4179 T2038 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53553 which had sessionid 0x13983fdddc20000
[junit4:junit4]   2> 4180 T2043 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4182 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4182 T2044 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53550
[junit4:junit4]   2> 4184 T2044 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53550, initiating session
[junit4:junit4]   2> 4184 T2038 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53556
[junit4:junit4]   2> 4185 T2038 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53556
[junit4:junit4]   2> 4188 T2040 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdddc20001 with negotiated timeout 10000 for client /127.0.0.1:53556
[junit4:junit4]   2> 4188 T2044 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53550, sessionid = 0x13983fdddc20001, negotiated timeout = 10000
[junit4:junit4]   2> 4188 T2045 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ae95158 name:ZooKeeperConnection Watcher:127.0.0.1:53550 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4188 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4188 T2025 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 4191 T2041 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdddc20001
[junit4:junit4]   2> 4194 T2025 oaz.ZooKeeper.close Session: 0x13983fdddc20001 closed
[junit4:junit4]   2> 4194 T2038 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13983fdddc20001, likely client has closed socket
[junit4:junit4]   2> 4194 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53550/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@74adbb77
[junit4:junit4]   2> 4194 T2045 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4195 T2038 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53556 which had sessionid 0x13983fdddc20001
[junit4:junit4]   2> 4195 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4195 T2046 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53550
[junit4:junit4]   2> 4199 T2046 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53550, initiating session
[junit4:junit4]   2> 4199 T2038 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53559
[junit4:junit4]   2> 4199 T2038 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53559
[junit4:junit4]   2> 4201 T2040 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdddc20002 with negotiated timeout 20000 for client /127.0.0.1:53559
[junit4:junit4]   2> 4201 T2046 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53550, sessionid = 0x13983fdddc20002, negotiated timeout = 20000
[junit4:junit4]   2> 4202 T2047 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@74adbb77 name:ZooKeeperConnection Watcher:127.0.0.1:53550/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4202 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4203 T2025 oascc.SolrZkClient.makePath makePath: /collections/collection2/leader_elect/slice1/election
[junit4:junit4]   2> 4220 T2041 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdddc20002 type:delete cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection2/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection2/leaders
[junit4:junit4]   2> 4842 T2025 oascc.SolrZkClient.makePath makePath: /collections/collection2/leaders/slice1
[junit4:junit4]   2> 4852 T2041 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdddc20002 type:create cxid:0x18 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 7968 T2047 oascc.SolrZkClient.makePath makePath: /collections/collection2/leaders/slice1
[junit4:junit4]   2> 7972 T2041 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdddc20002 type:create cxid:0x2a zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8588 T2041 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdddc20002
[junit4:junit4]   2> 8590 T2038 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53559 which had sessionid 0x13983fdddc20002
[junit4:junit4]   2> 8590 T2047 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8590 T2025 oaz.ZooKeeper.close Session: 0x13983fdddc20002 closed
[junit4:junit4]   2> 8593 T2041 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 8593 T2040 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 8594 T2025 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 8892 T2039 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 11389 T2038 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 11390 T2025 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 11390 T2025 oas.SolrTestCaseJ4.tearDown ###Ending testCancelElection
[junit4:junit4]   2> 11394 T2025 oas.SolrTestCaseJ4.setUp ###Starting testElection
[junit4:junit4]   2> 11394 T2025 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 11395 T2048 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 11396 T2048 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 11397 T2048 oazsp.FileSnap.deserialize Reading snapshot C:\Jenkins\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-LeaderElectionTest-1346539212303\zookeeper\server1\data\version-2\snapshot.14
[junit4:junit4]   2> 11400 T2048 oazsp.FileTxnSnapLog.save Snapshotting: 38
[junit4:junit4]   2> 11518 T2025 oasc.ZkTestServer.run start zk server on port:53562
[junit4:junit4]   2> 11518 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53562 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@3442b24f
[junit4:junit4]   2> 11520 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11520 T2053 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53562
[junit4:junit4]   2> 11521 T2053 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53562, initiating session
[junit4:junit4]   2> 11522 T2049 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53565
[junit4:junit4]   2> 11522 T2049 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53565
[junit4:junit4]   2> 11522 T2051 oazsp.FileTxnLog.append Creating new log file: log.39
[junit4:junit4]   2> 11527 T2051 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdfa990000 with negotiated timeout 10000 for client /127.0.0.1:53565
[junit4:junit4]   2> 11527 T2053 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53562, sessionid = 0x13983fdfa990000, negotiated timeout = 10000
[junit4:junit4]   2> 11528 T2054 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3442b24f name:ZooKeeperConnection Watcher:127.0.0.1:53562 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11528 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11556 T2052 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdfa990000
[junit4:junit4]   2> 11557 T2025 oaz.ZooKeeper.close Session: 0x13983fdfa990000 closed
[junit4:junit4]   2> 11557 T2049 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13983fdfa990000, likely client has closed socket
[junit4:junit4]   2> 11557 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53562 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@288d865d
[junit4:junit4]   2> 11557 T2049 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53565 which had sessionid 0x13983fdfa990000
[junit4:junit4]   2> 11558 T2054 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 11560 T2055 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53562
[junit4:junit4]   2> 11560 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11561 T2055 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53562, initiating session
[junit4:junit4]   2> 11561 T2049 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53568
[junit4:junit4]   2> 11562 T2049 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53568
[junit4:junit4]   2> 11564 T2051 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdfa990001 with negotiated timeout 10000 for client /127.0.0.1:53568
[junit4:junit4]   2> 11564 T2055 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53562, sessionid = 0x13983fdfa990001, negotiated timeout = 10000
[junit4:junit4]   2> 11564 T2056 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@288d865d name:ZooKeeperConnection Watcher:127.0.0.1:53562 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11564 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11566 T2025 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 11569 T2052 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdfa990001
[junit4:junit4]   2> 11571 T2025 oaz.ZooKeeper.close Session: 0x13983fdfa990001 closed
[junit4:junit4]   2> 11571 T2049 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13983fdfa990001, likely client has closed socket
[junit4:junit4]   2> 11571 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53562/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@7c885f43
[junit4:junit4]   2> 11571 T2056 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 11571 T2049 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53568 which had sessionid 0x13983fdfa990001
[junit4:junit4]   2> 11573 T2057 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53562
[junit4:junit4]   2> 11573 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11574 T2057 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53562, initiating session
[junit4:junit4]   2> 11574 T2049 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53571
[junit4:junit4]   2> 11574 T2049 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53571
[junit4:junit4]   2> 11577 T2051 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdfa990002 with negotiated timeout 20000 for client /127.0.0.1:53571
[junit4:junit4]   2> 11578 T2057 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53562, sessionid = 0x13983fdfa990002, negotiated timeout = 20000
[junit4:junit4]   2> 11578 T2058 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c885f43 name:ZooKeeperConnection Watcher:127.0.0.1:53562/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11578 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11579 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53562/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c0c8826
[junit4:junit4]   2> 11581 T2060 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53562
[junit4:junit4]   2> 11581 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11583 T2060 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53562, initiating session
[junit4:junit4]   2> 11583 T2049 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53574
[junit4:junit4]   2> 11583 T2049 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53574
[junit4:junit4]   2> 11585 T2051 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdfa990003 with negotiated timeout 20000 for client /127.0.0.1:53574
[junit4:junit4]   2> 11585 T2060 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53562, sessionid = 0x13983fdfa990003, negotiated timeout = 20000
[junit4:junit4]   2> 11585 T2061 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c0c8826 name:ZooKeeperConnection Watcher:127.0.0.1:53562/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11586 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11586 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53562/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@664107c9
[junit4:junit4]   2> 11587 T2063 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53562
[junit4:junit4]   2> 11587 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11589 T2063 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53562, initiating session
[junit4:junit4]   2> 11590 T2049 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53577
[junit4:junit4]   2> 11590 T2049 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53577
[junit4:junit4]   2> 11591 T2051 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdfa990004 with negotiated timeout 20000 for client /127.0.0.1:53577
[junit4:junit4]   2> 11591 T2063 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53562, sessionid = 0x13983fdfa990004, negotiated timeout = 20000
[junit4:junit4]   2> 11592 T2064 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@664107c9 name:ZooKeeperConnection Watcher:127.0.0.1:53562/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11592 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11592 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53562/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@373fd
[junit4:junit4]   2> 11595 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11595 T2066 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53562
[junit4:junit4]   2> 11596 T2066 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53562, initiating session
[junit4:junit4]   2> 11597 T2049 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53580
[junit4:junit4]   2> 11597 T2049 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53580
[junit4:junit4]   2> 11600 T2051 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdfa990005 with negotiated timeout 20000 for client /127.0.0.1:53580
[junit4:junit4]   2> 11600 T2066 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53562, sessionid = 0x13983fdfa990005, negotiated timeout = 20000
[junit4:junit4]   2> 11600 T2067 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@373fd name:ZooKeeperConnection Watcher:127.0.0.1:53562/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11601 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11601 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53562/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@61d45221
[junit4:junit4]   2> 11602 T2069 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53562
[junit4:junit4]   2> 11602 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11603 T2069 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53562, initiating session
[junit4:junit4]   2> 11603 T2049 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53583
[junit4:junit4]   2> 11604 T2049 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53583
[junit4:junit4]   2> 11606 T2051 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdfa990006 with negotiated timeout 20000 for client /127.0.0.1:53583
[junit4:junit4]   2> 11606 T2069 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53562, sessionid = 0x13983fdfa990006, negotiated timeout = 20000
[junit4:junit4]   2> 11607 T2070 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61d45221 name:ZooKeeperConnection Watcher:127.0.0.1:53562/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11607 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11607 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53562/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@577b5a6a
[junit4:junit4]   2> 11608 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11608 T2072 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53562
[junit4:junit4]   2> 11611 T2072 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53562, initiating session
[junit4:junit4]   2> 11611 T2049 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53586
[junit4:junit4]   2> 11611 T2049 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53586
[junit4:junit4]   2> 11613 T2051 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdfa990007 with negotiated timeout 20000 for client /127.0.0.1:53586
[junit4:junit4]   2> 11613 T2072 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53562, sessionid = 0x13983fdfa990007, negotiated timeout = 20000
[junit4:junit4]   2> 11613 T2073 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@577b5a6a name:ZooKeeperConnection Watcher:127.0.0.1:53562/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11614 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11614 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53562/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@5ac6d96f
[junit4:junit4]   2> 11615 T2075 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53562
[junit4:junit4]   2> 11615 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11617 T2075 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53562, initiating session
[junit4:junit4]   2> 11617 T2049 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53589
[junit4:junit4]   2> 11618 T2049 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53589
[junit4:junit4]   2> 11619 T2051 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdfa990008 with negotiated timeout 20000 for client /127.0.0.1:53589
[junit4:junit4]   2> 11619 T2075 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53562, sessionid = 0x13983fdfa990008, negotiated timeout = 20000
[junit4:junit4]   2> 11620 T2076 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5ac6d96f name:ZooKeeperConnection Watcher:127.0.0.1:53562/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11620 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11620 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53562/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@16dbac10
[junit4:junit4]   2> 11621 T2078 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53562
[junit4:junit4]   2> 11621 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11623 T2078 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53562, initiating session
[junit4:junit4]   2> 11624 T2049 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53592
[junit4:junit4]   2> 11624 T2049 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53592
[junit4:junit4]   2> 11625 T2051 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdfa990009 with negotiated timeout 20000 for client /127.0.0.1:53592
[junit4:junit4]   2> 11626 T2078 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53562, sessionid = 0x13983fdfa990009, negotiated timeout = 20000
[junit4:junit4]   2> 11626 T2079 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16dbac10 name:ZooKeeperConnection Watcher:127.0.0.1:53562/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11626 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11626 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53562/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@40d5c645
[junit4:junit4]   2> 11629 T2081 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53562
[junit4:junit4]   2> 11629 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11630 T2081 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53562, initiating session
[junit4:junit4]   2> 11630 T2049 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53595
[junit4:junit4]   2> 11631 T2049 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53595
[junit4:junit4]   2> 11632 T2051 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdfa99000a with negotiated timeout 20000 for client /127.0.0.1:53595
[junit4:junit4]   2> 11632 T2081 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53562, sessionid = 0x13983fdfa99000a, negotiated timeout = 20000
[junit4:junit4]   2> 11634 T2082 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@40d5c645 name:ZooKeeperConnection Watcher:127.0.0.1:53562/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11634 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11634 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53562/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@dcfca31
[junit4:junit4]   2> 11635 T2084 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53562
[junit4:junit4]   2> 11635 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11636 T2084 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53562, initiating session
[junit4:junit4]   2> 11637 T2049 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53598
[junit4:junit4]   2> 11637 T2049 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53598
[junit4:junit4]   2> 11640 T2051 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdfa99000b with negotiated timeout 20000 for client /127.0.0.1:53598
[junit4:junit4]   2> 11640 T2084 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53562, sessionid = 0x13983fdfa99000b, negotiated timeout = 20000
[junit4:junit4]   2> 11641 T2085 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@dcfca31 name:ZooKeeperConnection Watcher:127.0.0.1:53562/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11641 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11641 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53562/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@5f7ba84a
[junit4:junit4]   2> 11642 T2087 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53562
[junit4:junit4]   2> 11642 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11643 T2087 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53562, initiating session
[junit4:junit4]   2> 11643 T2049 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53601
[junit4:junit4]   2> 11644 T2049 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53601
[junit4:junit4]   2> 11646 T2051 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdfa99000c with negotiated timeout 20000 for client /127.0.0.1:53601
[junit4:junit4]   2> 11646 T2087 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53562, sessionid = 0x13983fdfa99000c, negotiated timeout = 20000
[junit4:junit4]   2> 11647 T2088 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5f7ba84a name:ZooKeeperConnection Watcher:127.0.0.1:53562/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11647 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11647 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53562/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3c9f832d
[junit4:junit4]   2> 11648 T2090 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53562
[junit4:junit4]   2> 11648 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11650 T2090 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53562, initiating session
[junit4:junit4]   2> 11652 T2049 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53604
[junit4:junit4]   2> 11652 T2049 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53604
[junit4:junit4]   2> 11653 T2051 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdfa99000d with negotiated timeout 20000 for client /127.0.0.1:53604
[junit4:junit4]   2> 11654 T2090 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53562, sessionid = 0x13983fdfa99000d, negotiated timeout = 20000
[junit4:junit4]   2> 11654 T2091 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c9f832d name:ZooKeeperConnection Watcher:127.0.0.1:53562/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11654 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11655 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53562/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@604961e4
[junit4:junit4]   2> 11657 T2093 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53562
[junit4:junit4]   2> 11657 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11658 T2093 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53562, initiating session
[junit4:junit4]   2> 11658 T2049 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53607
[junit4:junit4]   2> 11658 T2049 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53607
[junit4:junit4]   2> 11660 T2051 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdfa99000e with negotiated timeout 20000 for client /127.0.0.1:53607
[junit4:junit4]   2> 11660 T2093 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53562, sessionid = 0x13983fdfa99000e, negotiated timeout = 20000
[junit4:junit4]   2> 11660 T2094 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@604961e4 name:ZooKeeperConnection Watcher:127.0.0.1:53562/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11661 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11661 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53562/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@791bccb
[junit4:junit4]   2> 11663 T2096 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53562
[junit4:junit4]   2> 11663 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11664 T2096 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53562, initiating session
[junit4:junit4]   2> 11665 T2049 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53610
[junit4:junit4]   2> 11665 T2049 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53610
[junit4:junit4]   2> 11666 T2051 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdfa99000f with negotiated timeout 20000 for client /127.0.0.1:53610
[junit4:junit4]   2> 11666 T2096 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53562, sessionid = 0x13983fdfa99000f, negotiated timeout = 20000
[junit4:junit4]   2> 11667 T2097 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@791bccb name:ZooKeeperConnection Watcher:127.0.0.1:53562/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11667 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11667 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53562/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3af6ea95
[junit4:junit4]   2> 11669 T2099 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53562
[junit4:junit4]   2> 11669 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11671 T2099 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53562, initiating session
[junit4:junit4]   2> 11671 T2049 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53613
[junit4:junit4]   2> 11671 T2049 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53613
[junit4:junit4]   2> 11674 T2051 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdfa990010 with negotiated timeout 20000 for client /127.0.0.1:53613
[junit4:junit4]   2> 11674 T2099 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53562, sessionid = 0x13983fdfa990010, negotiated timeout = 20000
[junit4:junit4]   2> 11674 T2100 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3af6ea95 name:ZooKeeperConnection Watcher:127.0.0.1:53562/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11675 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11675 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53562/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3c8c64cc
[junit4:junit4]   2> 11676 T2102 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53562
[junit4:junit4]   2> 11676 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11677 T2102 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53562, initiating session
[junit4:junit4]   2> 11677 T2049 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53616
[junit4:junit4]   2> 11678 T2049 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53616
[junit4:junit4]   2> 11681 T2051 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fdfa990011 with negotiated timeout 20000 for client /127.0.0.1:53616
[junit4:junit4]   2> 11681 T2102 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53562, sessionid = 0x13983fdfa990011, negotiated timeout = 20000
[junit4:junit4]   2> 11681 T2103 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c8c64cc name:ZooKeeperConnection Watcher:127.0.0.1:53562/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11682 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11683 T2059 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11683 T2062 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11684 T2068 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11687 T2074 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11687 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990006 type:create cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections Error:KeeperErrorCode = NodeExists for /solr/collections
[junit4:junit4]   2> 11687 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990003 type:create cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections Error:KeeperErrorCode = NodeExists for /solr/collections
[junit4:junit4]   2> 11693 T2080 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11693 T2086 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11694 T2098 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11694 T2092 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11694 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990008 type:create cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1
[junit4:junit4]   2> 11694 T2065 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11695 T2083 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11695 T2089 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11695 T2071 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11695 T2077 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11698 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990006 type:create cxid:0x5 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1
[junit4:junit4]   2> 11698 T2095 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11703 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990008 type:create cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect
[junit4:junit4]   2> 11705 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990003 type:create cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect
[junit4:junit4]   2> 11706 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990006 type:create cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect
[junit4:junit4]   2> 11706 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa99000a type:create cxid:0x5 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect
[junit4:junit4]   2> 11707 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa99000c type:create cxid:0x5 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect
[junit4:junit4]   2> 11710 T2101 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11715 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990006 type:create cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1
[junit4:junit4]   2> 11715 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa99000e type:create cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1
[junit4:junit4]   2> 11715 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990008 type:create cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1
[junit4:junit4]   2> 11715 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa99000a type:create cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1
[junit4:junit4]   2> 11716 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa99000c type:create cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1
[junit4:junit4]   2> 11716 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990004 type:create cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1
[junit4:junit4]   2> 11717 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990003 type:create cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1
[junit4:junit4]   2> 11717 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa99000b type:create cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1
[junit4:junit4]   2> 11718 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990005 type:create cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1
[junit4:junit4]   2> 11718 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa99000d type:create cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1
[junit4:junit4]   2> 11718 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990007 type:create cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1
[junit4:junit4]   2> 11726 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990008 type:create cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11727 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa99000e type:create cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11728 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990009 type:create cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11728 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990010 type:create cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11728 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990006 type:create cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11728 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa99000c type:create cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11729 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990003 type:create cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11729 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa99000b type:create cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11729 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990005 type:create cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11729 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa99000d type:create cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11730 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990004 type:create cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11730 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa99000a type:create cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11734 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990007 type:create cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11741 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990011 type:create cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11745 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990008 type:delete cxid:0xd zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 12382 T2074 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 12393 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990008 type:create cxid:0x16 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 12437 T2052 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdfa990008
[junit4:junit4]   2> 12439 T2049 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53589 which had sessionid 0x13983fdfa990008
[junit4:junit4]   2> 12439 T2076 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 12439 T2025 oaz.ZooKeeper.close Session: 0x13983fdfa990008 closed
[junit4:junit4]   2> 12440 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa99000e type:delete cxid:0xd zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4]   2> 13063 T2094 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 13068 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa99000e type:create cxid:0x14 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 13685 T2052 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdfa990006
[junit4:junit4]   2> 13689 T2049 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53583 which had sessionid 0x13983fdfa990006
[junit4:junit4]   2> 13689 T2025 oaz.ZooKeeper.close Session: 0x13983fdfa990006 closed
[junit4:junit4]   2> 13689 T2070 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 13691 T2052 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdfa99000e
[junit4:junit4]   2> 13726 T2049 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53607 which had sessionid 0x13983fdfa99000e
[junit4:junit4]   2> 13726 T2025 oaz.ZooKeeper.close Session: 0x13983fdfa99000e closed
[junit4:junit4]   2> 13726 T2094 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 13727 T2052 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdfa990010
[junit4:junit4]   2> 13728 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990009 type:delete cxid:0xc zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4]   2> 13729 T2049 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53613 which had sessionid 0x13983fdfa990010
[junit4:junit4]   2> 13729 T2025 oaz.ZooKeeper.close Session: 0x13983fdfa990010 closed
[junit4:junit4]   2> 13731 T2100 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 14352 T2079 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 14358 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990009 type:create cxid:0x13 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 14974 T2052 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdfa99000c
[junit4:junit4]   2> 14976 T2049 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53601 which had sessionid 0x13983fdfa99000c
[junit4:junit4]   2> 14976 T2025 oaz.ZooKeeper.close Session: 0x13983fdfa99000c closed
[junit4:junit4]   2> 14976 T2088 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 14977 T2052 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdfa990009
[junit4:junit4]   2> 14978 T2025 oaz.ZooKeeper.close Session: 0x13983fdfa990009 closed
[junit4:junit4]   2> 14980 T2049 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53592 which had sessionid 0x13983fdfa990009
[junit4:junit4]   2> 14980 T2079 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 14980 T2052 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdfa990003
[junit4:junit4]   2> 14981 T2061 oasc.SolrException.log SEVERE Failed setting watch:org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leader_elect/shard1/election/88246794564730889-6-n_0000000002
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:102)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:301)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:298)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:298)
[junit4:junit4]   2> 		at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:120)
[junit4:junit4]   2> 		at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> 		at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:132)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 14982 T2049 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53574 which had sessionid 0x13983fdfa990003
[junit4:junit4]   2> 14982 T2025 oaz.ZooKeeper.close Session: 0x13983fdfa990003 closed
[junit4:junit4]   2> 14982 T2052 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdfa99000b
[junit4:junit4]   2> 14985 T2025 oaz.ZooKeeper.close Session: 0x13983fdfa99000b closed
[junit4:junit4]   2> 14985 T2049 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13983fdfa99000b, likely client has closed socket
[junit4:junit4]   2> 14985 T2049 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53598 which had sessionid 0x13983fdfa99000b
[junit4:junit4]   2> 14986 T2052 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdfa990005
[junit4:junit4]   2> 14987 T2049 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53580 which had sessionid 0x13983fdfa990005
[junit4:junit4]   2> 14987 T2025 oaz.ZooKeeper.close Session: 0x13983fdfa990005 closed
[junit4:junit4]   2> 14988 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990004 type:delete cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4]   2> 15610 T2064 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 15615 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa990004 type:create cxid:0x17 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16221 T2061 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:278)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:275)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:275)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:151)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:132)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 16221 T2061 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 16230 T2052 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdfa990004
[junit4:junit4]   2> 16232 T2049 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53577 which had sessionid 0x13983fdfa990004
[junit4:junit4]   2> 16232 T2025 oaz.ZooKeeper.close Session: 0x13983fdfa990004 closed
[junit4:junit4]   2> 16232 T2064 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 16234 T2052 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdfa990007
[junit4:junit4]   2> 16235 T2052 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fdfa99000a type:delete cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4]   2> 16236 T2025 oaz.ZooKeeper.close Session: 0x13983fdfa990007 closed
[junit4:junit4]   2> 16237 T2049 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13983fdfa990007, likely client has closed socket
[junit4:junit4]   2> 16237 T2073 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 16237 T2049 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53586 which had sessionid 0x13983fdfa990007
[junit4:junit4]   2> 16238 T2052 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdfa99000a
[junit4:junit4]   2> 16241 T2049 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53595 which had sessionid 0x13983fdfa99000a
[junit4:junit4]   2> 16242 T2025 oaz.ZooKeeper.close Session: 0x13983fdfa99000a closed
[junit4:junit4]   2> 16243 T2052 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdfa99000d
[junit4:junit4]   2> 16246 T2025 oaz.ZooKeeper.close Session: 0x13983fdfa99000d closed
[junit4:junit4]   2> 16246 T2049 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53604 which had sessionid 0x13983fdfa99000d
[junit4:junit4]   2> 16247 T2052 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdfa99000f
[junit4:junit4]   2> 16249 T2025 oaz.ZooKeeper.close Session: 0x13983fdfa99000f closed
[junit4:junit4]   2> 16249 T2049 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13983fdfa99000f, likely client has closed socket
[junit4:junit4]   2> 16251 T2049 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53610 which had sessionid 0x13983fdfa99000f
[junit4:junit4]   2> 16251 T2052 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdfa990011
[junit4:junit4]   2> 16253 T2025 oaz.ZooKeeper.close Session: 0x13983fdfa990011 closed
[junit4:junit4]   2> 16253 T2049 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53616 which had sessionid 0x13983fdfa990011
[junit4:junit4]   2> 16254 T2052 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fdfa990002
[junit4:junit4]   2> 16257 T2049 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53571 which had sessionid 0x13983fdfa990002
[junit4:junit4]   2> 16258 T2058 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 16258 T2025 oaz.ZooKeeper.close Session: 0x13983fdfa990002 closed
[junit4:junit4]   2> 16259 T2051 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 16259 T2052 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 16260 T2025 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 16787 T2085 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 18777 T2085 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:815)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:211)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:483)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:443)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:424)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:94)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:159)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:103)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:132)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 17929 T2103 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 17927 T2097 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 17923 T2091 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 16831 T2050 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 16803 T2082 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 18778 T2082 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:815)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:211)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:483)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:443)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:424)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:94)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:159)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:103)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:132)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 16791 T2067 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 18779 T2082 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 18779 T2067 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:815)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:211)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:483)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:443)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:424)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:94)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:159)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:103)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:132)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 18778 T2091 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:815)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:211)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:483)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:443)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:424)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:94)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:159)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:103)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:132)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 18778 T2097 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:815)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:211)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:483)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:443)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:424)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:94)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:159)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:103)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:132)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 18778 T2085 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 18777 T2049 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 18782 T2097 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 18783 T2103 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:815)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:211)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:483)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:443)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:424)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:94)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:159)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:103)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:132)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 18784 T2103 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 18782 T2091 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 18780 T2067 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 18784 T2025 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 18785 T2025 oas.SolrTestCaseJ4.tearDown ###Ending testElection
[junit4:junit4]   2> 18789 T2025 oas.SolrTestCaseJ4.setUp ###Starting testStressElection
[junit4:junit4]   2> 18789 T2025 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 18790 T2104 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 18791 T2104 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 18792 T2104 oazsp.FileSnap.deserialize Reading snapshot C:\Jenkins\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-LeaderElectionTest-1346539212303\zookeeper\server1\data\version-2\snapshot.38
[junit4:junit4]   2> 18796 T2104 oazsp.FileTxnSnapLog.save Snapshotting: b2
[junit4:junit4]   2> 18901 T2025 oasc.ZkTestServer.run start zk server on port:53619
[junit4:junit4]   2> 18901 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53619 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@6bf2abbd
[junit4:junit4]   2> 18904 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 18904 T2109 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53619
[junit4:junit4]   2> 18905 T2109 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53619, initiating session
[junit4:junit4]   2> 18905 T2105 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53622
[junit4:junit4]   2> 18906 T2105 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53622
[junit4:junit4]   2> 18906 T2107 oazsp.FileTxnLog.append Creating new log file: log.b3
[junit4:junit4]   2> 18910 T2107 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fe177d0000 with negotiated timeout 10000 for client /127.0.0.1:53622
[junit4:junit4]   2> 18910 T2109 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53619, sessionid = 0x13983fe177d0000, negotiated timeout = 10000
[junit4:junit4]   2> 18911 T2110 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6bf2abbd name:ZooKeeperConnection Watcher:127.0.0.1:53619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 18911 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 18942 T2108 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fe177d0000
[junit4:junit4]   2> 18943 T2110 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 18943 T2025 oaz.ZooKeeper.close Session: 0x13983fe177d0000 closed
[junit4:junit4]   2> 18944 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53619 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2066fe31
[junit4:junit4]   2> 18944 T2105 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13983fe177d0000, likely client has closed socket
[junit4:junit4]   2> 18944 T2105 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53622 which had sessionid 0x13983fe177d0000
[junit4:junit4]   2> 18945 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 18945 T2111 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53619
[junit4:junit4]   2> 18946 T2111 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53619, initiating session
[junit4:junit4]   2> 18946 T2105 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53625
[junit4:junit4]   2> 18947 T2105 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53625
[junit4:junit4]   2> 18949 T2107 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fe177d0001 with negotiated timeout 10000 for client /127.0.0.1:53625
[junit4:junit4]   2> 18949 T2111 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53619, sessionid = 0x13983fe177d0001, negotiated timeout = 10000
[junit4:junit4]   2> 18949 T2112 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2066fe31 name:ZooKeeperConnection Watcher:127.0.0.1:53619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 18949 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 18949 T2025 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 18953 T2108 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fe177d0001
[junit4:junit4]   2> 18954 T2025 oaz.ZooKeeper.close Session: 0x13983fe177d0001 closed
[junit4:junit4]   2> 18955 T2112 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 18955 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53619/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@32f41b31
[junit4:junit4]   2> 18955 T2105 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53625 which had sessionid 0x13983fe177d0001
[junit4:junit4]   2> 18956 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 18956 T2113 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53619
[junit4:junit4]   2> 18957 T2113 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53619, initiating session
[junit4:junit4]   2> 18958 T2105 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53628
[junit4:junit4]   2> 18959 T2105 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53628
[junit4:junit4]   2> 18960 T2107 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fe177d0002 with negotiated timeout 20000 for client /127.0.0.1:53628
[junit4:junit4]   2> 18961 T2113 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53619, sessionid = 0x13983fe177d0002, negotiated timeout = 20000
[junit4:junit4]   2> 18961 T2114 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32f41b31 name:ZooKeeperConnection Watcher:127.0.0.1:53619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 18961 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 18961 T2025 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53619/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@f00ed54
[junit4:junit4]   2> 18962 T2116 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53619
[junit4:junit4]   2> 18962 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 18965 T2116 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53619, initiating session
[junit4:junit4]   2> 18965 T2105 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53631
[junit4:junit4]   2> 18965 T2105 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53631
[junit4:junit4]   2> 18967 T2107 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fe177d0003 with negotiated timeout 20000 for client /127.0.0.1:53631
[junit4:junit4]   2> 18967 T2116 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53619, sessionid = 0x13983fe177d0003, negotiated timeout = 20000
[junit4:junit4]   2> 18967 T2117 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f00ed54 name:ZooKeeperConnection Watcher:127.0.0.1:53619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 18968 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 18969 T2118 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 18982 T2108 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fe177d0003 type:delete cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 19541 T2118 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 19550 T2108 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fe177d0003 type:create cxid:0x18 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 21203 T2119 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53619/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@545091ca
[junit4:junit4]   2> 21205 T2123 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53619
[junit4:junit4]   2> 21205 T2119 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 21206 T2123 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53619, initiating session
[junit4:junit4]   2> 21207 T2105 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53634
[junit4:junit4]   2> 21207 T2105 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53634
[junit4:junit4]   2> 21211 T2123 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53619, sessionid = 0x13983fe177d0004, negotiated timeout = 20000
[junit4:junit4]   2> 21211 T2107 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fe177d0004 with negotiated timeout 20000 for client /127.0.0.1:53634
[junit4:junit4]   2> 21211 T2124 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@545091ca name:ZooKeeperConnection Watcher:127.0.0.1:53619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 21211 T2119 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 21213 T2119 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53619/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3e8f2109
[junit4:junit4]   2> 21214 T2127 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53619
[junit4:junit4]   2> 21215 T2119 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 21216 T2127 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53619, initiating session
[junit4:junit4]   2> 21216 T2105 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53637
[junit4:junit4]   2> 21217 T2105 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53637
[junit4:junit4]   2> 21219 T2127 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53619, sessionid = 0x13983fe177d0005, negotiated timeout = 20000
[junit4:junit4]   2> 21219 T2107 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fe177d0005 with negotiated timeout 20000 for client /127.0.0.1:53637
[junit4:junit4]   2> 21219 T2128 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e8f2109 name:ZooKeeperConnection Watcher:127.0.0.1:53619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 21221 T2119 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 21221 T2119 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53619/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@20ce4de8
[junit4:junit4]   2> 21221 T2108 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fe177d0003
[junit4:junit4]   2> 21222 T2131 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53619
[junit4:junit4]   2> 21222 T2119 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 21222 T2120 oaz.ZooKeeper.close Session: 0x13983fe177d0003 closed
[junit4:junit4]   2> 21222 T2105 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53631 which had sessionid 0x13983fe177d0003
[junit4:junit4]   2> 21223 T2117 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 21224 T2131 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53619, initiating session
[junit4:junit4]   2> 21224 T2105 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53640
[junit4:junit4]   2> 21225 T2105 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53640
[junit4:junit4]   2> 21226 T2107 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fe177d0006 with negotiated timeout 20000 for client /127.0.0.1:53640
[junit4:junit4]   2> 21226 T2131 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53619, sessionid = 0x13983fe177d0006, negotiated timeout = 20000
[junit4:junit4]   2> 21226 T2132 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@20ce4de8 name:ZooKeeperConnection Watcher:127.0.0.1:53619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 21227 T2119 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 21227 T2119 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53619/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f44c624
[junit4:junit4]   2> 21228 T2119 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 21228 T2135 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53619
[junit4:junit4]   2> 21230 T2135 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53619, initiating session
[junit4:junit4]   2> 21230 T2105 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53643
[junit4:junit4]   2> 21230 T2105 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53643
[junit4:junit4]   2> 21233 T2107 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fe177d0007 with negotiated timeout 20000 for client /127.0.0.1:53643
[junit4:junit4]   2> 21233 T2135 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53619, sessionid = 0x13983fe177d0007, negotiated timeout = 20000
[junit4:junit4]   2> 21233 T2136 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f44c624 name:ZooKeeperConnection Watcher:127.0.0.1:53619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 21233 T2119 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 21234 T2119 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53619/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@43122a34
[junit4:junit4]   2> 21235 T2119 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 21235 T2108 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fe177d0005
[junit4:junit4]   2> 21235 T2139 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53619
[junit4:junit4]   2> 21236 T2139 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53619, initiating session
[junit4:junit4]   2> 21236 T2105 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53646
[junit4:junit4]   2> 21236 T2105 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53637 which had sessionid 0x13983fe177d0005
[junit4:junit4]   2> 21236 T2120 oaz.ZooKeeper.close Session: 0x13983fe177d0005 closed
[junit4:junit4]   2> 21236 T2128 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 21236 T2105 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53646
[junit4:junit4]   2> 21238 T2107 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fe177d0008 with negotiated timeout 20000 for client /127.0.0.1:53646
[junit4:junit4]   2> 21238 T2139 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53619, sessionid = 0x13983fe177d0008, negotiated timeout = 20000
[junit4:junit4]   2> 21239 T2140 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43122a34 name:ZooKeeperConnection Watcher:127.0.0.1:53619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 21239 T2119 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 21239 T2119 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53619/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@4a08ba1c
[junit4:junit4]   2> 21240 T2143 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:53619
[junit4:junit4]   2> 21240 T2119 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 21241 T2143 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53619, initiating session
[junit4:junit4]   2> 21241 T2105 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53649
[junit4:junit4]   2> 21241 T2105 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:53649
[junit4:junit4]   2> 21243 T2107 oazs.NIOServerCnxn.finishSessionInit Established session 0x13983fe177d0009 with negotiated timeout 20000 for client /127.0.0.1:53649
[junit4:junit4]   2> 21243 T2143 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:53619, sessionid = 0x13983fe177d0009, negotiated timeout = 20000
[junit4:junit4]   2> 21244 T2144 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a08ba1c name:ZooKeeperConnection Watcher:127.0.0.1:53619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 21246 T2119 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 21260 T2105 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13983fe177d0008, likely client has closed socket
[junit4:junit4]   2> 21260 T2139 oaz.ClientCnxn$SendThread.run WARNING Session 0x13983fe177d0008 for server null, unexpected error, closing socket connection and attempting reconnect java.nio.channels.CancelledKeyException
[junit4:junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:55)
[junit4:junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:59)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.disableWrite(ClientCnxn.java:919)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1163)
[junit4:junit4]   2> 
[junit4:junit4]   2> 21260 T2105 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53646 which had sessionid 0x13983fe177d0008
[junit4:junit4]   2> 21298 T2108 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fe177d0004
[junit4:junit4]   2> 21299 T2120 oaz.ZooKeeper.close Session: 0x13983fe177d0004 closed
[junit4:junit4]   2> 21299 T2124 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 21299 T2105 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13983fe177d0004, likely client has closed socket
[junit4:junit4]   2> 21300 T2105 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53634 which had sessionid 0x13983fe177d0004
[junit4:junit4]   2> 21312 T2118 oasc.LeaderElectionTest$ClientThread.run SEVERE setup failed org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:815)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:232)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:229)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:229)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:94)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:88)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.setup(LeaderElector.java:279)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElectionTest$ClientThread.setupOnConnect(LeaderElectionTest.java:116)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElectionTest$ClientThread.run(LeaderElectionTest.java:125)
[junit4:junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4:junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:98)
[junit4:junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:206)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 
[junit4:junit4]   2> 21324 T2108 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fe177d0007
[junit4:junit4]   2> 21325 T2120 oaz.ZooKeeper.close Session: 0x13983fe177d0007 closed
[junit4:junit4]   2> 21325 T2105 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53643 which had sessionid 0x13983fe177d0007
[junit4:junit4]   2> 21325 T2136 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 21372 T2140 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43122a34 name:ZooKeeperConnection Watcher:127.0.0.1:53619/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4]   2> 21372 T2140 oascc.ConnectionManager.process zkClient has disconnected
[junit4:junit4]   2> 21409 T2108 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fe177d0006
[junit4:junit4]   2> 21410 T2120 oaz.ZooKeeper.close Session: 0x13983fe177d0006 closed
[junit4:junit4]   2> 21410 T2132 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 21410 T2105 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13983fe177d0006, likely client has closed socket
[junit4:junit4]   2> 21410 T2105 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53640 which had sessionid 0x13983fe177d0006
[junit4:junit4]   2> 21443 T2118 oasc.LeaderElectionTest$ClientThread.run SEVERE setup failed org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:815)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:232)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:229)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:229)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:94)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:88)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.setup(LeaderElector.java:279)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElectionTest$ClientThread.setupOnConnect(LeaderElectionTest.java:116)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElectionTest$ClientThread.run(LeaderElectionTest.java:125)
[junit4:junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4:junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:98)
[junit4:junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:206)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 
[junit4:junit4]   2> 21468 T2108 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13983fe177d0009 type:delete cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4]   2> 21660 T2133 oasc.LeaderElectionTest$ClientThread.run SEVERE setup failed org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:815)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:232)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:229)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:229)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:94)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:88)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.setup(LeaderElector.java:279)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElectionTest$ClientThread.setupOnConnect(LeaderElectionTest.java:116)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElectionTest$ClientThread.run(LeaderElectionTest.java:125)
[junit4:junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4:junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:98)
[junit4:junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:206)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 
[junit4:junit4]   2> 21690 T2145 oasc.LeaderElectionTest$ClientThread.run SEVERE setup failed org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:815)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:232)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:229)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:229)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:94)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:88)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.setup(LeaderElector.java:279)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElectionTest$ClientThread.setupOnConnect(LeaderElectionTest.java:116)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElectionTest$ClientThread.run(LeaderElectionTest.java:125)
[junit4:junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4:junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:98)
[junit4:junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:206)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 
[junit4:junit4]   2> 21874 T2105 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13983fe177d0009, likely client has closed socket
[junit4:junit4]   2> 21874 T2143 oaz.ClientCnxn$SendThread.run WARNING Session 0x13983fe177d0009 for server 127.0.0.1/127.0.0.1:53619, unexpected error, closing socket connection and attempting reconnect java.nio.channels.ClosedChannelException
[junit4:junit4]   2> 	at sun.nio.ch.SocketChannelImpl.ensureReadOpen(SocketChannelImpl.java:122)
[junit4:junit4]   2> 	at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:165)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.doIO(ClientCnxn.java:856)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1154)
[junit4:junit4]   2> 
[junit4:junit4]   2> 21875 T2105 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53649 which had sessionid 0x13983fe177d0009
[junit4:junit4]   2> 21987 T2144 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a08ba1c name:ZooKeeperConnection Watcher:127.0.0.1:53619/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4]   2> 21987 T2144 oascc.ConnectionManager.process zkClient has disconnected
[junit4:junit4]   2> 22027 T2125 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 23025 T2139 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server 127.0.0.1/127.0.0.1:53619
[junit4:junit4]   2> 23025 T2139 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53619, initiating session
[junit4:junit4]   2> 23026 T2105 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53650
[junit4:junit4]   2> 23810 T2143 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server 127.0.0.1/127.0.0.1:53619
[junit4:junit4]   2> 23810 T2143 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53619, initiating session
[junit4:junit4]   2> 23811 T2105 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:53651
[junit4:junit4]   2> 27908 T2105 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x0, likely client has closed socket
[junit4:junit4]   2> 27908 T2105 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53650 (no session established for client)
[junit4:junit4]   2> 28461 T2105 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x0, likely client has closed socket
[junit4:junit4]   2> 28461 T2105 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53651 (no session established for client)
[junit4:junit4]   2> 33937 T2139 oaz.ClientCnxn$SendThread.run WARNING Session 0x13983fe177d0008 for server 127.0.0.1/127.0.0.1:53619, unexpected error, closing socket connection and attempting reconnect java.nio.channels.CancelledKeyException
[junit4:junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:55)
[junit4:junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:64)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.primeConnection(ClientCnxn.java:993)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1146)
[junit4:junit4]   2> 
[junit4:junit4]   2> 33937 T2137 oasc.LeaderElectionTest$ClientThread.run SEVERE setup failed java.lang.InterruptedException
[junit4:junit4]   2> 	at java.lang.Object.wait(Native Method)
[junit4:junit4]   2> 	at java.lang.Object.wait(Object.java:485)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1345)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:810)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:232)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:229)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:229)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:94)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:88)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.setup(LeaderElector.java:279)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElectionTest$ClientThread.setupOnConnect(LeaderElectionTest.java:116)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElectionTest$ClientThread.run(LeaderElectionTest.java:125)
[junit4:junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4:junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:98)
[junit4:junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:206)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 
[junit4:junit4]   2> 34038 T2140 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 34038 T2137 oaz.ZooKeeper.close Session: 0x13983fe177d0008 closed
[junit4:junit4]   2> 34490 T2143 oaz.ClientCnxn$SendThread.run WARNING Session 0x13983fe177d0009 for server 127.0.0.1/127.0.0.1:53619, unexpected error, closing socket connection and attempting reconnect java.nio.channels.CancelledKeyException
[junit4:junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:55)
[junit4:junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:64)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.primeConnection(ClientCnxn.java:993)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1146)
[junit4:junit4]   2> 
[junit4:junit4]   2> 34490 T2125 oasc.LeaderElectionTest$ClientThread.run SEVERE setup failed java.lang.InterruptedException
[junit4:junit4]   2> 	at java.lang.Object.wait(Native Method)
[junit4:junit4]   2> 	at java.lang.Object.wait(Object.java:485)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1345)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:810)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:211)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:483)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:443)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:424)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:94)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:159)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:103)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:263)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElectionTest$ClientThread.setupOnConnect(LeaderElectionTest.java:117)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElectionTest$ClientThread.run(LeaderElectionTest.java:125)
[junit4:junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4:junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:98)
[junit4:junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:206)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 
[junit4:junit4]   2> 34593 T2144 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 34592 T2125 oaz.ZooKeeper.close Session: 0x13983fe177d0009 closed
[junit4:junit4]   2> 41697 T2106 oazs.ZooKeeperServer.expire Expiring session 0x13983fe177d0008, timeout of 20000ms exceeded
[junit4:junit4]   2> 41697 T2106 oazs.ZooKeeperServer.expire Expiring session 0x13983fe177d0009, timeout of 20000ms exceeded
[junit4:junit4]   2> 41697 T2108 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fe177d0008
[junit4:junit4]   2> 41697 T2108 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fe177d0009
[junit4:junit4]   2> 53397 T2108 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13983fe177d0002
[junit4:junit4]   2> 53398 T2114 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 53398 T2025 oaz.ZooKeeper.close Session: 0x13983fe177d0002 closed
[junit4:junit4]   2> 53399 T2105 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13983fe177d0002, likely client has closed socket
[junit4:junit4]   2> 53399 T2108 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 53400 T2105 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53628 which had sessionid 0x13983fe177d0002
[junit4:junit4]   2> 53400 T2107 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 53400 T2025 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 53511 T2106 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 55179 T2105 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 55180 T2025 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 55180 T2025 oas.SolrTestCaseJ4.tearDown ###Ending testStressElection
[junit4:junit4]   1> / (2)
[junit4:junit4]   1>  /overseer (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1>   /overseer/queue (1)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       
[junit4:junit4]   1>    /overseer/queue/qn-0000000000 (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {
[junit4:junit4]   1>          "operation":"leader",
[junit4:junit4]   1>          "shard":"shard1",
[junit4:junit4]   1>          "state":"active",
[junit4:junit4]   1>          "core":"",
[junit4:junit4]   1>          "collection":"collection1",
[junit4:junit4]   1>          "base_url":"0"}
[junit4:junit4]   1>  /collections (1)
[junit4:junit4]   1>   /collections/collection1 (2)
[junit4:junit4]   1>    /collections/collection1/leader_elect (1)
[junit4:junit4]   1>     /collections/collection1/leader_elect/shard1 (1)
[junit4:junit4]   1>      /collections/collection1/leader_elect/shard1/election (0)
[junit4:junit4]   1>    /collections/collection1/leaders (0)
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=LeaderElectionTest -Dtests.method=testStressElection -Dtests.seed=C89F89B9944E2B69 -Dtests.slow=true -Dtests.locale=en_CA -Dtests.timezone=MET -Dtests.file.encoding=Cp1252
[junit4:junit4] ERROR   36.4s | LeaderElectionTest.testStressElection <<<
[junit4:junit4]    > Throwable #1: java.lang.RuntimeException: Could not get leader props
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([C89F89B9944E2B69:37C95D17F3003A7A]:0)
[junit4:junit4]    > 	at org.apache.solr.cloud.LeaderElectionTest.getLeaderUrl(LeaderElectionTest.java:226)
[junit4:junit4]    > 	at org.apache.solr.cloud.LeaderElectionTest.getLeaderThread(LeaderElectionTest.java:326)
[junit4:junit4]    > 	at org.apache.solr.cloud.LeaderElectionTest.testStressElection(LeaderElectionTest.java:435)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:597)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:345)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:769)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:429)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:40)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:345)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 55210 T2025 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 55228 T2024 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 4 leaked thread(s).
[junit4:junit4]   2> 75242 T2024 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 4 threads leaked from SUITE scope at org.apache.solr.cloud.LeaderElectionTest: 
[junit4:junit4]   2> 	   1) Thread[id=2151, name=Thread-724, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]   2> 	        at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2> 	        at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
[junit4:junit4]   2> 	   2) Thread[id=2150, name=Thread-723, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]   2> 	        at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2> 	        at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
[junit4:junit4]   2> 	   3) Thread[id=2153, name=Thread-726, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]   2> 	        at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2> 	        at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
[junit4:junit4]   2> 	   4) Thread[id=2152, name=Thread-725, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]   2> 	        at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2> 	        at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
[junit4:junit4]   2> 75243 T2024 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
[junit4:junit4]   2> 	   1) Thread[id=2151, name=Thread-724, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]   2> 	   2) Thread[id=2150, name=Thread-723, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]   2> 	   3) Thread[id=2153, name=Thread-726, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]   2> 	   4) Thread[id=2152, name=Thread-725, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]   2> 75244 T2024 ccr.ThreadLeakControl.tryToInterruptAll All leaked threads terminated.
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {}, sim=DefaultSimilarity, locale=en_CA, timezone=MET
[junit4:junit4]   2> NOTE: Windows 7 6.1 amd64/Sun Microsystems Inc. 1.6.0_35 (64-bit)/cpus=2,threads=1,free=38948384,total=118751232
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestXIncludeConfig, NumericFieldsTest, TestCharFilters, TestSolrXMLSerializer, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, TestSurroundQueryParser, RecoveryZkTest, TestFiltering, BinaryUpdateRequestHandlerTest, TestSolrJ, PingRequestHandlerTest, TestExtendedDismaxParser, CSVRequestHandlerTest, SortByFunctionTest, TestIndexSearcher, ZkControllerTest, SuggesterTest, UUIDFieldTest, TestSearchPerf, TestFoldingMultitermQuery, ZkSolrClientTest, TestRealTimeGet, QueryElevationComponentTest, TestSuggestSpellingConverter, DistanceFunctionTest, ResourceLoaderTest, ClusterStateUpdateTest, SampleTest, TestFaceting, TestMultiCoreConfBootstrap, QueryParsingTest, QueryEqualityTest, TestCodecSupport, SpellCheckComponentTest, MinimalSchemaTest, TestUpdate, DistributedQueryElevationComponentTest, PreAnalyzedFieldTest, ZkCLITest, TestFunctionQuery, TestWriterPerf, OverseerTest, WordBreakSolrSpellCheckerTest, SolrRequestParserTest, DocumentAnalysisRequestHandlerTest, TestReload, TestArbitraryIndexDir, TestRemoteStreaming, StatsComponentTest, JsonLoaderTest, ShowFileRequestHandlerTest, BasicZkTest, PrimitiveFieldTypeTest, ConvertedLegacyTest, DOMUtilTest, TestPhraseSuggestions, TestNumberUtils, SignatureUpdateProcessorFactoryTest, OutputWriterTest, TestDFRSimilarityFactory, ClusterStateTest, TestReplicationHandler, TestPerFieldSimilarity, TestCoreContainer, TimeZoneUtilsTest, TestJmxMonitoredMap, BadComponentTest, PrimUtilsTest, CoreAdminHandlerTest, TestStressReorder, AnalysisAfterCoreReloadTest, CopyFieldTest, TestIndexingPerformance, SolrInfoMBeanTest, TestSort, TestLRUCache, TestLMJelinekMercerSimilarityFactory, SolrCmdDistributorTest, TestOmitPositions, TestPropInjectDefaults, FullSolrCloudDistribCmdsTest, SpellPossibilityIteratorTest, NoCacheHeaderTest, RequiredFieldsTest, RequestHandlersTest, SolrPluginUtilsTest, TestGroupingSearch, TestPluginEnable, PathHierarchyTokenizerFactoryTest, URLClassifyProcessorTest, MultiTermTest, TestQueryTypes, TestUtils, SuggesterFSTTest, OpenExchangeRatesOrgProviderTest, LeaderElectionIntegrationTest, IndexSchemaRuntimeFieldTest, FileBasedSpellCheckerTest, TestCollationField, StandardRequestHandlerTest, SpellCheckCollatorTest, SolrIndexConfigTest, SystemInfoHandlerTest, DisMaxRequestHandlerTest, BasicDistributedZkTest, LeaderElectionTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=LeaderElectionTest -Dtests.seed=C89F89B9944E2B69 -Dtests.slow=true -Dtests.locale=en_CA -Dtests.timezone=MET -Dtests.file.encoding=Cp1252
[junit4:junit4] ERROR   0.00s | LeaderElectionTest (suite) <<<
[junit4:junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE scope at org.apache.solr.cloud.LeaderElectionTest: 
[junit4:junit4]    >    1) Thread[id=2151, name=Thread-724, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
[junit4:junit4]    >    2) Thread[id=2150, name=Thread-723, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
[junit4:junit4]    >    3) Thread[id=2153, name=Thread-726, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
[junit4:junit4]    >    4) Thread[id=2152, name=Thread-725, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([C89F89B9944E2B69]:0)
[junit4:junit4] Completed in 75.27s, 4 tests, 2 errors <<< FAILURES!

[...truncated 353 lines...]
BUILD FAILED
C:\Jenkins\workspace\Lucene-Solr-4.x-Windows\build.xml:29: The following error occurred while executing this line:
C:\Jenkins\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:144: The following error occurred while executing this line:
C:\Jenkins\workspace\Lucene-Solr-4.x-Windows\lucene\module-build.xml:62: The following error occurred while executing this line:
C:\Jenkins\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1056: The following error occurred while executing this line:
C:\Jenkins\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:741: There were test failures: 228 suites, 910 tests, 1 suite-level error, 1 error, 11 ignored (6 assumptions)

Total time: 38 minutes 59 seconds
Build step 'Invoke Ant' marked build as failure
Recording test results
Description set: Java: 64bit/jdk1.6.0_35 -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message