lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@sd-datasolutions.de>
Subject [JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.7.0_07) - Build # 584 - Failure!
Date Sun, 02 Sep 2012 22:01:41 GMT
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-Windows/584/
Java: 32bit/jdk1.7.0_07 -server -XX:+UseConcMarkSweepGC

2 tests failed.
REGRESSION:  org.apache.solr.cloud.LeaderElectionTest.testStressElection

Error Message:
Could not get leader props

Stack Trace:
java.lang.RuntimeException: Could not get leader props
	at __randomizedtesting.SeedInfo.seed([C2DD9467D63AD772:3D8B40C9B174C661]:0)
	at org.apache.solr.cloud.LeaderElectionTest.getLeaderUrl(LeaderElectionTest.java:226)
	at org.apache.solr.cloud.LeaderElectionTest.getLeaderThread(LeaderElectionTest.java:326)
	at org.apache.solr.cloud.LeaderElectionTest.testStressElection(LeaderElectionTest.java:435)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:345)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:769)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:429)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:40)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:345)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.LeaderElectionTest

Error Message:
4 threads leaked from SUITE scope at org.apache.solr.cloud.LeaderElectionTest:     1) Thread[id=923, name=Thread-405, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)    2) Thread[id=927, name=Thread-409, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)    3) Thread[id=928, name=Thread-410, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)    4) Thread[id=925, name=Thread-407, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE scope at org.apache.solr.cloud.LeaderElectionTest: 
   1) Thread[id=923, name=Thread-405, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
   2) Thread[id=927, name=Thread-409, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
   3) Thread[id=928, name=Thread-410, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
   4) Thread[id=925, name=Thread-407, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
	at __randomizedtesting.SeedInfo.seed([C2DD9467D63AD772]:0)




Build Log:
[...truncated 6764 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.LeaderElectionTest
[junit4:junit4]   2> Creating dataDir: C:\Jenkins\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-LeaderElectionTest-1346622287826
[junit4:junit4]   2> 4 T819 oas.SolrTestCaseJ4.setUp ###Starting testCancelElection
[junit4:junit4]   2> 4 T819 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 8 T820 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 9 T820 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 10 T820 oazsp.FileTxnSnapLog.save Snapshotting: 0
[junit4:junit4]   2> 104 T819 oasc.ZkTestServer.run start zk server on port:62805
[junit4:junit4]   2> 104 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62805 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1035de6
[junit4:junit4]   2> 105 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 105 T825 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62805
[junit4:junit4]   2> 107 T825 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62805, initiating session
[junit4:junit4]   2> 107 T821 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62808
[junit4:junit4]   2> 107 T821 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62808
[junit4:junit4]   2> 108 T823 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 111 T823 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f16fdd0000 with negotiated timeout 10000 for client /127.0.0.1:62808
[junit4:junit4]   2> 111 T825 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62805, sessionid = 0x13988f16fdd0000, negotiated timeout = 10000
[junit4:junit4]   2> 112 T826 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1035de6 name:ZooKeeperConnection Watcher:127.0.0.1:62805 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 112 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 113 T824 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f16fdd0000
[junit4:junit4]   2> 115 T821 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62808 which had sessionid 0x13988f16fdd0000
[junit4:junit4]   2> 115 T819 oaz.ZooKeeper.close Session: 0x13988f16fdd0000 closed
[junit4:junit4]   2> 115 T826 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 116 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62805 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f716e7
[junit4:junit4]   2> 117 T827 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62805
[junit4:junit4]   2> 117 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 119 T827 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62805, initiating session
[junit4:junit4]   2> 119 T821 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62811
[junit4:junit4]   2> 119 T821 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62811
[junit4:junit4]   2> 121 T823 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f16fdd0001 with negotiated timeout 10000 for client /127.0.0.1:62811
[junit4:junit4]   2> 121 T827 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62805, sessionid = 0x13988f16fdd0001, negotiated timeout = 10000
[junit4:junit4]   2> 122 T828 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f716e7 name:ZooKeeperConnection Watcher:127.0.0.1:62805 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 122 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 122 T819 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 126 T824 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f16fdd0001
[junit4:junit4]   2> 127 T821 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f16fdd0001, likely client has closed socket
[junit4:junit4]   2> 127 T828 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 127 T819 oaz.ZooKeeper.close Session: 0x13988f16fdd0001 closed
[junit4:junit4]   2> 128 T821 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62811 which had sessionid 0x13988f16fdd0001
[junit4:junit4]   2> 128 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62805/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c9aa0b
[junit4:junit4]   2> 130 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 130 T829 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62805
[junit4:junit4]   2> 132 T829 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62805, initiating session
[junit4:junit4]   2> 132 T821 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62814
[junit4:junit4]   2> 132 T821 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62814
[junit4:junit4]   2> 134 T823 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f16fdd0002 with negotiated timeout 20000 for client /127.0.0.1:62814
[junit4:junit4]   2> 134 T829 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62805, sessionid = 0x13988f16fdd0002, negotiated timeout = 20000
[junit4:junit4]   2> 134 T830 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c9aa0b name:ZooKeeperConnection Watcher:127.0.0.1:62805/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 134 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 135 T819 oascc.SolrZkClient.makePath makePath: /collections/collection2/leader_elect/slice1/election
[junit4:junit4]   2> 149 T824 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f16fdd0002 type:delete cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection2/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection2/leaders
[junit4:junit4]   2> 640 T819 oascc.SolrZkClient.makePath makePath: /collections/collection2/leaders/slice1
[junit4:junit4]   2> 648 T824 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f16fdd0002 type:create cxid:0x18 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 3246 T830 oascc.SolrZkClient.makePath makePath: /collections/collection2/leaders/slice1
[junit4:junit4]   2> 3252 T824 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f16fdd0002 type:create cxid:0x2a zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3783 T824 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f16fdd0002
[junit4:junit4]   2> 3785 T821 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f16fdd0002, likely client has closed socket
[junit4:junit4]   2> 3785 T819 oaz.ZooKeeper.close Session: 0x13988f16fdd0002 closed
[junit4:junit4]   2> 3785 T830 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3786 T824 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 3786 T823 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 3786 T821 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62814 which had sessionid 0x13988f16fdd0002
[junit4:junit4]   2> 3790 T819 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 4246 T822 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 6218 T821 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 6219 T819 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 6219 T819 oas.SolrTestCaseJ4.tearDown ###Ending testCancelElection
[junit4:junit4]   2> 6224 T819 oas.SolrTestCaseJ4.setUp ###Starting testElection
[junit4:junit4]   2> 6224 T819 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 6225 T831 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 6226 T831 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 6228 T831 oazsp.FileSnap.deserialize Reading snapshot C:\Jenkins\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-LeaderElectionTest-1346622287826\zookeeper\server1\data\version-2\snapshot.0
[junit4:junit4]   2> 6229 T831 oazsp.FileTxnSnapLog.save Snapshotting: 1a
[junit4:junit4]   2> 6332 T819 oasc.ZkTestServer.run start zk server on port:62817
[junit4:junit4]   2> 6332 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62817 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@55c8ca
[junit4:junit4]   2> 6334 T836 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62817
[junit4:junit4]   2> 6334 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6335 T836 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62817, initiating session
[junit4:junit4]   2> 6335 T832 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62820
[junit4:junit4]   2> 6336 T832 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62820
[junit4:junit4]   2> 6336 T834 oazsp.FileTxnLog.append Creating new log file: log.1b
[junit4:junit4]   2> 6340 T834 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1882a0000 with negotiated timeout 10000 for client /127.0.0.1:62820
[junit4:junit4]   2> 6340 T836 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62817, sessionid = 0x13988f1882a0000, negotiated timeout = 10000
[junit4:junit4]   2> 6340 T837 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55c8ca name:ZooKeeperConnection Watcher:127.0.0.1:62817 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6340 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6371 T835 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1882a0000
[junit4:junit4]   2> 6373 T819 oaz.ZooKeeper.close Session: 0x13988f1882a0000 closed
[junit4:junit4]   2> 6373 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62817 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@17aa781
[junit4:junit4]   2> 6373 T832 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1882a0000, likely client has closed socket
[junit4:junit4]   2> 6374 T832 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62820 which had sessionid 0x13988f1882a0000
[junit4:junit4]   2> 6374 T837 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6375 T838 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62817
[junit4:junit4]   2> 6375 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6377 T838 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62817, initiating session
[junit4:junit4]   2> 6377 T832 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62823
[junit4:junit4]   2> 6378 T832 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62823
[junit4:junit4]   2> 6380 T834 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1882a0001 with negotiated timeout 10000 for client /127.0.0.1:62823
[junit4:junit4]   2> 6380 T838 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62817, sessionid = 0x13988f1882a0001, negotiated timeout = 10000
[junit4:junit4]   2> 6382 T839 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17aa781 name:ZooKeeperConnection Watcher:127.0.0.1:62817 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6382 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6382 T819 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 6386 T835 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1882a0001
[junit4:junit4]   2> 6388 T819 oaz.ZooKeeper.close Session: 0x13988f1882a0001 closed
[junit4:junit4]   2> 6388 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62817/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@176214a
[junit4:junit4]   2> 6389 T832 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1882a0001, likely client has closed socket
[junit4:junit4]   2> 6389 T832 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62823 which had sessionid 0x13988f1882a0001
[junit4:junit4]   2> 6389 T839 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6389 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6391 T840 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62817
[junit4:junit4]   2> 6393 T840 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62817, initiating session
[junit4:junit4]   2> 6393 T832 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62826
[junit4:junit4]   2> 6393 T832 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62826
[junit4:junit4]   2> 6395 T834 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1882a0002 with negotiated timeout 20000 for client /127.0.0.1:62826
[junit4:junit4]   2> 6396 T840 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62817, sessionid = 0x13988f1882a0002, negotiated timeout = 20000
[junit4:junit4]   2> 6396 T841 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@176214a name:ZooKeeperConnection Watcher:127.0.0.1:62817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6396 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6398 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62817/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1d0bf3e
[junit4:junit4]   2> 6399 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6400 T843 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62817
[junit4:junit4]   2> 6403 T843 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62817, initiating session
[junit4:junit4]   2> 6403 T832 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62829
[junit4:junit4]   2> 6404 T832 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62829
[junit4:junit4]   2> 6406 T834 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1882a0003 with negotiated timeout 20000 for client /127.0.0.1:62829
[junit4:junit4]   2> 6406 T843 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62817, sessionid = 0x13988f1882a0003, negotiated timeout = 20000
[junit4:junit4]   2> 6407 T844 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d0bf3e name:ZooKeeperConnection Watcher:127.0.0.1:62817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6407 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6408 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62817/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@c56cbd
[junit4:junit4]   2> 6409 T846 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62817
[junit4:junit4]   2> 6409 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6411 T846 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62817, initiating session
[junit4:junit4]   2> 6411 T832 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62832
[junit4:junit4]   2> 6412 T832 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62832
[junit4:junit4]   2> 6414 T834 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1882a0004 with negotiated timeout 20000 for client /127.0.0.1:62832
[junit4:junit4]   2> 6414 T846 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62817, sessionid = 0x13988f1882a0004, negotiated timeout = 20000
[junit4:junit4]   2> 6414 T847 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c56cbd name:ZooKeeperConnection Watcher:127.0.0.1:62817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6415 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6415 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62817/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@17551c5
[junit4:junit4]   2> 6416 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6416 T849 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62817
[junit4:junit4]   2> 6418 T849 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62817, initiating session
[junit4:junit4]   2> 6418 T832 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62835
[junit4:junit4]   2> 6419 T832 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62835
[junit4:junit4]   2> 6422 T834 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1882a0005 with negotiated timeout 20000 for client /127.0.0.1:62835
[junit4:junit4]   2> 6422 T849 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62817, sessionid = 0x13988f1882a0005, negotiated timeout = 20000
[junit4:junit4]   2> 6422 T850 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17551c5 name:ZooKeeperConnection Watcher:127.0.0.1:62817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6422 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6423 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62817/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@388104
[junit4:junit4]   2> 6424 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6424 T852 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62817
[junit4:junit4]   2> 6426 T852 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62817, initiating session
[junit4:junit4]   2> 6426 T832 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62838
[junit4:junit4]   2> 6426 T832 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62838
[junit4:junit4]   2> 6428 T834 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1882a0006 with negotiated timeout 20000 for client /127.0.0.1:62838
[junit4:junit4]   2> 6428 T852 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62817, sessionid = 0x13988f1882a0006, negotiated timeout = 20000
[junit4:junit4]   2> 6428 T853 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@388104 name:ZooKeeperConnection Watcher:127.0.0.1:62817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6429 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6429 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62817/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@dc830a
[junit4:junit4]   2> 6430 T855 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62817
[junit4:junit4]   2> 6430 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6432 T855 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62817, initiating session
[junit4:junit4]   2> 6432 T832 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62841
[junit4:junit4]   2> 6432 T832 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62841
[junit4:junit4]   2> 6434 T834 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1882a0007 with negotiated timeout 20000 for client /127.0.0.1:62841
[junit4:junit4]   2> 6434 T855 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62817, sessionid = 0x13988f1882a0007, negotiated timeout = 20000
[junit4:junit4]   2> 6434 T856 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@dc830a name:ZooKeeperConnection Watcher:127.0.0.1:62817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6435 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6435 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62817/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@15ec8c8
[junit4:junit4]   2> 6436 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6436 T858 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62817
[junit4:junit4]   2> 6438 T858 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62817, initiating session
[junit4:junit4]   2> 6438 T832 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62844
[junit4:junit4]   2> 6439 T832 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62844
[junit4:junit4]   2> 6440 T834 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1882a0008 with negotiated timeout 20000 for client /127.0.0.1:62844
[junit4:junit4]   2> 6442 T858 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62817, sessionid = 0x13988f1882a0008, negotiated timeout = 20000
[junit4:junit4]   2> 6442 T859 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15ec8c8 name:ZooKeeperConnection Watcher:127.0.0.1:62817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6442 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6443 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62817/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@9f8e49
[junit4:junit4]   2> 6444 T861 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62817
[junit4:junit4]   2> 6444 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6445 T861 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62817, initiating session
[junit4:junit4]   2> 6445 T832 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62847
[junit4:junit4]   2> 6446 T832 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62847
[junit4:junit4]   2> 6448 T834 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1882a0009 with negotiated timeout 20000 for client /127.0.0.1:62847
[junit4:junit4]   2> 6448 T861 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62817, sessionid = 0x13988f1882a0009, negotiated timeout = 20000
[junit4:junit4]   2> 6448 T862 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9f8e49 name:ZooKeeperConnection Watcher:127.0.0.1:62817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6449 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6449 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62817/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@161ba58
[junit4:junit4]   2> 6450 T864 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62817
[junit4:junit4]   2> 6450 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6452 T864 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62817, initiating session
[junit4:junit4]   2> 6452 T832 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62850
[junit4:junit4]   2> 6452 T832 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62850
[junit4:junit4]   2> 6454 T834 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1882a000a with negotiated timeout 20000 for client /127.0.0.1:62850
[junit4:junit4]   2> 6454 T864 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62817, sessionid = 0x13988f1882a000a, negotiated timeout = 20000
[junit4:junit4]   2> 6454 T865 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@161ba58 name:ZooKeeperConnection Watcher:127.0.0.1:62817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6455 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6455 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62817/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1723ab4
[junit4:junit4]   2> 6456 T867 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62817
[junit4:junit4]   2> 6456 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6458 T867 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62817, initiating session
[junit4:junit4]   2> 6458 T832 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62853
[junit4:junit4]   2> 6458 T832 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62853
[junit4:junit4]   2> 6460 T834 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1882a000b with negotiated timeout 20000 for client /127.0.0.1:62853
[junit4:junit4]   2> 6460 T867 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62817, sessionid = 0x13988f1882a000b, negotiated timeout = 20000
[junit4:junit4]   2> 6462 T868 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1723ab4 name:ZooKeeperConnection Watcher:127.0.0.1:62817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6462 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6462 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62817/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@490389
[junit4:junit4]   2> 6463 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6463 T870 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62817
[junit4:junit4]   2> 6465 T870 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62817, initiating session
[junit4:junit4]   2> 6465 T832 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62856
[junit4:junit4]   2> 6465 T832 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62856
[junit4:junit4]   2> 6467 T834 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1882a000c with negotiated timeout 20000 for client /127.0.0.1:62856
[junit4:junit4]   2> 6467 T870 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62817, sessionid = 0x13988f1882a000c, negotiated timeout = 20000
[junit4:junit4]   2> 6468 T871 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@490389 name:ZooKeeperConnection Watcher:127.0.0.1:62817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6468 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6468 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62817/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1de265a
[junit4:junit4]   2> 6469 T873 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62817
[junit4:junit4]   2> 6469 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6471 T873 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62817, initiating session
[junit4:junit4]   2> 6471 T832 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62859
[junit4:junit4]   2> 6471 T832 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62859
[junit4:junit4]   2> 6473 T834 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1882a000d with negotiated timeout 20000 for client /127.0.0.1:62859
[junit4:junit4]   2> 6473 T873 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62817, sessionid = 0x13988f1882a000d, negotiated timeout = 20000
[junit4:junit4]   2> 6473 T874 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1de265a name:ZooKeeperConnection Watcher:127.0.0.1:62817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6474 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6474 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62817/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@8aa547
[junit4:junit4]   2> 6475 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6475 T876 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62817
[junit4:junit4]   2> 6477 T876 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62817, initiating session
[junit4:junit4]   2> 6477 T832 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62862
[junit4:junit4]   2> 6477 T832 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62862
[junit4:junit4]   2> 6479 T834 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1882a000e with negotiated timeout 20000 for client /127.0.0.1:62862
[junit4:junit4]   2> 6479 T876 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62817, sessionid = 0x13988f1882a000e, negotiated timeout = 20000
[junit4:junit4]   2> 6479 T877 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8aa547 name:ZooKeeperConnection Watcher:127.0.0.1:62817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6480 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6480 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62817/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@135efa8
[junit4:junit4]   2> 6483 T879 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62817
[junit4:junit4]   2> 6483 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6484 T879 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62817, initiating session
[junit4:junit4]   2> 6484 T832 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62865
[junit4:junit4]   2> 6485 T832 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62865
[junit4:junit4]   2> 6487 T834 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1882a000f with negotiated timeout 20000 for client /127.0.0.1:62865
[junit4:junit4]   2> 6487 T879 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62817, sessionid = 0x13988f1882a000f, negotiated timeout = 20000
[junit4:junit4]   2> 6488 T880 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@135efa8 name:ZooKeeperConnection Watcher:127.0.0.1:62817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6488 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6488 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62817/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@ffda1e
[junit4:junit4]   2> 6489 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6490 T882 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62817
[junit4:junit4]   2> 6491 T882 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62817, initiating session
[junit4:junit4]   2> 6491 T832 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62868
[junit4:junit4]   2> 6492 T832 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62868
[junit4:junit4]   2> 6494 T834 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1882a0010 with negotiated timeout 20000 for client /127.0.0.1:62868
[junit4:junit4]   2> 6494 T882 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62817, sessionid = 0x13988f1882a0010, negotiated timeout = 20000
[junit4:junit4]   2> 6494 T883 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ffda1e name:ZooKeeperConnection Watcher:127.0.0.1:62817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6494 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6495 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62817/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1be29da
[junit4:junit4]   2> 6496 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6496 T885 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62817
[junit4:junit4]   2> 6497 T885 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62817, initiating session
[junit4:junit4]   2> 6498 T832 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62871
[junit4:junit4]   2> 6499 T832 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62871
[junit4:junit4]   2> 6502 T885 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62817, sessionid = 0x13988f1882a0011, negotiated timeout = 20000
[junit4:junit4]   2> 6503 T834 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1882a0011 with negotiated timeout 20000 for client /127.0.0.1:62871
[junit4:junit4]   2> 6503 T886 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1be29da name:ZooKeeperConnection Watcher:127.0.0.1:62817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6503 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6517 T845 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6517 T851 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6518 T857 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6519 T863 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6520 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0006 type:create cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections Error:KeeperErrorCode = NodeExists for /solr/collections
[junit4:junit4]   2> 6522 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0008 type:create cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections Error:KeeperErrorCode = NodeExists for /solr/collections
[junit4:junit4]   2> 6522 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a000a type:create cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections Error:KeeperErrorCode = NodeExists for /solr/collections
[junit4:junit4]   2> 6522 T842 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6524 T848 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6527 T881 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6527 T875 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6527 T878 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6527 T872 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6529 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0006 type:create cxid:0x5 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1
[junit4:junit4]   2> 6529 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a000a type:create cxid:0x5 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1
[junit4:junit4]   2> 6530 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0008 type:create cxid:0x5 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1
[junit4:junit4]   2> 6532 T860 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6532 T869 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6534 T854 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6536 T884 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6536 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0006 type:create cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect
[junit4:junit4]   2> 6536 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a000a type:create cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect
[junit4:junit4]   2> 6536 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0003 type:create cxid:0x5 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect
[junit4:junit4]   2> 6537 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0005 type:create cxid:0x5 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect
[junit4:junit4]   2> 6536 T866 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6537 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0008 type:create cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect
[junit4:junit4]   2> 6544 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a000e type:create cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1
[junit4:junit4]   2> 6544 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0006 type:create cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1
[junit4:junit4]   2> 6544 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0010 type:create cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1
[junit4:junit4]   2> 6545 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a000a type:create cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1
[junit4:junit4]   2> 6545 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0003 type:create cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1
[junit4:junit4]   2> 6545 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a000f type:create cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1
[junit4:junit4]   2> 6545 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0005 type:create cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1
[junit4:junit4]   2> 6547 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0008 type:create cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1
[junit4:junit4]   2> 6547 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a000d type:create cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1 Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1
[junit4:junit4]   2> 6552 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0004 type:create cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6552 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0010 type:create cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6553 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0006 type:create cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6553 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a000c type:create cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6553 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a000a type:create cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6554 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a000f type:create cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6554 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0003 type:create cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6554 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0008 type:create cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6554 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0009 type:create cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6557 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0005 type:create cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6558 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a000d type:create cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6558 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0011 type:create cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6558 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0007 type:create cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6564 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a000b type:create cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6569 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0004 type:delete cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 7112 T845 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 7121 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0004 type:create cxid:0x17 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 7168 T835 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1882a0004
[junit4:junit4]   2> 7170 T819 oaz.ZooKeeper.close Session: 0x13988f1882a0004 closed
[junit4:junit4]   2> 7170 T832 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1882a0004, likely client has closed socket
[junit4:junit4]   2> 7170 T847 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 7171 T832 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62832 which had sessionid 0x13988f1882a0004
[junit4:junit4]   2> 7172 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0010 type:delete cxid:0xd zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4]   2> 7712 T883 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 7718 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0010 type:create cxid:0x14 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8253 T835 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1882a000c
[junit4:junit4]   2> 8255 T819 oaz.ZooKeeper.close Session: 0x13988f1882a000c closed
[junit4:junit4]   2> 8257 T832 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1882a000c, likely client has closed socket
[junit4:junit4]   2> 8257 T871 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8257 T832 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62856 which had sessionid 0x13988f1882a000c
[junit4:junit4]   2> 8259 T835 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1882a0010
[junit4:junit4]   2> 8260 T832 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62868 which had sessionid 0x13988f1882a0010
[junit4:junit4]   2> 8260 T819 oaz.ZooKeeper.close Session: 0x13988f1882a0010 closed
[junit4:junit4]   2> 8261 T883 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8262 T835 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1882a000a
[junit4:junit4]   2> 8264 T819 oaz.ZooKeeper.close Session: 0x13988f1882a000a closed
[junit4:junit4]   2> 8264 T832 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1882a000a, likely client has closed socket
[junit4:junit4]   2> 8264 T865 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8264 T832 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62850 which had sessionid 0x13988f1882a000a
[junit4:junit4]   2> 8265 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0006 type:delete cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4]   2> 8806 T853 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 8815 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0006 type:create cxid:0x17 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9345 T835 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1882a000f
[junit4:junit4]   2> 9347 T832 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62865 which had sessionid 0x13988f1882a000f
[junit4:junit4]   2> 9347 T880 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 9347 T819 oaz.ZooKeeper.close Session: 0x13988f1882a000f closed
[junit4:junit4]   2> 9348 T835 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1882a0006
[junit4:junit4]   2> 9350 T819 oaz.ZooKeeper.close Session: 0x13988f1882a0006 closed
[junit4:junit4]   2> 9350 T853 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 9350 T832 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1882a0006, likely client has closed socket
[junit4:junit4]   2> 9351 T832 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62838 which had sessionid 0x13988f1882a0006
[junit4:junit4]   2> 9351 T844 oasc.SolrException.log SEVERE Failed setting watch:org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leader_elect/shard1/election/88252238663385094-3-n_0000000002
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:102)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:301)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:298)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:298)
[junit4:junit4]   2> 		at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:120)
[junit4:junit4]   2> 		at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> 		at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:132)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 9354 T835 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1882a0003
[junit4:junit4]   2> 9355 T819 oaz.ZooKeeper.close Session: 0x13988f1882a0003 closed
[junit4:junit4]   2> 9355 T832 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1882a0003, likely client has closed socket
[junit4:junit4]   2> 9356 T832 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62829 which had sessionid 0x13988f1882a0003
[junit4:junit4]   2> 9356 T835 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1882a0008
[junit4:junit4]   2> 9358 T819 oaz.ZooKeeper.close Session: 0x13988f1882a0008 closed
[junit4:junit4]   2> 9358 T832 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1882a0008, likely client has closed socket
[junit4:junit4]   2> 9359 T832 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62844 which had sessionid 0x13988f1882a0008
[junit4:junit4]   2> 9359 T835 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1882a000e
[junit4:junit4]   2> 9361 T819 oaz.ZooKeeper.close Session: 0x13988f1882a000e closed
[junit4:junit4]   2> 9361 T832 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1882a000e, likely client has closed socket
[junit4:junit4]   2> 9361 T832 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62862 which had sessionid 0x13988f1882a000e
[junit4:junit4]   2> 9362 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0009 type:delete cxid:0xc zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4]   2> 9903 T862 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 9908 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a0009 type:create cxid:0x13 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10432 T844 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:278)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:275)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:275)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:151)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:132)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 10432 T844 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 10442 T835 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1882a0005
[junit4:junit4]   2> 10444 T819 oaz.ZooKeeper.close Session: 0x13988f1882a0005 closed
[junit4:junit4]   2> 10444 T832 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62835 which had sessionid 0x13988f1882a0005
[junit4:junit4]   2> 10444 T850 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 10446 T835 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1882a0007
[junit4:junit4]   2> 10448 T819 oaz.ZooKeeper.close Session: 0x13988f1882a0007 closed
[junit4:junit4]   2> 10448 T832 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1882a0007, likely client has closed socket
[junit4:junit4]   2> 10448 T856 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 10448 T832 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62841 which had sessionid 0x13988f1882a0007
[junit4:junit4]   2> 10451 T835 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1882a0009
[junit4:junit4]   2> 10453 T819 oaz.ZooKeeper.close Session: 0x13988f1882a0009 closed
[junit4:junit4]   2> 10453 T832 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1882a0009, likely client has closed socket
[junit4:junit4]   2> 10453 T862 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 10453 T832 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62847 which had sessionid 0x13988f1882a0009
[junit4:junit4]   2> 10456 T835 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1882a000b
[junit4:junit4]   2> 10456 T835 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1882a000d type:delete cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4]   2> 10458 T832 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1882a000b, likely client has closed socket
[junit4:junit4]   2> 10458 T819 oaz.ZooKeeper.close Session: 0x13988f1882a000b closed
[junit4:junit4]   2> 10458 T832 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62853 which had sessionid 0x13988f1882a000b
[junit4:junit4]   2> 10458 T868 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 10459 T835 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1882a000d
[junit4:junit4]   2> 10462 T832 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1882a000d, likely client has closed socket
[junit4:junit4]   2> 10461 T819 oaz.ZooKeeper.close Session: 0x13988f1882a000d closed
[junit4:junit4]   2> 10462 T832 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62859 which had sessionid 0x13988f1882a000d
[junit4:junit4]   2> 10463 T835 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1882a0011
[junit4:junit4]   2> 10465 T832 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1882a0011, likely client has closed socket
[junit4:junit4]   2> 10465 T819 oaz.ZooKeeper.close Session: 0x13988f1882a0011 closed
[junit4:junit4]   2> 10465 T832 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62871 which had sessionid 0x13988f1882a0011
[junit4:junit4]   2> 10466 T835 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1882a0002
[junit4:junit4]   2> 10468 T832 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1882a0002, likely client has closed socket
[junit4:junit4]   2> 10468 T841 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 10468 T819 oaz.ZooKeeper.close Session: 0x13988f1882a0002 closed
[junit4:junit4]   2> 10468 T832 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62826 which had sessionid 0x13988f1882a0002
[junit4:junit4]   2> 10470 T834 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 10470 T835 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 10471 T819 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 10973 T859 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 12874 T859 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:815)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:211)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:483)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:443)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:424)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:94)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:159)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:103)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:132)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 12081 T886 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 11248 T833 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 10999 T874 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 12876 T874 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:815)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:211)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:483)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:443)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:424)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:94)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:159)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:103)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:132)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 12876 T874 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 10976 T877 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 12878 T877 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:815)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:211)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:483)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:443)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:424)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:94)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:159)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:103)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:132)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 12878 T877 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 12876 T886 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:815)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:211)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:483)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:443)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:424)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:94)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:159)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:103)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:132)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 12879 T886 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 12876 T859 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 12876 T832 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 12880 T819 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 12880 T819 oas.SolrTestCaseJ4.tearDown ###Ending testElection
[junit4:junit4]   2> 12884 T819 oas.SolrTestCaseJ4.setUp ###Starting testStressElection
[junit4:junit4]   2> 12884 T819 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 12885 T887 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 12886 T887 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 12887 T887 oazsp.FileSnap.deserialize Reading snapshot C:\Jenkins\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-LeaderElectionTest-1346622287826\zookeeper\server1\data\version-2\snapshot.1a
[junit4:junit4]   2> 12890 T887 oazsp.FileTxnSnapLog.save Snapshotting: 94
[junit4:junit4]   2> 12985 T819 oasc.ZkTestServer.run start zk server on port:62874
[junit4:junit4]   2> 12985 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62874 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b6ea2e
[junit4:junit4]   2> 12986 T892 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62874
[junit4:junit4]   2> 12986 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12988 T892 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62874, initiating session
[junit4:junit4]   2> 12988 T888 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62877
[junit4:junit4]   2> 12988 T888 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62877
[junit4:junit4]   2> 12989 T890 oazsp.FileTxnLog.append Creating new log file: log.95
[junit4:junit4]   2> 12993 T890 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1a22f0000 with negotiated timeout 10000 for client /127.0.0.1:62877
[junit4:junit4]   2> 12993 T892 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62874, sessionid = 0x13988f1a22f0000, negotiated timeout = 10000
[junit4:junit4]   2> 12993 T893 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b6ea2e name:ZooKeeperConnection Watcher:127.0.0.1:62874 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12994 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 13020 T891 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1a22f0000
[junit4:junit4]   2> 13021 T819 oaz.ZooKeeper.close Session: 0x13988f1a22f0000 closed
[junit4:junit4]   2> 13021 T888 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1a22f0000, likely client has closed socket
[junit4:junit4]   2> 13021 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62874 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@35705f
[junit4:junit4]   2> 13022 T888 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62877 which had sessionid 0x13988f1a22f0000
[junit4:junit4]   2> 13025 T893 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 13026 T894 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62874
[junit4:junit4]   2> 13026 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 13027 T894 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62874, initiating session
[junit4:junit4]   2> 13027 T888 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62880
[junit4:junit4]   2> 13028 T888 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62880
[junit4:junit4]   2> 13029 T890 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1a22f0001 with negotiated timeout 10000 for client /127.0.0.1:62880
[junit4:junit4]   2> 13030 T894 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62874, sessionid = 0x13988f1a22f0001, negotiated timeout = 10000
[junit4:junit4]   2> 13030 T895 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@35705f name:ZooKeeperConnection Watcher:127.0.0.1:62874 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 13030 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 13030 T819 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 13034 T891 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1a22f0001
[junit4:junit4]   2> 13035 T819 oaz.ZooKeeper.close Session: 0x13988f1a22f0001 closed
[junit4:junit4]   2> 13035 T888 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1a22f0001, likely client has closed socket
[junit4:junit4]   2> 13035 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62874/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@10f3d1f
[junit4:junit4]   2> 13036 T888 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62880 which had sessionid 0x13988f1a22f0001
[junit4:junit4]   2> 13036 T895 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 13037 T896 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62874
[junit4:junit4]   2> 13037 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 13038 T896 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62874, initiating session
[junit4:junit4]   2> 13038 T888 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62883
[junit4:junit4]   2> 13039 T888 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62883
[junit4:junit4]   2> 13041 T890 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1a22f0002 with negotiated timeout 20000 for client /127.0.0.1:62883
[junit4:junit4]   2> 13041 T896 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62874, sessionid = 0x13988f1a22f0002, negotiated timeout = 20000
[junit4:junit4]   2> 13041 T897 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10f3d1f name:ZooKeeperConnection Watcher:127.0.0.1:62874/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 13042 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 13042 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62874/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ff7175
[junit4:junit4]   2> 13043 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 13043 T899 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62874
[junit4:junit4]   2> 13045 T899 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62874, initiating session
[junit4:junit4]   2> 13045 T888 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62886
[junit4:junit4]   2> 13045 T888 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62886
[junit4:junit4]   2> 13047 T890 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1a22f0003 with negotiated timeout 20000 for client /127.0.0.1:62886
[junit4:junit4]   2> 13047 T899 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62874, sessionid = 0x13988f1a22f0003, negotiated timeout = 20000
[junit4:junit4]   2> 13047 T900 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ff7175 name:ZooKeeperConnection Watcher:127.0.0.1:62874/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 13048 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 13049 T901 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 13061 T891 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1a22f0003 type:delete cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 13563 T901 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 13571 T891 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1a22f0003 type:create cxid:0x18 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 15050 T902 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62874/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@103c1ca
[junit4:junit4]   2> 15051 T906 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62874
[junit4:junit4]   2> 15052 T902 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15054 T906 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62874, initiating session
[junit4:junit4]   2> 15054 T888 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62889
[junit4:junit4]   2> 15055 T888 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62889
[junit4:junit4]   2> 15056 T906 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62874, sessionid = 0x13988f1a22f0004, negotiated timeout = 20000
[junit4:junit4]   2> 15056 T890 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1a22f0004 with negotiated timeout 20000 for client /127.0.0.1:62889
[junit4:junit4]   2> 15057 T907 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@103c1ca name:ZooKeeperConnection Watcher:127.0.0.1:62874/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15057 T902 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15059 T902 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62874/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@6360d5
[junit4:junit4]   2> 15060 T902 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15060 T910 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62874
[junit4:junit4]   2> 15062 T910 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62874, initiating session
[junit4:junit4]   2> 15062 T888 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62892
[junit4:junit4]   2> 15063 T888 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62892
[junit4:junit4]   2> 15066 T910 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62874, sessionid = 0x13988f1a22f0005, negotiated timeout = 20000
[junit4:junit4]   2> 15066 T890 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1a22f0005 with negotiated timeout 20000 for client /127.0.0.1:62892
[junit4:junit4]   2> 15067 T911 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6360d5 name:ZooKeeperConnection Watcher:127.0.0.1:62874/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15067 T902 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15068 T902 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62874/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@182d604
[junit4:junit4]   2> 15069 T891 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1a22f0003
[junit4:junit4]   2> 15070 T902 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15070 T903 oaz.ZooKeeper.close Session: 0x13988f1a22f0003 closed
[junit4:junit4]   2> 15070 T900 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 15072 T888 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1a22f0003, likely client has closed socket
[junit4:junit4]   2> 15072 T914 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62874
[junit4:junit4]   2> 15072 T888 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62886 which had sessionid 0x13988f1a22f0003
[junit4:junit4]   2> 15073 T914 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62874, initiating session
[junit4:junit4]   2> 15074 T888 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62895
[junit4:junit4]   2> 15074 T888 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62895
[junit4:junit4]   2> 15076 T890 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1a22f0006 with negotiated timeout 20000 for client /127.0.0.1:62895
[junit4:junit4]   2> 15076 T914 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62874, sessionid = 0x13988f1a22f0006, negotiated timeout = 20000
[junit4:junit4]   2> 15077 T915 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@182d604 name:ZooKeeperConnection Watcher:127.0.0.1:62874/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15077 T902 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15077 T902 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62874/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@137c964
[junit4:junit4]   2> 15078 T918 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62874
[junit4:junit4]   2> 15078 T902 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15080 T918 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62874, initiating session
[junit4:junit4]   2> 15080 T888 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62898
[junit4:junit4]   2> 15081 T888 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62898
[junit4:junit4]   2> 15081 T891 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1a22f0004
[junit4:junit4]   2> 15082 T890 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1a22f0007 with negotiated timeout 20000 for client /127.0.0.1:62898
[junit4:junit4]   2> 15082 T918 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62874, sessionid = 0x13988f1a22f0007, negotiated timeout = 20000
[junit4:junit4]   2> 15083 T919 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@137c964 name:ZooKeeperConnection Watcher:127.0.0.1:62874/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15083 T902 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15084 T888 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62889 which had sessionid 0x13988f1a22f0004
[junit4:junit4]   2> 15084 T903 oaz.ZooKeeper.close Session: 0x13988f1a22f0004 closed
[junit4:junit4]   2> 15085 T907 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 15100 T888 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1a22f0007, likely client has closed socket
[junit4:junit4]   2> 15100 T888 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62898 which had sessionid 0x13988f1a22f0007
[junit4:junit4]   2> 15101 T918 oaz.ClientCnxn$SendThread.run WARNING Session 0x13988f1a22f0007 for server null, unexpected error, closing socket connection and attempting reconnect java.nio.channels.CancelledKeyException
[junit4:junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4:junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.disableWrite(ClientCnxn.java:919)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1163)
[junit4:junit4]   2> 
[junit4:junit4]   2> 15118 T891 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1a22f0005
[junit4:junit4]   2> 15120 T903 oaz.ZooKeeper.close Session: 0x13988f1a22f0005 closed
[junit4:junit4]   2> 15120 T888 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1a22f0005, likely client has closed socket
[junit4:junit4]   2> 15120 T911 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 15121 T888 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62892 which had sessionid 0x13988f1a22f0005
[junit4:junit4]   2> 15202 T919 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@137c964 name:ZooKeeperConnection Watcher:127.0.0.1:62874/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4]   2> 15202 T919 oascc.ConnectionManager.process zkClient has disconnected
[junit4:junit4]   2> 15255 T891 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f1a22f0006 type:delete cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4]   2> 15262 T912 oasc.LeaderElectionTest$ClientThread.run SEVERE setup failed org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:815)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:232)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:229)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:229)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:94)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:88)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.setup(LeaderElector.java:279)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElectionTest$ClientThread.setupOnConnect(LeaderElectionTest.java:116)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElectionTest$ClientThread.run(LeaderElectionTest.java:125)
[junit4:junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
[junit4:junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 15292 T916 oasc.LeaderElectionTest$ClientThread.run SEVERE setup failed org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:815)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:232)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:229)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:229)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:94)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:88)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.setup(LeaderElector.java:279)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElectionTest$ClientThread.setupOnConnect(LeaderElectionTest.java:116)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElectionTest$ClientThread.run(LeaderElectionTest.java:125)
[junit4:junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
[junit4:junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 15650 T888 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1a22f0006, likely client has closed socket
[junit4:junit4]   2> 15651 T888 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62895 which had sessionid 0x13988f1a22f0006
[junit4:junit4]   2> 15651 T914 oaz.ClientCnxn$SendThread.run WARNING Session 0x13988f1a22f0006 for server null, unexpected error, closing socket connection and attempting reconnect java.nio.channels.CancelledKeyException
[junit4:junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4:junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.disableWrite(ClientCnxn.java:919)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1163)
[junit4:junit4]   2> 
[junit4:junit4]   2> 15752 T915 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@182d604 name:ZooKeeperConnection Watcher:127.0.0.1:62874/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4]   2> 15752 T915 oascc.ConnectionManager.process zkClient has disconnected
[junit4:junit4]   2> 15756 T908 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 17202 T918 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server 127.0.0.1/127.0.0.1:62874
[junit4:junit4]   2> 17203 T918 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62874, initiating session
[junit4:junit4]   2> 17203 T888 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62899
[junit4:junit4]   2> 17690 T914 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server 127.0.0.1/127.0.0.1:62874
[junit4:junit4]   2> 17690 T914 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62874, initiating session
[junit4:junit4]   2> 17691 T888 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62900
[junit4:junit4]   2> 21100 T888 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x0, likely client has closed socket
[junit4:junit4]   2> 21100 T888 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62899 (no session established for client)
[junit4:junit4]   2> 21650 T908 oasc.LeaderElectionTest$ClientThread.run SEVERE setup failed java.lang.InterruptedException
[junit4:junit4]   2> 	at java.lang.Object.wait(Native Method)
[junit4:junit4]   2> 	at java.lang.Object.wait(Object.java:503)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1345)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:810)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:211)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:208)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:483)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:443)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:424)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:94)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:159)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:103)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:263)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElectionTest$ClientThread.setupOnConnect(LeaderElectionTest.java:117)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElectionTest$ClientThread.run(LeaderElectionTest.java:125)
[junit4:junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
[junit4:junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 21650 T888 oazs.NIOServerCnxn.readConnectRequest Client attempting to renew session 0x13988f1a22f0006 at /127.0.0.1:62900
[junit4:junit4]   2> 21652 T888 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f1a22f0006 with negotiated timeout 20000 for client /127.0.0.1:62900
[junit4:junit4]   2> 21653 T914 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62874, sessionid = 0x13988f1a22f0006, negotiated timeout = 20000
[junit4:junit4]   2> 21653 T915 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@182d604 name:ZooKeeperConnection Watcher:127.0.0.1:62874/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 21654 T891 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1a22f0006
[junit4:junit4]   2> 21656 T908 oaz.ZooKeeper.close Session: 0x13988f1a22f0006 closed
[junit4:junit4]   2> 21656 T888 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62900 which had sessionid 0x13988f1a22f0006
[junit4:junit4]   2> 21656 T915 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 33100 T901 oasc.LeaderElectionTest$ClientThread.run SEVERE setup failed java.lang.InterruptedException
[junit4:junit4]   2> 	at java.lang.Object.wait(Native Method)
[junit4:junit4]   2> 	at java.lang.Object.wait(Object.java:503)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1345)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:810)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:232)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:229)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:229)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:94)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:88)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.setup(LeaderElector.java:279)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElectionTest$ClientThread.setupOnConnect(LeaderElectionTest.java:116)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElectionTest$ClientThread.run(LeaderElectionTest.java:125)
[junit4:junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
[junit4:junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 33100 T918 oaz.ClientCnxn$SendThread.run WARNING Session 0x13988f1a22f0007 for server 127.0.0.1/127.0.0.1:62874, unexpected error, closing socket connection and attempting reconnect java.nio.channels.CancelledKeyException
[junit4:junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4:junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:82)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.primeConnection(ClientCnxn.java:993)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1146)
[junit4:junit4]   2> 
[junit4:junit4]   2> 33203 T919 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 33203 T901 oaz.ZooKeeper.close Session: 0x13988f1a22f0007 closed
[junit4:junit4]   2> 35174 T889 oazs.ZooKeeperServer.expire Expiring session 0x13988f1a22f0007, timeout of 20000ms exceeded
[junit4:junit4]   2> 35174 T891 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1a22f0007
[junit4:junit4]   2> 49104 T891 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f1a22f0002
[junit4:junit4]   2> 49116 T819 oaz.ZooKeeper.close Session: 0x13988f1a22f0002 closed
[junit4:junit4]   2> 49117 T897 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 49118 T891 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 49118 T890 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 49117 T888 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f1a22f0002, likely client has closed socket
[junit4:junit4]   2> 49120 T888 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62883 which had sessionid 0x13988f1a22f0002
[junit4:junit4]   2> 49120 T819 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 49174 T889 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 51373 T888 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 51375 T819 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 51375 T819 oas.SolrTestCaseJ4.tearDown ###Ending testStressElection
[junit4:junit4]   1> / (2)
[junit4:junit4]   1>  /overseer (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1>   /overseer/queue (1)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       
[junit4:junit4]   1>    /overseer/queue/qn-0000000000 (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {
[junit4:junit4]   1>          "operation":"leader",
[junit4:junit4]   1>          "shard":"shard1",
[junit4:junit4]   1>          "state":"active",
[junit4:junit4]   1>          "core":"",
[junit4:junit4]   1>          "collection":"collection1",
[junit4:junit4]   1>          "base_url":"0"}
[junit4:junit4]   1>  /collections (1)
[junit4:junit4]   1>   /collections/collection1 (2)
[junit4:junit4]   1>    /collections/collection1/leader_elect (1)
[junit4:junit4]   1>     /collections/collection1/leader_elect/shard1 (1)
[junit4:junit4]   1>      /collections/collection1/leader_elect/shard1/election (0)
[junit4:junit4]   1>    /collections/collection1/leaders (0)
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=LeaderElectionTest -Dtests.method=testStressElection -Dtests.seed=C2DD9467D63AD772 -Dtests.slow=true -Dtests.locale=in -Dtests.timezone=America/Santo_Domingo -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR   38.6s | LeaderElectionTest.testStressElection <<<
[junit4:junit4]    > Throwable #1: java.lang.RuntimeException: Could not get leader props
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([C2DD9467D63AD772:3D8B40C9B174C661]:0)
[junit4:junit4]    > 	at org.apache.solr.cloud.LeaderElectionTest.getLeaderUrl(LeaderElectionTest.java:226)
[junit4:junit4]    > 	at org.apache.solr.cloud.LeaderElectionTest.getLeaderThread(LeaderElectionTest.java:326)
[junit4:junit4]    > 	at org.apache.solr.cloud.LeaderElectionTest.testStressElection(LeaderElectionTest.java:435)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:345)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:769)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:429)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:40)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:345)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 51469 T819 oas.SolrTestCaseJ4.setUp ###Starting testBasic
[junit4:junit4]   2> 51469 T819 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 51472 T929 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 51472 T929 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 51476 T929 oazsp.FileSnap.deserialize Reading snapshot C:\Jenkins\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-LeaderElectionTest-1346622287826\zookeeper\server1\data\version-2\snapshot.94
[junit4:junit4]   2> 51489 T929 oazsp.FileTxnSnapLog.save Snapshotting: c1
[junit4:junit4]   2> 51570 T819 oasc.ZkTestServer.run start zk server on port:62903
[junit4:junit4]   2> 51570 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62903 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@78ea1f
[junit4:junit4]   2> 51578 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 51578 T934 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62903
[junit4:junit4]   2> 51581 T934 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62903, initiating session
[junit4:junit4]   2> 51581 T930 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62906
[junit4:junit4]   2> 51582 T930 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62906
[junit4:junit4]   2> 51582 T932 oazsp.FileTxnLog.append Creating new log file: log.c2
[junit4:junit4]   2> 51635 T932 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f238f50000 with negotiated timeout 10000 for client /127.0.0.1:62906
[junit4:junit4]   2> 51635 T934 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62903, sessionid = 0x13988f238f50000, negotiated timeout = 10000
[junit4:junit4]   2> 51636 T935 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@78ea1f name:ZooKeeperConnection Watcher:127.0.0.1:62903 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 51636 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 51922 T933 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f238f50000
[junit4:junit4]   2> 51931 T930 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62906 which had sessionid 0x13988f238f50000
[junit4:junit4]   2> 51931 T819 oaz.ZooKeeper.close Session: 0x13988f238f50000 closed
[junit4:junit4]   2> 51931 T935 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 51932 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62903 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@95431d
[junit4:junit4]   2> 51935 T936 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62903
[junit4:junit4]   2> 51935 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 51937 T936 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62903, initiating session
[junit4:junit4]   2> 51937 T930 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62909
[junit4:junit4]   2> 51938 T930 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62909
[junit4:junit4]   2> 51952 T932 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f238f50001 with negotiated timeout 10000 for client /127.0.0.1:62909
[junit4:junit4]   2> 51952 T936 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62903, sessionid = 0x13988f238f50001, negotiated timeout = 10000
[junit4:junit4]   2> 51953 T937 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@95431d name:ZooKeeperConnection Watcher:127.0.0.1:62903 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 51953 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 51953 T819 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 51972 T933 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f238f50001
[junit4:junit4]   2> 51991 T930 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62909 which had sessionid 0x13988f238f50001
[junit4:junit4]   2> 51993 T819 oaz.ZooKeeper.close Session: 0x13988f238f50001 closed
[junit4:junit4]   2> 51993 T937 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 51993 T819 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:62903/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1cd082c
[junit4:junit4]   2> 51995 T938 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:62903
[junit4:junit4]   2> 51995 T819 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 51997 T938 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:62903, initiating session
[junit4:junit4]   2> 51997 T930 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:62912
[junit4:junit4]   2> 51997 T930 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:62912
[junit4:junit4]   2> 52012 T932 oazs.NIOServerCnxn.finishSessionInit Established session 0x13988f238f50002 with negotiated timeout 20000 for client /127.0.0.1:62912
[junit4:junit4]   2> 52012 T938 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:62903, sessionid = 0x13988f238f50002, negotiated timeout = 20000
[junit4:junit4]   2> 52012 T939 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cd082c name:ZooKeeperConnection Watcher:127.0.0.1:62903/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 52013 T819 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 52014 T819 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 52113 T933 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f238f50002 type:delete cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 52632 T819 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 52722 T933 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13988f238f50002 type:create cxid:0x18 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 52811 T933 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13988f238f50002
[junit4:junit4]   2> 52840 T819 oaz.ZooKeeper.close Session: 0x13988f238f50002 closed
[junit4:junit4]   2> 52841 T939 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 52841 T930 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13988f238f50002, likely client has closed socket
[junit4:junit4]   2> 52842 T932 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 52842 T933 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 52844 T819 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 52842 T930 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:62912 which had sessionid 0x13988f238f50002
[junit4:junit4]   2> 53174 T931 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 55098 T930 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 55099 T819 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 55099 T819 oas.SolrTestCaseJ4.tearDown ###Ending testBasic
[junit4:junit4]   2> 55100 T819 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 55137 T818 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 4 leaked thread(s).
[junit4:junit4]   2> 75194 T818 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 4 threads leaked from SUITE scope at org.apache.solr.cloud.LeaderElectionTest: 
[junit4:junit4]   2> 	   1) Thread[id=923, name=Thread-405, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]   2> 	        at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2> 	        at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
[junit4:junit4]   2> 	   2) Thread[id=927, name=Thread-409, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]   2> 	        at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2> 	        at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
[junit4:junit4]   2> 	   3) Thread[id=928, name=Thread-410, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]   2> 	        at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2> 	        at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
[junit4:junit4]   2> 	   4) Thread[id=925, name=Thread-407, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]   2> 	        at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2> 	        at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
[junit4:junit4]   2> 75195 T818 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
[junit4:junit4]   2> 	   1) Thread[id=923, name=Thread-405, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]   2> 	   2) Thread[id=927, name=Thread-409, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]   2> 	   3) Thread[id=928, name=Thread-410, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]   2> 	   4) Thread[id=925, name=Thread-407, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]   2> 75196 T818 ccr.ThreadLeakControl.tryToInterruptAll All leaked threads terminated.
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {}, sim=DefaultSimilarity, locale=in, timezone=America/Santo_Domingo
[junit4:junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_07 (32-bit)/cpus=2,threads=1,free=28761648,total=73244672
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestStressReorder, TestSolrQueryParser, CoreContainerCoreInitFailuresTest, SimplePostToolTest, TestCoreContainer, UpdateParamsTest, TestPropInject, SolrCoreTest, FullSolrCloudDistribCmdsTest, SolrInfoMBeanTest, TestPhraseSuggestions, LoggingHandlerTest, TestRemoteStreaming, TestPropInjectDefaults, TimeZoneUtilsTest, RequestHandlersTest, JSONWriterTest, SpellingQueryConverterTest, TestReplicationHandler, UUIDFieldTest, SortByFunctionTest, TestSolrJ, TestLMDirichletSimilarityFactory, TestHashPartitioner, ZkControllerTest, DistributedQueryElevationComponentTest, TestExtendedDismaxParser, SolrRequestParserTest, TestReload, OpenExchangeRatesOrgProviderTest, BasicDistributedZk2Test, LeaderElectionTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=LeaderElectionTest -Dtests.seed=C2DD9467D63AD772 -Dtests.slow=true -Dtests.locale=in -Dtests.timezone=America/Santo_Domingo -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR   0.00s | LeaderElectionTest (suite) <<<
[junit4:junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE scope at org.apache.solr.cloud.LeaderElectionTest: 
[junit4:junit4]    >    1) Thread[id=923, name=Thread-405, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
[junit4:junit4]    >    2) Thread[id=927, name=Thread-409, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
[junit4:junit4]    >    3) Thread[id=928, name=Thread-410, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
[junit4:junit4]    >    4) Thread[id=925, name=Thread-407, state=TIMED_WAITING, group=TGRP-LeaderElectionTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.SolrZooKeeper$1.run(SolrZooKeeper.java:64)
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([C2DD9467D63AD772]:0)
[junit4:junit4] Completed in 75.23s, 4 tests, 2 errors <<< FAILURES!

[...truncated 591 lines...]
BUILD FAILED
C:\Jenkins\workspace\Lucene-Solr-trunk-Windows\build.xml:29: The following error occurred while executing this line:
C:\Jenkins\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:144: The following error occurred while executing this line:
C:\Jenkins\workspace\Lucene-Solr-trunk-Windows\lucene\module-build.xml:62: The following error occurred while executing this line:
C:\Jenkins\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1056: The following error occurred while executing this line:
C:\Jenkins\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:741: There were test failures: 228 suites, 917 tests, 1 suite-level error, 1 error, 11 ignored (6 assumptions)

Total time: 38 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Recording test results
Description set: Java: 32bit/jdk1.7.0_07 -server -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message