lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0-ea-b79) - Build # 4657 - Still Failing!
Date Sun, 10 Mar 2013 23:54:36 GMT
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/4657/
Java: 32bit/jdk1.8.0-ea-b79 -client -XX:+UseSerialGC

2 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Server at http://127.0.0.1:42984/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:42984/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
	at __randomizedtesting.SeedInfo.seed([CDCEE18E17016B19:4C286F96605E0B25]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch

Error Message:
Still found shard

Stack Trace:
java.lang.AssertionError: Still found shard
	at __randomizedtesting.SeedInfo.seed([CDCEE18E17016B19:4C286F96605E0B25]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9125 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.UnloadDistributedZkTest
[junit4:junit4]   2> 0 T1043 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /ap_an/
[junit4:junit4]   2> 3 T1043 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140
[junit4:junit4]   2> 3 T1043 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 4 T1044 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 4 T1044 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 5 T1044 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 5 T1044 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 5 T1044 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 6 T1044 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-1362959008140/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 104 T1043 oasc.ZkTestServer.run start zk server on port:45260
[junit4:junit4]   2> 104 T1043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45260 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1dfddb3
[junit4:junit4]   2> 105 T1043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 105 T1049 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 106 T1049 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45260, initiating session
[junit4:junit4]   2> 106 T1045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35086
[junit4:junit4]   2> 106 T1045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35086
[junit4:junit4]   2> 106 T1047 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 195 T1047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d56b0018f0000 with negotiated timeout 10000 for client /127.0.0.1:35086
[junit4:junit4]   2> 195 T1049 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45260, sessionid = 0x13d56b0018f0000, negotiated timeout = 10000
[junit4:junit4]   2> 196 T1050 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1dfddb3 name:ZooKeeperConnection Watcher:127.0.0.1:45260 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 196 T1043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 196 T1043 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 199 T1048 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d56b0018f0000
[junit4:junit4]   2> 200 T1045 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35086 which had sessionid 0x13d56b0018f0000
[junit4:junit4]   2> 200 T1043 oaz.ZooKeeper.close Session: 0x13d56b0018f0000 closed
[junit4:junit4]   2> 200 T1050 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 201 T1043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45260/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1183b78
[junit4:junit4]   2> 202 T1043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 202 T1051 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 203 T1051 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45260, initiating session
[junit4:junit4]   2> 203 T1045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35087
[junit4:junit4]   2> 203 T1045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35087
[junit4:junit4]   2> 204 T1047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d56b0018f0001 with negotiated timeout 10000 for client /127.0.0.1:35087
[junit4:junit4]   2> 204 T1051 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45260, sessionid = 0x13d56b0018f0001, negotiated timeout = 10000
[junit4:junit4]   2> 204 T1052 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1183b78 name:ZooKeeperConnection Watcher:127.0.0.1:45260/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 204 T1043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 204 T1043 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 206 T1043 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 208 T1043 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 210 T1043 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 212 T1043 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 212 T1043 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 215 T1043 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 216 T1043 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 219 T1043 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 219 T1043 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 221 T1043 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 221 T1043 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 223 T1043 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 224 T1043 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 225 T1043 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 226 T1043 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 228 T1043 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 228 T1043 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 230 T1043 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 231 T1043 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 232 T1043 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 233 T1043 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 234 T1048 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d56b0018f0001
[junit4:junit4]   2> 235 T1052 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 235 T1045 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35087 which had sessionid 0x13d56b0018f0001
[junit4:junit4]   2> 235 T1043 oaz.ZooKeeper.close Session: 0x13d56b0018f0001 closed
[junit4:junit4]   2> 290 T1043 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 310 T1043 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:41929
[junit4:junit4]   2> 311 T1043 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 311 T1043 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 312 T1043 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1362959008373
[junit4:junit4]   2> 312 T1043 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1362959008373/solr.xml
[junit4:junit4]   2> 312 T1043 oasc.CoreContainer.<init> New CoreContainer 27065227
[junit4:junit4]   2> 313 T1043 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1362959008373/'
[junit4:junit4]   2> 313 T1043 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1362959008373/'
[junit4:junit4]   2> 330 T1043 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 331 T1043 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 331 T1043 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 331 T1043 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 331 T1043 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 332 T1043 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 332 T1043 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 332 T1043 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 333 T1043 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 333 T1043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 340 T1043 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 351 T1043 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45260/solr
[junit4:junit4]   2> 352 T1043 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 352 T1043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45260 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@14347e
[junit4:junit4]   2> 353 T1043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 353 T1062 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 354 T1062 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45260, initiating session
[junit4:junit4]   2> 354 T1045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35088
[junit4:junit4]   2> 354 T1045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35088
[junit4:junit4]   2> 355 T1047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d56b0018f0002 with negotiated timeout 20000 for client /127.0.0.1:35088
[junit4:junit4]   2> 355 T1062 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45260, sessionid = 0x13d56b0018f0002, negotiated timeout = 20000
[junit4:junit4]   2> 355 T1063 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14347e name:ZooKeeperConnection Watcher:127.0.0.1:45260 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 356 T1043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 357 T1048 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d56b0018f0002
[junit4:junit4]   2> 357 T1063 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 357 T1045 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35088 which had sessionid 0x13d56b0018f0002
[junit4:junit4]   2> 357 T1043 oaz.ZooKeeper.close Session: 0x13d56b0018f0002 closed
[junit4:junit4]   2> 358 T1043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 370 T1043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45260/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1138c9
[junit4:junit4]   2> 371 T1064 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 371 T1043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 372 T1064 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45260, initiating session
[junit4:junit4]   2> 372 T1045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35089
[junit4:junit4]   2> 372 T1045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35089
[junit4:junit4]   2> 373 T1047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d56b0018f0003 with negotiated timeout 20000 for client /127.0.0.1:35089
[junit4:junit4]   2> 373 T1064 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45260, sessionid = 0x13d56b0018f0003, negotiated timeout = 20000
[junit4:junit4]   2> 374 T1065 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1138c9 name:ZooKeeperConnection Watcher:127.0.0.1:45260/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 374 T1043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 376 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 377 T1043 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 378 T1043 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41929_ap_an
[junit4:junit4]   2> 379 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f0003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:41929_ap_an Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:41929_ap_an
[junit4:junit4]   2> 379 T1043 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41929_ap_an
[junit4:junit4]   2> 381 T1043 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 384 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f0003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 385 T1043 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 386 T1043 oasc.Overseer.start Overseer (id=89322881557659651-127.0.0.1:41929_ap_an-n_0000000000) starting
[junit4:junit4]   2> 387 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f0003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 387 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f0003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 388 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f0003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 388 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f0003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 389 T1067 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 390 T1043 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 391 T1043 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 392 T1043 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 394 T1066 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 395 T1043 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 396 T1043 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 396 T1043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 398 T1043 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 399 T1043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45260/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1664df6
[junit4:junit4]   2> 400 T1069 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 400 T1043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 400 T1069 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45260, initiating session
[junit4:junit4]   2> 400 T1045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35090
[junit4:junit4]   2> 401 T1045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35090
[junit4:junit4]   2> 401 T1047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d56b0018f0004 with negotiated timeout 10000 for client /127.0.0.1:35090
[junit4:junit4]   2> 401 T1069 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45260, sessionid = 0x13d56b0018f0004, negotiated timeout = 10000
[junit4:junit4]   2> 402 T1070 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1664df6 name:ZooKeeperConnection Watcher:127.0.0.1:45260/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 402 T1043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 403 T1043 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 404 T1043 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 459 T1043 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 460 T1043 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56910
[junit4:junit4]   2> 461 T1043 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 461 T1043 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 461 T1043 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362959008541
[junit4:junit4]   2> 462 T1043 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362959008541/solr.xml
[junit4:junit4]   2> 462 T1043 oasc.CoreContainer.<init> New CoreContainer 16462625
[junit4:junit4]   2> 463 T1043 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362959008541/'
[junit4:junit4]   2> 463 T1043 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362959008541/'
[junit4:junit4]   2> 480 T1043 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 480 T1043 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 481 T1043 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 481 T1043 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 481 T1043 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 481 T1043 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 482 T1043 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 482 T1043 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 482 T1043 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 483 T1043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 489 T1043 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 501 T1043 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45260/solr
[junit4:junit4]   2> 501 T1043 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 501 T1043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45260 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1dd920e
[junit4:junit4]   2> 502 T1043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 502 T1080 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 503 T1080 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45260, initiating session
[junit4:junit4]   2> 503 T1045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35091
[junit4:junit4]   2> 503 T1045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35091
[junit4:junit4]   2> 504 T1047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d56b0018f0005 with negotiated timeout 20000 for client /127.0.0.1:35091
[junit4:junit4]   2> 504 T1080 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45260, sessionid = 0x13d56b0018f0005, negotiated timeout = 20000
[junit4:junit4]   2> 504 T1081 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1dd920e name:ZooKeeperConnection Watcher:127.0.0.1:45260 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 505 T1043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 506 T1048 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d56b0018f0005
[junit4:junit4]   2> 506 T1081 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 506 T1045 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35091 which had sessionid 0x13d56b0018f0005
[junit4:junit4]   2> 506 T1043 oaz.ZooKeeper.close Session: 0x13d56b0018f0005 closed
[junit4:junit4]   2> 507 T1043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 509 T1043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45260/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@16df3b4
[junit4:junit4]   2> 510 T1043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 510 T1082 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 511 T1082 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45260, initiating session
[junit4:junit4]   2> 511 T1045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35092
[junit4:junit4]   2> 511 T1045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35092
[junit4:junit4]   2> 512 T1047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d56b0018f0006 with negotiated timeout 20000 for client /127.0.0.1:35092
[junit4:junit4]   2> 512 T1082 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45260, sessionid = 0x13d56b0018f0006, negotiated timeout = 20000
[junit4:junit4]   2> 512 T1083 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16df3b4 name:ZooKeeperConnection Watcher:127.0.0.1:45260/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 512 T1043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 513 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f0006 type:create cxid:0x1 zxid:0x2e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 513 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f0006 type:create cxid:0x2 zxid:0x2f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 516 T1043 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 1518 T1043 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56910_ap_an
[junit4:junit4]   2> 1519 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f0006 type:delete cxid:0xb zxid:0x30 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:56910_ap_an Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:56910_ap_an
[junit4:junit4]   2> 1520 T1043 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56910_ap_an
[junit4:junit4]   2> 1522 T1065 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 1522 T1070 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 1523 T1083 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 1526 T1043 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 1527 T1043 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 1527 T1043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1590 T1043 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 1592 T1043 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58282
[junit4:junit4]   2> 1593 T1043 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1593 T1043 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1594 T1043 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362959009667
[junit4:junit4]   2> 1594 T1043 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362959009667/solr.xml
[junit4:junit4]   2> 1594 T1043 oasc.CoreContainer.<init> New CoreContainer 15700308
[junit4:junit4]   2> 1595 T1043 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362959009667/'
[junit4:junit4]   2> 1595 T1043 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362959009667/'
[junit4:junit4]   2> 1612 T1043 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 1613 T1043 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 1613 T1043 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 1613 T1043 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 1614 T1043 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 1614 T1043 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 1614 T1043 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 1615 T1043 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 1615 T1043 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 1615 T1043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 1622 T1043 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 1633 T1043 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45260/solr
[junit4:junit4]   2> 1634 T1043 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 1634 T1043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45260 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@ded18b
[junit4:junit4]   2> 1635 T1043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1635 T1094 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 1636 T1094 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45260, initiating session
[junit4:junit4]   2> 1636 T1045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35093
[junit4:junit4]   2> 1636 T1045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35093
[junit4:junit4]   2> 1637 T1047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d56b0018f0007 with negotiated timeout 20000 for client /127.0.0.1:35093
[junit4:junit4]   2> 1637 T1094 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45260, sessionid = 0x13d56b0018f0007, negotiated timeout = 20000
[junit4:junit4]   2> 1637 T1095 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ded18b name:ZooKeeperConnection Watcher:127.0.0.1:45260 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1637 T1043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1638 T1048 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d56b0018f0007
[junit4:junit4]   2> 1639 T1095 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 1639 T1045 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35093 which had sessionid 0x13d56b0018f0007
[junit4:junit4]   2> 1639 T1043 oaz.ZooKeeper.close Session: 0x13d56b0018f0007 closed
[junit4:junit4]   2> 1639 T1043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 1642 T1043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45260/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@12f1055
[junit4:junit4]   2> 1643 T1043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1643 T1096 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 1644 T1096 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45260, initiating session
[junit4:junit4]   2> 1644 T1045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35094
[junit4:junit4]   2> 1644 T1045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35094
[junit4:junit4]   2> 1645 T1047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d56b0018f0008 with negotiated timeout 20000 for client /127.0.0.1:35094
[junit4:junit4]   2> 1645 T1096 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45260, sessionid = 0x13d56b0018f0008, negotiated timeout = 20000
[junit4:junit4]   2> 1646 T1097 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12f1055 name:ZooKeeperConnection Watcher:127.0.0.1:45260/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1646 T1043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1647 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f0008 type:create cxid:0x1 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1649 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f0008 type:create cxid:0x2 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1650 T1043 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2652 T1043 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58282_ap_an
[junit4:junit4]   2> 2652 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f0008 type:delete cxid:0xb zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:58282_ap_an Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:58282_ap_an
[junit4:junit4]   2> 2653 T1043 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58282_ap_an
[junit4:junit4]   2> 2655 T1070 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 2655 T1065 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 2656 T1097 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 2656 T1083 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 2668 T1043 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2669 T1043 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2669 T1043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2730 T1043 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 2732 T1043 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49811
[junit4:junit4]   2> 2733 T1043 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2733 T1043 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2733 T1043 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362959010809
[junit4:junit4]   2> 2734 T1043 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362959010809/solr.xml
[junit4:junit4]   2> 2734 T1043 oasc.CoreContainer.<init> New CoreContainer 3854414
[junit4:junit4]   2> 2734 T1043 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362959010809/'
[junit4:junit4]   2> 2735 T1043 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362959010809/'
[junit4:junit4]   2> 2753 T1043 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 2754 T1043 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2754 T1043 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 2754 T1043 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2755 T1043 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2755 T1043 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2755 T1043 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2756 T1043 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2756 T1043 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2756 T1043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 2763 T1043 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2777 T1043 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45260/solr
[junit4:junit4]   2> 2778 T1043 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2778 T1043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45260 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@b505ee
[junit4:junit4]   2> 2779 T1043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2779 T1108 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2780 T1108 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45260, initiating session
[junit4:junit4]   2> 2780 T1045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35095
[junit4:junit4]   2> 2780 T1045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35095
[junit4:junit4]   2> 2781 T1047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d56b0018f0009 with negotiated timeout 20000 for client /127.0.0.1:35095
[junit4:junit4]   2> 2781 T1108 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45260, sessionid = 0x13d56b0018f0009, negotiated timeout = 20000
[junit4:junit4]   2> 2781 T1109 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b505ee name:ZooKeeperConnection Watcher:127.0.0.1:45260 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2781 T1043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2782 T1048 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d56b0018f0009
[junit4:junit4]   2> 2783 T1109 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2783 T1045 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35095 which had sessionid 0x13d56b0018f0009
[junit4:junit4]   2> 2783 T1043 oaz.ZooKeeper.close Session: 0x13d56b0018f0009 closed
[junit4:junit4]   2> 2783 T1043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 2786 T1043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45260/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3c5b97
[junit4:junit4]   2> 2787 T1043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2787 T1110 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2788 T1110 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45260, initiating session
[junit4:junit4]   2> 2788 T1045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35096
[junit4:junit4]   2> 2788 T1045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35096
[junit4:junit4]   2> 2789 T1047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d56b0018f000a with negotiated timeout 20000 for client /127.0.0.1:35096
[junit4:junit4]   2> 2789 T1110 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45260, sessionid = 0x13d56b0018f000a, negotiated timeout = 20000
[junit4:junit4]   2> 2789 T1111 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c5b97 name:ZooKeeperConnection Watcher:127.0.0.1:45260/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2790 T1043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2791 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f000a type:create cxid:0x1 zxid:0x3e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2791 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f000a type:create cxid:0x2 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2792 T1043 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3795 T1043 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49811_ap_an
[junit4:junit4]   2> 3795 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f000a type:delete cxid:0xb zxid:0x40 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:49811_ap_an Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:49811_ap_an
[junit4:junit4]   2> 3796 T1043 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49811_ap_an
[junit4:junit4]   2> 3799 T1070 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 3799 T1083 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 3799 T1065 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 3800 T1097 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 3800 T1111 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 3804 T1043 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3804 T1043 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3804 T1043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3863 T1043 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3864 T1043 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:46971
[junit4:junit4]   2> 3865 T1043 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3865 T1043 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3866 T1043 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1362959011944
[junit4:junit4]   2> 3866 T1043 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1362959011944/solr.xml
[junit4:junit4]   2> 3866 T1043 oasc.CoreContainer.<init> New CoreContainer 19299950
[junit4:junit4]   2> 3867 T1043 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1362959011944/'
[junit4:junit4]   2> 3867 T1043 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1362959011944/'
[junit4:junit4]   2> 3884 T1043 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 3885 T1043 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3885 T1043 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 3885 T1043 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3885 T1043 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3886 T1043 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3886 T1043 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3886 T1043 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3887 T1043 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3887 T1043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 3893 T1043 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3905 T1043 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45260/solr
[junit4:junit4]   2> 3905 T1043 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3906 T1043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45260 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1377344
[junit4:junit4]   2> 3906 T1043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3907 T1122 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3907 T1122 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45260, initiating session
[junit4:junit4]   2> 3907 T1045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35097
[junit4:junit4]   2> 3908 T1045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35097
[junit4:junit4]   2> 3908 T1047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d56b0018f000b with negotiated timeout 20000 for client /127.0.0.1:35097
[junit4:junit4]   2> 3908 T1122 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45260, sessionid = 0x13d56b0018f000b, negotiated timeout = 20000
[junit4:junit4]   2> 3909 T1123 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1377344 name:ZooKeeperConnection Watcher:127.0.0.1:45260 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3909 T1043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3910 T1048 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d56b0018f000b
[junit4:junit4]   2> 3910 T1123 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3910 T1045 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35097 which had sessionid 0x13d56b0018f000b
[junit4:junit4]   2> 3910 T1043 oaz.ZooKeeper.close Session: 0x13d56b0018f000b closed
[junit4:junit4]   2> 3911 T1043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 3914 T1043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45260/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@c1ac94
[junit4:junit4]   2> 3914 T1043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3915 T1124 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3915 T1124 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45260, initiating session
[junit4:junit4]   2> 3915 T1045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35098
[junit4:junit4]   2> 3916 T1045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35098
[junit4:junit4]   2> 3916 T1047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d56b0018f000c with negotiated timeout 20000 for client /127.0.0.1:35098
[junit4:junit4]   2> 3916 T1124 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45260, sessionid = 0x13d56b0018f000c, negotiated timeout = 20000
[junit4:junit4]   2> 3917 T1125 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c1ac94 name:ZooKeeperConnection Watcher:127.0.0.1:45260/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3917 T1043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3918 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f000c type:create cxid:0x1 zxid:0x46 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3918 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f000c type:create cxid:0x2 zxid:0x47 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3920 T1043 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4922 T1043 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46971_ap_an
[junit4:junit4]   2> 4922 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f000c type:delete cxid:0xb zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:46971_ap_an Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:46971_ap_an
[junit4:junit4]   2> 4923 T1043 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46971_ap_an
[junit4:junit4]   2> 4926 T1083 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 4926 T1111 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 4926 T1070 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 4926 T1065 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 4926 T1097 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 4927 T1125 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 4931 T1043 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 4932 T1043 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 4932 T1043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 4935 T1043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 4939 T1078 oasc.CoreContainer.create Creating SolrCore 'unloadcollection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362959008541/unloadcollection1
[junit4:junit4]   2> 4939 T1078 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4]   2> 4940 T1078 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:unloadcollection
[junit4:junit4]   2> 4940 T1078 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 4941 T1078 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 4941 T1078 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection
[junit4:junit4]   2> 4943 T1078 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4]   2> 4944 T1078 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362959008541/unloadcollection1/'
[junit4:junit4]   2> 4985 T1078 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 5025 T1078 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5026 T1078 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5030 T1078 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5441 T1078 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5447 T1078 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5450 T1078 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5459 T1078 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5462 T1078 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5465 T1078 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5466 T1078 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 5466 T1078 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 5467 T1078 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5468 T1078 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 5468 T1078 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 5468 T1078 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 5468 T1078 oasc.SolrCore.<init> [unloadcollection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362959008541/unloadcollection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959013075unloadcollection1_1n/
[junit4:junit4]   2> 5469 T1078 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12176dd
[junit4:junit4]   2> 5469 T1078 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 5470 T1078 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959013075unloadcollection1_1n forceNew: false
[junit4:junit4]   2> 5470 T1078 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959013075unloadcollection1_1n/index/
[junit4:junit4]   2> 5470 T1078 oasc.SolrCore.initIndex WARNING [unloadcollection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959013075unloadcollection1_1n/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5471 T1078 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959013075unloadcollection1_1n/index forceNew: false
[junit4:junit4]   2> 5472 T1078 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e80663 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e20319),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5472 T1078 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 5474 T1078 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5474 T1078 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5474 T1078 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5475 T1078 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5475 T1078 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5476 T1078 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5476 T1078 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5476 T1078 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5477 T1078 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5479 T1078 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5482 T1078 oass.SolrIndexSearcher.<init> Opening Searcher@a9e871 main
[junit4:junit4]   2> 5482 T1078 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959013075unloadcollection1_1n/tlog
[junit4:junit4]   2> 5483 T1078 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5483 T1078 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5487 T1127 oasc.SolrCore.registerSearcher [unloadcollection1] Registered new searcher Searcher@a9e871 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5489 T1078 oasc.ZkController.publish publishing core=unloadcollection1 state=down
[junit4:junit4]   2> 5490 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f0006 type:create cxid:0x40 zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 6401 T1066 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6401 T1066 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:56910_ap_an",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"unloadcollection1",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:56910/ap_an"}
[junit4:junit4]   2> 6401 T1066 oasc.Overseer$ClusterStateUpdater.createCollection Create collection unloadcollection with numShards 1
[junit4:junit4]   2> 6402 T1066 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6402 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f0003 type:create cxid:0x46 zxid:0x4f txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 6407 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 6407 T1083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 6407 T1070 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 6407 T1111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 6407 T1065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 6407 T1125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 6492 T1078 oasc.CoreContainer.registerCore registering core: unloadcollection1
[junit4:junit4]   2> 6492 T1078 oasc.ZkController.register Register replica - core:unloadcollection1 address:http://127.0.0.1:56910/ap_an collection:unloadcollection shard:shard1
[junit4:junit4]   2> 6493 T1078 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection/leader_elect/shard1/election
[junit4:junit4]   2> 6497 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f0006 type:delete cxid:0x51 zxid:0x59 txntype:-1 reqpath:n/a Error Path:/solr/collections/unloadcollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/unloadcollection/leaders
[junit4:junit4]   2> 6498 T1078 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 6498 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f0006 type:create cxid:0x52 zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6499 T1078 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 6500 T1078 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 6500 T1078 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56910/ap_an/unloadcollection1/
[junit4:junit4]   2> 6500 T1078 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 6500 T1078 oasc.SyncStrategy.syncToMe http://127.0.0.1:56910/ap_an/unloadcollection1/ has no replicas
[junit4:junit4]   2> 6501 T1078 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56910/ap_an/unloadcollection1/
[junit4:junit4]   2> 6501 T1078 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection/leaders/shard1
[junit4:junit4]   2> 6503 T1048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d56b0018f0006 type:create cxid:0x5c zxid:0x5e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7911 T1066 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7916 T1065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 7916 T1125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 7916 T1070 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 7916 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 7916 T1111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 7916 T1083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 7957 T1078 oasc.ZkController.register We are http://127.0.0.1:56910/ap_an/unloadcollection1/ and leader is http://127.0.0.1:56910/ap_an/unloadcollection1/
[junit4:junit4]   2> 7958 T1078 oasc.ZkController.register No LogReplay needed for core=unloadcollection1 baseURL=http://127.0.0.1:56910/ap_an
[junit4:junit4]   2> 7958 T1078 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 7958 T1078 oasc.ZkController.publish publishing core=unloadcollection1 state=active
[junit4:junit4]   2> 7960 T1078 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7961 T1078 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362959008541/solr.xml
[junit4:junit4]   2> 7967 T1078 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362959008541/solr.xml
[junit4:junit4]   2> 7968 T1078 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959013075unloadcollection1_1n&name=unloadcollection1&version=2&wt=javabin&collection=unloadcollection&numShards=1&action=CREATE} status=0 QTime=3029 
[junit4:junit4]   2> 7969 T1043 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 7970 T1043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45260/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1d7fb80
[junit4:junit4]   2> 7971 T1043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7971 T1128 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7972 T1128 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45260, initiating session
[junit4:junit4]   2> 7972 T1045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35102
[junit4:junit4]   2> 7972 T1045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35102
[junit4:junit4]   2> 7973 T1047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d56b0018f000d with negotiated timeout 10000 for client /127.0.0.1:35102
[junit4:junit4]   2> 7973 T1128 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45260, sessionid = 0x13d56b0018f000d, negotiated timeout = 10000
[junit4:junit4]   2> 7974 T1129 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d7fb80 name:ZooKeeperConnection Watcher:127.0.0.1:45260/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7974 T1043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7975 T1043 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7977 T1043 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7977 T1043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7981 T1091 oasc.CoreContainer.create Creating SolrCore 'unloadcollection2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362959009667/unloadcollection2
[junit4:junit4]   2> 7981 T1091 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4]   2> 7982 T1091 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 7982 T1091 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4]   2> 7983 T1091 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362959009667/unloadcollection2/'
[junit4:junit4]   2> 8023 T1091 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 8058 T1091 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 8059 T1091 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 8064 T1091 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 8477 T1091 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 8483 T1091 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 8486 T1091 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 8496 T1091 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8500 T1091 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8503 T1091 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8504 T1091 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 8504 T1091 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 8505 T1091 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8505 T1091 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 8506 T1091 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 8506 T1091 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 8506 T1091 oasc.SolrCore.<init> [unloadcollection2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362959009667/unloadcollection2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959016117unloadcollection1_2n/
[junit4:junit4]   2> 8507 T1091 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12176dd
[junit4:junit4]   2> 8508 T1091 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 8508 T1091 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959016117unloadcollection1_2n forceNew: false
[junit4:junit4]   2> 8508 T1091 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959016117unloadcollection1_2n/index/
[junit4:junit4]   2> 8509 T1091 oasc.SolrCore.initIndex WARNING [unloadcollection2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959016117unloadcollection1_2n/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 8509 T1091 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959016117unloadcollection1_2n/index forceNew: false
[junit4:junit4]   2> 8510 T1091 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1a83067 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c8f5cc),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 8511 T1091 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 8512 T1091 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 8512 T1091 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 8513 T1091 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 8513 T1091 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 8514 T1091 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 8514 T1091 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 8514 T1091 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 8515 T1091 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 8515 T1091 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 8518 T1091 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 8520 T1091 oass.SolrIndexSearcher.<init> Opening Searcher@8ef013 main
[junit4:junit4]   2> 8521 T1091 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959016117unloadcollection1_2n/tlog
[junit4:junit4]   2> 8521 T1091 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 8522 T1091 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 8525 T1130 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@8ef013 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 8525 T1091 oasc.ZkController.publish publishing core=unloadcollection2 state=down
[junit4:junit4]   2> 8525 T1091 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9421 T1066 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9422 T1066 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:56910_ap_an",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"unloadcollection1",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:56910/ap_an"}
[junit4:junit4]   2> 9424 T1066 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:58282_ap_an",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"unloadcollection2",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:58282/ap_an"}
[junit4:junit4]   2> 9425 T1066 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 9425 T1066 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 9427 T1083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9428 T1125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9428 T1070 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9428 T1111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9428 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9428 T1129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9428 T1065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9527 T1091 oasc.CoreContainer.registerCore registering core: unloadcollection2
[junit4:junit4]   2> 9527 T1091 oasc.ZkController.register Register replica - core:unloadcollection2 address:http://127.0.0.1:58282/ap_an collection:unloadcollection shard:shard1
[junit4:junit4]   2> 9530 T1091 oasc.ZkController.register We are http://127.0.0.1:58282/ap_an/unloadcollection2/ and leader is http://127.0.0.1:56910/ap_an/unloadcollection1/
[junit4:junit4]   2> 9530 T1091 oasc.ZkController.register No LogReplay needed for core=unloadcollection2 baseURL=http://127.0.0.1:58282/ap_an
[junit4:junit4]   2> 9531 T1091 oasc.ZkController.checkRecovery Core needs to recover:unloadcollection2
[junit4:junit4]   2> 9531 T1091 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C54 name=unloadcollection2 org.apache.solr.core.SolrCore@67e0f url=http://127.0.0.1:58282/ap_an/unloadcollection2 node=127.0.0.1:58282_ap_an C54_STATE=coll:unloadcollection core:unloadcollection2 props:{state=down, collection=unloadcollection, node_name=127.0.0.1:58282_ap_an, core=unloadcollection2, base_url=http://127.0.0.1:58282/ap_an}
[junit4:junit4]   2> 9531 T1131 C54 P58282 oasc.RecoveryStrategy.run Starting recovery process.  core=unloadcollection2 recoveringAfterStartup=true
[junit4:junit4]   2> 9532 T1091 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9532 T1131 C54 P58282 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 9533 T1131 C54 P58282 oasc.ZkController.publish publishing core=unloadcollection2 state=recovering
[junit4:junit4]   2> 9533 T1131 C54 P58282 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9533 T1091 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362959009667/solr.xml
[junit4:junit4]   2> 9534 T1131 C54 P58282 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9541 T1091 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362959009667/solr.xml
[junit4:junit4]   2> 9542 T1091 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959016117unloadcollection1_2n&name=unloadcollection2&version=2&wt=javabin&collection=unloadcollection&action=CREATE} status=0 QTime=1561 
[junit4:junit4]   2> 9543 T1043 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9544 T1043 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 9545 T1043 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10546 T1043 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10934 T1066 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10935 T1066 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:58282_ap_an",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"unloadcollection2",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:58282/ap_an"}
[junit4:junit4]   2> 10954 T1129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 10954 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 10955 T1065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 10955 T1125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 10955 T1083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 10955 T1111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 10955 T1070 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 11540 T1079 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {version=2&wt=javabin&checkLive=true&state=recovering&nodeName=127.0.0.1:58282_ap_an&core=unloadcollection1&onlyIfLeader=true&coreNodeName=127.0.0.1:58282_ap_an_unloadcollection2&action=PREPRECOVERY} status=0 QTime=2001 
[junit4:junit4]   2> 11547 T1043 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12549 T1043 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C54_STATE=coll:unloadcollection core:unloadcollection2 props:{state=recovering, shard=shard1, collection=unloadcollection, node_name=127.0.0.1:58282_ap_an, core=unloadcollection2, base_url=http://127.0.0.1:58282/ap_an}
[junit4:junit4]   2> 13541 T1131 C54 P58282 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:56910/ap_an/unloadcollection1/ core=unloadcollection2 - recoveringAfterStartup=true
[junit4:junit4]   2> 13541 T1131 C54 P58282 oasu.PeerSync.sync PeerSync: core=unloadcollection2 url=http://127.0.0.1:58282/ap_an START replicas=[http://127.0.0.1:56910/ap_an/unloadcollection1/] nUpdates=100
[junit4:junit4]   2> 13541 T1131 C54 P58282 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 13542 T1131 C54 P58282 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=unloadcollection2
[junit4:junit4]   2> 13542 T1131 C54 P58282 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=unloadcollection2
[junit4:junit4]   2> 13542 T1131 C54 P58282 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=unloadcollection2
[junit4:junit4]   2> 13542 T1131 C54 P58282 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 13542 T1131 C54 P58282 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:56910/ap_an/unloadcollection1/. core=unloadcollection2
[junit4:junit4]   2> 13543 T1131 C54 P58282 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 13550 T1043 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C55 name=unloadcollection1 org.apache.solr.core.SolrCore@1a197f url=http://127.0.0.1:56910/ap_an/unloadcollection1 node=127.0.0.1:56910_ap_an C55_STATE=coll:unloadcollection core:unloadcollection1 props:{state=active, shard=shard1, collection=unloadcollection, node_name=127.0.0.1:56910_ap_an, core=unloadcollection1, base_url=http://127.0.0.1:56910/ap_an, leader=true}
[junit4:junit4]   2> 13550 T1077 C55 P56910 REQ /get {version=2&wt=javabin&getVersions=100&distrib=false&qt=/get} status=0 QTime=1 
[junit4:junit4]   2> 13553 T1076 C55 P56910 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 13554 T1076 C55 P56910 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e80663 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e20319),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 13554 T1076 C55 P56910 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 13555 T1076 C55 P56910 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e80663 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e20319),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e80663 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e20319),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 13556 T1076 C55 P56910 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 13556 T1076 C55 P56910 oass.SolrIndexSearcher.<init> Opening Searcher@17f546c realtime
[junit4:junit4]   2> 13557 T1076 C55 P56910 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 13557 T1076 C55 P56910 /update {waitSearcher=true&commit=true&version=2&wt=javabin&openSearcher=false&softCommit=false&commit_end_point=true} {commit=} 0 4
[junit4:junit4]   2> 13558 T1131 C54 P58282 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 13558 T1131 C54 P58282 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 13562 T1079 C55 P56910 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 13562 T1079 C55 P56910 REQ /replication {version=2&wt=javabin&qt=/replication&command=indexversion} status=0 QTime=3 
[junit4:junit4]   2> 13563 T1131 C54 P58282 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 13563 T1131 C54 P58282 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 13563 T1131 C54 P58282 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 13565 T1077 C55 P56910 REQ /replication {version=2&wt=javabin&generation=2&qt=/replication&command=filelist} status=0 QTime=0 
[junit4:junit4]   2> 13565 T1131 C54 P58282 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 13566 T1131 C54 P58282 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959016117unloadcollection1_2n/index.20130310194341703 forceNew: false
[junit4:junit4]   2> 13567 T1131 C54 P58282 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@65599f lockFactory=org.apache.lucene.store.NativeFSLockFactory@d96725) fullCopy=false
[junit4:junit4]   2> 13569 T1076 C55 P56910 REQ /replication {file=segments_2&wt=filestream&generation=2&qt=/replication&command=filecontent&checksum=true} status=0 QTime=0 
[junit4:junit4]   2> 13570 T1131 C54 P58282 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 13571 T1131 C54 P58282 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 13571 T1131 C54 P58282 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=unloadcollection2
[junit4:junit4]   2> 13572 T1131 C54 P58282 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1a83067 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c8f5cc),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1a83067 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c8f5cc),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 13573 T1131 C54 P58282 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 13573 T1131 C54 P58282 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 13573 T1131 C54 P58282 oass.SolrIndexSearcher.<init> Opening Searcher@b3911e main
[junit4:junit4]   2> 13574 T1130 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@b3911e main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 13574 T1131 C54 P58282 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@65599f lockFactory=org.apache.lucene.store.NativeFSLockFactory@d96725)
[junit4:junit4]   2> 13574 T1131 C54 P58282 oasc.RecoveryStrategy.replay No replay needed. core=unloadcollection2
[junit4:junit4]   2> 13575 T1131 C54 P58282 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=unloadcollection2
[junit4:junit4]   2> 13575 T1131 C54 P58282 oasc.ZkController.publish publishing core=unloadcollection2 state=active
[junit4:junit4]   2> 13575 T1131 C54 P58282 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 13576 T1131 C54 P58282 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=unloadcollection2
[junit4:junit4]   2> 13960 T1066 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13961 T1066 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:58282_ap_an",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"unloadcollection2",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:58282/ap_an"}
[junit4:junit4]   2> 13964 T1065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13964 T1070 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13964 T1083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13964 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13964 T1111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13964 T1129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13964 T1125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14552 T1043 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14552 T1043 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: unloadcollection
[junit4:junit4]   2> 14553 T1043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 14557 T1105 oasc.CoreContainer.create Creating SolrCore 'unloadcollection3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362959010809/unloadcollection3
[junit4:junit4]   2> 14557 T1105 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4]   2> 14558 T1105 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 14558 T1105 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4]   2> 14559 T1105 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362959010809/unloadcollection3/'
[junit4:junit4]   2> 14603 T1105 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 14642 T1105 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 14643 T1105 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 14647 T1105 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 15079 T1105 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 15085 T1105 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 15088 T1105 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 15096 T1105 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15100 T1105 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15103 T1105 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15104 T1105 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15104 T1105 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15104 T1105 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15105 T1105 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15105 T1105 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15106 T1105 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 15106 T1105 oasc.SolrCore.<init> [unloadcollection3] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362959010809/unloadcollection3/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959022693unloadcollection_3n/
[junit4:junit4]   2> 15106 T1105 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12176dd
[junit4:junit4]   2> 15107 T1105 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 15107 T1105 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959022693unloadcollection_3n forceNew: false
[junit4:junit4]   2> 15108 T1105 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959022693unloadcollection_3n/index/
[junit4:junit4]   2> 15108 T1105 oasc.SolrCore.initIndex WARNING [unloadcollection3] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959022693unloadcollection_3n/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 15108 T1105 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959022693unloadcollection_3n/index forceNew: false
[junit4:junit4]   2> 15109 T1105 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@ff9c85 lockFactory=org.apache.lucene.store.NativeFSLockFactory@fac1d),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15110 T1105 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15111 T1105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 15111 T1105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 15112 T1105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 15112 T1105 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 15113 T1105 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 15113 T1105 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 15113 T1105 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 15114 T1105 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 15114 T1105 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 15116 T1105 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 15119 T1105 oass.SolrIndexSearcher.<init> Opening Searcher@e11485 main
[junit4:junit4]   2> 15119 T1105 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959022693unloadcollection_3n/tlog
[junit4:junit4]   2> 15120 T1105 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 15120 T1105 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 15124 T1134 oasc.SolrCore.registerSearcher [unloadcollection3] Registered new searcher Searcher@e11485 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 15126 T1105 oasc.ZkController.publish publishing core=unloadcollection3 state=down
[junit4:junit4]   2> 15126 T1105 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15468 T1066 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15468 T1066 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:49811_ap_an",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"unloadcollection3",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:49811/ap_an"}
[junit4:junit4]   2> 15468 T1066 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 15469 T1066 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 15473 T1129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15473 T1111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15473 T1125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15473 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15473 T1070 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15473 T1065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15473 T1083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16128 T1105 oasc.CoreContainer.registerCore registering core: unloadcollection3
[junit4:junit4]   2> 16128 T1105 oasc.ZkController.register Register replica - core:unloadcollection3 address:http://127.0.0.1:49811/ap_an collection:unloadcollection shard:shard1
[junit4:junit4]   2> 16131 T1105 oasc.ZkController.register We are http://127.0.0.1:49811/ap_an/unloadcollection3/ and leader is http://127.0.0.1:56910/ap_an/unloadcollection1/
[junit4:junit4]   2> 16132 T1105 oasc.ZkController.register No LogReplay needed for core=unloadcollection3 baseURL=http://127.0.0.1:49811/ap_an
[junit4:junit4]   2> 16132 T1105 oasc.ZkController.checkRecovery Core needs to recover:unloadcollection3
[junit4:junit4]   2> 16133 T1105 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C56 name=unloadcollection3 org.apache.solr.core.SolrCore@94f8df url=http://127.0.0.1:49811/ap_an/unloadcollection3 node=127.0.0.1:49811_ap_an C56_STATE=coll:unloadcollection core:unloadcollection3 props:{state=down, collection=unloadcollection, node_name=127.0.0.1:49811_ap_an, core=unloadcollection3, base_url=http://127.0.0.1:49811/ap_an}
[junit4:junit4]   2> 16133 T1135 C56 P49811 oasc.RecoveryStrategy.run Starting recovery process.  core=unloadcollection3 recoveringAfterStartup=true
[junit4:junit4]   2> 16135 T1135 C56 P49811 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 16134 T1105 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16135 T1135 C56 P49811 oasc.ZkController.publish publishing core=unloadcollection3 state=recovering
[junit4:junit4]   2> 16135 T1135 C56 P49811 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 16135 T1105 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362959010809/solr.xml
[junit4:junit4]   2> 16136 T1135 C56 P49811 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 16145 T1105 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362959010809/solr.xml
[junit4:junit4]   2> 16146 T1105 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959022693unloadcollection_3n&name=unloadcollection3&version=2&wt=javabin&collection=unloadcollection&action=CREATE} status=0 QTime=1589 
[junit4:junit4]   2> 16147 T1043 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 16147 T1043 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16977 T1066 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16978 T1066 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:49811_ap_an",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"unloadcollection3",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:49811/ap_an"}
[junit4:junit4]   2> 16980 T1129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16980 T1125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16980 T1083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16980 T1070 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16980 T1111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16980 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16981 T1065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17140 T1076 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {version=2&wt=javabin&checkLive=true&state=recovering&nodeName=127.0.0.1:49811_ap_an&core=unloadcollection1&onlyIfLeader=true&coreNodeName=127.0.0.1:49811_ap_an_unloadcollection3&action=PREPRECOVERY} status=0 QTime=1000 
[junit4:junit4]   2> 17149 T1043 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18150 T1043 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C56_STATE=coll:unloadcollection core:unloadcollection3 props:{state=recovering, shard=shard1, collection=unloadcollection, node_name=127.0.0.1:49811_ap_an, core=unloadcollection3, base_url=http://127.0.0.1:49811/ap_an}
[junit4:junit4]   2> 19141 T1135 C56 P49811 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:56910/ap_an/unloadcollection1/ core=unloadcollection3 - recoveringAfterStartup=true
[junit4:junit4]   2> 19141 T1135 C56 P49811 oasu.PeerSync.sync PeerSync: core=unloadcollection3 url=http://127.0.0.1:49811/ap_an START replicas=[http://127.0.0.1:56910/ap_an/unloadcollection1/] nUpdates=100
[junit4:junit4]   2> 19141 T1135 C56 P49811 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 19142 T1135 C56 P49811 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=unloadcollection3
[junit4:junit4]   2> 19142 T1135 C56 P49811 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=unloadcollection3
[junit4:junit4]   2> 19142 T1135 C56 P49811 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=unloadcollection3
[junit4:junit4]   2> 19142 T1135 C56 P49811 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 19142 T1135 C56 P49811 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:56910/ap_an/unloadcollection1/. core=unloadcollection3
[junit4:junit4]   2> 19142 T1135 C56 P49811 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 19143 T1077 C55 P56910 REQ /get {version=2&wt=javabin&getVersions=100&distrib=false&qt=/get} status=0 QTime=0 
[junit4:junit4]   2> 19146 T1079 C55 P56910 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 19147 T1079 C55 P56910 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e80663 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e20319),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e80663 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e20319),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 19148 T1079 C55 P56910 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 19148 T1079 C55 P56910 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 19148 T1079 C55 P56910 /update {waitSearcher=true&commit=true&version=2&wt=javabin&openSearcher=false&softCommit=false&commit_end_point=true} {commit=} 0 2
[junit4:junit4]   2> 19149 T1135 C56 P49811 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 19149 T1135 C56 P49811 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 19151 T1078 C55 P56910 REQ /replication {version=2&wt=javabin&qt=/replication&command=indexversion} status=0 QTime=0 
[junit4:junit4]   2> 19151 T1135 C56 P49811 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4]   2> 19151 T1135 C56 P49811 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 19152 T1135 C56 P49811 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 19152 T1043 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19153 T1077 C55 P56910 REQ /replication {version=2&wt=javabin&generation=3&qt=/replication&command=filelist} status=0 QTime=0 
[junit4:junit4]   2> 19154 T1135 C56 P49811 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 19155 T1135 C56 P49811 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362959008140/1362959022693unloadcollection_3n/index.20130310194347291 forceNew: false
[junit4:junit4]   2> 19155 T1135 C56 P49811 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@1167ba4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ece286) fullCopy=false
[junit4:junit4]   2> 19157 T1079 C55 P56910 REQ /replication {file=segments_3&wt=filestream&generation=3&qt=/replication&command=filecontent&checksum=true} status=0 QTime=0 
[junit4:junit4]   2> 19158 T1135 C56 P49811 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 19159 T1135 C56 P49811 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 19159 T1135 C56 P49811 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=unloadcollection3
[junit4:junit4]   2> 19159 T1135 C56 P49811 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@ff9c85 lockFactory=org.apache.lucene.store.NativeFSLockFactory@fac1d),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@ff9c85 lockFactory=org.apache.lucene.store.NativeFSLockFactory@fac1d),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 19160 T1135 C56 P49811 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 19160 T1135 C56 P49811 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 19160 T1135 C56 P49811 oass.SolrIndexSearcher.<init> Opening Searcher@13311a7 main
[junit4:junit4]   2> 19161 T1134 oasc.SolrCore.registerSearcher [unloadcollection3] Registered new searcher Searcher@13311a7 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4]   2> 19162 T1135 C56 P49811 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@1167ba4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ece286)
[junit4:junit4]   2> 19162 T1135 C56 P49811 oasc.RecoveryStrategy.replay No replay needed. core=unloadcollection3
[junit4:junit4]   2> 19162 T1135 C56 P49811 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=unloadcollection3
[junit4:junit4]   2> 19162 T1135 C56 P49811 oasc.ZkController.publish publishing core=unloadcollection3 state=active
[junit4:junit4]   2> 19162 T1135 C56 P49811 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 19163 T1135 C56 P49811 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=unloadcollection3
[junit4:junit4]   2> 19986 T1066 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19987 T1066 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:49811_ap_an",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"unloadcollection3",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:49811/ap_an"}
[junit4:junit4]   2> 19995 T1065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19995 T1111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19995 T1070 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19995 T1125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19995 T1083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19995 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19995 T1129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20153 T1043 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20154 T1043 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: unloadcollection
[junit4:junit4]   2> 20155 T1043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2>  C56_STATE=coll:unloadcollection core:unloadcollection3 props:{state=active, shard=shard1, collection=unloadcollection, node_name=127.0.0.1:49811_ap_an, core=unloadcollection3, base_url=http://127.0.0.1:49811/ap_an}
[junit4:junit4]   2> 20182 T1107 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[20 (1429166126072332288)]} 0 1
[junit4:junit4]   2>  C54_STATE=coll:unloadcollection core:unloadcollection2 props:{state=active, shard=shard1, collection=unloadcollection, node_name=127.0.0.1:58282_ap_an, core=unloadcollection2, base_url=http://127.0.0.1:58282/ap_an}
[junit4:junit4]   2> 20188 T1091 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[20 (1429166126072332288)]} 0 2
[junit4:junit4]   2> 20188 T1079 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[20 (1429166126072332288)]} 0 12
[junit4:junit4]   2> 20189 T1104 C56 P49811 /update {version=2&wt=javabin} {add=[20]} 0 15
[junit4:junit4]   2> 20197 T1106 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[21 (1429166126090158080)]} 0 1
[junit4:junit4]   2> 20197 T1093 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[21 (1429166126090158080)]} 0 1
[junit4:junit4]   2> 20198 T1076 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[21 (1429166126090158080)]} 0 5
[junit4:junit4]   2> 20198 T1105 C56 P49811 /update {version=2&wt=javabin} {add=[21]} 0 6
[junit4:junit4]   2> 20208 T1104 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[22 (1429166126099595264)]} 0 2
[junit4:junit4]   2> 20208 T1090 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[22 (1429166126099595264)]} 0 2
[junit4:junit4]   2> 20209 T1078 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[22 (1429166126099595264)]} 0 7
[junit4:junit4]   2> 20209 T1107 C56 P49811 /update {version=2&wt=javabin} {add=[22]} 0 9
[junit4:junit4]   2> 20217 T1105 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[23 (1429166126112178176)]} 0 0
[junit4:junit4]   2> 20218 T1092 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[23 (1429166126112178176)]} 0 1
[junit4:junit4]   2> 20218 T1077 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[23 (1429166126112178176)]} 0 4
[junit4:junit4]   2> 20219 T1106 C56 P49811 /update {version=2&wt=javabin} {add=[23]} 0 7
[junit4:junit4]   2> 20226 T1107 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[24 (1429166126121615360)]} 0 1
[junit4:junit4]   2> 20226 T1091 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[24 (1429166126121615360)]} 0 1
[junit4:junit4]   2> 20227 T1079 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[24 (1429166126121615360)]} 0 4
[junit4:junit4]   2> 20227 T1104 C56 P49811 /update {version=2&wt=javabin} {add=[24]} 0 6
[junit4:junit4]   2> 20236 T1093 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[25 (1429166126131052544)]} 0 2
[junit4:junit4]   2> 20236 T1106 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[25 (1429166126131052544)]} 0 2
[junit4:junit4]   2> 20237 T1076 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[25 (1429166126131052544)]} 0 6
[junit4:junit4]   2> 20237 T1105 C56 P49811 /update {version=2&wt=javabin} {add=[25]} 0 7
[junit4:junit4]   2> 20245 T1104 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[26 (1429166126141538304)]} 0 1
[junit4:junit4]   2> 20245 T1090 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[26 (1429166126141538304)]} 0 1
[junit4:junit4]   2> 20245 T1078 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[26 (1429166126141538304)]} 0 3
[junit4:junit4]   2> 20246 T1107 C56 P49811 /update {version=2&wt=javabin} {add=[26]} 0 6
[junit4:junit4]   2> 20253 T1092 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[27 (1429166126149926912)]} 0 1
[junit4:junit4]   2> 20253 T1105 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[27 (1429166126149926912)]} 0 1
[junit4:junit4]   2> 20253 T1077 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[27 (1429166126149926912)]} 0 3
[junit4:junit4]   2> 20254 T1106 C56 P49811 /update {version=2&wt=javabin} {add=[27]} 0 6
[junit4:junit4]   2> 20261 T1107 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[28 (1429166126158315520)]} 0 1
[junit4:junit4]   2> 20261 T1091 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[28 (1429166126158315520)]} 0 1
[junit4:junit4]   2> 20262 T1079 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[28 (1429166126158315520)]} 0 4
[junit4:junit4]   2> 20262 T1104 C56 P49811 /update {version=2&wt=javabin} {add=[28]} 0 6
[junit4:junit4]   2> 20269 T1093 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[29 (1429166126166704128)]} 0 0
[junit4:junit4]   2> 20269 T1106 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[29 (1429166126166704128)]} 0 0
[junit4:junit4]   2> 20270 T1076 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[29 (1429166126166704128)]} 0 4
[junit4:junit4]   2> 20271 T1105 C56 P49811 /update {version=2&wt=javabin} {add=[29]} 0 7
[junit4:junit4]   2> 20277 T1104 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[30 (1429166126176141312)]} 0 0
[junit4:junit4]   2> 20277 T1090 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[30 (1429166126176141312)]} 0 0
[junit4:junit4]   2> 20278 T1078 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[30 (1429166126176141312)]} 0 4
[junit4:junit4]   2> 20279 T1107 C56 P49811 /update {version=2&wt=javabin} {add=[30]} 0 6
[junit4:junit4]   2> 20286 T1092 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[31 (1429166126184529920)]} 0 1
[junit4:junit4]   2> 20286 T1105 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[31 (1429166126184529920)]} 0 1
[junit4:junit4]   2> 20287 T1077 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[31 (1429166126184529920)]} 0 4
[junit4:junit4]   2> 20288 T1106 C56 P49811 /update {version=2&wt=javabin} {add=[31]} 0 7
[junit4:junit4]   2> 20295 T1091 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[32 (1429166126193967104)]} 0 1
[junit4:junit4]   2> 20295 T1107 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[32 (1429166126193967104)]} 0 1
[junit4:junit4]   2> 20296 T1079 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[32 (1429166126193967104)]} 0 4
[junit4:junit4]   2> 20296 T1104 C56 P49811 /update {version=2&wt=javabin} {add=[32]} 0 6
[junit4:junit4]   2> 20303 T1106 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[33 (1429166126203404288)]} 0 0
[junit4:junit4]   2> 20304 T1093 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[33 (1429166126203404288)]} 0 1
[junit4:junit4]   2> 20304 T1076 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[33 (1429166126203404288)]} 0 4
[junit4:junit4]   2> 20305 T1105 C56 P49811 /update {version=2&wt=javabin} {add=[33]} 0 6
[junit4:junit4]   2> 20312 T1090 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[34 (1429166126211792896)]} 0 1
[junit4:junit4]   2> 20312 T1104 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[34 (1429166126211792896)]} 0 1
[junit4:junit4]   2> 20313 T1078 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[34 (1429166126211792896)]} 0 4
[junit4:junit4]   2> 20314 T1107 C56 P49811 /update {version=2&wt=javabin} {add=[34]} 0 7
[junit4:junit4]   2> 20321 T1105 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[35 (1429166126221230080)]} 0 1
[junit4:junit4]   2> 20321 T1092 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[35 (1429166126221230080)]} 0 1
[junit4:junit4]   2> 20322 T1077 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[35 (1429166126221230080)]} 0 4
[junit4:junit4]   2> 20322 T1106 C56 P49811 /update {version=2&wt=javabin} {add=[35]} 0 6
[junit4:junit4]   2> 20329 T1107 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[36 (1429166126229618688)]} 0 1
[junit4:junit4]   2> 20329 T1091 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[36 (1429166126229618688)]} 0 1
[junit4:junit4]   2> 20330 T1079 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[36 (1429166126229618688)]} 0 4
[junit4:junit4]   2> 20330 T1104 C56 P49811 /update {version=2&wt=javabin} {add=[36]} 0 6
[junit4:junit4]   2> 20338 T1106 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[37 (1429166126238007296)]} 0 1
[junit4:junit4]   2> 20338 T1093 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[37 (1429166126238007296)]} 0 1
[junit4:junit4]   2> 20339 T1076 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[37 (1429166126238007296)]} 0 5
[junit4:junit4]   2> 20339 T1105 C56 P49811 /update {version=2&wt=javabin} {add=[37]} 0 7
[junit4:junit4]   2> 20346 T1104 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[38 (1429166126248493056)]} 0 0
[junit4:junit4]   2> 20346 T1090 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[38 (1429166126248493056)]} 0 0
[junit4:junit4]   2> 20347 T1078 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[38 (1429166126248493056)]} 0 4
[junit4:junit4]   2> 20348 T1107 C56 P49811 /update {version=2&wt=javabin} {add=[38]} 0 6
[junit4:junit4]   2> 20355 T1105 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[39 (1429166126256881664)]} 0 1
[junit4:junit4]   2> 20355 T1092 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[39 (1429166126256881664)]} 0 1
[junit4:junit4]   2> 20355 T1079 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[39 (1429166126256881664)]} 0 3
[junit4:junit4]   2> 20356 T1106 C56 P49811 /update {version=2&wt=javabin} {add=[39]} 0 6
[junit4:junit4]   2> 20363 T1091 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[40 (1429166126265270272)]} 0 1
[junit4:junit4]   2> 20363 T1107 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[40 (1429166126265270272)]} 0 1
[junit4:junit4]   2> 20364 T1076 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[40 (1429166126265270272)]} 0 4
[junit4:junit4]   2> 20364 T1104 C56 P49811 /update {version=2&wt=javabin} {add=[40]} 0 6
[junit4:junit4]   2> 20371 T1106 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[41 (1429166126273658880)]} 0 1
[junit4:junit4]   2> 20371 T1093 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[41 (1429166126273658880)]} 0 1
[junit4:junit4]   2> 20372 T1078 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[41 (1429166126273658880)]} 0 4
[junit4:junit4]   2> 20372 T1105 C56 P49811 /update {version=2&wt=javabin} {add=[41]} 0 6
[junit4:junit4]   2> 20379 T1104 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[42 (1429166126283096064)]} 0 0
[junit4:junit4]   2> 20379 T1090 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[42 (1429166126283096064)]} 0 0
[junit4:junit4]   2> 20380 T1077 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[42 (1429166126283096064)]} 0 4
[junit4:junit4]   2> 20380 T1107 C56 P49811 /update {version=2&wt=javabin} {add=[42]} 0 5
[junit4:junit4]   2> 20388 T1092 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[43 (1429166126291484672)]} 0 1
[junit4:junit4]   2> 20388 T1105 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[43 (1429166126291484672)]} 0 1
[junit4:junit4]   2> 20389 T1079 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[43 (1429166126291484672)]} 0 5
[junit4:junit4]   2> 20390 T1106 C56 P49811 /update {version=2&wt=javabin} {add=[43]} 0 7
[junit4:junit4]   2> 20397 T1107 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[44 (1429166126300921856)]} 0 1
[junit4:junit4]   2> 20397 T1091 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[44 (1429166126300921856)]} 0 1
[junit4:junit4]   2> 20398 T1076 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[44 (1429166126300921856)]} 0 4
[junit4:junit4]   2> 20399 T1104 C56 P49811 /update {version=2&wt=javabin} {add=[44]} 0 7
[junit4:junit4]   2> 20406 T1106 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[45 (1429166126310359040)]} 0 1
[junit4:junit4]   2> 20406 T1093 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[45 (1429166126310359040)]} 0 1
[junit4:junit4]   2> 20406 T1078 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[45 (1429166126310359040)]} 0 3
[junit4:junit4]   2> 20407 T1105 C56 P49811 /update {version=2&wt=javabin} {add=[45]} 0 6
[junit4:junit4]   2> 20414 T1104 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[46 (1429166126318747648)]} 0 1
[junit4:junit4]   2> 20414 T1090 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[46 (1429166126318747648)]} 0 1
[junit4:junit4]   2> 20415 T1077 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[46 (1429166126318747648)]} 0 4
[junit4:junit4]   2> 20415 T1107 C56 P49811 /update {version=2&wt=javabin} {add=[46]} 0 6
[junit4:junit4]   2> 20422 T1092 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[47 (1429166126328184832)]} 0 0
[junit4:junit4]   2> 20423 T1105 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[47 (1429166126328184832)]} 0 1
[junit4:junit4]   2> 20423 T1079 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[47 (1429166126328184832)]} 0 4
[junit4:junit4]   2> 20424 T1106 C56 P49811 /update {version=2&wt=javabin} {add=[47]} 0 6
[junit4:junit4]   2> 20431 T1091 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[48 (1429166126336573440)]} 0 1
[junit4:junit4]   2> 20431 T1107 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[48 (1429166126336573440)]} 0 1
[junit4:junit4]   2> 20432 T1076 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[48 (1429166126336573440)]} 0 4
[junit4:junit4]   2> 20432 T1104 C56 P49811 /update {version=2&wt=javabin} {add=[48]} 0 6
[junit4:junit4]   2> 20439 T1106 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[49 (1429166126344962048)]} 0 1
[junit4:junit4]   2> 20439 T1093 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[49 (1429166126344962048)]} 0 1
[junit4:junit4]   2> 20440 T1078 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[49 (1429166126344962048)]} 0 4
[junit4:junit4]   2> 20440 T1105 C56 P49811 /update {version=2&wt=javabin} {add=[49]} 0 6
[junit4:junit4]   2> 20447 T1104 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[50 (1429166126354399232)]} 0 0
[junit4:junit4]   2> 20447 T1090 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[50 (1429166126354399232)]} 0 0
[junit4:junit4]   2> 20448 T1077 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[50 (1429166126354399232)]} 0 3
[junit4:junit4]   2> 20449 T1107 C56 P49811 /update {version=2&wt=javabin} {add=[50]} 0 6
[junit4:junit4]   2> 20456 T1105 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[51 (1429166126362787840)]} 0 1
[junit4:junit4]   2> 20456 T1092 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[51 (1429166126362787840)]} 0 1
[junit4:junit4]   2> 20457 T1079 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[51 (1429166126362787840)]} 0 4
[junit4:junit4]   2> 20458 T1106 C56 P49811 /update {version=2&wt=javabin} {add=[51]} 0 7
[junit4:junit4]   2> 20465 T1091 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[52 (1429166126372225024)]} 0 1
[junit4:junit4]   2> 20465 T1107 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[52 (1429166126372225024)]} 0 1
[junit4:junit4]   2> 20466 T1076 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[52 (1429166126372225024)]} 0 4
[junit4:junit4]   2> 20466 T1104 C56 P49811 /update {version=2&wt=javabin} {add=[52]} 0 6
[junit4:junit4]   2> 20473 T1106 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[53 (1429166126381662208)]} 0 0
[junit4:junit4]   2> 20473 T1093 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[53 (1429166126381662208)]} 0 0
[junit4:junit4]   2> 20474 T1078 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[53 (1429166126381662208)]} 0 4
[junit4:junit4]   2> 20475 T1105 C56 P49811 /update {version=2&wt=javabin} {add=[53]} 0 6
[junit4:junit4]   2> 20481 T1104 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[54 (1429166126390050816)]} 0 0
[junit4:junit4]   2> 20482 T1090 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[54 (1429166126390050816)]} 0 1
[junit4:junit4]   2> 20482 T1077 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[54 (1429166126390050816)]} 0 3
[junit4:junit4]   2> 20483 T1107 C56 P49811 /update {version=2&wt=javabin} {add=[54]} 0 6
[junit4:junit4]   2> 20490 T1105 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[55 (1429166126398439424)]} 0 0
[junit4:junit4]   2> 20491 T1092 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[55 (1429166126398439424)]} 0 1
[junit4:junit4]   2> 20491 T1079 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[55 (1429166126398439424)]} 0 4
[junit4:junit4]   2> 20492 T1106 C56 P49811 /update {version=2&wt=javabin} {add=[55]} 0 7
[junit4:junit4]   2> 20498 T1091 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[56 (1429166126407876608)]} 0 0
[junit4:junit4]   2> 20499 T1107 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[56 (1429166126407876608)]} 0 1
[junit4:junit4]   2> 20499 T1076 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[56 (1429166126407876608)]} 0 3
[junit4:junit4]   2> 20500 T1104 C56 P49811 /update {version=2&wt=javabin} {add=[56]} 0 6
[junit4:junit4]   2> 20506 T1106 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[57 (1429166126416265216)]} 0 0
[junit4:junit4]   2> 20507 T1093 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[57 (1429166126416265216)]} 0 1
[junit4:junit4]   2> 20507 T1078 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[57 (1429166126416265216)]} 0 3
[junit4:junit4]   2> 20508 T1105 C56 P49811 /update {version=2&wt=javabin} {add=[57]} 0 6
[junit4:junit4]   2> 20515 T1090 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[58 (1429166126424653824)]} 0 1
[junit4:junit4]   2> 20515 T1104 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[58 (1429166126424653824)]} 0 1
[junit4:junit4]   2> 20516 T1077 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[58 (1429166126424653824)]} 0 4
[junit4:junit4]   2> 20517 T1107 C56 P49811 /update {version=2&wt=javabin} {add=[58]} 0 7
[junit4:junit4]   2> 20523 T1105 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[59 (1429166126434091008)]} 0 0
[junit4:junit4]   2> 20524 T1092 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[59 (1429166126434091008)]} 0 1
[junit4:junit4]   2> 20524 T1079 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[59 (1429166126434091008)]} 0 3
[junit4:junit4]   2> 20525 T1106 C56 P49811 /update {version=2&wt=javabin} {add=[59]} 0 6
[junit4:junit4]   2> 20532 T1091 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[60 (1429166126442479616)]} 0 1
[junit4:junit4]   2> 20533 T1107 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[60 (1429166126442479616)]} 0 0
[junit4:junit4]   2> 20534 T1076 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[60 (1429166126442479616)]} 0 5
[junit4:junit4]   2> 20535 T1104 C56 P49811 /update {version=2&wt=javabin} {add=[60]} 0 8
[junit4:junit4]   2> 20542 T1093 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[61 (1429166126451916800)]} 0 1
[junit4:junit4]   2> 20542 T1106 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[61 (1429166126451916800)]} 0 1
[junit4:junit4]   2> 20543 T1078 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[61 (1429166126451916800)]} 0 5
[junit4:junit4]   2> 20543 T1105 C56 P49811 /update {version=2&wt=javabin} {add=[61]} 0 6
[junit4:junit4]   2> 20550 T1104 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[62 (1429166126461353984)]} 0 0
[junit4:junit4]   2> 20550 T1090 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[62 (1429166126461353984)]} 0 0
[junit4:junit4]   2> 20551 T1077 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[62 (1429166126461353984)]} 0 4
[junit4:junit4]   2> 20552 T1107 C56 P49811 /update {version=2&wt=javabin} {add=[62]} 0 7
[junit4:junit4]   2> 20559 T1105 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[63 (1429166126470791168)]} 0 1
[junit4:junit4]   2> 20559 T1092 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[63 (1429166126470791168)]} 0 1
[junit4:junit4]   2> 20559 T1079 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[63 (1429166126470791168)]} 0 3
[junit4:junit4]   2> 20560 T1106 C56 P49811 /update {version=2&wt=javabin} {add=[63]} 0 6
[junit4:junit4]   2> 20567 T1091 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[64 (1429166126479179776)]} 0 1
[junit4:junit4]   2> 20567 T1105 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[64 (1429166126479179776)]} 0 1
[junit4:junit4]   2> 20568 T1076 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[64 (1429166126479179776)]} 0 4
[junit4:junit4]   2> 20569 T1104 C56 P49811 /update {version=2&wt=javabin} {add=[64]} 0 7
[junit4:junit4]   2> 20576 T1093 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[65 (1429166126488616960)]} 0 1
[junit4:junit4]   2> 20576 T1107 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[65 (1429166126488616960)]} 0 1
[junit4:junit4]   2> 20577 T1078 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[65 (1429166126488616960)]} 0 4
[junit4:junit4]   2> 20578 T1106 C56 P49811 /update {version=2&wt=javabin} {add=[65]} 0 7
[junit4:junit4]   2> 20585 T1104 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[66 (1429166126498054144)]} 0 1
[junit4:junit4]   2> 20585 T1090 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[66 (1429166126498054144)]} 0 1
[junit4:junit4]   2> 20586 T1077 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[66 (1429166126498054144)]} 0 4
[junit4:junit4]   2> 20586 T1105 C56 P49811 /update {version=2&wt=javabin} {add=[66]} 0 6
[junit4:junit4]   2> 20594 T1107 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[67 (1429166126506442752)]} 0 1
[junit4:junit4]   2> 20594 T1093 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[67 (1429166126506442752)]} 0 1
[junit4:junit4]   2> 20595 T1079 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[67 (1429166126506442752)]} 0 5
[junit4:junit4]   2> 20595 T1106 C56 P49811 /update {version=2&wt=javabin} {add=[67]} 0 7
[junit4:junit4]   2> 20602 T1092 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[68 (1429166126516928512)]} 0 0
[junit4:junit4]   2> 20603 T1105 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[68 (1429166126516928512)]} 0 1
[junit4:junit4]   2> 20603 T1076 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[68 (1429166126516928512)]} 0 4
[junit4:junit4]   2> 20604 T1104 C56 P49811 /update {version=2&wt=javabin} {add=[68]} 0 7
[junit4:junit4]   2> 20611 T1106 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[69 (1429166126525317120)]} 0 1
[junit4:junit4]   2> 20611 T1090 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[69 (1429166126525317120)]} 0 1
[junit4:junit4]   2> 20612 T1078 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[69 (1429166126525317120)]} 0 4
[junit4:junit4]   2> 20612 T1107 C56 P49811 /update {version=2&wt=javabin} {add=[69]} 0 6
[junit4:junit4]   2> 20619 T1104 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[70 (1429166126533705728)]} 0 0
[junit4:junit4]   2> 20619 T1091 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[70 (1429166126533705728)]} 0 0
[junit4:junit4]   2> 20620 T1077 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[70 (1429166126533705728)]} 0 4
[junit4:junit4]   2> 20620 T1105 C56 P49811 /update {version=2&wt=javabin} {add=[70]} 0 6
[junit4:junit4]   2> 20627 T1093 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[71 (1429166126542094336)]} 0 0
[junit4:junit4]   2> 20627 T1107 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[71 (1429166126542094336)]} 0 0
[junit4:junit4]   2> 20628 T1079 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[71 (1429166126542094336)]} 0 4
[junit4:junit4]   2> 20629 T1106 C56 P49811 /update {version=2&wt=javabin} {add=[71]} 0 6
[junit4:junit4]   2> 20635 T1105 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[72 (1429166126551531520)]} 0 0
[junit4:junit4]   2> 20636 T1092 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[72 (1429166126551531520)]} 0 1
[junit4:junit4]   2> 20636 T1076 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[72 (1429166126551531520)]} 0 3
[junit4:junit4]   2> 20637 T1104 C56 P49811 /update {version=2&wt=javabin} {add=[72]} 0 6
[junit4:junit4]   2> 20644 T1090 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[73 (1429166126559920128)]} 0 1
[junit4:junit4]   2> 20644 T1106 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[73 (1429166126559920128)]} 0 1
[junit4:junit4]   2> 20645 T1078 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[73 (1429166126559920128)]} 0 4
[junit4:junit4]   2> 20646 T1107 C56 P49811 /update {version=2&wt=javabin} {add=[73]} 0 7
[junit4:junit4]   2> 20653 T1104 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[74 (1429166126569357312)]} 0 1
[junit4:junit4]   2> 20653 T1091 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[74 (1429166126569357312)]} 0 1
[junit4:junit4]   2> 20653 T1077 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[74 (1429166126569357312)]} 0 3
[junit4:junit4]   2> 20654 T1105 C56 P49811 /update {version=2&wt=javabin} {add=[74]} 0 6
[junit4:junit4]   2> 20661 T1107 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[75 (1429166126577745920)]} 0 1
[junit4:junit4]   2> 20661 T1093 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[75 (1429166126577745920)]} 0 1
[junit4:junit4]   2> 20662 T1079 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[75 (1429166126577745920)]} 0 4
[junit4:junit4]   2> 20662 T1106 C56 P49811 /update {version=2&wt=javabin} {add=[75]} 0 6
[junit4:junit4]   2> 20669 T1105 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[76 (1429166126586134528)]} 0 1
[junit4:junit4]   2> 20669 T1092 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[76 (1429166126586134528)]} 0 1
[junit4:junit4]   2> 20670 T1076 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[76 (1429166126586134528)]} 0 4
[junit4:junit4]   2> 20671 T1104 C56 P49811 /update {version=2&wt=javabin} {add=[76]} 0 7
[junit4:junit4]   2> 20678 T1090 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[77 (1429166126595571712)]} 0 1
[junit4:junit4]   2> 20678 T1106 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[77 (1429166126595571712)]} 0 1
[junit4:junit4]   2> 20678 T1078 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[77 (1429166126595571712)]} 0 4
[junit4:junit4]   2> 20679 T1107 C56 P49811 /update {version=2&wt=javabin} {add=[77]} 0 6
[junit4:junit4]   2> 20686 T1104 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[78 (1429166126603960320)]} 0 1
[junit4:junit4]   2> 20686 T1091 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[78 (1429166126603960320)]} 0 1
[junit4:junit4]   2> 20687 T1077 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[78 (1429166126603960320)]} 0 4
[junit4:junit4]   2> 20687 T1105 C56 P49811 /update {version=2&wt=javabin} {add=[78]} 0 6
[junit4:junit4]   2> 20694 T1107 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[79 (1429166126612348928)]} 0 1
[junit4:junit4]   2> 20694 T1093 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[79 (1429166126612348928)]} 0 1
[junit4:junit4]   2> 20695 T1079 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[79 (1429166126612348928)]} 0 4
[junit4:junit4]   2> 20696 T1106 C56 P49811 /update {version=2&wt=javabin} {add=[79]} 0 7
[junit4:junit4]   2> 20702 T1105 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[80 (1429166126621786112)]} 0 0
[junit4:junit4]   2> 20702 T1092 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[80 (1429166126621786112)]} 0 0
[junit4:junit4]   2> 20703 T1076 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[80 (1429166126621786112)]} 0 3
[junit4:junit4]   2> 20704 T1104 C56 P49811 /update {version=2&wt=javabin} {add=[80]} 0 6
[junit4:junit4]   2> 20711 T1090 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[81 (1429166126630174720)]} 0 1
[junit4:junit4]   2> 20711 T1106 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[81 (1429166126630174720)]} 0 1
[junit4:junit4]   2> 20712 T1078 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[81 (1429166126630174720)]} 0 4
[junit4:junit4]   2> 20712 T1107 C56 P49811 /update {version=2&wt=javabin} {add=[81]} 0 6
[junit4:junit4]   2> 20719 T1104 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[82 (1429166126638563328)]} 0 1
[junit4:junit4]   2> 20719 T1091 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[82 (1429166126638563328)]} 0 0
[junit4:junit4]   2> 20720 T1077 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[82 (1429166126638563328)]} 0 4
[junit4:junit4]   2> 20720 T1105 C56 P49811 /update {version=2&wt=javabin} {add=[82]} 0 6
[junit4:junit4]   2> 20727 T1093 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[83 (1429166126646951936)]} 0 1
[junit4:junit4]   2> 20727 T1107 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[83 (1429166126646951936)]} 0 1
[junit4:junit4]   2> 20728 T1079 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[83 (1429166126646951936)]} 0 4
[junit4:junit4]   2> 20728 T1106 C56 P49811 /update {version=2&wt=javabin} {add=[83]} 0 5
[junit4:junit4]   2> 20735 T1092 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[84 (1429166126655340544)]} 0 1
[junit4:junit4]   2> 20735 T1105 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[84 (1429166126655340544)]} 0 1
[junit4:junit4]   2> 20735 T1076 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[84 (1429166126655340544)]} 0 3
[junit4:junit4]   2> 20736 T1104 C56 P49811 /update {version=2&wt=javabin} {add=[84]} 0 6
[junit4:junit4]   2> 20743 T1106 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[85 (1429166126663729152)]} 0 1
[junit4:junit4]   2> 20743 T1090 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[85 (1429166126663729152)]} 0 1
[junit4:junit4]   2> 20744 T1078 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[85 (1429166126663729152)]} 0 4
[junit4:junit4]   2> 20744 T1107 C56 P49811 /update {version=2&wt=javabin} {add=[85]} 0 6
[junit4:junit4]   2> 20751 T1091 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[86 (1429166126672117760)]} 0 1
[junit4:junit4]   2> 20751 T1104 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[86 (1429166126672117760)]} 0 1
[junit4:junit4]   2> 20752 T1077 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[86 (1429166126672117760)]} 0 4
[junit4:junit4]   2> 20752 T1105 C56 P49811 /update {version=2&wt=javabin} {add=[86]} 0 6
[junit4:junit4]   2> 20759 T1107 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[87 (1429166126680506368)]} 0 1
[junit4:junit4]   2> 20759 T1093 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[87 (1429166126680506368)]} 0 1
[junit4:junit4]   2> 20759 T1076 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[87 (1429166126680506368)]} 0 3
[junit4:junit4]   2> 20760 T1106 C56 P49811 /update {version=2&wt=javabin} {add=[87]} 0 6
[junit4:junit4]   2> 20767 T1092 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[88 (1429166126688894976)]} 0 1
[junit4:junit4]   2> 20767 T1105 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[88 (1429166126688894976)]} 0 1
[junit4:junit4]   2> 20767 T1077 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[88 (1429166126688894976)]} 0 3
[junit4:junit4]   2> 20768 T1104 C56 P49811 /update {version=2&wt=javabin} {add=[88]} 0 6
[junit4:junit4]   2> 20775 T1106 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[89 (1429166126697283584)]} 0 1
[junit4:junit4]   2> 20775 T1090 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[89 (1429166126697283584)]} 0 1
[junit4:junit4]   2> 20775 T1079 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[89 (1429166126697283584)]} 0 3
[junit4:junit4]   2> 20776 T1107 C56 P49811 /update {version=2&wt=javabin} {add=[89]} 0 6
[junit4:junit4]   2> 20783 T1091 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[90 (1429166126705672192)]} 0 1
[junit4:junit4]   2> 20783 T1104 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[90 (1429166126705672192)]} 0 1
[junit4:junit4]   2> 20784 T1078 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[90 (1429166126705672192)]} 0 4
[junit4:junit4]   2> 20784 T1105 C56 P49811 /update {version=2&wt=javabin} {add=[90]} 0 6
[junit4:junit4]   2> 20791 T1107 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[91 (1429166126714060800)]} 0 0
[junit4:junit4]   2> 20793 T1093 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[91 (1429166126714060800)]} 0 0
[junit4:junit4]   2> 20794 T1076 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[91 (1429166126714060800)]} 0 6
[junit4:junit4]   2> 20795 T1106 C56 P49811 /update {version=2&wt=javabin} {add=[91]} 0 9
[junit4:junit4]   2> 20801 T1092 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[92 (1429166126725595136)]} 0 0
[junit4:junit4]   2> 20802 T1105 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[92 (1429166126725595136)]} 0 1
[junit4:junit4]   2> 20802 T1077 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[92 (1429166126725595136)]} 0 3
[junit4:junit4]   2> 20803 T1104 C56 P49811 /update {version=2&wt=javabin} {add=[92]} 0 6
[junit4:junit4]   2> 20810 T1106 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[93 (1429166126733983744)]} 0 0
[junit4:junit4]   2> 20810 T1090 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[93 (1429166126733983744)]} 0 0
[junit4:junit4]   2> 20811 T1079 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[93 (1429166126733983744)]} 0 4
[junit4:junit4]   2> 20812 T1107 C56 P49811 /update {version=2&wt=javabin} {add=[93]} 0 7
[junit4:junit4]   2> 20819 T1091 C54 P58282 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[94 (1429166126743420928)]} 0 1
[junit4:junit4]   2> 20819 T1104 C56 P49811 /update {version=2&wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:56910/ap_an/unloadcollection1/} {add=[94 (1429166126743420928)]} 0 1
[junit4:junit4]   2> 20820 T1078 C55 P56910 /update {version=2&wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:49811/ap_an/unloadcollection3/} {add=[94 (1429166126743420928)]}

[...truncated too long message...]

t.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 32233 T2315 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 32236 T2314 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4]   2> 32329 T2389 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 32329 T2389 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 32330 T2389 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 32330 T2389 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 32738 T2318 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 33432 T2406 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 33432 T2406 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 33432 T2406 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 33432 T2406 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=tr, timezone=Asia/Aqtobe
[junit4:junit4]   2> NOTE: Linux 3.2.0-38-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=3,free=113119608,total=196456448
[junit4:junit4]   2> NOTE: All tests run in this JVM: [SpatialFilterTest, QueryParsingTest, JsonLoaderTest, AlternateDirectoryTest, TestFunctionQuery, TestRealTimeGet, PrimitiveFieldTypeTest, BadComponentTest, TestValueSourceCache, ShowFileRequestHandlerTest, TestDocSet, TestFuzzyAnalyzedSuggestions, TestIBSimilarityFactory, ShardRoutingTest, TestStressRecovery, DateFieldTest, TestReversedWildcardFilterFactory, ClusterStateUpdateTest, DistributedSpellCheckComponentTest, TestCoreContainer, TestXIncludeConfig, TermsComponentTest, QueryElevationComponentTest, UUIDFieldTest, BasicFunctionalityTest, SynonymTokenizerTest, QueryEqualityTest, AnalysisAfterCoreReloadTest, TestSolrDeletionPolicy2, OverseerCollectionProcessorTest, SuggesterFSTTest, BinaryUpdateRequestHandlerTest, CoreAdminHandlerTest, SimpleFacetsTest, DistributedTermsComponentTest, ZkCLITest, TestPerFieldSimilarity, TestGroupingSearch, TestRandomDVFaceting, SystemInfoHandlerTest, ZkControllerTest, TestExtendedDismaxParser, UnloadDistributedZkTest, SoftAutoCommitTest, TestSolrDeletionPolicy1, RegexBoostProcessorTest, MoreLikeThisHandlerTest, TestPhraseSuggestions, TestFastLRUCache, SliceStateUpdateTest, LeaderElectionTest, SyncSliceTest, DirectSolrConnectionTest, DistributedQueryElevationComponentTest, LoggingHandlerTest, MBeansHandlerTest, FieldMutatingUpdateProcessorTest, RAMDirectoryFactoryTest, TestQueryUtils, PrimUtilsTest, TermVectorComponentTest, TestPseudoReturnFields, TestSweetSpotSimilarityFactory, SpellingQueryConverterTest, LukeRequestHandlerTest, SuggesterTest, TestReplicationHandler, BasicDistributedZk2Test]
[junit4:junit4] Completed on J0 in 33.51s, 1 test, 1 error <<< FAILURES!

[...truncated 416 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:877: There were test failures: 270 suites, 1138 tests, 1 error, 1 failure, 13 ignored (7 assumptions)

Total time: 114 minutes 10 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.8.0-ea-b79 -client -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message