lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0-ea-b79) - Build # 4813 - Still Failing!
Date Thu, 21 Mar 2013 20:45:55 GMT
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/4813/
Java: 32bit/jdk1.8.0-ea-b79 -server -XX:+UseSerialGC

2 tests failed.
REGRESSION:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Server at http://127.0.0.1:34807/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:34807/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
	at __randomizedtesting.SeedInfo.seed([77035A56D75EC3D:8696BBBD1A2A8C01]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


REGRESSION:  org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch

Error Message:
Still found shard2 in collection test_unload_shard_and_collection

Stack Trace:
java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
	at __randomizedtesting.SeedInfo.seed([77035A56D75EC3D:8696BBBD1A2A8C01]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9154 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.UnloadDistributedZkTest
[junit4:junit4]   2> 0 T1406 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4]   2> 4 T1406 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594
[junit4:junit4]   2> 4 T1406 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 5 T1407 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 6 T1407 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 7 T1407 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 7 T1407 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 7 T1407 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 8 T1407 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-1363897952594/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 105 T1406 oasc.ZkTestServer.run start zk server on port:58908
[junit4:junit4]   2> 106 T1406 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58908 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@277c85
[junit4:junit4]   2> 107 T1406 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 107 T1412 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:58908. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 108 T1412 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:58908, initiating session
[junit4:junit4]   2> 108 T1408 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49726
[junit4:junit4]   2> 108 T1408 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49726
[junit4:junit4]   2> 108 T1410 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 123 T1410 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8ea729570000 with negotiated timeout 10000 for client /127.0.0.1:49726
[junit4:junit4]   2> 123 T1412 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:58908, sessionid = 0x13d8ea729570000, negotiated timeout = 10000
[junit4:junit4]   2> 124 T1413 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@277c85 name:ZooKeeperConnection Watcher:127.0.0.1:58908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 124 T1406 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 124 T1406 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 128 T1411 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8ea729570000
[junit4:junit4]   2> 128 T1413 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 129 T1408 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49726 which had sessionid 0x13d8ea729570000
[junit4:junit4]   2> 128 T1406 oaz.ZooKeeper.close Session: 0x13d8ea729570000 closed
[junit4:junit4]   2> 129 T1406 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58908/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@e09171
[junit4:junit4]   2> 130 T1414 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:58908. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 130 T1406 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 131 T1414 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:58908, initiating session
[junit4:junit4]   2> 131 T1408 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49727
[junit4:junit4]   2> 131 T1408 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49727
[junit4:junit4]   2> 132 T1410 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8ea729570001 with negotiated timeout 10000 for client /127.0.0.1:49727
[junit4:junit4]   2> 132 T1414 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:58908, sessionid = 0x13d8ea729570001, negotiated timeout = 10000
[junit4:junit4]   2> 132 T1415 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e09171 name:ZooKeeperConnection Watcher:127.0.0.1:58908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 132 T1406 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 133 T1406 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 135 T1406 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 138 T1406 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 141 T1406 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 144 T1406 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 144 T1406 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 148 T1406 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 149 T1406 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 153 T1406 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 153 T1406 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 155 T1406 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 156 T1406 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 158 T1406 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 159 T1406 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 161 T1406 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 162 T1406 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 164 T1406 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 165 T1406 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 168 T1406 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 169 T1406 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 173 T1406 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 173 T1406 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 176 T1411 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8ea729570001
[junit4:junit4]   2> 176 T1415 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 177 T1408 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49727 which had sessionid 0x13d8ea729570001
[junit4:junit4]   2> 176 T1406 oaz.ZooKeeper.close Session: 0x13d8ea729570001 closed
[junit4:junit4]   2> 241 T1406 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 258 T1406 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53294
[junit4:junit4]   2> 258 T1406 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 259 T1406 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 259 T1406 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1363897952767
[junit4:junit4]   2> 259 T1406 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1363897952767/solr.xml
[junit4:junit4]   2> 260 T1406 oasc.CoreContainer.<init> New CoreContainer 21899254
[junit4:junit4]   2> 260 T1406 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1363897952767/'
[junit4:junit4]   2> 261 T1406 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1363897952767/'
[junit4:junit4]   2> 287 T1406 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 288 T1406 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 288 T1406 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 289 T1406 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 289 T1406 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 290 T1406 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 291 T1406 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 291 T1406 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 292 T1406 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 292 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 299 T1406 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 307 T1406 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:58908/solr
[junit4:junit4]   2> 312 T1406 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 312 T1406 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58908 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@143e40b
[junit4:junit4]   2> 313 T1425 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:58908. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 313 T1406 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 314 T1425 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:58908, initiating session
[junit4:junit4]   2> 314 T1408 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49728
[junit4:junit4]   2> 314 T1408 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49728
[junit4:junit4]   2> 316 T1410 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8ea729570002 with negotiated timeout 20000 for client /127.0.0.1:49728
[junit4:junit4]   2> 317 T1425 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:58908, sessionid = 0x13d8ea729570002, negotiated timeout = 20000
[junit4:junit4]   2> 317 T1426 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@143e40b name:ZooKeeperConnection Watcher:127.0.0.1:58908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 317 T1406 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 319 T1411 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8ea729570002
[junit4:junit4]   2> 319 T1426 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 319 T1408 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49728 which had sessionid 0x13d8ea729570002
[junit4:junit4]   2> 319 T1406 oaz.ZooKeeper.close Session: 0x13d8ea729570002 closed
[junit4:junit4]   2> 321 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 324 T1406 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58908/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@133b00
[junit4:junit4]   2> 325 T1427 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:58908. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 325 T1406 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 325 T1427 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:58908, initiating session
[junit4:junit4]   2> 326 T1408 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49729
[junit4:junit4]   2> 326 T1408 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49729
[junit4:junit4]   2> 327 T1410 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8ea729570003 with negotiated timeout 20000 for client /127.0.0.1:49729
[junit4:junit4]   2> 327 T1427 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:58908, sessionid = 0x13d8ea729570003, negotiated timeout = 20000
[junit4:junit4]   2> 327 T1428 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@133b00 name:ZooKeeperConnection Watcher:127.0.0.1:58908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 327 T1406 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 328 T1406 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4]   2> 333 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea729570003 type:create cxid:0x7 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 334 T1406 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4]   2> 337 T1406 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 344 T1406 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53294_
[junit4:junit4]   2> 345 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea729570003 type:delete cxid:0x12 zxid:0x1e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:53294_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:53294_
[junit4:junit4]   2> 347 T1406 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53294_
[junit4:junit4]   2> 352 T1406 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 363 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea729570003 type:delete cxid:0x20 zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 364 T1406 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 366 T1406 oasc.Overseer.start Overseer (id=89384416221528067-127.0.0.1:53294_-n_0000000000) starting
[junit4:junit4]   2> 367 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea729570003 type:create cxid:0x25 zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 368 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea729570003 type:create cxid:0x26 zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 369 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea729570003 type:create cxid:0x28 zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 370 T1406 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4]   2> 373 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea729570003 type:create cxid:0x2e zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 374 T1430 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 375 T1406 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 377 T1406 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 379 T1406 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 381 T1429 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 382 T1406 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 382 T1406 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 383 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 386 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 387 T1406 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58908/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@24e368
[junit4:junit4]   2> 388 T1406 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 388 T1432 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:58908. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 389 T1432 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:58908, initiating session
[junit4:junit4]   2> 389 T1408 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49730
[junit4:junit4]   2> 389 T1408 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49730
[junit4:junit4]   2> 390 T1410 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8ea729570004 with negotiated timeout 10000 for client /127.0.0.1:49730
[junit4:junit4]   2> 390 T1432 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:58908, sessionid = 0x13d8ea729570004, negotiated timeout = 10000
[junit4:junit4]   2> 390 T1433 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24e368 name:ZooKeeperConnection Watcher:127.0.0.1:58908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 390 T1406 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 391 T1406 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 394 T1406 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 450 T1406 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 452 T1406 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52413
[junit4:junit4]   2> 453 T1406 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 453 T1406 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 454 T1406 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363897952984
[junit4:junit4]   2> 454 T1406 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363897952984/solr.xml
[junit4:junit4]   2> 455 T1406 oasc.CoreContainer.<init> New CoreContainer 18154870
[junit4:junit4]   2> 455 T1406 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363897952984/'
[junit4:junit4]   2> 456 T1406 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363897952984/'
[junit4:junit4]   2> 478 T1406 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 479 T1406 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 479 T1406 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 479 T1406 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 480 T1406 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 480 T1406 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 487 T1406 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 487 T1406 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 488 T1406 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 488 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 494 T1406 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 503 T1406 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:58908/solr
[junit4:junit4]   2> 504 T1406 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 504 T1406 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58908 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@19ce843
[junit4:junit4]   2> 505 T1443 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:58908. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 505 T1406 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 506 T1443 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:58908, initiating session
[junit4:junit4]   2> 506 T1408 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49731
[junit4:junit4]   2> 506 T1408 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49731
[junit4:junit4]   2> 508 T1410 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8ea729570005 with negotiated timeout 20000 for client /127.0.0.1:49731
[junit4:junit4]   2> 508 T1443 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:58908, sessionid = 0x13d8ea729570005, negotiated timeout = 20000
[junit4:junit4]   2> 508 T1444 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19ce843 name:ZooKeeperConnection Watcher:127.0.0.1:58908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 509 T1406 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 510 T1411 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8ea729570005
[junit4:junit4]   2> 511 T1444 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 511 T1408 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49731 which had sessionid 0x13d8ea729570005
[junit4:junit4]   2> 511 T1406 oaz.ZooKeeper.close Session: 0x13d8ea729570005 closed
[junit4:junit4]   2> 512 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 517 T1406 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58908/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@479dab
[junit4:junit4]   2> 519 T1445 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:58908. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 519 T1406 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 519 T1445 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:58908, initiating session
[junit4:junit4]   2> 520 T1408 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49732
[junit4:junit4]   2> 520 T1408 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49732
[junit4:junit4]   2> 521 T1410 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8ea729570006 with negotiated timeout 20000 for client /127.0.0.1:49732
[junit4:junit4]   2> 521 T1445 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:58908, sessionid = 0x13d8ea729570006, negotiated timeout = 20000
[junit4:junit4]   2> 522 T1446 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@479dab name:ZooKeeperConnection Watcher:127.0.0.1:58908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 522 T1406 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 523 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea729570006 type:create cxid:0x1 zxid:0x30 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 524 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea729570006 type:create cxid:0x3 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 526 T1406 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 1529 T1406 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52413_
[junit4:junit4]   2> 1530 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea729570006 type:delete cxid:0xd zxid:0x32 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:52413_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:52413_
[junit4:junit4]   2> 1532 T1406 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52413_
[junit4:junit4]   2> 1536 T1428 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 1536 T1433 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 1536 T1446 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 1542 T1406 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 1542 T1406 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 1543 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1620 T1406 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 1622 T1406 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:39591
[junit4:junit4]   2> 1622 T1406 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1623 T1406 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1623 T1406 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363897954136
[junit4:junit4]   2> 1623 T1406 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363897954136/solr.xml
[junit4:junit4]   2> 1624 T1406 oasc.CoreContainer.<init> New CoreContainer 16615525
[junit4:junit4]   2> 1624 T1406 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363897954136/'
[junit4:junit4]   2> 1624 T1406 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363897954136/'
[junit4:junit4]   2> 1640 T1406 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 1640 T1406 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 1640 T1406 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 1641 T1406 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 1641 T1406 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 1641 T1406 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 1641 T1406 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 1642 T1406 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 1642 T1406 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 1642 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 1655 T1406 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 1665 T1406 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:58908/solr
[junit4:junit4]   2> 1665 T1406 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 1666 T1406 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58908 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@8dfa12
[junit4:junit4]   2> 1667 T1406 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1667 T1457 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:58908. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 1667 T1457 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:58908, initiating session
[junit4:junit4]   2> 1667 T1408 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49733
[junit4:junit4]   2> 1668 T1408 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49733
[junit4:junit4]   2> 1673 T1410 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8ea729570007 with negotiated timeout 20000 for client /127.0.0.1:49733
[junit4:junit4]   2> 1673 T1457 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:58908, sessionid = 0x13d8ea729570007, negotiated timeout = 20000
[junit4:junit4]   2> 1673 T1458 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8dfa12 name:ZooKeeperConnection Watcher:127.0.0.1:58908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1673 T1406 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1674 T1411 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8ea729570007
[junit4:junit4]   2> 1675 T1458 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 1675 T1408 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49733 which had sessionid 0x13d8ea729570007
[junit4:junit4]   2> 1675 T1406 oaz.ZooKeeper.close Session: 0x13d8ea729570007 closed
[junit4:junit4]   2> 1675 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 1678 T1406 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58908/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ca4317
[junit4:junit4]   2> 1679 T1406 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1679 T1459 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:58908. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 1679 T1459 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:58908, initiating session
[junit4:junit4]   2> 1680 T1408 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49734
[junit4:junit4]   2> 1680 T1408 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49734
[junit4:junit4]   2> 1681 T1410 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8ea729570008 with negotiated timeout 20000 for client /127.0.0.1:49734
[junit4:junit4]   2> 1681 T1459 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:58908, sessionid = 0x13d8ea729570008, negotiated timeout = 20000
[junit4:junit4]   2> 1681 T1460 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ca4317 name:ZooKeeperConnection Watcher:127.0.0.1:58908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1681 T1406 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1682 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea729570008 type:create cxid:0x1 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1683 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea729570008 type:create cxid:0x3 zxid:0x39 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1685 T1406 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2688 T1406 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39591_
[junit4:junit4]   2> 2689 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea729570008 type:delete cxid:0xd zxid:0x3a txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:39591_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:39591_
[junit4:junit4]   2> 2691 T1406 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39591_
[junit4:junit4]   2> 2695 T1433 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 2695 T1428 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 2695 T1446 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 2695 T1460 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 2700 T1406 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2700 T1406 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2701 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2761 T1406 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 2763 T1406 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:44044
[junit4:junit4]   2> 2763 T1406 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2764 T1406 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2764 T1406 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363897955293
[junit4:junit4]   2> 2764 T1406 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363897955293/solr.xml
[junit4:junit4]   2> 2765 T1406 oasc.CoreContainer.<init> New CoreContainer 6628950
[junit4:junit4]   2> 2765 T1406 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363897955293/'
[junit4:junit4]   2> 2765 T1406 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363897955293/'
[junit4:junit4]   2> 2786 T1406 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 2786 T1406 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2786 T1406 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 2787 T1406 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2787 T1406 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2787 T1406 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2787 T1406 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2788 T1406 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2788 T1406 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2788 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 2794 T1406 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2812 T1406 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:58908/solr
[junit4:junit4]   2> 2812 T1406 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2813 T1406 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58908 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1257dc8
[junit4:junit4]   2> 2813 T1406 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2813 T1471 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:58908. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2814 T1471 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:58908, initiating session
[junit4:junit4]   2> 2814 T1408 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49735
[junit4:junit4]   2> 2814 T1408 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49735
[junit4:junit4]   2> 2818 T1410 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8ea729570009 with negotiated timeout 20000 for client /127.0.0.1:49735
[junit4:junit4]   2> 2818 T1471 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:58908, sessionid = 0x13d8ea729570009, negotiated timeout = 20000
[junit4:junit4]   2> 2818 T1472 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1257dc8 name:ZooKeeperConnection Watcher:127.0.0.1:58908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2818 T1406 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2819 T1411 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8ea729570009
[junit4:junit4]   2> 2820 T1472 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2820 T1408 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49735 which had sessionid 0x13d8ea729570009
[junit4:junit4]   2> 2820 T1406 oaz.ZooKeeper.close Session: 0x13d8ea729570009 closed
[junit4:junit4]   2> 2820 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 2823 T1406 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58908/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@4ef03f
[junit4:junit4]   2> 2823 T1406 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2824 T1473 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:58908. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2824 T1473 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:58908, initiating session
[junit4:junit4]   2> 2824 T1408 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49736
[junit4:junit4]   2> 2825 T1408 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49736
[junit4:junit4]   2> 2825 T1410 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8ea72957000a with negotiated timeout 20000 for client /127.0.0.1:49736
[junit4:junit4]   2> 2825 T1473 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:58908, sessionid = 0x13d8ea72957000a, negotiated timeout = 20000
[junit4:junit4]   2> 2825 T1474 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4ef03f name:ZooKeeperConnection Watcher:127.0.0.1:58908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2826 T1406 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2826 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea72957000a type:create cxid:0x1 zxid:0x40 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2827 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea72957000a type:create cxid:0x3 zxid:0x41 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2828 T1406 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3831 T1406 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44044_
[junit4:junit4]   2> 3832 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea72957000a type:delete cxid:0xd zxid:0x42 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:44044_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:44044_
[junit4:junit4]   2> 3833 T1406 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44044_
[junit4:junit4]   2> 3835 T1428 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 3835 T1446 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 3836 T1433 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 3836 T1474 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 3836 T1460 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 3839 T1406 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3840 T1406 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3840 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3900 T1406 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3903 T1406 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:42994
[junit4:junit4]   2> 3903 T1406 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3903 T1406 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3904 T1406 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1363897956432
[junit4:junit4]   2> 3904 T1406 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1363897956432/solr.xml
[junit4:junit4]   2> 3904 T1406 oasc.CoreContainer.<init> New CoreContainer 18015582
[junit4:junit4]   2> 3905 T1406 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1363897956432/'
[junit4:junit4]   2> 3905 T1406 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1363897956432/'
[junit4:junit4]   2> 3920 T1406 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 3921 T1406 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3921 T1406 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 3921 T1406 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3922 T1406 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3922 T1406 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3922 T1406 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3922 T1406 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3923 T1406 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3923 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 3928 T1406 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3944 T1406 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:58908/solr
[junit4:junit4]   2> 3944 T1406 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3945 T1406 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58908 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@121387c
[junit4:junit4]   2> 3946 T1485 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:58908. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3946 T1406 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3946 T1485 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:58908, initiating session
[junit4:junit4]   2> 3946 T1408 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49737
[junit4:junit4]   2> 3947 T1408 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49737
[junit4:junit4]   2> 3948 T1410 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8ea72957000b with negotiated timeout 20000 for client /127.0.0.1:49737
[junit4:junit4]   2> 3948 T1485 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:58908, sessionid = 0x13d8ea72957000b, negotiated timeout = 20000
[junit4:junit4]   2> 3948 T1486 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@121387c name:ZooKeeperConnection Watcher:127.0.0.1:58908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3949 T1406 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3950 T1411 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8ea72957000b
[junit4:junit4]   2> 3950 T1486 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3950 T1408 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49737 which had sessionid 0x13d8ea72957000b
[junit4:junit4]   2> 3950 T1406 oaz.ZooKeeper.close Session: 0x13d8ea72957000b closed
[junit4:junit4]   2> 3951 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 3953 T1406 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58908/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@f474db
[junit4:junit4]   2> 3954 T1406 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3954 T1487 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:58908. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3955 T1487 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:58908, initiating session
[junit4:junit4]   2> 3955 T1408 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49738
[junit4:junit4]   2> 3955 T1408 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49738
[junit4:junit4]   2> 3956 T1410 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8ea72957000c with negotiated timeout 20000 for client /127.0.0.1:49738
[junit4:junit4]   2> 3956 T1487 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:58908, sessionid = 0x13d8ea72957000c, negotiated timeout = 20000
[junit4:junit4]   2> 3956 T1488 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f474db name:ZooKeeperConnection Watcher:127.0.0.1:58908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3957 T1406 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3957 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea72957000c type:create cxid:0x1 zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3958 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea72957000c type:create cxid:0x3 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3960 T1406 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4963 T1406 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42994_
[junit4:junit4]   2> 4964 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea72957000c type:delete cxid:0xd zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:42994_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:42994_
[junit4:junit4]   2> 4966 T1406 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:42994_
[junit4:junit4]   2> 4970 T1488 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 4970 T1433 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 4970 T1474 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 4971 T1428 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 4971 T1446 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 4971 T1460 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 4978 T1406 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 4978 T1406 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 4979 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 4983 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 4989 T1439 oasc.CoreContainer.create Creating SolrCore 'unloadcollection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363897952984/unloadcollection1
[junit4:junit4]   2> 4989 T1439 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4]   2> 4990 T1439 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:unloadcollection
[junit4:junit4]   2> 4990 T1439 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 4991 T1439 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 4991 T1439 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection
[junit4:junit4]   2> 4993 T1439 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4]   2> 4994 T1439 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363897952984/unloadcollection1/'
[junit4:junit4]   2> 5015 T1439 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 5051 T1439 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5052 T1439 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5058 T1439 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5409 T1439 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5414 T1439 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5416 T1439 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5430 T1439 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5433 T1439 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5436 T1439 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5437 T1439 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 5437 T1439 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 5437 T1439 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5439 T1439 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 5439 T1439 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 5439 T1439 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 5439 T1439 oasc.SolrCore.<init> [unloadcollection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363897952984/unloadcollection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897957576unloadcollection1_1n/
[junit4:junit4]   2> 5440 T1439 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@108fe4c
[junit4:junit4]   2> 5440 T1439 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 5441 T1439 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897957576unloadcollection1_1n forceNew: false
[junit4:junit4]   2> 5441 T1439 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897957576unloadcollection1_1n/index/
[junit4:junit4]   2> 5441 T1439 oasc.SolrCore.initIndex WARNING [unloadcollection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897957576unloadcollection1_1n/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5442 T1439 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897957576unloadcollection1_1n/index forceNew: false
[junit4:junit4]   2> 5443 T1439 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@197e88 lockFactory=org.apache.lucene.store.NativeFSLockFactory@188d947),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5443 T1439 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 5444 T1439 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5445 T1439 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5445 T1439 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5446 T1439 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5446 T1439 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5446 T1439 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5446 T1439 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5447 T1439 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5447 T1439 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5449 T1439 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5451 T1439 oass.SolrIndexSearcher.<init> Opening Searcher@a2de20 main
[junit4:junit4]   2> 5452 T1439 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897957576unloadcollection1_1n/tlog
[junit4:junit4]   2> 5452 T1439 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5452 T1439 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5455 T1490 oasc.SolrCore.registerSearcher [unloadcollection1] Registered new searcher Searcher@a2de20 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5456 T1439 oasc.ZkController.publish publishing core=unloadcollection1 state=down
[junit4:junit4]   2> 6391 T1429 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6392 T1429 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "core":"unloadcollection1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:52413_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:52413",
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "state":"down"}
[junit4:junit4]   2> 6392 T1429 oasc.Overseer$ClusterStateUpdater.createCollection Create collection unloadcollection with numShards 1
[junit4:junit4]   2> 6393 T1429 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6399 T1433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 6399 T1488 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 6399 T1428 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 6399 T1460 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 6399 T1446 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 6399 T1474 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 6473 T1439 oasc.CoreContainer.registerCore registering core: unloadcollection1
[junit4:junit4]   2> 6473 T1439 oasc.ZkController.register Register replica - core:unloadcollection1 address:http://127.0.0.1:52413 collection:unloadcollection shard:shard1
[junit4:junit4]   2> 6476 T1439 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 6480 T1439 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection/leader_elect/shard1/election
[junit4:junit4]   2> 6485 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea729570006 type:delete cxid:0x51 zxid:0x57 txntype:-1 reqpath:n/a Error Path:/solr/collections/unloadcollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/unloadcollection/leaders
[junit4:junit4]   2> 6486 T1439 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 6487 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea729570006 type:create cxid:0x52 zxid:0x58 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6488 T1439 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 6489 T1439 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 6489 T1439 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52413/unloadcollection1/
[junit4:junit4]   2> 6490 T1439 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 6490 T1439 oasc.SyncStrategy.syncToMe http://127.0.0.1:52413/unloadcollection1/ has no replicas
[junit4:junit4]   2> 6491 T1439 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52413/unloadcollection1/
[junit4:junit4]   2> 6491 T1439 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection/leaders/shard1
[junit4:junit4]   2> 6497 T1411 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8ea729570006 type:create cxid:0x5d zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7907 T1429 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7914 T1488 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 7914 T1474 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 7914 T1460 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 7914 T1446 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 7914 T1433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 7914 T1428 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 7954 T1439 oasc.ZkController.register We are http://127.0.0.1:52413/unloadcollection1/ and leader is http://127.0.0.1:52413/unloadcollection1/
[junit4:junit4]   2> 7955 T1439 oasc.ZkController.register No LogReplay needed for core=unloadcollection1 baseURL=http://127.0.0.1:52413
[junit4:junit4]   2> 7955 T1439 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 7955 T1439 oasc.ZkController.publish publishing core=unloadcollection1 state=active
[junit4:junit4]   2> 7957 T1439 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7957 T1439 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363897952984/solr.xml
[junit4:junit4]   2> 7963 T1439 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363897952984/solr.xml
[junit4:junit4]   2> 7964 T1439 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {collection=unloadcollection&name=unloadcollection1&numShards=1&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897957576unloadcollection1_1n&action=CREATE&version=2&wt=javabin} status=0 QTime=2976 
[junit4:junit4]   2> 7965 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 7967 T1406 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58908/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ce00a6
[junit4:junit4]   2> 7968 T1491 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:58908. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7968 T1406 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7968 T1491 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:58908, initiating session
[junit4:junit4]   2> 7968 T1408 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49740
[junit4:junit4]   2> 7969 T1408 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49740
[junit4:junit4]   2> 7982 T1410 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8ea72957000d with negotiated timeout 10000 for client /127.0.0.1:49740
[junit4:junit4]   2> 7982 T1491 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:58908, sessionid = 0x13d8ea72957000d, negotiated timeout = 10000
[junit4:junit4]   2> 7982 T1492 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ce00a6 name:ZooKeeperConnection Watcher:127.0.0.1:58908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7982 T1406 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7984 T1406 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7986 T1406 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7987 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7992 T1454 oasc.CoreContainer.create Creating SolrCore 'unloadcollection2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363897954136/unloadcollection2
[junit4:junit4]   2> 7993 T1454 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4]   2> 7994 T1454 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 7994 T1454 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4]   2> 7995 T1454 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363897954136/unloadcollection2/'
[junit4:junit4]   2> 8031 T1454 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 8065 T1454 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 8066 T1454 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 8071 T1454 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 8420 T1454 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 8426 T1454 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 8434 T1454 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 8447 T1454 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8450 T1454 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8452 T1454 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8453 T1454 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 8454 T1454 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 8454 T1454 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8455 T1454 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 8455 T1454 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 8455 T1454 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 8456 T1454 oasc.SolrCore.<init> [unloadcollection2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363897954136/unloadcollection2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897960581unloadcollection1_2n/
[junit4:junit4]   2> 8456 T1454 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@108fe4c
[junit4:junit4]   2> 8456 T1454 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 8457 T1454 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897960581unloadcollection1_2n forceNew: false
[junit4:junit4]   2> 8457 T1454 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897960581unloadcollection1_2n/index/
[junit4:junit4]   2> 8457 T1454 oasc.SolrCore.initIndex WARNING [unloadcollection2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897960581unloadcollection1_2n/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 8458 T1454 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897960581unloadcollection1_2n/index forceNew: false
[junit4:junit4]   2> 8459 T1454 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e5c9f5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@11a55fd),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 8459 T1454 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 8461 T1454 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 8461 T1454 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 8461 T1454 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 8462 T1454 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 8462 T1454 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 8462 T1454 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 8463 T1454 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 8463 T1454 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 8463 T1454 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 8466 T1454 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 8468 T1454 oass.SolrIndexSearcher.<init> Opening Searcher@1241f1a main
[junit4:junit4]   2> 8468 T1454 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897960581unloadcollection1_2n/tlog
[junit4:junit4]   2> 8468 T1454 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 8469 T1454 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 8471 T1493 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@1241f1a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 8472 T1454 oasc.ZkController.publish publishing core=unloadcollection2 state=down
[junit4:junit4]   2> 8472 T1454 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9419 T1429 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9420 T1429 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "core":"unloadcollection1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:52413_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:52413",
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:52413__unloadcollection1",
[junit4:junit4]   2> 	  "state":"active"}
[junit4:junit4]   2> 9453 T1429 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "core":"unloadcollection2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:39591_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:39591",
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "state":"down"}
[junit4:junit4]   2> 9454 T1429 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 9454 T1429 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 9457 T1492 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9457 T1488 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9457 T1460 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9457 T1433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9457 T1474 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9457 T1428 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9457 T1446 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9474 T1454 oasc.CoreContainer.registerCore registering core: unloadcollection2
[junit4:junit4]   2> 9474 T1454 oasc.ZkController.register Register replica - core:unloadcollection2 address:http://127.0.0.1:39591 collection:unloadcollection shard:shard1
[junit4:junit4]   2> 9478 T1454 oasc.ZkController.register We are http://127.0.0.1:39591/unloadcollection2/ and leader is http://127.0.0.1:52413/unloadcollection1/
[junit4:junit4]   2> 9478 T1454 oasc.ZkController.register No LogReplay needed for core=unloadcollection2 baseURL=http://127.0.0.1:39591
[junit4:junit4]   2> 9478 T1454 oasc.ZkController.checkRecovery Core needs to recover:unloadcollection2
[junit4:junit4]   2> 9479 T1454 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C69 name=unloadcollection2 org.apache.solr.core.SolrCore@1dfaf15 url=http://127.0.0.1:39591/unloadcollection2 node=127.0.0.1:39591_ C69_STATE=coll:unloadcollection core:unloadcollection2 props:{core=unloadcollection2, node_name=127.0.0.1:39591_, base_url=http://127.0.0.1:39591, collection=unloadcollection, state=down}
[junit4:junit4]   2> 9482 T1494 C69 P39591 oasc.RecoveryStrategy.run Starting recovery process.  core=unloadcollection2 recoveringAfterStartup=true
[junit4:junit4]   2> 9482 T1454 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9483 T1494 C69 P39591 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 9483 T1494 C69 P39591 oasc.ZkController.publish publishing core=unloadcollection2 state=recovering
[junit4:junit4]   2> 9484 T1494 C69 P39591 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9484 T1454 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363897954136/solr.xml
[junit4:junit4]   2> 9484 T1494 C69 P39591 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9488 T1454 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363897954136/solr.xml
[junit4:junit4]   2> 9490 T1454 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {collection=unloadcollection&name=unloadcollection2&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897960581unloadcollection1_2n&action=CREATE&version=2&wt=javabin} status=0 QTime=1498 
[junit4:junit4]   2> 9491 T1406 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9492 T1406 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 9493 T1406 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10494 T1406 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10966 T1429 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10967 T1429 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "core":"unloadcollection2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:39591_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:39591",
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:39591__unloadcollection2",
[junit4:junit4]   2> 	  "state":"recovering"}
[junit4:junit4]   2> 10982 T1492 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 10982 T1428 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 10982 T1474 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 10982 T1460 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 10982 T1488 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 10982 T1433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 10982 T1446 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 11490 T1442 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {onlyIfLeader=true&core=unloadcollection1&coreNodeName=127.0.0.1:39591__unloadcollection2&nodeName=127.0.0.1:39591_&checkLive=true&action=PREPRECOVERY&version=2&state=recovering&wt=javabin} status=0 QTime=2001 
[junit4:junit4]   2> 11496 T1406 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12498 T1406 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C69_STATE=coll:unloadcollection core:unloadcollection2 props:{core=unloadcollection2, shard=shard1, node_name=127.0.0.1:39591_, base_url=http://127.0.0.1:39591, collection=unloadcollection, state=recovering}
[junit4:junit4]   2> 13491 T1494 C69 P39591 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:52413/unloadcollection1/ core=unloadcollection2 - recoveringAfterStartup=true
[junit4:junit4]   2> 13491 T1494 C69 P39591 oasu.PeerSync.sync PeerSync: core=unloadcollection2 url=http://127.0.0.1:39591 START replicas=[http://127.0.0.1:52413/unloadcollection1/] nUpdates=100
[junit4:junit4]   2> 13492 T1494 C69 P39591 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 13492 T1494 C69 P39591 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=unloadcollection2
[junit4:junit4]   2> 13492 T1494 C69 P39591 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=unloadcollection2
[junit4:junit4]   2> 13492 T1494 C69 P39591 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=unloadcollection2
[junit4:junit4]   2> 13492 T1494 C69 P39591 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 13492 T1494 C69 P39591 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:52413/unloadcollection1/. core=unloadcollection2
[junit4:junit4]   2> 13492 T1494 C69 P39591 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C70 name=unloadcollection1 org.apache.solr.core.SolrCore@15a6f78 url=http://127.0.0.1:52413/unloadcollection1 node=127.0.0.1:52413_ C70_STATE=coll:unloadcollection core:unloadcollection1 props:{core=unloadcollection1, shard=shard1, node_name=127.0.0.1:52413_, base_url=http://127.0.0.1:52413, collection=unloadcollection, state=active, leader=true}
[junit4:junit4]   2> 13498 T1442 C70 P52413 REQ /get {distrib=false&qt=/get&getVersions=100&version=2&wt=javabin} status=0 QTime=1 
[junit4:junit4]   2> 13499 T1406 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13500 T1439 C70 P52413 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 13501 T1439 C70 P52413 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@197e88 lockFactory=org.apache.lucene.store.NativeFSLockFactory@188d947),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 13502 T1439 C70 P52413 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 13502 T1439 C70 P52413 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@197e88 lockFactory=org.apache.lucene.store.NativeFSLockFactory@188d947),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@197e88 lockFactory=org.apache.lucene.store.NativeFSLockFactory@188d947),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 13503 T1439 C70 P52413 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 13503 T1439 C70 P52413 oass.SolrIndexSearcher.<init> Opening Searcher@f5a2a2 realtime
[junit4:junit4]   2> 13504 T1439 C70 P52413 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 13504 T1439 C70 P52413 /update {openSearcher=false&commit=true&softCommit=false&version=2&waitSearcher=true&wt=javabin&commit_end_point=true} {commit=} 0 5
[junit4:junit4]   2> 13505 T1494 C69 P39591 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 13505 T1494 C69 P39591 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 13512 T1440 C70 P52413 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 13512 T1440 C70 P52413 REQ /replication {qt=/replication&command=indexversion&version=2&wt=javabin} status=0 QTime=6 
[junit4:junit4]   2> 13513 T1494 C69 P39591 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 13513 T1494 C69 P39591 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 13513 T1494 C69 P39591 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 13515 T1442 C70 P52413 REQ /replication {qt=/replication&command=filelist&generation=2&version=2&wt=javabin} status=0 QTime=0 
[junit4:junit4]   2> 13515 T1494 C69 P39591 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 13516 T1494 C69 P39591 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897960581unloadcollection1_2n/index.20130322080246105 forceNew: false
[junit4:junit4]   2> 13516 T1494 C69 P39591 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@2c5a4b lockFactory=org.apache.lucene.store.NativeFSLockFactory@14a7371) fullCopy=false
[junit4:junit4]   2> 13518 T1439 C70 P52413 REQ /replication {file=segments_2&qt=/replication&command=filecontent&generation=2&checksum=true&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 13519 T1494 C69 P39591 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 13520 T1494 C69 P39591 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 13520 T1494 C69 P39591 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=unloadcollection2
[junit4:junit4]   2> 13521 T1494 C69 P39591 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e5c9f5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@11a55fd),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e5c9f5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@11a55fd),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 13521 T1494 C69 P39591 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 13522 T1494 C69 P39591 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 13522 T1494 C69 P39591 oass.SolrIndexSearcher.<init> Opening Searcher@daffd6 main
[junit4:junit4]   2> 13523 T1493 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@daffd6 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 13523 T1494 C69 P39591 oasc.RecoveryStrategy.replay No replay needed. core=unloadcollection2
[junit4:junit4]   2> 13523 T1494 C69 P39591 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=unloadcollection2
[junit4:junit4]   2> 13523 T1494 C69 P39591 oasc.ZkController.publish publishing core=unloadcollection2 state=active
[junit4:junit4]   2> 13523 T1494 C69 P39591 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 13529 T1494 C69 P39591 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=unloadcollection2
[junit4:junit4]   2> 13989 T1429 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13990 T1429 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "core":"unloadcollection2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:39591_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:39591",
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:39591__unloadcollection2",
[junit4:junit4]   2> 	  "state":"active"}
[junit4:junit4]   2> 14014 T1433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14014 T1488 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14014 T1446 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14014 T1428 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14014 T1474 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14014 T1460 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14014 T1492 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14501 T1406 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14502 T1406 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: unloadcollection
[junit4:junit4]   2> 14502 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2>  C69_STATE=coll:unloadcollection core:unloadcollection2 props:{core=unloadcollection2, shard=shard1, node_name=127.0.0.1:39591_, base_url=http://127.0.0.1:39591, collection=unloadcollection, state=active}
[junit4:junit4]   2> 14527 T1454 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[6 (1430150674754043904)]} 0 2
[junit4:junit4]   2> 14527 T1439 C70 P52413 /update {version=2&wt=javabin} {add=[6 (1430150674754043904)]} 0 14
[junit4:junit4]   2> 14535 T1456 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[7 (1430150674770821120)]} 0 2
[junit4:junit4]   2> 14536 T1441 C70 P52413 /update {version=2&wt=javabin} {add=[7 (1430150674770821120)]} 0 6
[junit4:junit4]   2> 14541 T1453 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[8 (1430150674779209728)]} 0 1
[junit4:junit4]   2> 14542 T1440 C70 P52413 /update {version=2&wt=javabin} {add=[8 (1430150674779209728)]} 0 4
[junit4:junit4]   2> 14544 T1442 C70 P52413 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 14547 T1442 C70 P52413 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@197e88 lockFactory=org.apache.lucene.store.NativeFSLockFactory@188d947),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@197e88 lockFactory=org.apache.lucene.store.NativeFSLockFactory@188d947),segFN=segments_3,generation=3,filenames=[_0.cbnm, _0.dvdd, _0.tim, _0.dvdm, _0.tip, _0.doc, _0.fnm, _0.fdt, _0.si, _0.pos, segments_3, _0.cbnd, _0.fdx]
[junit4:junit4]   2> 14548 T1442 C70 P52413 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0.cbnm, _0.dvdd, _0.tim, _0.dvdm, _0.tip, _0.doc, _0.fnm, _0.fdt, _0.si, _0.pos, segments_3, _0.cbnd, _0.fdx]
[junit4:junit4]   2> 14549 T1442 C70 P52413 oass.SolrIndexSearcher.<init> Opening Searcher@115bce0 main
[junit4:junit4]   2> 14550 T1442 C70 P52413 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 14550 T1490 oasc.SolrCore.registerSearcher [unloadcollection1] Registered new searcher Searcher@115bce0 main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C3)}
[junit4:junit4]   2> 14551 T1442 C70 P52413 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:39591/unloadcollection2/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 14553 T1455 C69 P39591 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 14556 T1455 C69 P39591 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e5c9f5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@11a55fd),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e5c9f5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@11a55fd),segFN=segments_3,generation=3,filenames=[_0.cbnm, _0.dvdd, _0.tim, _0.dvdm, _0.tip, _0.doc, _0.fnm, _0.fdt, _0.si, _0.pos, segments_3, _0.cbnd, _0.fdx]
[junit4:junit4]   2> 14556 T1455 C69 P39591 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0.cbnm, _0.dvdd, _0.tim, _0.dvdm, _0.tip, _0.doc, _0.fnm, _0.fdt, _0.si, _0.pos, segments_3, _0.cbnd, _0.fdx]
[junit4:junit4]   2> 14557 T1455 C69 P39591 oass.SolrIndexSearcher.<init> Opening Searcher@18bbd3 main
[junit4:junit4]   2> 14558 T1455 C69 P39591 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 14558 T1493 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@18bbd3 main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C3)}
[junit4:junit4]   2> 14559 T1455 C69 P39591 /update {expungeDeletes=false&commit=true&softCommit=false&version=2&waitSearcher=true&wt=javabin&commit_end_point=true} {commit=} 0 6
[junit4:junit4]   2> 14559 T1442 C70 P52413 /update {commit=true&softCommit=false&version=2&waitSearcher=true&wt=javabin} {commit=} 0 15
[junit4:junit4]   2> 14560 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 14563 T1469 oasc.CoreContainer.create Creating SolrCore 'unloadcollection3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363897955293/unloadcollection3
[junit4:junit4]   2> 14564 T1469 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4]   2> 14564 T1469 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 14565 T1469 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4]   2> 14566 T1469 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363897955293/unloadcollection3/'
[junit4:junit4]   2> 14590 T1469 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 14640 T1469 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 14641 T1469 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 14646 T1469 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 15018 T1469 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 15024 T1469 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 15026 T1469 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 15038 T1469 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15041 T1469 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15043 T1469 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15044 T1469 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15044 T1469 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15045 T1469 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15045 T1469 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15046 T1469 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15046 T1469 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 15046 T1469 oasc.SolrCore.<init> [unloadcollection3] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363897955293/unloadcollection3/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897967152unloadcollection_3n/
[junit4:junit4]   2> 15047 T1469 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@108fe4c
[junit4:junit4]   2> 15047 T1469 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 15047 T1469 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897967152unloadcollection_3n forceNew: false
[junit4:junit4]   2> 15048 T1469 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897967152unloadcollection_3n/index/
[junit4:junit4]   2> 15048 T1469 oasc.SolrCore.initIndex WARNING [unloadcollection3] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897967152unloadcollection_3n/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 15048 T1469 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897967152unloadcollection_3n/index forceNew: false
[junit4:junit4]   2> 15050 T1469 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@91e104 lockFactory=org.apache.lucene.store.NativeFSLockFactory@143754),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15050 T1469 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15051 T1469 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 15051 T1469 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 15052 T1469 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 15052 T1469 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 15053 T1469 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 15053 T1469 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 15053 T1469 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 15053 T1469 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 15054 T1469 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 15056 T1469 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 15058 T1469 oass.SolrIndexSearcher.<init> Opening Searcher@1d057d3 main
[junit4:junit4]   2> 15058 T1469 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897967152unloadcollection_3n/tlog
[junit4:junit4]   2> 15059 T1469 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 15059 T1469 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 15061 T1498 oasc.SolrCore.registerSearcher [unloadcollection3] Registered new searcher Searcher@1d057d3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 15062 T1469 oasc.ZkController.publish publishing core=unloadcollection3 state=down
[junit4:junit4]   2> 15062 T1469 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15518 T1429 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15519 T1429 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "core":"unloadcollection3",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:44044_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:44044",
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "state":"down"}
[junit4:junit4]   2> 15519 T1429 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 15519 T1429 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 15532 T1492 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15532 T1446 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15532 T1488 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15532 T1474 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15532 T1460 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15532 T1428 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15532 T1433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16073 T1469 oasc.CoreContainer.registerCore registering core: unloadcollection3
[junit4:junit4]   2> 16073 T1469 oasc.ZkController.register Register replica - core:unloadcollection3 address:http://127.0.0.1:44044 collection:unloadcollection shard:shard1
[junit4:junit4]   2> 16077 T1469 oasc.ZkController.register We are http://127.0.0.1:44044/unloadcollection3/ and leader is http://127.0.0.1:52413/unloadcollection1/
[junit4:junit4]   2> 16078 T1469 oasc.ZkController.register No LogReplay needed for core=unloadcollection3 baseURL=http://127.0.0.1:44044
[junit4:junit4]   2> 16078 T1469 oasc.ZkController.checkRecovery Core needs to recover:unloadcollection3
[junit4:junit4]   2> 16078 T1469 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C71 name=unloadcollection3 org.apache.solr.core.SolrCore@12d39a9 url=http://127.0.0.1:44044/unloadcollection3 node=127.0.0.1:44044_ C71_STATE=coll:unloadcollection core:unloadcollection3 props:{core=unloadcollection3, node_name=127.0.0.1:44044_, base_url=http://127.0.0.1:44044, collection=unloadcollection, state=down}
[junit4:junit4]   2> 16078 T1499 C71 P44044 oasc.RecoveryStrategy.run Starting recovery process.  core=unloadcollection3 recoveringAfterStartup=true
[junit4:junit4]   2> 16079 T1499 C71 P44044 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 16079 T1499 C71 P44044 oasc.ZkController.publish publishing core=unloadcollection3 state=recovering
[junit4:junit4]   2> 16079 T1469 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16079 T1499 C71 P44044 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 16080 T1469 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363897955293/solr.xml
[junit4:junit4]   2> 16080 T1499 C71 P44044 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 16092 T1469 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363897955293/solr.xml
[junit4:junit4]   2> 16093 T1469 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {collection=unloadcollection&name=unloadcollection3&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897967152unloadcollection_3n&action=CREATE&version=2&wt=javabin} status=0 QTime=1530 
[junit4:junit4]   2> 16094 T1406 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 16095 T1406 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17038 T1429 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17038 T1429 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "core":"unloadcollection3",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:44044_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:44044",
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:44044__unloadcollection3",
[junit4:junit4]   2> 	  "state":"recovering"}
[junit4:junit4]   2> 17042 T1474 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17042 T1488 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17042 T1492 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17043 T1428 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17043 T1460 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17042 T1433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17043 T1446 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17092 T1440 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {onlyIfLeader=true&core=unloadcollection1&coreNodeName=127.0.0.1:44044__unloadcollection3&nodeName=127.0.0.1:44044_&checkLive=true&action=PREPRECOVERY&version=2&state=recovering&wt=javabin} status=0 QTime=1000 
[junit4:junit4]   2> 17096 T1406 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18098 T1406 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C71_STATE=coll:unloadcollection core:unloadcollection3 props:{core=unloadcollection3, shard=shard1, node_name=127.0.0.1:44044_, base_url=http://127.0.0.1:44044, collection=unloadcollection, state=recovering}
[junit4:junit4]   2> 19093 T1499 C71 P44044 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:52413/unloadcollection1/ core=unloadcollection3 - recoveringAfterStartup=true
[junit4:junit4]   2> 19093 T1499 C71 P44044 oasu.PeerSync.sync PeerSync: core=unloadcollection3 url=http://127.0.0.1:44044 START replicas=[http://127.0.0.1:52413/unloadcollection1/] nUpdates=100
[junit4:junit4]   2> 19094 T1499 C71 P44044 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 19094 T1499 C71 P44044 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=unloadcollection3
[junit4:junit4]   2> 19094 T1499 C71 P44044 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=unloadcollection3
[junit4:junit4]   2> 19094 T1499 C71 P44044 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=unloadcollection3
[junit4:junit4]   2> 19095 T1499 C71 P44044 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 19095 T1499 C71 P44044 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:52413/unloadcollection1/. core=unloadcollection3
[junit4:junit4]   2> 19095 T1499 C71 P44044 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 19096 T1442 C70 P52413 REQ /get {distrib=false&qt=/get&getVersions=100&version=2&wt=javabin} status=0 QTime=0 
[junit4:junit4]   2> 19099 T1406 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19101 T1441 C70 P52413 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 19101 T1441 C70 P52413 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@197e88 lockFactory=org.apache.lucene.store.NativeFSLockFactory@188d947),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@197e88 lockFactory=org.apache.lucene.store.NativeFSLockFactory@188d947),segFN=segments_3,generation=3,filenames=[_0.cbnm, _0.dvdd, _0.tim, _0.dvdm, _0.tip, _0.doc, _0.fnm, _0.fdt, _0.si, _0.pos, segments_3, _0.cbnd, _0.fdx]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@197e88 lockFactory=org.apache.lucene.store.NativeFSLockFactory@188d947),segFN=segments_4,generation=4,filenames=[_0.cbnm, _0.dvdd, _0.tim, segments_4, _0.dvdm, _0.tip, _0.doc, _0.fnm, _0.fdt, _0.si, _0.pos, _0.cbnd, _0.fdx]
[junit4:junit4]   2> 19102 T1441 C70 P52413 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[_0.cbnm, _0.dvdd, _0.tim, segments_4, _0.dvdm, _0.tip, _0.doc, _0.fnm, _0.fdt, _0.si, _0.pos, _0.cbnd, _0.fdx]
[junit4:junit4]   2> 19102 T1441 C70 P52413 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 19102 T1441 C70 P52413 /update {openSearcher=false&commit=true&softCommit=false&version=2&waitSearcher=true&wt=javabin&commit_end_point=true} {commit=} 0 1
[junit4:junit4]   2> 19103 T1499 C71 P44044 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 19103 T1499 C71 P44044 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 19106 T1442 C70 P52413 REQ /replication {qt=/replication&command=indexversion&version=2&wt=javabin} status=0 QTime=1 
[junit4:junit4]   2> 19106 T1499 C71 P44044 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4]   2> 19106 T1499 C71 P44044 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 19106 T1499 C71 P44044 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 19108 T1439 C70 P52413 REQ /replication {qt=/replication&command=filelist&generation=4&version=2&wt=javabin} status=0 QTime=0 
[junit4:junit4]   2> 19109 T1499 C71 P44044 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 13
[junit4:junit4]   2> 19110 T1499 C71 P44044 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363897952594/1363897967152unloadcollection_3n/index.20130322080251699 forceNew: false
[junit4:junit4]   2> 19110 T1499 C71 P44044 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b96aa4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@af57b3) fullCopy=false
[junit4:junit4]   2> 19112 T1441 C70 P52413 REQ /replication {file=_0.dvdd&qt=/replication&command=filecontent&generation=4&checksum=true&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 19115 T1440 C70 P52413 REQ /replication {file=_0.cbnm&qt=/replication&command=filecontent&generation=4&checksum=true&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 19118 T1442 C70 P52413 REQ /replication {file=_0.tim&qt=/replication&command=filecontent&generation=4&checksum=true&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 19121 T1439 C70 P52413 REQ /replication {file=segments_4&qt=/replication&command=filecontent&generation=4&checksum=true&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 19124 T1441 C70 P52413 REQ /replication {file=_0.dvdm&qt=/replication&command=filecontent&generation=4&checksum=true&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 19127 T1440 C70 P52413 REQ /replication {file=_0.doc&qt=/replication&command=filecontent&generation=4&checksum=true&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 19130 T1442 C70 P52413 REQ /replication {file=_0.tip&qt=/replication&command=filecontent&generation=4&checksum=true&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 19133 T1439 C70 P52413 REQ /replication {file=_0.fnm&qt=/replication&command=filecontent&generation=4&checksum=true&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 19136 T1441 C70 P52413 REQ /replication {file=_0.fdt&qt=/replication&command=filecontent&generation=4&checksum=true&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 19146 T1440 C70 P52413 REQ /replication {file=_0.si&qt=/replication&command=filecontent&generation=4&checksum=true&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 19149 T1442 C70 P52413 REQ /replication {file=_0.pos&qt=/replication&command=filecontent&generation=4&checksum=true&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 19152 T1439 C70 P52413 REQ /replication {file=_0.cbnd&qt=/replication&command=filecontent&generation=4&checksum=true&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 19155 T1441 C70 P52413 REQ /replication {file=_0.fdx&qt=/replication&command=filecontent&generation=4&checksum=true&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 19156 T1499 C71 P44044 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 19156 T1499 C71 P44044 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 19157 T1499 C71 P44044 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=unloadcollection3
[junit4:junit4]   2> 19158 T1499 C71 P44044 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@91e104 lockFactory=org.apache.lucene.store.NativeFSLockFactory@143754),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@91e104 lockFactory=org.apache.lucene.store.NativeFSLockFactory@143754),segFN=segments_4,generation=4,filenames=[_0.dvdd, _0.cbnm, _0.tim, segments_4, _0.dvdm, _0.doc, _0.tip, _0.fnm, _0.fdt, _0.si, _0.pos, _0.cbnd, _0.fdx]
[junit4:junit4]   2> 19158 T1499 C71 P44044 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[_0.dvdd, _0.cbnm, _0.tim, segments_4, _0.dvdm, _0.doc, _0.tip, _0.fnm, _0.fdt, _0.si, _0.pos, _0.cbnd, _0.fdx]
[junit4:junit4]   2> 19158 T1499 C71 P44044 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 19159 T1499 C71 P44044 oass.SolrIndexSearcher.<init> Opening Searcher@1c805a main
[junit4:junit4]   2> 19160 T1498 oasc.SolrCore.registerSearcher [unloadcollection3] Registered new searcher Searcher@1c805a main{StandardDirectoryReader(segments_4:3:nrt _0(5.0):C3)}
[junit4:junit4]   2> 19160 T1499 C71 P44044 oasc.RecoveryStrategy.replay No replay needed. core=unloadcollection3
[junit4:junit4]   2> 19160 T1499 C71 P44044 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=unloadcollection3
[junit4:junit4]   2> 19160 T1499 C71 P44044 oasc.ZkController.publish publishing core=unloadcollection3 state=active
[junit4:junit4]   2> 19161 T1499 C71 P44044 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 19163 T1499 C71 P44044 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=unloadcollection3
[junit4:junit4]   2> 20049 T1429 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20050 T1429 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "core":"unloadcollection3",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:44044_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:44044",
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:44044__unloadcollection3",
[junit4:junit4]   2> 	  "state":"active"}
[junit4:junit4]   2> 20062 T1433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20062 T1474 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20062 T1488 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20062 T1446 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20062 T1428 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20062 T1492 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20062 T1460 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20101 T1406 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20102 T1406 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: unloadcollection
[junit4:junit4]   2> 20102 T1406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2>  C71_STATE=coll:unloadcollection core:unloadcollection3 props:{core=unloadcollection3, shard=shard1, node_name=127.0.0.1:44044_, base_url=http://127.0.0.1:44044, collection=unloadcollection, state=active}
[junit4:junit4]   2> 20122 T1467 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[20 (1430150680628166656)]} 0 2
[junit4:junit4]   2> 20122 T1453 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[20 (1430150680628166656)]} 0 2
[junit4:junit4]   2> 20123 T1442 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[20 (1430150680628166656)]} 0 7
[junit4:junit4]   2> 20124 T1469 C71 P44044 /update {version=2&wt=javabin} {add=[20]} 0 12
[junit4:junit4]   2> 20133 T1470 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[21 (1430150680640749568)]} 0 2
[junit4:junit4]   2> 20134 T1454 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[21 (1430150680640749568)]} 0 3
[junit4:junit4]   2> 20134 T1439 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[21 (1430150680640749568)]} 0 6
[junit4:junit4]   2> 20135 T1468 C71 P44044 /update {version=2&wt=javabin} {add=[21]} 0 9
[junit4:junit4]   2> 20143 T1469 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[22 (1430150680652283904)]} 0 1
[junit4:junit4]   2> 20144 T1456 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[22 (1430150680652283904)]} 0 2
[junit4:junit4]   2> 20144 T1441 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[22 (1430150680652283904)]} 0 5
[junit4:junit4]   2> 20145 T1467 C71 P44044 /update {version=2&wt=javabin} {add=[22]} 0 8
[junit4:junit4]   2> 20153 T1468 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[23 (1430150680662769664)]} 0 1
[junit4:junit4]   2> 20153 T1455 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[23 (1430150680662769664)]} 0 1
[junit4:junit4]   2> 20154 T1440 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[23 (1430150680662769664)]} 0 6
[junit4:junit4]   2> 20154 T1470 C71 P44044 /update {version=2&wt=javabin} {add=[23]} 0 7
[junit4:junit4]   2> 20162 T1467 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[24 (1430150680672206848)]} 0 1
[junit4:junit4]   2> 20162 T1453 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[24 (1430150680672206848)]} 0 1
[junit4:junit4]   2> 20163 T1442 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[24 (1430150680672206848)]} 0 5
[junit4:junit4]   2> 20163 T1469 C71 P44044 /update {version=2&wt=javabin} {add=[24]} 0 7
[junit4:junit4]   2> 20172 T1470 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[25 (1430150680681644032)]} 0 1
[junit4:junit4]   2> 20172 T1454 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[25 (1430150680681644032)]} 0 1
[junit4:junit4]   2> 20173 T1439 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[25 (1430150680681644032)]} 0 6
[junit4:junit4]   2> 20173 T1468 C71 P44044 /update {version=2&wt=javabin} {add=[25]} 0 8
[junit4:junit4]   2> 20181 T1469 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[26 (1430150680692129792)]} 0 1
[junit4:junit4]   2> 20181 T1456 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[26 (1430150680692129792)]} 0 1
[junit4:junit4]   2> 20182 T1441 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[26 (1430150680692129792)]} 0 5
[junit4:junit4]   2> 20182 T1467 C71 P44044 /update {version=2&wt=javabin} {add=[26]} 0 7
[junit4:junit4]   2> 20191 T1468 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[27 (1430150680701566976)]} 0 2
[junit4:junit4]   2> 20191 T1455 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[27 (1430150680701566976)]} 0 2
[junit4:junit4]   2> 20191 T1440 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[27 (1430150680701566976)]} 0 5
[junit4:junit4]   2> 20192 T1470 C71 P44044 /update {version=2&wt=javabin} {add=[27]} 0 8
[junit4:junit4]   2> 20200 T1467 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[28 (1430150680712052736)]} 0 1
[junit4:junit4]   2> 20200 T1453 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[28 (1430150680712052736)]} 0 1
[junit4:junit4]   2> 20201 T1442 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[28 (1430150680712052736)]} 0 5
[junit4:junit4]   2> 20201 T1469 C71 P44044 /update {version=2&wt=javabin} {add=[28]} 0 7
[junit4:junit4]   2> 20208 T1454 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[29 (1430150680721489920)]} 0 0
[junit4:junit4]   2> 20208 T1470 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[29 (1430150680721489920)]} 0 0
[junit4:junit4]   2> 20209 T1439 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[29 (1430150680721489920)]} 0 4
[junit4:junit4]   2> 20210 T1468 C71 P44044 /update {version=2&wt=javabin} {add=[29]} 0 7
[junit4:junit4]   2> 20217 T1469 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[30 (1430150680729878528)]} 0 1
[junit4:junit4]   2> 20217 T1456 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[30 (1430150680729878528)]} 0 1
[junit4:junit4]   2> 20218 T1441 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[30 (1430150680729878528)]} 0 5
[junit4:junit4]   2> 20218 T1467 C71 P44044 /update {version=2&wt=javabin} {add=[30]} 0 6
[junit4:junit4]   2> 20226 T1468 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[31 (1430150680739315712)]} 0 1
[junit4:junit4]   2> 20226 T1455 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[31 (1430150680739315712)]} 0 1
[junit4:junit4]   2> 20227 T1440 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[31 (1430150680739315712)]} 0 5
[junit4:junit4]   2> 20228 T1470 C71 P44044 /update {version=2&wt=javabin} {add=[31]} 0 8
[junit4:junit4]   2> 20235 T1467 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[32 (1430150680749801472)]} 0 1
[junit4:junit4]   2> 20236 T1453 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[32 (1430150680749801472)]} 0 2
[junit4:junit4]   2> 20236 T1442 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[32 (1430150680749801472)]} 0 4
[junit4:junit4]   2> 20237 T1469 C71 P44044 /update {version=2&wt=javabin} {add=[32]} 0 7
[junit4:junit4]   2> 20244 T1454 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[33 (1430150680759238656)]} 0 1
[junit4:junit4]   2> 20244 T1470 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[33 (1430150680759238656)]} 0 1
[junit4:junit4]   2> 20245 T1439 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[33 (1430150680759238656)]} 0 4
[junit4:junit4]   2> 20245 T1468 C71 P44044 /update {version=2&wt=javabin} {add=[33]} 0 6
[junit4:junit4]   2> 20253 T1469 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[34 (1430150680767627264)]} 0 1
[junit4:junit4]   2> 20253 T1456 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[34 (1430150680767627264)]} 0 1
[junit4:junit4]   2> 20254 T1441 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[34 (1430150680767627264)]} 0 5
[junit4:junit4]   2> 20254 T1467 C71 P44044 /update {version=2&wt=javabin} {add=[34]} 0 6
[junit4:junit4]   2> 20262 T1468 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[35 (1430150680777064448)]} 0 1
[junit4:junit4]   2> 20263 T1455 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[35 (1430150680777064448)]} 0 2
[junit4:junit4]   2> 20263 T1440 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[35 (1430150680777064448)]} 0 5
[junit4:junit4]   2> 20264 T1470 C71 P44044 /update {version=2&wt=javabin} {add=[35]} 0 8
[junit4:junit4]   2> 20271 T1467 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[36 (1430150680787550208)]} 0 1
[junit4:junit4]   2> 20272 T1453 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[36 (1430150680787550208)]} 0 2
[junit4:junit4]   2> 20272 T1442 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[36 (1430150680787550208)]} 0 4
[junit4:junit4]   2> 20273 T1469 C71 P44044 /update {version=2&wt=javabin} {add=[36]} 0 7
[junit4:junit4]   2> 20280 T1470 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[37 (1430150680796987392)]} 0 1
[junit4:junit4]   2> 20281 T1454 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[37 (1430150680796987392)]} 0 2
[junit4:junit4]   2> 20281 T1439 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[37 (1430150680796987392)]} 0 4
[junit4:junit4]   2> 20282 T1468 C71 P44044 /update {version=2&wt=javabin} {add=[37]} 0 7
[junit4:junit4]   2> 20289 T1469 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[38 (1430150680806424576)]} 0 1
[junit4:junit4]   2> 20290 T1456 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[38 (1430150680806424576)]} 0 2
[junit4:junit4]   2> 20290 T1441 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[38 (1430150680806424576)]} 0 4
[junit4:junit4]   2> 20291 T1467 C71 P44044 /update {version=2&wt=javabin} {add=[38]} 0 7
[junit4:junit4]   2> 20306 T1468 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[39 (1430150680824250368)]} 0 1
[junit4:junit4]   2> 20307 T1455 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[39 (1430150680824250368)]} 0 2
[junit4:junit4]   2> 20307 T1440 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[39 (1430150680824250368)]} 0 4
[junit4:junit4]   2> 20308 T1470 C71 P44044 /update {version=2&wt=javabin} {add=[39]} 0 7
[junit4:junit4]   2> 20316 T1467 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[40 (1430150680833687552)]} 0 1
[junit4:junit4]   2> 20316 T1454 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[40 (1430150680833687552)]} 0 1
[junit4:junit4]   2> 20317 T1442 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[40 (1430150680833687552)]} 0 5
[junit4:junit4]   2> 20317 T1469 C71 P44044 /update {version=2&wt=javabin} {add=[40]} 0 7
[junit4:junit4]   2> 20326 T1470 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[41 (1430150680843124736)]} 0 2
[junit4:junit4]   2> 20326 T1456 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[41 (1430150680843124736)]} 0 2
[junit4:junit4]   2> 20327 T1439 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[41 (1430150680843124736)]} 0 6
[junit4:junit4]   2> 20327 T1468 C71 P44044 /update {version=2&wt=javabin} {add=[41]} 0 8
[junit4:junit4]   2> 20336 T1469 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[42 (1430150680854659072)]} 0 1
[junit4:junit4]   2> 20336 T1455 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[42 (1430150680854659072)]} 0 1
[junit4:junit4]   2> 20337 T1441 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[42 (1430150680854659072)]} 0 5
[junit4:junit4]   2> 20337 T1467 C71 P44044 /update {version=2&wt=javabin} {add=[42]} 0 7
[junit4:junit4]   2> 20345 T1453 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[43 (1430150680864096256)]} 0 1
[junit4:junit4]   2> 20345 T1468 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[43 (1430150680864096256)]} 0 1
[junit4:junit4]   2> 20346 T1440 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[43 (1430150680864096256)]} 0 5
[junit4:junit4]   2> 20346 T1470 C71 P44044 /update {version=2&wt=javabin} {add=[43]} 0 7
[junit4:junit4]   2> 20355 T1454 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[44 (1430150680874582016)]} 0 1
[junit4:junit4]   2> 20355 T1467 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[44 (1430150680874582016)]} 0 1
[junit4:junit4]   2> 20355 T1442 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[44 (1430150680874582016)]} 0 5
[junit4:junit4]   2> 20356 T1469 C71 P44044 /update {version=2&wt=javabin} {add=[44]} 0 8
[junit4:junit4]   2> 20364 T1456 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[45 (1430150680884019200)]} 0 1
[junit4:junit4]   2> 20364 T1470 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[45 (1430150680884019200)]} 0 2
[junit4:junit4]   2> 20364 T1439 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[45 (1430150680884019200)]} 0 4
[junit4:junit4]   2> 20365 T1468 C71 P44044 /update {version=2&wt=javabin} {add=[45]} 0 7
[junit4:junit4]   2> 20372 T1469 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[46 (1430150680893456384)]} 0 0
[junit4:junit4]   2> 20373 T1455 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[46 (1430150680893456384)]} 0 1
[junit4:junit4]   2> 20373 T1440 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[46 (1430150680893456384)]} 0 4
[junit4:junit4]   2> 20374 T1467 C71 P44044 /update {version=2&wt=javabin} {add=[46]} 0 7
[junit4:junit4]   2> 20381 T1468 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[47 (1430150680902893568)]} 0 1
[junit4:junit4]   2> 20382 T1453 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[47 (1430150680902893568)]} 0 2
[junit4:junit4]   2> 20382 T1442 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[47 (1430150680902893568)]} 0 4
[junit4:junit4]   2> 20383 T1470 C71 P44044 /update {version=2&wt=javabin} {add=[47]} 0 7
[junit4:junit4]   2> 20391 T1454 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[48 (1430150680912330752)]} 0 1
[junit4:junit4]   2> 20392 T1468 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[48 (1430150680912330752)]} 0 2
[junit4:junit4]   2> 20392 T1441 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[48 (1430150680912330752)]} 0 5
[junit4:junit4]   2> 20393 T1469 C71 P44044 /update {version=2&wt=javabin} {add=[48]} 0 8
[junit4:junit4]   2> 20402 T1467 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[49 (1430150680923865088)]} 0 1
[junit4:junit4]   2> 20402 T1456 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[49 (1430150680923865088)]} 0 1
[junit4:junit4]   2> 20403 T1439 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[49 (1430150680923865088)]} 0 6
[junit4:junit4]   2> 20404 T1470 C71 P44044 /update {version=2&wt=javabin} {add=[49]} 0 9
[junit4:junit4]   2> 20412 T1469 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[50 (1430150680934350848)]} 0 1
[junit4:junit4]   2> 20412 T1455 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[50 (1430150680934350848)]} 0 1
[junit4:junit4]   2> 20413 T1440 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[50 (1430150680934350848)]} 0 5
[junit4:junit4]   2> 20413 T1468 C71 P44044 /update {version=2&wt=javabin} {add=[50]} 0 7
[junit4:junit4]   2> 20422 T1470 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[51 (1430150680943788032)]} 0 2
[junit4:junit4]   2> 20423 T1453 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[51 (1430150680943788032)]} 0 2
[junit4:junit4]   2> 20424 T1442 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[51 (1430150680943788032)]} 0 7
[junit4:junit4]   2> 20424 T1467 C71 P44044 /update {version=2&wt=javabin} {add=[51]} 0 9
[junit4:junit4]   2> 20433 T1454 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[52 (1430150680956370944)]} 0 1
[junit4:junit4]   2> 20433 T1468 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[52 (1430150680956370944)]} 0 1
[junit4:junit4]   2> 20434 T1441 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[52 (1430150680956370944)]} 0 5
[junit4:junit4]   2> 20435 T1469 C71 P44044 /update {version=2&wt=javabin} {add=[52]} 0 8
[junit4:junit4]   2> 20444 T1456 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[53 (1430150680966856704)]} 0 2
[junit4:junit4]   2> 20444 T1467 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[53 (1430150680966856704)]} 0 2
[junit4:junit4]   2> 20444 T1439 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[53 (1430150680966856704)]} 0 5
[junit4:junit4]   2> 20445 T1470 C71 P44044 /update {version=2&wt=javabin} {add=[53]} 0 8
[junit4:junit4]   2> 20454 T1469 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[54 (1430150680978391040)]} 0 1
[junit4:junit4]   2> 20454 T1455 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[54 (1430150680978391040)]} 0 1
[junit4:junit4]   2> 20455 T1440 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[54 (1430150680978391040)]} 0 6
[junit4:junit4]   2> 20456 T1468 C71 P44044 /update {version=2&wt=javabin} {add=[54]} 0 9
[junit4:junit4]   2> 20464 T1453 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[55 (1430150680988876800)]} 0 1
[junit4:junit4]   2> 20464 T1470 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[55 (1430150680988876800)]} 0 1
[junit4:junit4]   2> 20465 T1442 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[55 (1430150680988876800)]} 0 5
[junit4:junit4]   2> 20465 T1467 C71 P44044 /update {version=2&wt=javabin} {add=[55]} 0 7
[junit4:junit4]   2> 20473 T1454 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[56 (1430150680999362560)]} 0 1
[junit4:junit4]   2> 20474 T1468 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[56 (1430150680999362560)]} 0 2
[junit4:junit4]   2> 20474 T1441 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[56 (1430150680999362560)]} 0 4
[junit4:junit4]   2> 20475 T1469 C71 P44044 /update {version=2&wt=javabin} {add=[56]} 0 7
[junit4:junit4]   2> 20483 T1456 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[57 (1430150681008799744)]} 0 1
[junit4:junit4]   2> 20483 T1467 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[57 (1430150681008799744)]} 0 1
[junit4:junit4]   2> 20484 T1439 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[57 (1430150681008799744)]} 0 5
[junit4:junit4]   2> 20484 T1470 C71 P44044 /update {version=2&wt=javabin} {add=[57]} 0 7
[junit4:junit4]   2> 20493 T1469 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[58 (1430150681019285504)]} 0 1
[junit4:junit4]   2> 20495 T1455 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[58 (1430150681019285504)]} 0 3
[junit4:junit4]   2> 20495 T1440 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[58 (1430150681019285504)]} 0 7
[junit4:junit4]   2> 20496 T1468 C71 P44044 /update {version=2&wt=javabin} {add=[58]} 0 9
[junit4:junit4]   2> 20504 T1453 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[59 (1430150681030819840)]} 0 1
[junit4:junit4]   2> 20504 T1470 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[59 (1430150681030819840)]} 0 1
[junit4:junit4]   2> 20505 T1442 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[59 (1430150681030819840)]} 0 5
[junit4:junit4]   2> 20505 T1467 C71 P44044 /update {version=2&wt=javabin} {add=[59]} 0 7
[junit4:junit4]   2> 20514 T1454 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[60 (1430150681041305600)]} 0 2
[junit4:junit4]   2> 20514 T1469 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[60 (1430150681041305600)]} 0 2
[junit4:junit4]   2> 20514 T1441 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[60 (1430150681041305600)]} 0 5
[junit4:junit4]   2> 20515 T1468 C71 P44044 /update {version=2&wt=javabin} {add=[60]} 0 7
[junit4:junit4]   2> 20523 T1467 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[61 (1430150681050742784)]} 0 1
[junit4:junit4]   2> 20523 T1456 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[61 (1430150681050742784)]} 0 1
[junit4:junit4]   2> 20524 T1439 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[61 (1430150681050742784)]} 0 5
[junit4:junit4]   2> 20525 T1470 C71 P44044 /update {version=2&wt=javabin} {add=[61]} 0 8
[junit4:junit4]   2> 20533 T1468 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[62 (1430150681061228544)]} 0 1
[junit4:junit4]   2> 20533 T1453 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[62 (1430150681061228544)]} 0 1
[junit4:junit4]   2> 20533 T1440 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[62 (1430150681061228544)]} 0 4
[junit4:junit4]   2> 20534 T1469 C71 P44044 /update {version=2&wt=javabin} {add=[62]} 0 7
[junit4:junit4]   2> 20541 T1470 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[63 (1430150681070665728)]} 0 1
[junit4:junit4]   2> 20541 T1454 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[63 (1430150681070665728)]} 0 1
[junit4:junit4]   2> 20542 T1442 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[63 (1430150681070665728)]} 0 4
[junit4:junit4]   2> 20543 T1467 C71 P44044 /update {version=2&wt=javabin} {add=[63]} 0 7
[junit4:junit4]   2> 20551 T1455 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[64 (1430150681080102912)]} 0 2
[junit4:junit4]   2> 20551 T1469 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[64 (1430150681080102912)]} 0 2
[junit4:junit4]   2> 20551 T1441 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[64 (1430150681080102912)]} 0 4
[junit4:junit4]   2> 20552 T1468 C71 P44044 /update {version=2&wt=javabin} {add=[64]} 0 7
[junit4:junit4]   2> 20560 T1456 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[65 (1430150681089540096)]} 0 1
[junit4:junit4]   2> 20560 T1467 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[65 (1430150681089540096)]} 0 1
[junit4:junit4]   2> 20561 T1439 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[65 (1430150681089540096)]} 0 5
[junit4:junit4]   2> 20561 T1470 C71 P44044 /update {version=2&wt=javabin} {add=[65]} 0 7
[junit4:junit4]   2> 20569 T1468 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[66 (1430150681100025856)]} 0 1
[junit4:junit4]   2> 20570 T1453 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[66 (1430150681100025856)]} 0 2
[junit4:junit4]   2> 20570 T1440 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[66 (1430150681100025856)]} 0 5
[junit4:junit4]   2> 20571 T1469 C71 P44044 /update {version=2&wt=javabin} {add=[66]} 0 8
[junit4:junit4]   2> 20579 T1470 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[67 (1430150681109463040)]} 0 1
[junit4:junit4]   2> 20579 T1454 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[67 (1430150681109463040)]} 0 1
[junit4:junit4]   2> 20580 T1442 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[67 (1430150681109463040)]} 0 5
[junit4:junit4]   2> 20580 T1467 C71 P44044 /update {version=2&wt=javabin} {add=[67]} 0 7
[junit4:junit4]   2> 20588 T1455 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[68 (1430150681119948800)]} 0 1
[junit4:junit4]   2> 20589 T1469 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[68 (1430150681119948800)]} 0 2
[junit4:junit4]   2> 20589 T1441 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[68 (1430150681119948800)]} 0 5
[junit4:junit4]   2> 20590 T1468 C71 P44044 /update {version=2&wt=javabin} {add=[68]} 0 8
[junit4:junit4]   2> 20597 T1456 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[69 (1430150681129385984)]} 0 1
[junit4:junit4]   2> 20598 T1467 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[69 (1430150681129385984)]} 0 1
[junit4:junit4]   2> 20598 T1439 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[69 (1430150681129385984)]} 0 4
[junit4:junit4]   2> 20599 T1470 C71 P44044 /update {version=2&wt=javabin} {add=[69]} 0 7
[junit4:junit4]   2> 20607 T1453 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[70 (1430150681138823168)]} 0 1
[junit4:junit4]   2> 20607 T1468 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[70 (1430150681138823168)]} 0 1
[junit4:junit4]   2> 20608 T1440 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[70 (1430150681138823168)]} 0 5
[junit4:junit4]   2> 20608 T1469 C71 P44044 /update {version=2&wt=javabin} {add=[70]} 0 7
[junit4:junit4]   2> 20616 T1470 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[71 (1430150681149308928)]} 0 1
[junit4:junit4]   2> 20616 T1454 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[71 (1430150681149308928)]} 0 1
[junit4:junit4]   2> 20617 T1442 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[71 (1430150681149308928)]} 0 5
[junit4:junit4]   2> 20618 T1467 C71 P44044 /update {version=2&wt=javabin} {add=[71]} 0 8
[junit4:junit4]   2> 20626 T1469 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[72 (1430150681158746112)]} 0 1
[junit4:junit4]   2> 20626 T1455 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[72 (1430150681158746112)]} 0 1
[junit4:junit4]   2> 20627 T1441 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[72 (1430150681158746112)]} 0 5
[junit4:junit4]   2> 20627 T1468 C71 P44044 /update {version=2&wt=javabin} {add=[72]} 0 7
[junit4:junit4]   2> 20634 T1467 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[73 (1430150681168183296)]} 0 0
[junit4:junit4]   2> 20635 T1456 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[73 (1430150681168183296)]} 0 1
[junit4:junit4]   2> 20635 T1439 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[73 (1430150681168183296)]} 0 4
[junit4:junit4]   2> 20636 T1470 C71 P44044 /update {version=2&wt=javabin} {add=[73]} 0 7
[junit4:junit4]   2> 20647 T1453 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[74 (1430150681177620480)]} 0 5
[junit4:junit4]   2> 20647 T1468 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[74 (1430150681177620480)]} 0 5
[junit4:junit4]   2> 20647 T1440 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[74 (1430150681177620480)]} 0 7
[junit4:junit4]   2> 20648 T1469 C71 P44044 /update {version=2&wt=javabin} {add=[74]} 0 10
[junit4:junit4]   2> 20655 T1470 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[75 (1430150681190203392)]} 0 1
[junit4:junit4]   2> 20655 T1454 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[75 (1430150681190203392)]} 0 1
[junit4:junit4]   2> 20656 T1442 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[75 (1430150681190203392)]} 0 4
[junit4:junit4]   2> 20656 T1467 C71 P44044 /update {version=2&wt=javabin} {add=[75]} 0 6
[junit4:junit4]   2> 20664 T1469 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[76 (1430150681198592000)]} 0 1
[junit4:junit4]   2> 20664 T1455 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[76 (1430150681198592000)]} 0 1
[junit4:junit4]   2> 20664 T1441 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[76 (1430150681198592000)]} 0 4
[junit4:junit4]   2> 20665 T1468 C71 P44044 /update {version=2&wt=javabin} {add=[76]} 0 6
[junit4:junit4]   2> 20672 T1467 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[77 (1430150681208029184)]} 0 1
[junit4:junit4]   2> 20673 T1456 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[77 (1430150681208029184)]} 0 1
[junit4:junit4]   2> 20673 T1439 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[77 (1430150681208029184)]} 0 4
[junit4:junit4]   2> 20674 T1470 C71 P44044 /update {version=2&wt=javabin} {add=[77]} 0 7
[junit4:junit4]   2> 20681 T1468 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[78 (1430150681217466368)]} 0 1
[junit4:junit4]   2> 20681 T1453 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[78 (1430150681217466368)]} 0 1
[junit4:junit4]   2> 20682 T1440 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[78 (1430150681217466368)]} 0 5
[junit4:junit4]   2> 20683 T1469 C71 P44044 /update {version=2&wt=javabin} {add=[78]} 0 7
[junit4:junit4]   2> 20690 T1470 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[79 (1430150681226903552)]} 0 1
[junit4:junit4]   2> 20690 T1454 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[79 (1430150681226903552)]} 0 1
[junit4:junit4]   2> 20690 T1442 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[79 (1430150681226903552)]} 0 4
[junit4:junit4]   2> 20691 T1467 C71 P44044 /update {version=2&wt=javabin} {add=[79]} 0 6
[junit4:junit4]   2> 20699 T1469 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[80 (1430150681235292160)]} 0 1
[junit4:junit4]   2> 20699 T1455 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[80 (1430150681235292160)]} 0 1
[junit4:junit4]   2> 20700 T1441 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[80 (1430150681235292160)]} 0 5
[junit4:junit4]   2> 20700 T1468 C71 P44044 /update {version=2&wt=javabin} {add=[80]} 0 7
[junit4:junit4]   2> 20708 T1467 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[81 (1430150681244729344)]} 0 1
[junit4:junit4]   2> 20709 T1456 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[81 (1430150681244729344)]} 0 2
[junit4:junit4]   2> 20709 T1439 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[81 (1430150681244729344)]} 0 5
[junit4:junit4]   2> 20710 T1470 C71 P44044 /update {version=2&wt=javabin} {add=[81]} 0 8
[junit4:junit4]   2> 20717 T1453 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[82 (1430150681255215104)]} 0 1
[junit4:junit4]   2> 20717 T1468 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[82 (1430150681255215104)]} 0 1
[junit4:junit4]   2> 20718 T1442 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[82 (1430150681255215104)]} 0 4
[junit4:junit4]   2> 20718 T1469 C71 P44044 /update {version=2&wt=javabin} {add=[82]} 0 6
[junit4:junit4]   2> 20726 T1470 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[83 (1430150681264652288)]} 0 1
[junit4:junit4]   2> 20726 T1454 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[83 (1430150681264652288)]} 0 1
[junit4:junit4]   2> 20727 T1441 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[83 (1430150681264652288)]} 0 5
[junit4:junit4]   2> 20727 T1467 C71 P44044 /update {version=2&wt=javabin} {add=[83]} 0 6
[junit4:junit4]   2> 20735 T1469 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[84 (1430150681274089472)]} 0 1
[junit4:junit4]   2> 20736 T1455 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[84 (1430150681274089472)]} 0 2
[junit4:junit4]   2> 20736 T1440 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[84 (1430150681274089472)]} 0 5
[junit4:junit4]   2> 20737 T1468 C71 P44044 /update {version=2&wt=javabin} {add=[84]} 0 7
[junit4:junit4]   2> 20744 T1467 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[85 (1430150681283526656)]} 0 1
[junit4:junit4]   2> 20745 T1456 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[85 (1430150681283526656)]} 0 2
[junit4:junit4]   2> 20745 T1439 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[85 (1430150681283526656)]} 0 4
[junit4:junit4]   2> 20746 T1470 C71 P44044 /update {version=2&wt=javabin} {add=[85]} 0 7
[junit4:junit4]   2> 20753 T1468 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[86 (1430150681292963840)]} 0 0
[junit4:junit4]   2> 20754 T1453 C69 P39591 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unloadcollection1/&version=2&wt=javabin} {add=[86 (1430150681292963840)]} 0 1
[junit4:junit4]   2> 20754 T1442 C70 P52413 /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44044/unloadcollection3/&version=2&wt=javabin} {add=[86 (1430150681292963840)]} 0 4
[junit4:junit4]   2> 20755 T1469 C71 P44044 /update {version=2&wt=javabin} {add=[86]} 0 7
[junit4:junit4]   2> 20762 T1470 C71 P44044 /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:52413/unload

[...truncated too long message...]

)
[junit4:junit4]   1>   /solr/aliases.json (0)
[junit4:junit4]   1>   /solr/overseer (3)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       
[junit4:junit4]   1>    /solr/overseer/collection-queue-work (0)
[junit4:junit4]   1>    /solr/overseer/queue (0)
[junit4:junit4]   1>    /solr/overseer/queue-work (0)
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=77035A56D75EC3D -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=be_BY -Dtests.timezone=Africa/Nairobi -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR   32.7s J1 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: org.apache.solr.common.SolrException: Server at http://127.0.0.1:34807/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([77035A56D75EC3D:8696BBBD1A2A8C01]:0)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 32729 T1339 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 32732 T1338 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4]   2> 32799 T1342 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> NOTE: test params are: codec=SimpleText, sim=DefaultSimilarity, locale=be_BY, timezone=Africa/Nairobi
[junit4:junit4]   2> NOTE: Linux 3.2.0-39-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=1,free=89425856,total=223096832
[junit4:junit4]   2> NOTE: All tests run in this JVM: [CopyFieldTest, NoCacheHeaderTest, OpenExchangeRatesOrgProviderTest, TestHashPartitioner, SimplePostToolTest, NumericFieldsTest, ShardRoutingCustomTest, SolrPluginUtilsTest, XsltUpdateRequestHandlerTest, StatsComponentTest, TestShardHandlerFactory, SuggesterTSTTest, SpellCheckComponentTest, TestDefaultSimilarityFactory, RequestHandlersTest, HighlighterTest, DistanceFunctionTest, SpellCheckCollatorTest, SuggesterWFSTTest, BadIndexSchemaTest, DateMathParserTest, TestFiltering, CollectionsAPIDistributedZkTest, TestArbitraryIndexDir, TestWordDelimiterFilterFactory, TestBM25SimilarityFactory, TestCodecSupport, AliasIntegrationTest, SolrRequestParserTest, SolrCmdDistributorTest, TestMergePolicyConfig, TestSolrXMLSerializer, DOMUtilTest, TestSolrDiscoveryProperties, UniqFieldsUpdateProcessorFactoryTest, TestQueryTypes, TestSuggestSpellingConverter, TestJmxMonitoredMap, TestPostingsSolrHighlighter, TimeZoneUtilsTest, SolrCoreCheckLockOnStartupTest, EchoParamsTest, TestNumberUtils, TestBinaryField, CoreContainerCoreInitFailuresTest, DocumentAnalysisRequestHandlerTest, TestSystemIdResolver, TestRTGBase, DocValuesMultiTest, TestFastOutputStream, UpdateParamsTest, TestRandomFaceting, ClusterStateTest, IndexReaderFactoryTest, TestSolrJ, TestPartialUpdateDeduplication, TestOmitPositions, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 33.00s, 1 test, 1 error <<< FAILURES!

[...truncated 500 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:375: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:355: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1210: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:874: There were test failures: 272 suites, 1144 tests, 1 error, 1 failure, 13 ignored (7 assumptions)

Total time: 41 minutes 23 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.8.0-ea-b79 -server -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message