lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b79) - Build # 4784 - Failure!
Date Fri, 22 Mar 2013 21:17:47 GMT
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4784/
Java: 32bit/jdk1.8.0-ea-b79 -client -XX:+UseG1GC -XX:MarkStackSize=256K

2 tests failed.
REGRESSION:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Server at http://127.0.0.1:44607/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:44607/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
	at __randomizedtesting.SeedInfo.seed([BD94D3CF4F605AD4:3C725DD7383F3AE8]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


REGRESSION:  org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch

Error Message:
Still found shard2 in collection test_unload_shard_and_collection

Stack Trace:
java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
	at __randomizedtesting.SeedInfo.seed([BD94D3CF4F605AD4:3C725DD7383F3AE8]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:127)
	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9156 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.UnloadDistributedZkTest
[junit4:junit4]   2> 0 T187 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4]   2> 5 T187 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376
[junit4:junit4]   2> 5 T187 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 6 T188 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 7 T188 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 8 T188 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 8 T188 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 9 T188 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 10 T188 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-1363986133376/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 106 T187 oasc.ZkTestServer.run start zk server on port:47723
[junit4:junit4]   2> 106 T187 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47723 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2da861
[junit4:junit4]   2> 107 T187 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 107 T193 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:47723. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 108 T193 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:47723, initiating session
[junit4:junit4]   2> 108 T189 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56164
[junit4:junit4]   2> 109 T189 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56164
[junit4:junit4]   2> 109 T191 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 179 T191 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d93e8b1860000 with negotiated timeout 10000 for client /127.0.0.1:56164
[junit4:junit4]   2> 179 T193 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:47723, sessionid = 0x13d93e8b1860000, negotiated timeout = 10000
[junit4:junit4]   2> 179 T194 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2da861 name:ZooKeeperConnection Watcher:127.0.0.1:47723 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 179 T187 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 180 T187 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 183 T192 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d93e8b1860000
[junit4:junit4]   2> 183 T194 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 183 T189 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:56164 which had sessionid 0x13d93e8b1860000
[junit4:junit4]   2> 183 T187 oaz.ZooKeeper.close Session: 0x13d93e8b1860000 closed
[junit4:junit4]   2> 184 T187 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47723/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@ea5ed4
[junit4:junit4]   2> 184 T187 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 185 T195 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:47723. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 185 T195 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:47723, initiating session
[junit4:junit4]   2> 185 T189 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56165
[junit4:junit4]   2> 185 T189 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56165
[junit4:junit4]   2> 186 T191 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d93e8b1860001 with negotiated timeout 10000 for client /127.0.0.1:56165
[junit4:junit4]   2> 186 T195 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:47723, sessionid = 0x13d93e8b1860001, negotiated timeout = 10000
[junit4:junit4]   2> 186 T196 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ea5ed4 name:ZooKeeperConnection Watcher:127.0.0.1:47723/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 187 T187 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 187 T187 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 190 T187 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 192 T187 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 193 T187 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 196 T187 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 196 T187 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 200 T187 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 200 T187 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 203 T187 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 204 T187 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 206 T187 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 206 T187 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 208 T187 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 209 T187 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 211 T187 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 212 T187 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 214 T187 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 214 T187 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 216 T187 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 217 T187 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 219 T187 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 219 T187 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 221 T192 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d93e8b1860001
[junit4:junit4]   2> 222 T196 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 222 T187 oaz.ZooKeeper.close Session: 0x13d93e8b1860001 closed
[junit4:junit4]   2> 222 T189 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:56165 which had sessionid 0x13d93e8b1860001
[junit4:junit4]   2> 297 T187 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 303 T187 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:41950
[junit4:junit4]   2> 304 T187 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 304 T187 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 305 T187 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1363986133594
[junit4:junit4]   2> 305 T187 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1363986133594/solr.xml
[junit4:junit4]   2> 305 T187 oasc.CoreContainer.<init> New CoreContainer 17057696
[junit4:junit4]   2> 306 T187 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1363986133594/'
[junit4:junit4]   2> 306 T187 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1363986133594/'
[junit4:junit4]   2> 328 T187 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 328 T187 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 329 T187 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 329 T187 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 330 T187 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 330 T187 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 331 T187 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 331 T187 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 331 T187 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 332 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 340 T187 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 360 T187 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:47723/solr
[junit4:junit4]   2> 361 T187 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 361 T187 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47723 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@e2c598
[junit4:junit4]   2> 362 T187 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 362 T206 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:47723. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 363 T206 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:47723, initiating session
[junit4:junit4]   2> 363 T189 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56166
[junit4:junit4]   2> 363 T189 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56166
[junit4:junit4]   2> 364 T191 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d93e8b1860002 with negotiated timeout 20000 for client /127.0.0.1:56166
[junit4:junit4]   2> 364 T206 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:47723, sessionid = 0x13d93e8b1860002, negotiated timeout = 20000
[junit4:junit4]   2> 365 T207 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e2c598 name:ZooKeeperConnection Watcher:127.0.0.1:47723 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 365 T187 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 366 T192 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d93e8b1860002
[junit4:junit4]   2> 366 T207 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 366 T187 oaz.ZooKeeper.close Session: 0x13d93e8b1860002 closed
[junit4:junit4]   2> 366 T189 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:56166 which had sessionid 0x13d93e8b1860002
[junit4:junit4]   2> 367 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 370 T187 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47723/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@172f58c
[junit4:junit4]   2> 371 T187 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 371 T208 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:47723. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 372 T208 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:47723, initiating session
[junit4:junit4]   2> 372 T189 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56167
[junit4:junit4]   2> 372 T189 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56167
[junit4:junit4]   2> 373 T191 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d93e8b1860003 with negotiated timeout 20000 for client /127.0.0.1:56167
[junit4:junit4]   2> 373 T208 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:47723, sessionid = 0x13d93e8b1860003, negotiated timeout = 20000
[junit4:junit4]   2> 373 T209 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@172f58c name:ZooKeeperConnection Watcher:127.0.0.1:47723/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 373 T187 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 375 T187 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4]   2> 377 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b1860003 type:create cxid:0x7 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 378 T187 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4]   2> 380 T187 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 381 T187 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41950_
[junit4:junit4]   2> 382 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b1860003 type:delete cxid:0x12 zxid:0x1e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:41950_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:41950_
[junit4:junit4]   2> 383 T187 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41950_
[junit4:junit4]   2> 385 T187 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 389 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b1860003 type:delete cxid:0x20 zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 390 T187 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 392 T187 oasc.Overseer.start Overseer (id=89390195237322755-127.0.0.1:41950_-n_0000000000) starting
[junit4:junit4]   2> 392 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b1860003 type:create cxid:0x25 zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 393 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b1860003 type:create cxid:0x26 zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 394 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b1860003 type:create cxid:0x28 zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 395 T187 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4]   2> 397 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b1860003 type:create cxid:0x2e zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 398 T211 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 399 T187 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 401 T187 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 402 T187 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 404 T210 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 406 T187 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 406 T187 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 407 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 411 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 412 T187 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47723/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4c6573
[junit4:junit4]   2> 413 T187 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 413 T213 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:47723. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 414 T213 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:47723, initiating session
[junit4:junit4]   2> 414 T189 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56168
[junit4:junit4]   2> 414 T189 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56168
[junit4:junit4]   2> 415 T191 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d93e8b1860004 with negotiated timeout 10000 for client /127.0.0.1:56168
[junit4:junit4]   2> 415 T213 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:47723, sessionid = 0x13d93e8b1860004, negotiated timeout = 10000
[junit4:junit4]   2> 415 T214 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c6573 name:ZooKeeperConnection Watcher:127.0.0.1:47723/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 415 T187 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 417 T187 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 419 T187 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 488 T187 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 490 T187 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:45639
[junit4:junit4]   2> 491 T187 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 491 T187 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 491 T187 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363986133791
[junit4:junit4]   2> 492 T187 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363986133791/solr.xml
[junit4:junit4]   2> 492 T187 oasc.CoreContainer.<init> New CoreContainer 14658295
[junit4:junit4]   2> 492 T187 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363986133791/'
[junit4:junit4]   2> 493 T187 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363986133791/'
[junit4:junit4]   2> 512 T187 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 513 T187 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 513 T187 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 514 T187 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 514 T187 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 514 T187 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 515 T187 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 515 T187 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 515 T187 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 516 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 523 T187 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 537 T187 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:47723/solr
[junit4:junit4]   2> 537 T187 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 538 T187 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47723 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6ae4be
[junit4:junit4]   2> 538 T187 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 539 T224 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:47723. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 539 T224 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:47723, initiating session
[junit4:junit4]   2> 539 T189 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56169
[junit4:junit4]   2> 540 T189 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56169
[junit4:junit4]   2> 540 T191 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d93e8b1860005 with negotiated timeout 20000 for client /127.0.0.1:56169
[junit4:junit4]   2> 540 T224 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:47723, sessionid = 0x13d93e8b1860005, negotiated timeout = 20000
[junit4:junit4]   2> 541 T225 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6ae4be name:ZooKeeperConnection Watcher:127.0.0.1:47723 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 541 T187 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 542 T192 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d93e8b1860005
[junit4:junit4]   2> 542 T225 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 542 T187 oaz.ZooKeeper.close Session: 0x13d93e8b1860005 closed
[junit4:junit4]   2> 543 T189 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:56169 which had sessionid 0x13d93e8b1860005
[junit4:junit4]   2> 543 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 546 T187 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47723/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b09411
[junit4:junit4]   2> 547 T226 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:47723. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 547 T187 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 548 T226 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:47723, initiating session
[junit4:junit4]   2> 548 T189 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56170
[junit4:junit4]   2> 548 T189 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56170
[junit4:junit4]   2> 550 T191 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d93e8b1860006 with negotiated timeout 20000 for client /127.0.0.1:56170
[junit4:junit4]   2> 550 T226 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:47723, sessionid = 0x13d93e8b1860006, negotiated timeout = 20000
[junit4:junit4]   2> 550 T227 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b09411 name:ZooKeeperConnection Watcher:127.0.0.1:47723/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 550 T187 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 551 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b1860006 type:create cxid:0x1 zxid:0x30 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 552 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b1860006 type:create cxid:0x3 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 554 T187 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 1557 T187 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45639_
[junit4:junit4]   2> 1558 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b1860006 type:delete cxid:0xd zxid:0x32 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45639_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45639_
[junit4:junit4]   2> 1559 T187 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45639_
[junit4:junit4]   2> 1564 T214 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 1564 T209 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 1564 T227 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 1573 T187 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 1574 T187 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 1574 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1653 T187 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 1655 T187 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:46713
[junit4:junit4]   2> 1656 T187 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1656 T187 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1656 T187 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363986134951
[junit4:junit4]   2> 1657 T187 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363986134951/solr.xml
[junit4:junit4]   2> 1657 T187 oasc.CoreContainer.<init> New CoreContainer 27249477
[junit4:junit4]   2> 1657 T187 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363986134951/'
[junit4:junit4]   2> 1658 T187 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363986134951/'
[junit4:junit4]   2> 1676 T187 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 1677 T187 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 1677 T187 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 1678 T187 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 1678 T187 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 1678 T187 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 1679 T187 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 1679 T187 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 1679 T187 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 1680 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 1693 T187 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 1707 T187 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:47723/solr
[junit4:junit4]   2> 1707 T187 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 1708 T187 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47723 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@f50e4a
[junit4:junit4]   2> 1709 T187 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1709 T238 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:47723. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 1709 T238 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:47723, initiating session
[junit4:junit4]   2> 1710 T189 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56173
[junit4:junit4]   2> 1710 T189 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56173
[junit4:junit4]   2> 1711 T191 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d93e8b1860007 with negotiated timeout 20000 for client /127.0.0.1:56173
[junit4:junit4]   2> 1711 T238 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:47723, sessionid = 0x13d93e8b1860007, negotiated timeout = 20000
[junit4:junit4]   2> 1711 T239 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f50e4a name:ZooKeeperConnection Watcher:127.0.0.1:47723 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1711 T187 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1712 T192 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d93e8b1860007
[junit4:junit4]   2> 1713 T189 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:56173 which had sessionid 0x13d93e8b1860007
[junit4:junit4]   2> 1713 T239 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 1713 T187 oaz.ZooKeeper.close Session: 0x13d93e8b1860007 closed
[junit4:junit4]   2> 1714 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 1717 T187 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47723/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1430faa
[junit4:junit4]   2> 1718 T240 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:47723. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 1717 T187 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1718 T240 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:47723, initiating session
[junit4:junit4]   2> 1718 T189 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56174
[junit4:junit4]   2> 1719 T189 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56174
[junit4:junit4]   2> 1720 T191 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d93e8b1860008 with negotiated timeout 20000 for client /127.0.0.1:56174
[junit4:junit4]   2> 1720 T240 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:47723, sessionid = 0x13d93e8b1860008, negotiated timeout = 20000
[junit4:junit4]   2> 1720 T241 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1430faa name:ZooKeeperConnection Watcher:127.0.0.1:47723/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1721 T187 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1722 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b1860008 type:create cxid:0x1 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1724 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b1860008 type:create cxid:0x3 zxid:0x39 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1727 T187 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2731 T187 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46713_
[junit4:junit4]   2> 2732 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b1860008 type:delete cxid:0xd zxid:0x3a txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:46713_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:46713_
[junit4:junit4]   2> 2733 T187 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46713_
[junit4:junit4]   2> 2738 T209 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 2738 T227 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 2739 T241 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 2739 T214 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 2748 T187 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2749 T187 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2750 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2844 T187 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 2847 T187 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:36843
[junit4:junit4]   2> 2847 T187 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2848 T187 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2848 T187 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363986136130
[junit4:junit4]   2> 2849 T187 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363986136130/solr.xml
[junit4:junit4]   2> 2849 T187 oasc.CoreContainer.<init> New CoreContainer 24377130
[junit4:junit4]   2> 2850 T187 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363986136130/'
[junit4:junit4]   2> 2851 T187 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363986136130/'
[junit4:junit4]   2> 2873 T187 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 2873 T187 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2873 T187 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 2874 T187 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2874 T187 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2875 T187 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2875 T187 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2875 T187 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2876 T187 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2876 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 2883 T187 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2896 T187 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:47723/solr
[junit4:junit4]   2> 2896 T187 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2897 T187 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47723 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@d733db
[junit4:junit4]   2> 2897 T187 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2898 T252 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:47723. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2898 T252 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:47723, initiating session
[junit4:junit4]   2> 2898 T189 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56175
[junit4:junit4]   2> 2899 T189 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56175
[junit4:junit4]   2> 2899 T191 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d93e8b1860009 with negotiated timeout 20000 for client /127.0.0.1:56175
[junit4:junit4]   2> 2899 T252 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:47723, sessionid = 0x13d93e8b1860009, negotiated timeout = 20000
[junit4:junit4]   2> 2903 T253 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d733db name:ZooKeeperConnection Watcher:127.0.0.1:47723 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2903 T187 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2905 T192 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d93e8b1860009
[junit4:junit4]   2> 2905 T253 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2905 T189 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:56175 which had sessionid 0x13d93e8b1860009
[junit4:junit4]   2> 2905 T187 oaz.ZooKeeper.close Session: 0x13d93e8b1860009 closed
[junit4:junit4]   2> 2906 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 2910 T187 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47723/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@156d761
[junit4:junit4]   2> 2911 T254 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:47723. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2911 T187 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2912 T254 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:47723, initiating session
[junit4:junit4]   2> 2912 T189 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56176
[junit4:junit4]   2> 2912 T189 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56176
[junit4:junit4]   2> 2913 T191 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d93e8b186000a with negotiated timeout 20000 for client /127.0.0.1:56176
[junit4:junit4]   2> 2913 T254 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:47723, sessionid = 0x13d93e8b186000a, negotiated timeout = 20000
[junit4:junit4]   2> 2914 T255 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@156d761 name:ZooKeeperConnection Watcher:127.0.0.1:47723/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2914 T187 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2915 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b186000a type:create cxid:0x1 zxid:0x40 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2916 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b186000a type:create cxid:0x3 zxid:0x41 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2918 T187 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3921 T187 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36843_
[junit4:junit4]   2> 3922 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b186000a type:delete cxid:0xd zxid:0x42 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:36843_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:36843_
[junit4:junit4]   2> 3923 T187 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36843_
[junit4:junit4]   2> 3928 T255 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 3928 T241 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 3928 T227 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 3928 T209 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 3928 T214 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 3937 T187 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3938 T187 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3939 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 4012 T187 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 4014 T187 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:33996
[junit4:junit4]   2> 4021 T187 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 4022 T187 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4022 T187 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1363986137315
[junit4:junit4]   2> 4022 T187 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1363986137315/solr.xml
[junit4:junit4]   2> 4023 T187 oasc.CoreContainer.<init> New CoreContainer 29673671
[junit4:junit4]   2> 4023 T187 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1363986137315/'
[junit4:junit4]   2> 4023 T187 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1363986137315/'
[junit4:junit4]   2> 4041 T187 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 4042 T187 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4042 T187 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 4043 T187 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4043 T187 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4043 T187 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4044 T187 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4044 T187 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4044 T187 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4045 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 4051 T187 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4063 T187 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:47723/solr
[junit4:junit4]   2> 4064 T187 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4065 T187 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47723 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@568b2f
[junit4:junit4]   2> 4066 T187 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4066 T266 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:47723. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4067 T266 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:47723, initiating session
[junit4:junit4]   2> 4067 T189 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56178
[junit4:junit4]   2> 4068 T189 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56178
[junit4:junit4]   2> 4069 T191 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d93e8b186000b with negotiated timeout 20000 for client /127.0.0.1:56178
[junit4:junit4]   2> 4069 T266 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:47723, sessionid = 0x13d93e8b186000b, negotiated timeout = 20000
[junit4:junit4]   2> 4070 T267 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@568b2f name:ZooKeeperConnection Watcher:127.0.0.1:47723 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4071 T187 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4073 T192 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d93e8b186000b
[junit4:junit4]   2> 4074 T189 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:56178 which had sessionid 0x13d93e8b186000b
[junit4:junit4]   2> 4074 T267 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4074 T187 oaz.ZooKeeper.close Session: 0x13d93e8b186000b closed
[junit4:junit4]   2> 4074 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 4077 T187 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47723/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@64346c
[junit4:junit4]   2> 4079 T268 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:47723. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4079 T187 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4079 T268 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:47723, initiating session
[junit4:junit4]   2> 4079 T189 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56179
[junit4:junit4]   2> 4080 T189 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56179
[junit4:junit4]   2> 4082 T191 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d93e8b186000c with negotiated timeout 20000 for client /127.0.0.1:56179
[junit4:junit4]   2> 4082 T268 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:47723, sessionid = 0x13d93e8b186000c, negotiated timeout = 20000
[junit4:junit4]   2> 4083 T269 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@64346c name:ZooKeeperConnection Watcher:127.0.0.1:47723/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4083 T187 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4085 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b186000c type:create cxid:0x1 zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4087 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b186000c type:create cxid:0x3 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4091 T187 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5095 T187 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33996_
[junit4:junit4]   2> 5096 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b186000c type:delete cxid:0xd zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:33996_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:33996_
[junit4:junit4]   2> 5097 T187 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33996_
[junit4:junit4]   2> 5100 T209 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 5100 T227 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 5100 T241 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 5100 T214 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 5100 T269 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 5100 T255 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 5106 T187 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 5106 T187 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 5107 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5111 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5119 T222 oasc.CoreContainer.create Creating SolrCore 'unloadcollection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363986133791/unloadcollection1
[junit4:junit4]   2> 5120 T222 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4]   2> 5120 T222 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:unloadcollection
[junit4:junit4]   2> 5121 T222 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 5122 T222 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 5122 T222 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection
[junit4:junit4]   2> 5124 T222 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4]   2> 5125 T222 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363986133791/unloadcollection1/'
[junit4:junit4]   2> 5154 T222 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 5198 T222 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5200 T222 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5204 T222 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5650 T222 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5657 T222 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5660 T222 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5671 T222 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5675 T222 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5678 T222 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5679 T222 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 5680 T222 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 5681 T222 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5682 T222 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 5682 T222 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 5682 T222 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 5683 T222 oasc.SolrCore.<init> [unloadcollection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363986133791/unloadcollection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986138488unloadcollection1_1n/
[junit4:junit4]   2> 5683 T222 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@dfc97b
[junit4:junit4]   2> 5684 T222 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 5684 T222 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986138488unloadcollection1_1n
[junit4:junit4]   2> 5685 T222 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986138488unloadcollection1_1n/index/
[junit4:junit4]   2> 5685 T222 oasc.SolrCore.initIndex WARNING [unloadcollection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986138488unloadcollection1_1n/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5685 T222 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986138488unloadcollection1_1n/index
[junit4:junit4]   2> 5687 T222 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ddeb7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@852516),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5687 T222 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 5689 T222 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5689 T222 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5690 T222 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5690 T222 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5691 T222 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5691 T222 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5691 T222 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5692 T222 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5692 T222 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5695 T222 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5697 T222 oass.SolrIndexSearcher.<init> Opening Searcher@1f573e7 main
[junit4:junit4]   2> 5698 T222 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986138488unloadcollection1_1n/tlog
[junit4:junit4]   2> 5698 T222 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5699 T222 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5702 T271 oasc.SolrCore.registerSearcher [unloadcollection1] Registered new searcher Searcher@1f573e7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5703 T222 oasc.ZkController.publish publishing core=unloadcollection1 state=down
[junit4:junit4]   2> 6414 T210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6415 T210 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45639",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45639_",
[junit4:junit4]   2> 	  "core":"unloadcollection1",
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null}
[junit4:junit4]   2> 6415 T210 oasc.Overseer$ClusterStateUpdater.createCollection Create collection unloadcollection with numShards 1
[junit4:junit4]   2> 6417 T210 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6422 T227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 6422 T241 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 6422 T209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 6422 T269 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 6422 T214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 6422 T255 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 6705 T222 oasc.CoreContainer.registerCore registering core: unloadcollection1
[junit4:junit4]   2> 6705 T222 oasc.ZkController.register Register replica - core:unloadcollection1 address:http://127.0.0.1:45639 collection:unloadcollection shard:shard1
[junit4:junit4]   2> 6707 T222 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection/leader_elect/shard1/election
[junit4:junit4]   2> 6719 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b1860006 type:delete cxid:0x51 zxid:0x57 txntype:-1 reqpath:n/a Error Path:/solr/collections/unloadcollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/unloadcollection/leaders
[junit4:junit4]   2> 6720 T222 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 6721 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b1860006 type:create cxid:0x52 zxid:0x58 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6723 T222 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 6723 T222 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 6723 T222 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45639/unloadcollection1/
[junit4:junit4]   2> 6724 T222 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 6724 T222 oasc.SyncStrategy.syncToMe http://127.0.0.1:45639/unloadcollection1/ has no replicas
[junit4:junit4]   2> 6724 T222 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45639/unloadcollection1/
[junit4:junit4]   2> 6725 T222 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection/leaders/shard1
[junit4:junit4]   2> 6728 T192 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d93e8b1860006 type:create cxid:0x5d zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7929 T210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7944 T209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 7944 T269 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 7944 T214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 7944 T227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 7944 T241 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 7944 T255 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 7988 T222 oasc.ZkController.register We are http://127.0.0.1:45639/unloadcollection1/ and leader is http://127.0.0.1:45639/unloadcollection1/
[junit4:junit4]   2> 7988 T222 oasc.ZkController.register No LogReplay needed for core=unloadcollection1 baseURL=http://127.0.0.1:45639
[junit4:junit4]   2> 7988 T222 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 7989 T222 oasc.ZkController.publish publishing core=unloadcollection1 state=active
[junit4:junit4]   2> 7990 T222 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7991 T222 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363986133791/solr.xml
[junit4:junit4]   2> 7999 T222 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363986133791/solr.xml
[junit4:junit4]   2> 8000 T222 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {numShards=1&wt=javabin&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986138488unloadcollection1_1n&version=2&collection=unloadcollection&action=CREATE&name=unloadcollection1} status=0 QTime=2882 
[junit4:junit4]   2> 8001 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 8002 T187 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47723/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1fcdc48
[junit4:junit4]   2> 8003 T187 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8003 T272 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:47723. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 8004 T272 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:47723, initiating session
[junit4:junit4]   2> 8004 T189 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56183
[junit4:junit4]   2> 8004 T189 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56183
[junit4:junit4]   2> 8008 T191 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d93e8b186000d with negotiated timeout 10000 for client /127.0.0.1:56183
[junit4:junit4]   2> 8008 T272 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:47723, sessionid = 0x13d93e8b186000d, negotiated timeout = 10000
[junit4:junit4]   2> 8008 T273 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fcdc48 name:ZooKeeperConnection Watcher:127.0.0.1:47723/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8008 T187 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8010 T187 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 8012 T187 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8013 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8017 T237 oasc.CoreContainer.create Creating SolrCore 'unloadcollection2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363986134951/unloadcollection2
[junit4:junit4]   2> 8017 T237 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4]   2> 8019 T237 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 8019 T237 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4]   2> 8021 T237 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363986134951/unloadcollection2/'
[junit4:junit4]   2> 8070 T237 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 8114 T237 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 8116 T237 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 8120 T237 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 8556 T237 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 8562 T237 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 8565 T237 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 8582 T237 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8589 T237 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8595 T237 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8596 T237 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 8598 T237 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 8598 T237 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8600 T237 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 8601 T237 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 8602 T237 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 8602 T237 oasc.SolrCore.<init> [unloadcollection2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363986134951/unloadcollection2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986141386unloadcollection1_2n/
[junit4:junit4]   2> 8603 T237 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@dfc97b
[junit4:junit4]   2> 8604 T237 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 8605 T237 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986141386unloadcollection1_2n
[junit4:junit4]   2> 8606 T237 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986141386unloadcollection1_2n/index/
[junit4:junit4]   2> 8607 T237 oasc.SolrCore.initIndex WARNING [unloadcollection2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986141386unloadcollection1_2n/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 8608 T237 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986141386unloadcollection1_2n/index
[junit4:junit4]   2> 8611 T237 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ac268e lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b19e8),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 8612 T237 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 8615 T237 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 8616 T237 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 8617 T237 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 8617 T237 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 8618 T237 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 8618 T237 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 8619 T237 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 8619 T237 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 8620 T237 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 8622 T237 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 8625 T237 oass.SolrIndexSearcher.<init> Opening Searcher@1aa050b main
[junit4:junit4]   2> 8625 T237 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986141386unloadcollection1_2n/tlog
[junit4:junit4]   2> 8626 T237 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 8626 T237 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 8632 T274 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@1aa050b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 8633 T237 oasc.ZkController.publish publishing core=unloadcollection2 state=down
[junit4:junit4]   2> 8634 T237 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9449 T210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9450 T210 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:45639__unloadcollection1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45639",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45639_",
[junit4:junit4]   2> 	  "core":"unloadcollection1",
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null}
[junit4:junit4]   2> 9453 T210 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:46713",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:46713_",
[junit4:junit4]   2> 	  "core":"unloadcollection2",
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null}
[junit4:junit4]   2> 9453 T210 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 9453 T210 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 9456 T255 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9456 T273 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9456 T269 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9456 T214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9456 T227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9456 T241 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9456 T209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9636 T237 oasc.CoreContainer.registerCore registering core: unloadcollection2
[junit4:junit4]   2> 9636 T237 oasc.ZkController.register Register replica - core:unloadcollection2 address:http://127.0.0.1:46713 collection:unloadcollection shard:shard1
[junit4:junit4]   2> 9639 T237 oasc.ZkController.register We are http://127.0.0.1:46713/unloadcollection2/ and leader is http://127.0.0.1:45639/unloadcollection1/
[junit4:junit4]   2> 9640 T237 oasc.ZkController.register No LogReplay needed for core=unloadcollection2 baseURL=http://127.0.0.1:46713
[junit4:junit4]   2> 9640 T237 oasc.ZkController.checkRecovery Core needs to recover:unloadcollection2
[junit4:junit4]   2> 9640 T237 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C22 name=unloadcollection2 org.apache.solr.core.SolrCore@12061c8 url=http://127.0.0.1:46713/unloadcollection2 node=127.0.0.1:46713_ C22_STATE=coll:unloadcollection core:unloadcollection2 props:{base_url=http://127.0.0.1:46713, state=down, node_name=127.0.0.1:46713_, core=unloadcollection2, collection=unloadcollection}
[junit4:junit4]   2> 9644 T275 C22 P46713 oasc.RecoveryStrategy.run Starting recovery process.  core=unloadcollection2 recoveringAfterStartup=true
[junit4:junit4]   2> 9644 T237 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9644 T275 C22 P46713 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 9647 T237 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363986134951/solr.xml
[junit4:junit4]   2> 9648 T275 C22 P46713 oasc.ZkController.publish publishing core=unloadcollection2 state=recovering
[junit4:junit4]   2> 9648 T275 C22 P46713 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9663 T275 C22 P46713 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9667 T237 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363986134951/solr.xml
[junit4:junit4]   2> 9668 T237 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {wt=javabin&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986141386unloadcollection1_2n&version=2&collection=unloadcollection&action=CREATE&name=unloadcollection2} status=0 QTime=1651 
[junit4:junit4]   2> 9669 T187 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9670 T187 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 9671 T187 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10672 T187 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10962 T210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10963 T210 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:46713__unloadcollection2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:46713",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:46713_",
[junit4:junit4]   2> 	  "core":"unloadcollection2",
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null}
[junit4:junit4]   2> 10966 T214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 10967 T273 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 10967 T241 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 10967 T227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 10967 T209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 10967 T269 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 10966 T255 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 11669 T220 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {wt=javabin&coreNodeName=127.0.0.1:46713__unloadcollection2&state=recovering&core=unloadcollection1&version=2&checkLive=true&action=PREPRECOVERY&onlyIfLeader=true&nodeName=127.0.0.1:46713_} status=0 QTime=2001 
[junit4:junit4]   2> 11674 T187 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12675 T187 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C22_STATE=coll:unloadcollection core:unloadcollection2 props:{shard=shard1, base_url=http://127.0.0.1:46713, state=recovering, node_name=127.0.0.1:46713_, core=unloadcollection2, collection=unloadcollection}
[junit4:junit4]   2> 13670 T275 C22 P46713 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:45639/unloadcollection1/ core=unloadcollection2 - recoveringAfterStartup=true
[junit4:junit4]   2> 13673 T275 C22 P46713 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 13677 T187 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13678 T275 C22 P46713 oasu.PeerSync.sync PeerSync: core=unloadcollection2 url=http://127.0.0.1:46713 START replicas=[http://127.0.0.1:45639/unloadcollection1/] nUpdates=100
[junit4:junit4]   2> 13678 T275 C22 P46713 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 13679 T275 C22 P46713 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=unloadcollection2
[junit4:junit4]   2> 13679 T275 C22 P46713 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=unloadcollection2
[junit4:junit4]   2> 13679 T275 C22 P46713 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=unloadcollection2
[junit4:junit4]   2> 13679 T275 C22 P46713 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 13680 T275 C22 P46713 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:45639/unloadcollection1/. core=unloadcollection2
[junit4:junit4]   2> 13680 T275 C22 P46713 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C23 name=unloadcollection1 org.apache.solr.core.SolrCore@6acbfa url=http://127.0.0.1:45639/unloadcollection1 node=127.0.0.1:45639_ C23_STATE=coll:unloadcollection core:unloadcollection1 props:{shard=shard1, base_url=http://127.0.0.1:45639, state=active, node_name=127.0.0.1:45639_, core=unloadcollection1, collection=unloadcollection, leader=true}
[junit4:junit4]   2> 13684 T222 C23 P45639 REQ /get {getVersions=100&wt=javabin&qt=/get&distrib=false&version=2} status=0 QTime=0 
[junit4:junit4]   2> 13688 T221 C23 P45639 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 13689 T221 C23 P45639 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ddeb7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@852516),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 13689 T221 C23 P45639 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 13690 T221 C23 P45639 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ddeb7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@852516),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ddeb7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@852516),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 13690 T221 C23 P45639 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 13691 T221 C23 P45639 oass.SolrIndexSearcher.<init> Opening Searcher@747f07 realtime
[junit4:junit4]   2> 13691 T221 C23 P45639 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 13691 T221 C23 P45639 /update {commit_end_point=true&wt=javabin&waitSearcher=true&softCommit=false&version=2&openSearcher=false&commit=true} {commit=} 0 4
[junit4:junit4]   2> 13692 T275 C22 P46713 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 13692 T275 C22 P46713 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 13697 T275 C22 P46713 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 13702 T223 C23 P45639 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 13702 T223 C23 P45639 REQ /replication {wt=javabin&qt=/replication&command=indexversion&version=2} status=0 QTime=3 
[junit4:junit4]   2> 13703 T275 C22 P46713 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 13703 T275 C22 P46713 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 13703 T275 C22 P46713 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 13705 T222 C23 P45639 REQ /replication {wt=javabin&qt=/replication&command=filelist&version=2&generation=2} status=0 QTime=0 
[junit4:junit4]   2> 13706 T275 C22 P46713 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 13707 T275 C22 P46713 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986141386unloadcollection1_2n/index.20130322230227077
[junit4:junit4]   2> 13707 T275 C22 P46713 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@1632218 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f30c63) fullCopy=false
[junit4:junit4]   2> 13712 T221 C23 P45639 REQ /replication {wt=filestream&checksum=true&qt=/replication&command=filecontent&file=segments_2&generation=2} status=0 QTime=1 
[junit4:junit4]   2> 13715 T275 C22 P46713 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 13722 T275 C22 P46713 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 13722 T275 C22 P46713 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=unloadcollection2
[junit4:junit4]   2> 13723 T275 C22 P46713 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ac268e lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b19e8),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ac268e lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b19e8),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 13723 T275 C22 P46713 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 13723 T275 C22 P46713 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 13723 T275 C22 P46713 oass.SolrIndexSearcher.<init> Opening Searcher@1a79630 main
[junit4:junit4]   2> 13725 T274 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@1a79630 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 13725 T275 C22 P46713 oasc.RecoveryStrategy.replay No replay needed. core=unloadcollection2
[junit4:junit4]   2> 13726 T275 C22 P46713 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=unloadcollection2
[junit4:junit4]   2> 13726 T275 C22 P46713 oasc.ZkController.publish publishing core=unloadcollection2 state=active
[junit4:junit4]   2> 13726 T275 C22 P46713 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 13727 T275 C22 P46713 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=unloadcollection2
[junit4:junit4]   2> 13975 T210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13976 T210 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:46713__unloadcollection2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:46713",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:46713_",
[junit4:junit4]   2> 	  "core":"unloadcollection2",
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null}
[junit4:junit4]   2> 13983 T241 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13983 T227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13983 T255 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13984 T273 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13984 T214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13983 T269 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13983 T209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14679 T187 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14681 T187 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: unloadcollection
[junit4:junit4]   2> 14682 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2>  C22_STATE=coll:unloadcollection core:unloadcollection2 props:{shard=shard1, base_url=http://127.0.0.1:46713, state=active, node_name=127.0.0.1:46713_, core=unloadcollection2, collection=unloadcollection}
[junit4:junit4]   2> 14740 T236 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[6 (1430243139196551168)]} 0 2
[junit4:junit4]   2> 14741 T223 C23 P45639 /update {wt=javabin&version=2} {add=[6 (1430243139196551168)]} 0 51
[junit4:junit4]   2> 14752 T237 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[7 (1430243139245834240)]} 0 3
[junit4:junit4]   2> 14753 T222 C23 P45639 /update {wt=javabin&version=2} {add=[7 (1430243139245834240)]} 0 9
[junit4:junit4]   2> 14764 T235 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[8 (1430243139258417152)]} 0 2
[junit4:junit4]   2> 14765 T220 C23 P45639 /update {wt=javabin&version=2} {add=[8 (1430243139258417152)]} 0 9
[junit4:junit4]   2> 14769 T221 C23 P45639 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 14790 T221 C23 P45639 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ddeb7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@852516),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ddeb7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@852516),segFN=segments_3,generation=3,filenames=[_0_MockFixedIntBlock_0.skp, _0.fnm, _0_Memory_0.ram, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.pos, _0_Lucene41WithOrds_0.tib, _0_MockFixedIntBlock_0.tii, _0.fdt, _0_MockFixedIntBlock_0.doc, segments_3, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.doc, _0.nvm, _0_MockFixedIntBlock_0.frq, _0_MockFixedIntBlock_0.tib, _0_SimpleText_0.pst, _0.nvd, _0_Lucene41WithOrds_0.pos, _0.si, _0.fdx]
[junit4:junit4]   2> 14791 T221 C23 P45639 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0_MockFixedIntBlock_0.skp, _0.fnm, _0_Memory_0.ram, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.pos, _0_Lucene41WithOrds_0.tib, _0_MockFixedIntBlock_0.tii, _0.fdt, _0_MockFixedIntBlock_0.doc, segments_3, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.doc, _0.nvm, _0_MockFixedIntBlock_0.frq, _0_MockFixedIntBlock_0.tib, _0_SimpleText_0.pst, _0.nvd, _0_Lucene41WithOrds_0.pos, _0.si, _0.fdx]
[junit4:junit4]   2> 14799 T221 C23 P45639 oass.SolrIndexSearcher.<init> Opening Searcher@7eb492 main
[junit4:junit4]   2> 14800 T221 C23 P45639 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 14800 T271 oasc.SolrCore.registerSearcher [unloadcollection1] Registered new searcher Searcher@7eb492 main{StandardDirectoryReader(segments_3:3:nrt _0(4.3):C3)}
[junit4:junit4]   2> 14801 T221 C23 P45639 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:46713/unloadcollection2/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 14803 T234 C22 P46713 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 14808 T234 C22 P46713 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ac268e lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b19e8),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ac268e lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b19e8),segFN=segments_3,generation=3,filenames=[_0_MockFixedIntBlock_0.skp, _0.fnm, _0_Memory_0.ram, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.pos, _0_Lucene41WithOrds_0.tib, _0_MockFixedIntBlock_0.tii, _0.fdt, _0_MockFixedIntBlock_0.doc, segments_3, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.doc, _0.nvm, _0_MockFixedIntBlock_0.frq, _0_MockFixedIntBlock_0.tib, _0_SimpleText_0.pst, _0.nvd, _0_Lucene41WithOrds_0.pos, _0.si, _0.fdx]
[junit4:junit4]   2> 14808 T234 C22 P46713 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0_MockFixedIntBlock_0.skp, _0.fnm, _0_Memory_0.ram, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.pos, _0_Lucene41WithOrds_0.tib, _0_MockFixedIntBlock_0.tii, _0.fdt, _0_MockFixedIntBlock_0.doc, segments_3, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.doc, _0.nvm, _0_MockFixedIntBlock_0.frq, _0_MockFixedIntBlock_0.tib, _0_SimpleText_0.pst, _0.nvd, _0_Lucene41WithOrds_0.pos, _0.si, _0.fdx]
[junit4:junit4]   2> 14810 T234 C22 P46713 oass.SolrIndexSearcher.<init> Opening Searcher@108c372 main
[junit4:junit4]   2> 14810 T234 C22 P46713 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 14811 T274 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@108c372 main{StandardDirectoryReader(segments_3:3:nrt _0(4.3):C3)}
[junit4:junit4]   2> 14811 T234 C22 P46713 /update {expungeDeletes=false&commit_end_point=true&wt=javabin&waitSearcher=true&softCommit=false&version=2&commit=true} {commit=} 0 8
[junit4:junit4]   2> 14812 T221 C23 P45639 /update {wt=javabin&waitSearcher=true&softCommit=false&version=2&commit=true} {commit=} 0 43
[junit4:junit4]   2> 14812 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 14818 T251 oasc.CoreContainer.create Creating SolrCore 'unloadcollection3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363986136130/unloadcollection3
[junit4:junit4]   2> 14818 T251 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4]   2> 14820 T251 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 14820 T251 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4]   2> 14822 T251 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363986136130/unloadcollection3/'
[junit4:junit4]   2> 14868 T251 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 14910 T251 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 14912 T251 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 14916 T251 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 15374 T251 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 15381 T251 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 15384 T251 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 15394 T251 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15398 T251 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15402 T251 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15403 T251 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15403 T251 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15404 T251 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15405 T251 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15405 T251 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15405 T251 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 15406 T251 oasc.SolrCore.<init> [unloadcollection3] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363986136130/unloadcollection3/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986148187unloadcollection_3n/
[junit4:junit4]   2> 15406 T251 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@dfc97b
[junit4:junit4]   2> 15407 T251 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 15408 T251 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986148187unloadcollection_3n
[junit4:junit4]   2> 15408 T251 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986148187unloadcollection_3n/index/
[junit4:junit4]   2> 15408 T251 oasc.SolrCore.initIndex WARNING [unloadcollection3] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986148187unloadcollection_3n/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 15409 T251 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986148187unloadcollection_3n/index
[junit4:junit4]   2> 15411 T251 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@dcbeb5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@a85ba8),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15411 T251 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15413 T251 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 15413 T251 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 15414 T251 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 15415 T251 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 15415 T251 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 15416 T251 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 15416 T251 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 15417 T251 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 15417 T251 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 15420 T251 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 15424 T251 oass.SolrIndexSearcher.<init> Opening Searcher@1b35952 main
[junit4:junit4]   2> 15424 T251 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986148187unloadcollection_3n/tlog
[junit4:junit4]   2> 15425 T251 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 15425 T251 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 15430 T279 oasc.SolrCore.registerSearcher [unloadcollection3] Registered new searcher Searcher@1b35952 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 15431 T251 oasc.ZkController.publish publishing core=unloadcollection3 state=down
[junit4:junit4]   2> 15431 T251 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15491 T210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15492 T210 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:36843",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:36843_",
[junit4:junit4]   2> 	  "core":"unloadcollection3",
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null}
[junit4:junit4]   2> 15493 T210 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 15493 T210 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 15499 T255 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15499 T273 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15499 T227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15499 T209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15499 T241 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15499 T269 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15499 T214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16432 T251 oasc.CoreContainer.registerCore registering core: unloadcollection3
[junit4:junit4]   2> 16433 T251 oasc.ZkController.register Register replica - core:unloadcollection3 address:http://127.0.0.1:36843 collection:unloadcollection shard:shard1
[junit4:junit4]   2> 16439 T251 oasc.ZkController.register We are http://127.0.0.1:36843/unloadcollection3/ and leader is http://127.0.0.1:45639/unloadcollection1/
[junit4:junit4]   2> 16439 T251 oasc.ZkController.register No LogReplay needed for core=unloadcollection3 baseURL=http://127.0.0.1:36843
[junit4:junit4]   2> 16440 T251 oasc.ZkController.checkRecovery Core needs to recover:unloadcollection3
[junit4:junit4]   2> 16440 T251 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C24 name=unloadcollection3 org.apache.solr.core.SolrCore@c536bb url=http://127.0.0.1:36843/unloadcollection3 node=127.0.0.1:36843_ C24_STATE=coll:unloadcollection core:unloadcollection3 props:{base_url=http://127.0.0.1:36843, state=down, node_name=127.0.0.1:36843_, core=unloadcollection3, collection=unloadcollection}
[junit4:junit4]   2> 16441 T280 C24 P36843 oasc.RecoveryStrategy.run Starting recovery process.  core=unloadcollection3 recoveringAfterStartup=true
[junit4:junit4]   2> 16442 T280 C24 P36843 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 16442 T251 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16443 T280 C24 P36843 oasc.ZkController.publish publishing core=unloadcollection3 state=recovering
[junit4:junit4]   2> 16443 T280 C24 P36843 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 16444 T251 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363986136130/solr.xml
[junit4:junit4]   2> 16445 T280 C24 P36843 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 16469 T251 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363986136130/solr.xml
[junit4:junit4]   2> 16471 T251 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {wt=javabin&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986148187unloadcollection_3n&version=2&collection=unloadcollection&action=CREATE&name=unloadcollection3} status=0 QTime=1653 
[junit4:junit4]   2> 16473 T187 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 16474 T187 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17007 T210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17008 T210 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:36843__unloadcollection3",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:36843",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:36843_",
[junit4:junit4]   2> 	  "core":"unloadcollection3",
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null}
[junit4:junit4]   2> 17015 T269 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17015 T214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17015 T241 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17016 T209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17016 T255 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17015 T227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17016 T273 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17453 T220 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {wt=javabin&coreNodeName=127.0.0.1:36843__unloadcollection3&state=recovering&core=unloadcollection1&version=2&checkLive=true&action=PREPRECOVERY&onlyIfLeader=true&nodeName=127.0.0.1:36843_} status=0 QTime=1000 
[junit4:junit4]   2> 17477 T187 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18478 T187 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C24_STATE=coll:unloadcollection core:unloadcollection3 props:{shard=shard1, base_url=http://127.0.0.1:36843, state=recovering, node_name=127.0.0.1:36843_, core=unloadcollection3, collection=unloadcollection}
[junit4:junit4]   2> 19454 T280 C24 P36843 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:45639/unloadcollection1/ core=unloadcollection3 - recoveringAfterStartup=true
[junit4:junit4]   2> 19455 T280 C24 P36843 oasu.PeerSync.sync PeerSync: core=unloadcollection3 url=http://127.0.0.1:36843 START replicas=[http://127.0.0.1:45639/unloadcollection1/] nUpdates=100
[junit4:junit4]   2> 19455 T280 C24 P36843 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 19456 T280 C24 P36843 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=unloadcollection3
[junit4:junit4]   2> 19456 T280 C24 P36843 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=unloadcollection3
[junit4:junit4]   2> 19456 T280 C24 P36843 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=unloadcollection3
[junit4:junit4]   2> 19457 T280 C24 P36843 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 19457 T280 C24 P36843 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:45639/unloadcollection1/. core=unloadcollection3
[junit4:junit4]   2> 19457 T280 C24 P36843 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 19464 T223 C23 P45639 REQ /get {getVersions=100&wt=javabin&qt=/get&distrib=false&version=2} status=0 QTime=6 
[junit4:junit4]   2> 19466 T222 C23 P45639 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 19468 T222 C23 P45639 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ddeb7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@852516),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ddeb7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@852516),segFN=segments_3,generation=3,filenames=[_0_MockFixedIntBlock_0.skp, _0.fnm, _0_Memory_0.ram, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.pos, _0_Lucene41WithOrds_0.tib, _0_MockFixedIntBlock_0.tii, _0.fdt, _0_MockFixedIntBlock_0.doc, segments_3, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.doc, _0.nvm, _0_MockFixedIntBlock_0.frq, _0_MockFixedIntBlock_0.tib, _0_SimpleText_0.pst, _0.nvd, _0_Lucene41WithOrds_0.pos, _0.si, _0.fdx]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ddeb7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@852516),segFN=segments_4,generation=4,filenames=[_0_MockFixedIntBlock_0.skp, _0.fnm, _0_Memory_0.ram, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.pos, _0_Lucene41WithOrds_0.tib, _0_MockFixedIntBlock_0.tii, _0.fdt, _0_MockFixedIntBlock_0.doc, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.doc, _0.nvm, _0_MockFixedIntBlock_0.frq, _0_MockFixedIntBlock_0.tib, _0_SimpleText_0.pst, _0.nvd, segments_4, _0_Lucene41WithOrds_0.pos, _0.si, _0.fdx]
[junit4:junit4]   2> 19469 T222 C23 P45639 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[_0_MockFixedIntBlock_0.skp, _0.fnm, _0_Memory_0.ram, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.pos, _0_Lucene41WithOrds_0.tib, _0_MockFixedIntBlock_0.tii, _0.fdt, _0_MockFixedIntBlock_0.doc, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.doc, _0.nvm, _0_MockFixedIntBlock_0.frq, _0_MockFixedIntBlock_0.tib, _0_SimpleText_0.pst, _0.nvd, segments_4, _0_Lucene41WithOrds_0.pos, _0.si, _0.fdx]
[junit4:junit4]   2> 19470 T222 C23 P45639 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 19470 T222 C23 P45639 /update {commit_end_point=true&wt=javabin&waitSearcher=true&softCommit=false&version=2&openSearcher=false&commit=true} {commit=} 0 5
[junit4:junit4]   2> 19472 T280 C24 P36843 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 19472 T280 C24 P36843 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 19476 T221 C23 P45639 REQ /replication {wt=javabin&qt=/replication&command=indexversion&version=2} status=0 QTime=1 
[junit4:junit4]   2> 19477 T280 C24 P36843 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4]   2> 19477 T280 C24 P36843 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 19478 T280 C24 P36843 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 19480 T223 C23 P45639 REQ /replication {wt=javabin&qt=/replication&command=filelist&version=2&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 19481 T187 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19482 T280 C24 P36843 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 20
[junit4:junit4]   2> 19483 T280 C24 P36843 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1363986133376/1363986148187unloadcollection_3n/index.20130322230232853
[junit4:junit4]   2> 19484 T280 C24 P36843 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@1378f06 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e0c712) fullCopy=false
[junit4:junit4]   2> 19488 T222 C23 P45639 REQ /replication {wt=filestream&checksum=true&qt=/replication&command=filecontent&file=_0_MockFixedIntBlock_0.skp&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 19498 T280 C24 P36843 oash.SnapPuller$DirectoryFileFetcher.fetchPackets WARNING No content recieved for file: {name=_0_MockFixedIntBlock_0.skp, size=0}
[junit4:junit4]   2> 19501 T220 C23 P45639 REQ /replication {wt=filestream&checksum=true&qt=/replication&command=filecontent&file=_0_MockFixedIntBlock_0.pyl&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 19502 T280 C24 P36843 oash.SnapPuller$DirectoryFileFetcher.fetchPackets WARNING No content recieved for file: {name=_0_MockFixedIntBlock_0.pyl, size=0}
[junit4:junit4]   2> 19505 T221 C23 P45639 REQ /replication {wt=filestream&checksum=true&qt=/replication&command=filecontent&file=_0_Memory_0.ram&generation=4} status=0 QTime=1 
[junit4:junit4]   2> 19508 T223 C23 P45639 REQ /replication {wt=filestream&checksum=true&qt=/replication&command=filecontent&file=_0.fnm&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 19511 T222 C23 P45639 REQ /replication {wt=filestream&checksum=true&qt=/replication&command=filecontent&file=_0_MockFixedIntBlock_0.pos&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 19514 T220 C23 P45639 REQ /replication {wt=filestream&checksum=true&qt=/replication&command=filecontent&file=_0_Lucene41WithOrds_0.tib&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 19526 T221 C23 P45639 REQ /replication {wt=filestream&checksum=true&qt=/replication&command=filecontent&file=_0_MockFixedIntBlock_0.tii&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 19531 T223 C23 P45639 REQ /replication {wt=filestream&checksum=true&qt=/replication&command=filecontent&file=_0.fdt&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 19540 T222 C23 P45639 REQ /replication {wt=filestream&checksum=true&qt=/replication&command=filecontent&file=_0_MockFixedIntBlock_0.doc&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 19544 T220 C23 P45639 REQ /replication {wt=filestream&checksum=true&qt=/replication&command=filecontent&file=_0_Lucene41WithOrds_0.tii&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 19548 T221 C23 P45639 REQ /replication {wt=filestream&checksum=true&qt=/replication&command=filecontent&file=_0.nvm&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 19553 T223 C23 P45639 REQ /replication {wt=filestream&checksum=true&qt=/replication&command=filecontent&file=_0_Lucene41WithOrds_0.doc&generation=4} status=0 QTime=1 
[junit4:junit4]   2> 19557 T222 C23 P45639 REQ /replication {wt=filestream&checksum=true&qt=/replication&command=filecontent&file=_0_MockFixedIntBlock_0.frq&generation=4} status=0 QTime=1 
[junit4:junit4]   2> 19561 T220 C23 P45639 REQ /replication {wt=filestream&checksum=true&qt=/replication&command=filecontent&file=_0_SimpleText_0.pst&generation=4} status=0 QTime=1 
[junit4:junit4]   2> 19564 T221 C23 P45639 REQ /replication {wt=filestream&checksum=true&qt=/replication&command=filecontent&file=_0_MockFixedIntBlock_0.tib&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 19568 T223 C23 P45639 REQ /replication {wt=filestream&checksum=true&qt=/replication&command=filecontent&file=_0.nvd&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 19572 T222 C23 P45639 REQ /replication {wt=filestream&checksum=true&qt=/replication&command=filecontent&file=segments_4&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 19576 T220 C23 P45639 REQ /replication {wt=filestream&checksum=true&qt=/replication&command=filecontent&file=_0_Lucene41WithOrds_0.pos&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 19580 T221 C23 P45639 REQ /replication {wt=filestream&checksum=true&qt=/replication&command=filecontent&file=_0.si&generation=4} status=0 QTime=1 
[junit4:junit4]   2> 19583 T223 C23 P45639 REQ /replication {wt=filestream&checksum=true&qt=/replication&command=filecontent&file=_0.fdx&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 19585 T280 C24 P36843 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 19586 T280 C24 P36843 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 19586 T280 C24 P36843 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=unloadcollection3
[junit4:junit4]   2> 19588 T280 C24 P36843 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@dcbeb5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@a85ba8),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@dcbeb5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@a85ba8),segFN=segments_4,generation=4,filenames=[_0_MockFixedIntBlock_0.skp, _0.fnm, _0_Memory_0.ram, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.pos, _0_Lucene41WithOrds_0.tib, _0_MockFixedIntBlock_0.tii, _0.fdt, _0_MockFixedIntBlock_0.doc, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.doc, _0.nvm, _0_MockFixedIntBlock_0.frq, _0_SimpleText_0.pst, _0_MockFixedIntBlock_0.tib, _0.nvd, segments_4, _0_Lucene41WithOrds_0.pos, _0.si, _0.fdx]
[junit4:junit4]   2> 19588 T280 C24 P36843 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[_0_MockFixedIntBlock_0.skp, _0.fnm, _0_Memory_0.ram, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.pos, _0_Lucene41WithOrds_0.tib, _0_MockFixedIntBlock_0.tii, _0.fdt, _0_MockFixedIntBlock_0.doc, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.doc, _0.nvm, _0_MockFixedIntBlock_0.frq, _0_SimpleText_0.pst, _0_MockFixedIntBlock_0.tib, _0.nvd, segments_4, _0_Lucene41WithOrds_0.pos, _0.si, _0.fdx]
[junit4:junit4]   2> 19588 T280 C24 P36843 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 19590 T280 C24 P36843 oass.SolrIndexSearcher.<init> Opening Searcher@1c06bbd main
[junit4:junit4]   2> 19591 T279 oasc.SolrCore.registerSearcher [unloadcollection3] Registered new searcher Searcher@1c06bbd main{StandardDirectoryReader(segments_4:3:nrt _0(4.3):C3)}
[junit4:junit4]   2> 19591 T280 C24 P36843 oasc.RecoveryStrategy.replay No replay needed. core=unloadcollection3
[junit4:junit4]   2> 19591 T280 C24 P36843 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=unloadcollection3
[junit4:junit4]   2> 19592 T280 C24 P36843 oasc.ZkController.publish publishing core=unloadcollection3 state=active
[junit4:junit4]   2> 19592 T280 C24 P36843 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 19593 T280 C24 P36843 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=unloadcollection3
[junit4:junit4]   2> 20025 T210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20026 T210 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:36843__unloadcollection3",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:36843",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:36843_",
[junit4:junit4]   2> 	  "core":"unloadcollection3",
[junit4:junit4]   2> 	  "collection":"unloadcollection",
[junit4:junit4]   2> 	  "roles":null}
[junit4:junit4]   2> 20029 T227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20029 T255 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20029 T269 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20029 T214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20029 T273 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20029 T209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20029 T241 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20483 T187 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20484 T187 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: unloadcollection
[junit4:junit4]   2> 20484 T187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2>  C24_STATE=coll:unloadcollection core:unloadcollection3 props:{shard=shard1, base_url=http://127.0.0.1:36843, state=active, node_name=127.0.0.1:36843_, core=unloadcollection3, collection=unloadcollection}
[junit4:junit4]   2> 20513 T251 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[20 (1430243145288777728)]} 0 3
[junit4:junit4]   2> 20513 T236 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[20 (1430243145288777728)]} 0 2
[junit4:junit4]   2> 20514 T222 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[20 (1430243145288777728)]} 0 7
[junit4:junit4]   2> 20514 T248 C24 P36843 /update {wt=javabin&version=2} {add=[20]} 0 11
[junit4:junit4]   2> 20530 T235 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[21 (1430243145306603520)]} 0 2
[junit4:junit4]   2> 20530 T250 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[21 (1430243145306603520)]} 0 2
[junit4:junit4]   2> 20531 T220 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[21 (1430243145306603520)]} 0 7
[junit4:junit4]   2> 20531 T249 C24 P36843 /update {wt=javabin&version=2} {add=[21]} 0 14
[junit4:junit4]   2> 20541 T234 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[22 (1430243145320235008)]} 0 1
[junit4:junit4]   2> 20541 T248 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[22 (1430243145320235008)]} 0 1
[junit4:junit4]   2> 20542 T221 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[22 (1430243145320235008)]} 0 6
[junit4:junit4]   2> 20542 T251 C24 P36843 /update {wt=javabin&version=2} {add=[22]} 0 8
[junit4:junit4]   2> 20554 T237 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[23 (1430243145330720768)]} 0 3
[junit4:junit4]   2> 20554 T249 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[23 (1430243145330720768)]} 0 3
[junit4:junit4]   2> 20556 T223 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[23 (1430243145330720768)]} 0 9
[junit4:junit4]   2> 20557 T250 C24 P36843 /update {wt=javabin&version=2} {add=[23]} 0 12
[junit4:junit4]   2> 20569 T251 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[24 (1430243145348546560)]} 0 2
[junit4:junit4]   2> 20570 T236 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[24 (1430243145348546560)]} 0 2
[junit4:junit4]   2> 20571 T222 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[24 (1430243145348546560)]} 0 8
[junit4:junit4]   2> 20572 T248 C24 P36843 /update {wt=javabin&version=2} {add=[24]} 0 11
[junit4:junit4]   2> 20585 T250 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[25 (1430243145363226624)]} 0 2
[junit4:junit4]   2> 20585 T235 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[25 (1430243145363226624)]} 0 2
[junit4:junit4]   2> 20586 T220 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[25 (1430243145363226624)]} 0 8
[junit4:junit4]   2> 20587 T249 C24 P36843 /update {wt=javabin&version=2} {add=[25]} 0 12
[junit4:junit4]   2> 20600 T234 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[26 (1430243145380003840)]} 0 2
[junit4:junit4]   2> 20600 T248 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[26 (1430243145380003840)]} 0 2
[junit4:junit4]   2> 20602 T221 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[26 (1430243145380003840)]} 0 9
[junit4:junit4]   2> 20603 T251 C24 P36843 /update {wt=javabin&version=2} {add=[26]} 0 13
[junit4:junit4]   2> 20616 T237 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[27 (1430243145395732480)]} 0 3
[junit4:junit4]   2> 20616 T249 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[27 (1430243145395732480)]} 0 3
[junit4:junit4]   2> 20618 T223 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[27 (1430243145395732480)]} 0 9
[junit4:junit4]   2> 20619 T250 C24 P36843 /update {wt=javabin&version=2} {add=[27]} 0 13
[junit4:junit4]   2> 20631 T236 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[28 (1430243145412509696)]} 0 2
[junit4:junit4]   2> 20631 T251 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[28 (1430243145412509696)]} 0 2
[junit4:junit4]   2> 20633 T222 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[28 (1430243145412509696)]} 0 8
[junit4:junit4]   2> 20634 T248 C24 P36843 /update {wt=javabin&version=2} {add=[28]} 0 12
[junit4:junit4]   2> 20646 T235 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[29 (1430243145428238336)]} 0 1
[junit4:junit4]   2> 20647 T250 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[29 (1430243145428238336)]} 0 1
[junit4:junit4]   2> 20648 T220 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[29 (1430243145428238336)]} 0 8
[junit4:junit4]   2> 20649 T249 C24 P36843 /update {wt=javabin&version=2} {add=[29]} 0 12
[junit4:junit4]   2> 20659 T248 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[30 (1430243145443966976)]} 0 1
[junit4:junit4]   2> 20659 T234 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[30 (1430243145443966976)]} 0 1
[junit4:junit4]   2> 20660 T221 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[30 (1430243145443966976)]} 0 5
[junit4:junit4]   2> 20661 T251 C24 P36843 /update {wt=javabin&version=2} {add=[30]} 0 9
[junit4:junit4]   2> 20669 T249 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[31 (1430243145454452736)]} 0 1
[junit4:junit4]   2> 20671 T237 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[31 (1430243145454452736)]} 0 1
[junit4:junit4]   2> 20671 T223 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[31 (1430243145454452736)]} 0 6
[junit4:junit4]   2> 20672 T250 C24 P36843 /update {wt=javabin&version=2} {add=[31]} 0 9
[junit4:junit4]   2> 20679 T236 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[32 (1430243145465987072)]} 0 0
[junit4:junit4]   2> 20679 T251 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[32 (1430243145465987072)]} 0 0
[junit4:junit4]   2> 20680 T222 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[32 (1430243145465987072)]} 0 4
[junit4:junit4]   2> 20681 T248 C24 P36843 /update {wt=javabin&version=2} {add=[32]} 0 7
[junit4:junit4]   2> 20691 T235 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[33 (1430243145475424256)]} 0 2
[junit4:junit4]   2> 20691 T250 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[33 (1430243145475424256)]} 0 2
[junit4:junit4]   2> 20693 T220 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[33 (1430243145475424256)]} 0 8
[junit4:junit4]   2> 20694 T249 C24 P36843 /update {wt=javabin&version=2} {add=[33]} 0 11
[junit4:junit4]   2> 20706 T248 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[34 (1430243145491152896)]} 0 2
[junit4:junit4]   2> 20706 T234 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[34 (1430243145491152896)]} 0 2
[junit4:junit4]   2> 20708 T221 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[34 (1430243145491152896)]} 0 8
[junit4:junit4]   2> 20709 T251 C24 P36843 /update {wt=javabin&version=2} {add=[34]} 0 12
[junit4:junit4]   2> 20721 T249 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[35 (1430243145506881536)]} 0 2
[junit4:junit4]   2> 20722 T237 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[35 (1430243145506881536)]} 0 3
[junit4:junit4]   2> 20724 T223 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[35 (1430243145506881536)]} 0 9
[junit4:junit4]   2> 20725 T250 C24 P36843 /update {wt=javabin&version=2} {add=[35]} 0 13
[junit4:junit4]   2> 20737 T236 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[36 (1430243145523658752)]} 0 2
[junit4:junit4]   2> 20737 T251 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[36 (1430243145523658752)]} 0 2
[junit4:junit4]   2> 20739 T222 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[36 (1430243145523658752)]} 0 8
[junit4:junit4]   2> 20740 T248 C24 P36843 /update {wt=javabin&version=2} {add=[36]} 0 12
[junit4:junit4]   2> 20751 T235 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[37 (1430243145539387392)]} 0 1
[junit4:junit4]   2> 20752 T250 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[37 (1430243145539387392)]} 0 2
[junit4:junit4]   2> 20754 T220 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[37 (1430243145539387392)]} 0 9
[junit4:junit4]   2> 20755 T249 C24 P36843 /update {wt=javabin&version=2} {add=[37]} 0 12
[junit4:junit4]   2> 20767 T248 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[38 (1430243145555116032)]} 0 2
[junit4:junit4]   2> 20767 T234 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[38 (1430243145555116032)]} 0 2
[junit4:junit4]   2> 20769 T221 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[38 (1430243145555116032)]} 0 8
[junit4:junit4]   2> 20770 T251 C24 P36843 /update {wt=javabin&version=2} {add=[38]} 0 12
[junit4:junit4]   2> 20781 T249 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[39 (1430243145570844672)]} 0 1
[junit4:junit4]   2> 20782 T237 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[39 (1430243145570844672)]} 0 2
[junit4:junit4]   2> 20783 T223 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[39 (1430243145570844672)]} 0 7
[junit4:junit4]   2> 20784 T250 C24 P36843 /update {wt=javabin&version=2} {add=[39]} 0 11
[junit4:junit4]   2> 20796 T251 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[40 (1430243145585524736)]} 0 2
[junit4:junit4]   2> 20796 T236 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[40 (1430243145585524736)]} 0 2
[junit4:junit4]   2> 20797 T222 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[40 (1430243145585524736)]} 0 7
[junit4:junit4]   2> 20797 T248 C24 P36843 /update {wt=javabin&version=2} {add=[40]} 0 10
[junit4:junit4]   2> 20806 T235 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[41 (1430243145598107648)]} 0 1
[junit4:junit4]   2> 20806 T250 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[41 (1430243145598107648)]} 0 1
[junit4:junit4]   2> 20806 T221 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[41 (1430243145598107648)]} 0 5
[junit4:junit4]   2> 20807 T249 C24 P36843 /update {wt=javabin&version=2} {add=[41]} 0 8
[junit4:junit4]   2> 20814 T248 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[42 (1430243145607544832)]} 0 1
[junit4:junit4]   2> 20814 T234 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[42 (1430243145607544832)]} 0 1
[junit4:junit4]   2> 20815 T223 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[42 (1430243145607544832)]} 0 4
[junit4:junit4]   2> 20815 T251 C24 P36843 /update {wt=javabin&version=2} {add=[42]} 0 6
[junit4:junit4]   2> 20828 T249 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[43 (1430243145619079168)]} 0 2
[junit4:junit4]   2> 20828 T237 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[43 (1430243145619079168)]} 0 2
[junit4:junit4]   2> 20829 T220 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[43 (1430243145619079168)]} 0 7
[junit4:junit4]   2> 20830 T250 C24 P36843 /update {wt=javabin&version=2} {add=[43]} 0 12
[junit4:junit4]   2> 20841 T251 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[44 (1430243145633759232)]} 0 2
[junit4:junit4]   2> 20841 T235 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[44 (1430243145633759232)]} 0 2
[junit4:junit4]   2> 20842 T222 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[44 (1430243145633759232)]} 0 7
[junit4:junit4]   2> 20843 T248 C24 P36843 /update {wt=javabin&version=2} {add=[44]} 0 10
[junit4:junit4]   2> 20854 T250 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[45 (1430243145647390720)]} 0 1
[junit4:junit4]   2> 20854 T234 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[45 (1430243145647390720)]} 0 1
[junit4:junit4]   2> 20856 T221 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[45 (1430243145647390720)]} 0 7
[junit4:junit4]   2> 20856 T249 C24 P36843 /update {wt=javabin&version=2} {add=[45]} 0 10
[junit4:junit4]   2> 20865 T236 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[46 (1430243145659973632)]} 0 1
[junit4:junit4]   2> 20865 T248 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[46 (1430243145659973632)]} 0 1
[junit4:junit4]   2> 20865 T223 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[46 (1430243145659973632)]} 0 5
[junit4:junit4]   2> 20866 T251 C24 P36843 /update {wt=javabin&version=2} {add=[46]} 0 7
[junit4:junit4]   2> 20873 T237 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[47 (1430243145669410816)]} 0 1
[junit4:junit4]   2> 20873 T249 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[47 (1430243145669410816)]} 0 1
[junit4:junit4]   2> 20874 T220 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[47 (1430243145669410816)]} 0 4
[junit4:junit4]   2> 20874 T250 C24 P36843 /update {wt=javabin&version=2} {add=[47]} 0 6
[junit4:junit4]   2> 20885 T235 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[48 (1430243145679896576)]} 0 2
[junit4:junit4]   2> 20885 T251 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[48 (1430243145679896576)]} 0 1
[junit4:junit4]   2> 20887 T222 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[48 (1430243145679896576)]} 0 6
[junit4:junit4]   2> 20888 T248 C24 P36843 /update {wt=javabin&version=2} {add=[48]} 0 11
[junit4:junit4]   2> 20899 T234 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[49 (1430243145694576640)]} 0 2
[junit4:junit4]   2> 20899 T250 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[49 (1430243145694576640)]} 0 2
[junit4:junit4]   2> 20900 T221 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[49 (1430243145694576640)]} 0 7
[junit4:junit4]   2> 20901 T249 C24 P36843 /update {wt=javabin&version=2} {add=[49]} 0 10
[junit4:junit4]   2> 20914 T250 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[50 (1430243145709256704)]} 0 2
[junit4:junit4]   2> 20914 T236 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[50 (1430243145709256704)]} 0 2
[junit4:junit4]   2> 20915 T223 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[50 (1430243145709256704)]} 0 8
[junit4:junit4]   2> 20916 T248 C24 P36843 /update {wt=javabin&version=2} {add=[50]} 0 12
[junit4:junit4]   2> 20928 T237 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[51 (1430243145724985344)]} 0 2
[junit4:junit4]   2> 20928 T249 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[51 (1430243145724985344)]} 0 2
[junit4:junit4]   2> 20929 T220 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[51 (1430243145724985344)]} 0 7
[junit4:junit4]   2> 20930 T251 C24 P36843 /update {wt=javabin&version=2} {add=[51]} 0 11
[junit4:junit4]   2> 20942 T235 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[52 (1430243145738616832)]} 0 1
[junit4:junit4]   2> 20942 T248 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[52 (1430243145738616832)]} 0 2
[junit4:junit4]   2> 20943 T222 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[52 (1430243145738616832)]} 0 7
[junit4:junit4]   2> 20944 T250 C24 P36843 /update {wt=javabin&version=2} {add=[52]} 0 11
[junit4:junit4]   2> 20955 T234 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[53 (1430243145753296896)]} 0 1
[junit4:junit4]   2> 20956 T251 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[53 (1430243145753296896)]} 0 2
[junit4:junit4]   2> 20957 T221 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[53 (1430243145753296896)]} 0 7
[junit4:junit4]   2> 20959 T249 C24 P36843 /update {wt=javabin&version=2} {add=[53]} 0 12
[junit4:junit4]   2> 20970 T250 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[54 (1430243145769025536)]} 0 2
[junit4:junit4]   2> 20970 T236 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[54 (1430243145769025536)]} 0 2
[junit4:junit4]   2> 20971 T223 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[54 (1430243145769025536)]} 0 7
[junit4:junit4]   2> 20973 T248 C24 P36843 /update {wt=javabin&version=2} {add=[54]} 0 11
[junit4:junit4]   2> 20984 T249 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[55 (1430243145783705600)]} 0 2
[junit4:junit4]   2> 20984 T237 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[55 (1430243145783705600)]} 0 1
[junit4:junit4]   2> 20986 T220 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[55 (1430243145783705600)]} 0 7
[junit4:junit4]   2> 20988 T251 C24 P36843 /update {wt=javabin&version=2} {add=[55]} 0 12
[junit4:junit4]   2> 20999 T235 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[56 (1430243145799434240)]} 0 2
[junit4:junit4]   2> 20999 T248 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[56 (1430243145799434240)]} 0 2
[junit4:junit4]   2> 21000 T222 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[56 (1430243145799434240)]} 0 7
[junit4:junit4]   2> 21001 T250 C24 P36843 /update {wt=javabin&version=2} {add=[56]} 0 10
[junit4:junit4]   2> 21013 T251 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[57 (1430243145814114304)]} 0 2
[junit4:junit4]   2> 21013 T234 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[57 (1430243145814114304)]} 0 2
[junit4:junit4]   2> 21014 T221 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[57 (1430243145814114304)]} 0 7
[junit4:junit4]   2> 21016 T249 C24 P36843 /update {wt=javabin&version=2} {add=[57]} 0 12
[junit4:junit4]   2> 21027 T250 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[58 (1430243145828794368)]} 0 1
[junit4:junit4]   2> 21028 T236 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[58 (1430243145828794368)]} 0 2
[junit4:junit4]   2> 21029 T223 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[58 (1430243145828794368)]} 0 7
[junit4:junit4]   2> 21030 T248 C24 P36843 /update {wt=javabin&version=2} {add=[58]} 0 11
[junit4:junit4]   2> 21042 T237 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[59 (1430243145843474432)]} 0 2
[junit4:junit4]   2> 21042 T249 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[59 (1430243145843474432)]} 0 2
[junit4:junit4]   2> 21044 T220 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[59 (1430243145843474432)]} 0 8
[junit4:junit4]   2> 21045 T251 C24 P36843 /update {wt=javabin&version=2} {add=[59]} 0 12
[junit4:junit4]   2> 21057 T235 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[60 (1430243145860251648)]} 0 2
[junit4:junit4]   2> 21057 T248 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[60 (1430243145860251648)]} 0 2
[junit4:junit4]   2> 21058 T222 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[60 (1430243145860251648)]} 0 7
[junit4:junit4]   2> 21058 T250 C24 P36843 /update {wt=javabin&version=2} {add=[60]} 0 9
[junit4:junit4]   2> 21067 T251 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[61 (1430243145870737408)]} 0 2
[junit4:junit4]   2> 21067 T234 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[61 (1430243145870737408)]} 0 2
[junit4:junit4]   2> 21068 T221 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[61 (1430243145870737408)]} 0 6
[junit4:junit4]   2> 21069 T249 C24 P36843 /update {wt=javabin&version=2} {add=[61]} 0 9
[junit4:junit4]   2> 21079 T236 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[62 (1430243145884368896)]} 0 2
[junit4:junit4]   2> 21079 T250 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[62 (1430243145884368896)]} 0 1
[junit4:junit4]   2> 21080 T220 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[62 (1430243145884368896)]} 0 5
[junit4:junit4]   2> 21081 T248 C24 P36843 /update {wt=javabin&version=2} {add=[62]} 0 9
[junit4:junit4]   2> 21092 T237 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[63 (1430243145896951808)]} 0 1
[junit4:junit4]   2> 21093 T249 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[63 (1430243145896951808)]} 0 2
[junit4:junit4]   2> 21094 T222 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[63 (1430243145896951808)]} 0 7
[junit4:junit4]   2> 21095 T251 C24 P36843 /update {wt=javabin&version=2} {add=[63]} 0 11
[junit4:junit4]   2> 21106 T235 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[64 (1430243145911631872)]} 0 2
[junit4:junit4]   2> 21106 T248 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[64 (1430243145911631872)]} 0 2
[junit4:junit4]   2> 21107 T221 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[64 (1430243145911631872)]} 0 6
[junit4:junit4]   2> 21109 T250 C24 P36843 /update {wt=javabin&version=2} {add=[64]} 0 11
[junit4:junit4]   2> 21120 T251 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[65 (1430243145926311936)]} 0 2
[junit4:junit4]   2> 21120 T234 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[65 (1430243145926311936)]} 0 2
[junit4:junit4]   2> 21121 T223 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[65 (1430243145926311936)]} 0 7
[junit4:junit4]   2> 21122 T249 C24 P36843 /update {wt=javabin&version=2} {add=[65]} 0 10
[junit4:junit4]   2> 21134 T250 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[66 (1430243145940992000)]} 0 2
[junit4:junit4]   2> 21134 T236 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[66 (1430243145940992000)]} 0 2
[junit4:junit4]   2> 21135 T220 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[66 (1430243145940992000)]} 0 7
[junit4:junit4]   2> 21136 T248 C24 P36843 /update {wt=javabin&version=2} {add=[66]} 0 10
[junit4:junit4]   2> 21147 T249 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[67 (1430243145954623488)]} 0 1
[junit4:junit4]   2> 21148 T237 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[67 (1430243145954623488)]} 0 2
[junit4:junit4]   2> 21149 T222 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[67 (1430243145954623488)]} 0 7
[junit4:junit4]   2> 21150 T251 C24 P36843 /update {wt=javabin&version=2} {add=[67]} 0 11
[junit4:junit4]   2> 21162 T248 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[68 (1430243145969303552)]} 0 2
[junit4:junit4]   2> 21162 T235 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[68 (1430243145969303552)]} 0 2
[junit4:junit4]   2> 21163 T221 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[68 (1430243145969303552)]} 0 7
[junit4:junit4]   2> 21164 T250 C24 P36843 /update {wt=javabin&version=2} {add=[68]} 0 11
[junit4:junit4]   2> 21175 T251 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[69 (1430243145985032192)]} 0 1
[junit4:junit4]   2> 21175 T234 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[69 (1430243145985032192)]} 0 1
[junit4:junit4]   2> 21177 T223 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[69 (1430243145985032192)]} 0 7
[junit4:junit4]   2> 21178 T249 C24 P36843 /update {wt=javabin&version=2} {add=[69]} 0 10
[junit4:junit4]   2> 21199 T250 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[70 (1430243146009149440)]} 0 2
[junit4:junit4]   2> 21199 T236 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[70 (1430243146009149440)]} 0 2
[junit4:junit4]   2> 21200 T220 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[70 (1430243146009149440)]} 0 6
[junit4:junit4]   2> 21201 T248 C24 P36843 /update {wt=javabin&version=2} {add=[70]} 0 10
[junit4:junit4]   2> 21212 T249 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[71 (1430243146022780928)]} 0 2
[junit4:junit4]   2> 21212 T237 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[71 (1430243146022780928)]} 0 2
[junit4:junit4]   2> 21213 T221 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[71 (1430243146022780928)]} 0 6
[junit4:junit4]   2> 21214 T251 C24 P36843 /update {wt=javabin&version=2} {add=[71]} 0 10
[junit4:junit4]   2> 21225 T235 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[72 (1430243146036412416)]} 0 2
[junit4:junit4]   2> 21225 T248 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[72 (1430243146036412416)]} 0 2
[junit4:junit4]   2> 21226 T223 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[72 (1430243146036412416)]} 0 6
[junit4:junit4]   2> 21227 T250 C24 P36843 /update {wt=javabin&version=2} {add=[72]} 0 10
[junit4:junit4]   2> 21238 T251 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[73 (1430243146050043904)]} 0 2
[junit4:junit4]   2> 21238 T234 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[73 (1430243146050043904)]} 0 2
[junit4:junit4]   2> 21239 T222 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[73 (1430243146050043904)]} 0 6
[junit4:junit4]   2> 21240 T249 C24 P36843 /update {wt=javabin&version=2} {add=[73]} 0 10
[junit4:junit4]   2> 21251 T250 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[74 (1430243146064723968)]} 0 1
[junit4:junit4]   2> 21251 T237 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[74 (1430243146064723968)]} 0 1
[junit4:junit4]   2> 21253 T220 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[74 (1430243146064723968)]} 0 7
[junit4:junit4]   2> 21254 T248 C24 P36843 /update {wt=javabin&version=2} {add=[74]} 0 11
[junit4:junit4]   2> 21264 T235 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[75 (1430243146078355456)]} 0 1
[junit4:junit4]   2> 21264 T249 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[75 (1430243146078355456)]} 0 1
[junit4:junit4]   2> 21266 T221 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[75 (1430243146078355456)]} 0 7
[junit4:junit4]   2> 21267 T251 C24 P36843 /update {wt=javabin&version=2} {add=[75]} 0 10
[junit4:junit4]   2> 21277 T234 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[76 (1430243146090938368)]} 0 1
[junit4:junit4]   2> 21277 T248 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[76 (1430243146090938368)]} 0 1
[junit4:junit4]   2> 21279 T223 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[76 (1430243146090938368)]} 0 7
[junit4:junit4]   2> 21280 T250 C24 P36843 /update {wt=javabin&version=2} {add=[76]} 0 10
[junit4:junit4]   2> 21290 T251 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[77 (1430243146104569856)]} 0 1
[junit4:junit4]   2> 21290 T237 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[77 (1430243146104569856)]} 0 1
[junit4:junit4]   2> 21291 T222 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[77 (1430243146104569856)]} 0 6
[junit4:junit4]   2> 21292 T249 C24 P36843 /update {wt=javabin&version=2} {add=[77]} 0 10
[junit4:junit4]   2> 21302 T250 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[78 (1430243146118201344)]} 0 1
[junit4:junit4]   2> 21303 T235 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[78 (1430243146118201344)]} 0 2
[junit4:junit4]   2> 21304 T220 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[78 (1430243146118201344)]} 0 6
[junit4:junit4]   2> 21305 T248 C24 P36843 /update {wt=javabin&version=2} {add=[78]} 0 10
[junit4:junit4]   2> 21315 T236 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[79 (1430243146131832832)]} 0 1
[junit4:junit4]   2> 21315 T250 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[79 (1430243146131832832)]} 0 1
[junit4:junit4]   2> 21317 T221 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[79 (1430243146131832832)]} 0 6
[junit4:junit4]   2> 21318 T249 C24 P36843 /update {wt=javabin&version=2} {add=[79]} 0 10
[junit4:junit4]   2> 21329 T248 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[80 (1430243146145464320)]} 0 2
[junit4:junit4]   2> 21329 T234 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[80 (1430243146145464320)]} 0 2
[junit4:junit4]   2> 21330 T223 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[80 (1430243146145464320)]} 0 7
[junit4:junit4]   2> 21331 T251 C24 P36843 /update {wt=javabin&version=2} {add=[80]} 0 10
[junit4:junit4]   2> 21343 T249 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[81 (1430243146159095808)]} 0 3
[junit4:junit4]   2> 21343 T237 C22 P46713 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[81 (1430243146159095808)]} 0 3
[junit4:junit4]   2> 21344 T222 C23 P45639 /update {wt=javabin&distrib.from=http://127.0.0.1:36843/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[81 (1430243146159095808)]} 0 7
[junit4:junit4]   2> 21345 T250 C24 P36843 /update {wt=javabin&version=2} {add=[81]} 0 11
[junit4:junit4]   2> 21356 T251 C24 P36843 /update {wt=javabin&distrib.from=http://127.0.0.1:45639/unloadcollection1/&version=2&up

[...truncated too long message...]

t org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 32274 T2084 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 32278 T2083 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4]   2> 32325 T2158 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 32325 T2158 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 32326 T2158 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 32326 T2158 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 32889 T2087 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 33440 T2175 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 33440 T2175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 33440 T2175 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 33441 T2175 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=ar_KW, timezone=ART
[junit4:junit4]   2> NOTE: Linux 3.2.0-39-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=3,free=83790544,total=257949696
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestLazyCores, TestQuerySenderNoQuery, LeaderElectionIntegrationTest, TestSystemIdResolver, TestFiltering, UniqFieldsUpdateProcessorFactoryTest, DistanceFunctionTest, TestComponentsName, CoreContainerCoreInitFailuresTest, DisMaxRequestHandlerTest, TestBM25SimilarityFactory, TestFoldingMultitermQuery, TestNumberUtils, ShardRoutingCustomTest, TestStressLucene, TestDefaultSimilarityFactory, NoCacheHeaderTest, TestRTGBase, TestAtomicUpdateErrorCases, SpellCheckCollatorTest, TestCSVResponseWriter, FullSolrCloudDistribCmdsTest, SolrCmdDistributorTest, DOMUtilTest, DirectUpdateHandlerTest, TestLMJelinekMercerSimilarityFactory, SolrPluginUtilsTest, BasicZkTest, TestSolrDiscoveryProperties, DocumentAnalysisRequestHandlerTest, FieldAnalysisRequestHandlerTest, TestSolrXMLSerializer, CollectionsAPIDistributedZkTest, CurrencyFieldXmlFileTest, DefaultValueUpdateProcessorTest, NumericFieldsTest, TestIndexSearcher, ConvertedLegacyTest, TestSolr4Spatial, SampleTest, IndexReaderFactoryTest, SolrRequestParserTest, FileUtilsTest, BadIndexSchemaTest, TestFieldCollectionResource, URLClassifyProcessorTest, TestSolrJ, ChaosMonkeySafeLeaderTest, UpdateParamsTest, SortByFunctionTest, MultiTermTest, TestRecovery, TestMultiCoreConfBootstrap, RequestHandlersTest, TestCSVLoader, OpenExchangeRatesOrgProviderTest, TestDistributedSearch, SignatureUpdateProcessorFactoryTest, TestPropInject, TestDistributedGrouping, TestLuceneMatchVersion, TestBinaryField, SpellPossibilityIteratorTest, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 33.56s, 1 test, 1 error <<< FAILURES!

[...truncated 498 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:877: There were test failures: 273 suites, 1149 tests, 1 error, 1 failure, 13 ignored (7 assumptions)

Total time: 44 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.8.0-ea-b79 -client -XX:+UseG1GC -XX:MarkStackSize=256K
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message