lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@sd-datasolutions.de>
Subject [JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.6.0_37) - Build # 1436 - Failure!
Date Sun, 04 Nov 2012 14:45:39 GMT
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-Windows/1436/
Java: 32bit/jdk1.6.0_37 -server -XX:+UseParallelGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.RecoveryZkTest.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 180 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 180 seconds
	at __randomizedtesting.SeedInfo.seed([7590DF627C07359D:F476517A0B5855A1]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:166)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:116)
	at org.apache.solr.cloud.RecoveryZkTest.doTest(RecoveryZkTest.java:76)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:695)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)




Build Log:
[...truncated 7837 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.RecoveryZkTest
[junit4:junit4]   2> 5 T196 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-RecoveryZkTest-1352038540955
[junit4:junit4]   2> 7 T196 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 16 T197 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 18 T197 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 20 T197 oazsp.FileTxnSnapLog.save Snapshotting: 0
[junit4:junit4]   2> 148 T196 oasc.ZkTestServer.run start zk server on port:54796
[junit4:junit4]   2> 151 T196 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54796 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@a76650
[junit4:junit4]   2> 153 T196 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 153 T202 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:54796
[junit4:junit4]   2> 156 T202 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:54796, initiating session
[junit4:junit4]   2> 156 T198 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:54799
[junit4:junit4]   2> 157 T198 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:54799
[junit4:junit4]   2> 157 T200 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 178 T202 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:54796, sessionid = 0x13acbc6e6ad0000, negotiated timeout = 10000
[junit4:junit4]   2> 178 T200 oazs.NIOServerCnxn.finishSessionInit Established session 0x13acbc6e6ad0000 with negotiated timeout 10000 for client /127.0.0.1:54799
[junit4:junit4]   2> 179 T203 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a76650 name:ZooKeeperConnection Watcher:127.0.0.1:54796 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 179 T196 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 179 T196 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 189 T201 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13acbc6e6ad0000
[junit4:junit4]   2> 193 T198 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54799 which had sessionid 0x13acbc6e6ad0000
[junit4:junit4]   2> 193 T196 oaz.ZooKeeper.close Session: 0x13acbc6e6ad0000 closed
[junit4:junit4]   2> 193 T196 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54796/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@150fa46
[junit4:junit4]   2> 197 T203 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 201 T196 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 201 T204 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:54796
[junit4:junit4]   2> 203 T204 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:54796, initiating session
[junit4:junit4]   2> 203 T198 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:54802
[junit4:junit4]   2> 204 T198 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:54802
[junit4:junit4]   2> 207 T204 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:54796, sessionid = 0x13acbc6e6ad0001, negotiated timeout = 10000
[junit4:junit4]   2> 208 T200 oazs.NIOServerCnxn.finishSessionInit Established session 0x13acbc6e6ad0001 with negotiated timeout 10000 for client /127.0.0.1:54802
[junit4:junit4]   2> 209 T205 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@150fa46 name:ZooKeeperConnection Watcher:127.0.0.1:54796/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 209 T196 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 209 T196 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 223 T196 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 235 T196 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 244 T196 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 263 T196 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 264 T196 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 409 T196 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 411 T196 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 424 T196 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 425 T196 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 456 T196 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 456 T196 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 463 T196 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 465 T196 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 470 T196 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 472 T196 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 478 T196 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 478 T196 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 487 T196 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 488 T196 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 492 T196 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 495 T196 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 500 T196 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 502 T196 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 508 T201 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13acbc6e6ad0001
[junit4:junit4]   2> 511 T196 oaz.ZooKeeper.close Session: 0x13acbc6e6ad0001 closed
[junit4:junit4]   2> 511 T198 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54802 which had sessionid 0x13acbc6e6ad0001
[junit4:junit4]   2> 512 T205 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 1437 T196 oejs.Server.doStart jetty-8.1.2.v20120308
[junit4:junit4]   2> 1771 T196 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:54803
[junit4:junit4]   2> 1829 T196 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1830 T196 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-controljetty-1352038541461
[junit4:junit4]   2> 1830 T196 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-controljetty-1352038541461\'
[junit4:junit4]   2> 1883 T196 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1883 T196 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1883 T196 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-controljetty-1352038541461
[junit4:junit4]   2> 1885 T196 oasc.CoreContainer$Initializer.initialize looking for solr.xml: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-controljetty-1352038541461\solr.xml
[junit4:junit4]   2> 1885 T196 oasc.CoreContainer.<init> New CoreContainer 22207867
[junit4:junit4]   2> 1886 T196 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-controljetty-1352038541461\'
[junit4:junit4]   2> 1886 T196 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-controljetty-1352038541461\'
[junit4:junit4]   2> 1936 T196 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 1975 T196 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:54796/solr
[junit4:junit4]   2> 1979 T196 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54796/solr sessionTimeout=5000 watcher=org.apache.solr.common.cloud.ConnectionManager@352ec
[junit4:junit4]   2> 1982 T216 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:54796
[junit4:junit4]   2> 1982 T196 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1984 T216 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:54796, initiating session
[junit4:junit4]   2> 1984 T198 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:54808
[junit4:junit4]   2> 1986 T198 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:54808
[junit4:junit4]   2> 2005 T200 oazs.NIOServerCnxn.finishSessionInit Established session 0x13acbc6e6ad0002 with negotiated timeout 5000 for client /127.0.0.1:54808
[junit4:junit4]   2> 2005 T216 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:54796, sessionid = 0x13acbc6e6ad0002, negotiated timeout = 5000
[junit4:junit4]   2> 2005 T217 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@352ec name:ZooKeeperConnection Watcher:127.0.0.1:54796/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2006 T196 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2029 T201 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13acbc6e6ad0002 type:create cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2043 T196 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 2048 T196 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54803_solr
[junit4:junit4]   2> 2050 T201 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13acbc6e6ad0002 type:delete cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:54803_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:54803_solr
[junit4:junit4]   2> 2053 T196 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54803_solr
[junit4:junit4]   2> 2085 T196 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 2087 T196 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2089 T196 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 2089 T196 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2091 T196 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2091 T196 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2092 T196 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2092 T196 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2092 T196 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2093 T196 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 2118 T196 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 2143 T201 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13acbc6e6ad0002 type:delete cxid:0x15 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 2147 T196 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 2152 T196 oasc.Overseer.start Overseer (id=88607197821206530-127.0.0.1:54803_solr-n_0000000000) starting
[junit4:junit4]   2> 2154 T201 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13acbc6e6ad0002 type:create cxid:0x1a zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2173 T201 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13acbc6e6ad0002 type:create cxid:0x1b zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2177 T201 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13acbc6e6ad0002 type:create cxid:0x1c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2188 T201 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13acbc6e6ad0002 type:create cxid:0x1d zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2195 T219 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 2195 T196 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 2203 T196 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2234 T218 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 2281 T196 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-controljetty-1352038541461\collection1
[junit4:junit4]   2> 2281 T196 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 2283 T196 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2283 T196 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 2287 T196 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-controljetty-1352038541461\collection1\'
[junit4:junit4]   2> 2293 T196 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-controljetty-1352038541461/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2297 T196 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-controljetty-1352038541461/collection1/lib/README' to classloader
[junit4:junit4]   2> 2433 T196 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 2627 T196 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2682 T196 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2698 T196 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 3643 T196 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 3664 T196 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 3670 T196 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3718 T196 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3729 T196 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3740 T196 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3746 T196 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3750 T196 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-controljetty-1352038541461\collection1\, dataDir=.\org.apache.solr.cloud.RecoveryZkTest-1352038540954/control/data\
[junit4:junit4]   2> 3750 T196 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2515
[junit4:junit4]   2> 3752 T196 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 3752 T196 oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType configured for MockDirWrapper(org.apache.lucene.store.RAMDirectory@19ab0d6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@cfdf8f) assuming 'simple'
[junit4:junit4]   2> 3754 T196 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\control\data forceNew:false
[junit4:junit4]   2> 3755 T196 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\control\data
[junit4:junit4]   2> 3755 T196 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.RecoveryZkTest-1352038540954/control/data\index/
[junit4:junit4]   2> 3758 T196 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\control\data\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3759 T196 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\control\data\index forceNew:false
[junit4:junit4]   2> 3767 T196 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@11e07f lockFactory=org.apache.lucene.store.NativeFSLockFactory@130646),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3769 T196 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3770 T196 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\control\data\index
[junit4:junit4]   2> 3771 T196 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 3774 T196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 3777 T196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 3777 T196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 3778 T196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 3780 T196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 3780 T196 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 3782 T196 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 3784 T196 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 3785 T196 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 3788 T196 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 3849 T196 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 3849 T196 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 3851 T196 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 3853 T196 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 3853 T196 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 3855 T196 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3856 T196 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3859 T196 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3860 T196 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3862 T196 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3863 T196 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3864 T196 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3867 T196 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3868 T196 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 3868 T196 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 3878 T196 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3886 T196 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 3904 T196 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 3908 T196 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\control\data
[junit4:junit4]   2> 3911 T196 oass.SolrIndexSearcher.<init> Opening Searcher@146d950 main
[junit4:junit4]   2> 3912 T196 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3912 T196 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3912 T196 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 3928 T196 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4016 T220 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@146d950 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4023 T196 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4024 T201 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13acbc6e6ad0002 type:create cxid:0x56 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 4032 T196 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 4032 T196 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:54803/solr shardId:control_shard
[junit4:junit4]   2> 4050 T196 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 4070 T196 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 4088 T201 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13acbc6e6ad0002 type:delete cxid:0x65 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 4091 T196 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 4092 T201 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13acbc6e6ad0002 type:create cxid:0x66 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4350 T218 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4353 T218 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54803_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54803/solr"}
[junit4:junit4]   2> 4378 T201 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13acbc6e6ad0002 type:create cxid:0x6d zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 4420 T217 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 4797 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 4797 T196 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 4797 T196 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54803/solr/collection1/
[junit4:junit4]   2> 4798 T196 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 4798 T196 oasc.SyncStrategy.syncToMe http://127.0.0.1:54803/solr/collection1/ has no replicas
[junit4:junit4]   2> 4800 T196 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54803/solr/collection1/
[junit4:junit4]   2> 4800 T196 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 4977 T201 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13acbc6e6ad0002 type:create cxid:0x8c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5133 T218 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5149 T217 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 5159 T196 oasc.ZkController.register We are http://127.0.0.1:54803/solr/collection1/ and leader is http://127.0.0.1:54803/solr/collection1/
[junit4:junit4]   2> 5159 T196 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54803/solr
[junit4:junit4]   2> 5159 T196 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 5160 T196 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5167 T196 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5168 T196 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 5168 T196 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 5239 T196 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5257 T196 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 5268 T196 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54796/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1351290
[junit4:junit4]   2> 5271 T221 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:54796
[junit4:junit4]   2> 5271 T196 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5273 T221 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:54796, initiating session
[junit4:junit4]   2> 5273 T198 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:54811
[junit4:junit4]   2> 5273 T198 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:54811
[junit4:junit4]   2> 5279 T200 oazs.NIOServerCnxn.finishSessionInit Established session 0x13acbc6e6ad0003 with negotiated timeout 10000 for client /127.0.0.1:54811
[junit4:junit4]   2> 5279 T221 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:54796, sessionid = 0x13acbc6e6ad0003, negotiated timeout = 10000
[junit4:junit4]   2> 5279 T222 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1351290 name:ZooKeeperConnection Watcher:127.0.0.1:54796/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5280 T196 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5284 T196 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5292 T196 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 5712 T196 oejs.Server.doStart jetty-8.1.2.v20120308
[junit4:junit4]   2> 5716 T196 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:54812
[junit4:junit4]   2> 5717 T196 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5717 T196 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty1-1352038546241
[junit4:junit4]   2> 5717 T196 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty1-1352038546241\'
[junit4:junit4]   2> 5751 T196 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 5752 T196 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5752 T196 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty1-1352038546241
[junit4:junit4]   2> 5752 T196 oasc.CoreContainer$Initializer.initialize looking for solr.xml: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty1-1352038546241\solr.xml
[junit4:junit4]   2> 5754 T196 oasc.CoreContainer.<init> New CoreContainer 3924060
[junit4:junit4]   2> 5754 T196 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty1-1352038546241\'
[junit4:junit4]   2> 5754 T196 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty1-1352038546241\'
[junit4:junit4]   2> 5781 T196 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 5800 T196 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:54796/solr
[junit4:junit4]   2> 5800 T196 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54796/solr sessionTimeout=5000 watcher=org.apache.solr.common.cloud.ConnectionManager@9b0985
[junit4:junit4]   2> 5802 T196 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5804 T232 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:54796
[junit4:junit4]   2> 5808 T232 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:54796, initiating session
[junit4:junit4]   2> 5808 T198 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:54817
[junit4:junit4]   2> 5808 T198 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:54817
[junit4:junit4]   2> 5823 T200 oazs.NIOServerCnxn.finishSessionInit Established session 0x13acbc6e6ad0004 with negotiated timeout 5000 for client /127.0.0.1:54817
[junit4:junit4]   2> 5823 T232 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:54796, sessionid = 0x13acbc6e6ad0004, negotiated timeout = 5000
[junit4:junit4]   2> 5825 T233 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9b0985 name:ZooKeeperConnection Watcher:127.0.0.1:54796/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5825 T196 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5826 T201 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13acbc6e6ad0004 type:create cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5829 T201 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13acbc6e6ad0004 type:create cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5832 T196 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54812_solr
[junit4:junit4]   2> 5833 T201 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13acbc6e6ad0004 type:delete cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:54812_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:54812_solr
[junit4:junit4]   2> 5836 T196 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54812_solr
[junit4:junit4]   2> 5843 T217 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5843 T217 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 5843 T222 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5844 T196 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 5845 T196 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5845 T196 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 5845 T196 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5847 T196 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5847 T196 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5847 T196 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5848 T196 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5848 T196 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5848 T196 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 5856 T218 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5858 T218 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54803_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54803/solr"}
[junit4:junit4]   2> 5878 T196 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5884 T217 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 5884 T233 oaz.ClientCnxn$EventThread.processEvent SEVERE Error while calling watcher  java.lang.NullPointerException
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$2.process(ZkStateReader.java:189)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 5892 T222 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 5903 T196 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty1-1352038546241\collection1
[junit4:junit4]   2> 5904 T196 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5908 T196 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5908 T196 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5931 T196 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty1-1352038546241\collection1\'
[junit4:junit4]   2> 5934 T196 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty1-1352038546241/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5935 T196 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty1-1352038546241/collection1/lib/README' to classloader
[junit4:junit4]   2> 6012 T196 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 6105 T196 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 6109 T196 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 6129 T196 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 6976 T196 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 6999 T196 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 7009 T196 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 7041 T196 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7051 T196 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7059 T196 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7065 T196 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7067 T196 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty1-1352038546241\collection1\, dataDir=.\org.apache.solr.cloud.RecoveryZkTest-1352038540954/jetty1\
[junit4:junit4]   2> 7069 T196 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2515
[junit4:junit4]   2> 7070 T196 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 7070 T196 oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType configured for MockDirWrapper(org.apache.lucene.store.RAMDirectory@1fa3fa9 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@698f02) assuming 'simple'
[junit4:junit4]   2> 7071 T196 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\jetty1 forceNew:false
[junit4:junit4]   2> 7071 T196 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\jetty1
[junit4:junit4]   2> 7073 T196 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.RecoveryZkTest-1352038540954/jetty1\index/
[junit4:junit4]   2> 7074 T196 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\jetty1\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 7075 T196 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\jetty1\index forceNew:false
[junit4:junit4]   2> 7080 T196 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@194ca49 lockFactory=org.apache.lucene.store.NativeFSLockFactory@57c63b),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7081 T196 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 7082 T196 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\jetty1\index
[junit4:junit4]   2> 7082 T196 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 7085 T196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 7085 T196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 7086 T196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 7086 T196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 7088 T196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 7088 T196 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 7089 T196 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 7090 T196 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 7093 T196 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 7096 T196 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 7099 T196 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 7099 T196 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 7100 T196 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 7100 T196 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 7101 T196 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 7103 T196 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 7104 T196 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7106 T196 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7107 T196 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7108 T196 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7110 T196 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7111 T196 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7112 T196 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7115 T196 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 7116 T196 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 7127 T196 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 7134 T196 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 7137 T196 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 7140 T196 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\jetty1
[junit4:junit4]   2> 7142 T196 oass.SolrIndexSearcher.<init> Opening Searcher@1a87069 main
[junit4:junit4]   2> 7144 T196 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 7144 T196 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 7144 T196 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 7185 T196 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 7318 T196 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7324 T234 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a87069 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 7345 T218 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7346 T218 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54812_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54812/solr"}
[junit4:junit4]   2> 7346 T218 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 7371 T222 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 7373 T217 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 77588 T196 oasc.SolrException.log SEVERE null:org.apache.solr.common.SolrException: Could not get shard_id for core: collection1
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.doGetShardIdProcess(ZkController.java:998)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.preRegister(ZkController.java:1056)
[junit4:junit4]   2> 		at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:716)
[junit4:junit4]   2> 		at org.apache.solr.core.CoreContainer.register(CoreContainer.java:696)
[junit4:junit4]   2> 		at org.apache.solr.core.CoreContainer.load(CoreContainer.java:565)
[junit4:junit4]   2> 		at org.apache.solr.core.CoreContainer.load(CoreContainer.java:375)
[junit4:junit4]   2> 		at org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:307)
[junit4:junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:107)
[junit4:junit4]   2> 		at org.eclipse.jetty.servlet.FilterHolder.doStart(FilterHolder.java:114)
[junit4:junit4]   2> 		at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:59)
[junit4:junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:754)
[junit4:junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1227)
[junit4:junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1263)
[junit4:junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:965)
[junit4:junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:923)
[junit4:junit4]   2> 		at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:333)
[junit4:junit4]   2> 		at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:173)
[junit4:junit4]   2> 		at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:169)
[junit4:junit4]   2> 		at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:60)
[junit4:junit4]   2> 		at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:225)
[junit4:junit4]   2> 		at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:205)
[junit4:junit4]   2> 		at org.apache.solr.BaseDistributedSearchTestCase.createJetty(BaseDistributedSearchTestCase.java:262)
[junit4:junit4]   2> 		at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:292)
[junit4:junit4]   2> 		at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:245)
[junit4:junit4]   2> 		at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:693)
[junit4:junit4]   2> 		at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]   2> 		at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit4:junit4]   2> 		at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit4:junit4]   2> 		at java.lang.reflect.Method.invoke(Method.java:597)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]   2> 		at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]   2> 		at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]   2> 		at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]   2> 		at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4:junit4]   2> 		at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]   2> 		at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]   2> 		at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]   2> 		at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]   2> 		at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]   2> 		at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]   2> 		at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]   2> 		at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]   2> 		at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 77590 T196 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@8ae1fb
[junit4:junit4]   2> 77605 T196 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 77606 T196 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 77606 T196 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 77606 T196 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 77607 T196 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 77608 T196 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\jetty1\index
[junit4:junit4]   2> 77609 T196 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 77609 T196 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 77610 T196 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 77864 T196 oejs.Server.doStart jetty-8.1.2.v20120308
[junit4:junit4]   2> 77866 T196 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:54818
[junit4:junit4]   2> 77866 T196 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 77866 T196 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty2-1352038618575
[junit4:junit4]   2> 77867 T196 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty2-1352038618575\'
[junit4:junit4]   2> 77886 T196 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 77887 T196 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 77887 T196 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty2-1352038618575
[junit4:junit4]   2> 77887 T196 oasc.CoreContainer$Initializer.initialize looking for solr.xml: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty2-1352038618575\solr.xml
[junit4:junit4]   2> 77887 T196 oasc.CoreContainer.<init> New CoreContainer 28666635
[junit4:junit4]   2> 77887 T196 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty2-1352038618575\'
[junit4:junit4]   2> 77887 T196 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty2-1352038618575\'
[junit4:junit4]   2> 77901 T196 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 77911 T196 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:54796/solr
[junit4:junit4]   2> 77912 T196 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54796/solr sessionTimeout=5000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ab5b91
[junit4:junit4]   2> 77912 T244 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:54796
[junit4:junit4]   2> 77912 T196 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 77915 T244 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:54796, initiating session
[junit4:junit4]   2> 77915 T198 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:54823
[junit4:junit4]   2> 77915 T198 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:54823
[junit4:junit4]   2> 77926 T200 oazs.NIOServerCnxn.finishSessionInit Established session 0x13acbc6e6ad0005 with negotiated timeout 5000 for client /127.0.0.1:54823
[junit4:junit4]   2> 77926 T244 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:54796, sessionid = 0x13acbc6e6ad0005, negotiated timeout = 5000
[junit4:junit4]   2> 77926 T245 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ab5b91 name:ZooKeeperConnection Watcher:127.0.0.1:54796/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 77927 T196 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 77928 T201 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13acbc6e6ad0005 type:create cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 77929 T201 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13acbc6e6ad0005 type:create cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 77932 T196 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54818_solr
[junit4:junit4]   2> 77933 T201 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13acbc6e6ad0005 type:delete cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:54818_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:54818_solr
[junit4:junit4]   2> 77934 T196 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54818_solr
[junit4:junit4]   2> 77938 T222 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 77938 T217 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 77939 T217 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 77939 T196 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 77939 T196 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 77939 T222 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 77940 T233 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 77940 T196 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 77940 T196 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 77940 T196 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 77941 T196 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 77941 T196 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 77941 T196 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 77942 T196 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 77942 T196 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 77952 T196 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 77958 T196 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty2-1352038618575\collection1
[junit4:junit4]   2> 77958 T196 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 77959 T196 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 77959 T196 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 77961 T196 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty2-1352038618575\collection1\'
[junit4:junit4]   2> 77963 T196 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty2-1352038618575/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 77963 T196 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty2-1352038618575/collection1/lib/README' to classloader
[junit4:junit4]   2> 77995 T196 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 78039 T196 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 78041 T196 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 78047 T196 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 78524 T196 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 78531 T196 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 78534 T196 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 78555 T196 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 78560 T196 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 78565 T196 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 78566 T196 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 78567 T196 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty2-1352038618575\collection1\, dataDir=.\org.apache.solr.cloud.RecoveryZkTest-1352038540954/jetty2\
[junit4:junit4]   2> 78568 T196 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2515
[junit4:junit4]   2> 78568 T196 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 78569 T196 oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType configured for MockDirWrapper(org.apache.lucene.store.RAMDirectory@ac9126 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@16d6585) assuming 'simple'
[junit4:junit4]   2> 78569 T196 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\jetty2 forceNew:false
[junit4:junit4]   2> 78569 T196 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\jetty2
[junit4:junit4]   2> 78569 T196 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.RecoveryZkTest-1352038540954/jetty2\index/
[junit4:junit4]   2> 78571 T196 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\jetty2\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 78571 T196 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\jetty2\index forceNew:false
[junit4:junit4]   2> 78573 T196 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10d2cf0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@725f5),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 78573 T196 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 78575 T196 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\jetty2\index
[junit4:junit4]   2> 78575 T196 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 78576 T196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 78576 T196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 78576 T196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 78576 T196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 78577 T196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 78577 T196 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 78578 T196 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 78578 T196 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 78579 T196 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 78580 T196 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 78581 T196 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 78581 T196 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 78581 T196 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 78581 T196 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 78581 T196 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 78583 T196 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 78583 T196 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 78584 T196 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 78586 T196 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 78586 T196 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 78586 T196 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 78586 T196 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 78587 T196 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 78588 T196 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 78588 T196 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 78593 T196 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 78596 T196 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 78597 T196 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 78600 T196 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\jetty2
[junit4:junit4]   2> 78601 T196 oass.SolrIndexSearcher.<init> Opening Searcher@bf066a main
[junit4:junit4]   2> 78603 T196 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 78604 T196 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 78604 T196 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 78618 T196 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 78669 T246 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@bf066a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 78671 T196 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 79030 T218 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 79031 T218 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54818_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54818/solr"}
[junit4:junit4]   2> 79040 T222 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 79040 T217 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 79040 T245 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 79072 T196 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 79072 T196 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:54818/solr shardId:shard1
[junit4:junit4]   2> 79074 T196 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 79093 T201 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13acbc6e6ad0005 type:delete cxid:0x43 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 79094 T196 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 79096 T201 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13acbc6e6ad0005 type:create cxid:0x44 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 79102 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=179999
[junit4:junit4]   2> 79449 T218 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 79462 T222 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 79464 T245 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 79464 T217 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 79501 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=179600
[junit4:junit4]   2> 79901 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=179200
[junit4:junit4]   2> 80301 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=178800
[junit4:junit4]   2> 80701 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=178400
[junit4:junit4]   2> 81101 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=178000
[junit4:junit4]   2> 81501 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=177600
[junit4:junit4]   2> 81901 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=177200
[junit4:junit4]   2> 82301 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=176800
[junit4:junit4]   2> 82702 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=176399
[junit4:junit4]   2> 83101 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=176000
[junit4:junit4]   2> 83500 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=175601
[junit4:junit4]   2> 83900 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=175201
[junit4:junit4]   2> 84299 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=174802
[junit4:junit4]   2> 84698 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=174403
[junit4:junit4]   2> 85097 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=174004
[junit4:junit4]   2> 85497 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=173604
[junit4:junit4]   2> 85860 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=173241
[junit4:junit4]   2> 86219 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=172882
[junit4:junit4]   2> 86579 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=172522
[junit4:junit4]   2> 86939 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=172162
[junit4:junit4]   2> 87299 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=171802
[junit4:junit4]   2> 87659 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=171442
[junit4:junit4]   2> 88019 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=171082
[junit4:junit4]   2> 88380 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=170721
[junit4:junit4]   2> 88740 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=170361
[junit4:junit4]   2> 89098 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=170003
[junit4:junit4]   2> 89459 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=169642
[junit4:junit4]   2> 89817 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=169284
[junit4:junit4]   2> 90178 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=168923
[junit4:junit4]   2> 90538 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=168563
[junit4:junit4]   2> 90898 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=168203
[junit4:junit4]   2> 91258 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=167843
[junit4:junit4]   2> 91619 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=167482
[junit4:junit4]   2> 91978 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=167123
[junit4:junit4]   2> 92338 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=166763
[junit4:junit4]   2> 92699 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=166402
[junit4:junit4]   2> 93023 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=166078
[junit4:junit4]   2> 93347 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=165754
[junit4:junit4]   2> 93684 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=165417
[junit4:junit4]   2> 94006 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=165095
[junit4:junit4]   2> 94329 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=164772
[junit4:junit4]   2> 94652 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=164449
[junit4:junit4]   2> 94975 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=164126
[junit4:junit4]   2> 95298 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=163803
[junit4:junit4]   2> 95621 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=163480
[junit4:junit4]   2> 95944 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=163157
[junit4:junit4]   2> 96266 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=162835
[junit4:junit4]   2> 96589 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=162512
[junit4:junit4]   2> 96912 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=162189
[junit4:junit4]   2> 97235 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=161866
[junit4:junit4]   2> 97558 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=161543
[junit4:junit4]   2> 97881 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=161220
[junit4:junit4]   2> 98204 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=160897
[junit4:junit4]   2> 98526 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=160575
[junit4:junit4]   2> 98849 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=160252
[junit4:junit4]   2> 99172 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=159929
[junit4:junit4]   2> 99526 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=159575
[junit4:junit4]   2> 99881 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=159220
[junit4:junit4]   2> 100237 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=158864
[junit4:junit4]   2> 100592 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=158509
[junit4:junit4]   2> 100947 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=158154
[junit4:junit4]   2> 101302 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=157799
[junit4:junit4]   2> 101657 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=157444
[junit4:junit4]   2> 102012 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=157089
[junit4:junit4]   2> 102367 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=156734
[junit4:junit4]   2> 102723 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=156378
[junit4:junit4]   2> 103078 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=156023
[junit4:junit4]   2> 103433 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=155668
[junit4:junit4]   2> 103788 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=155313
[junit4:junit4]   2> 104143 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=154958
[junit4:junit4]   2> 104498 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=154603
[junit4:junit4]   2> 104854 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=154247
[junit4:junit4]   2> 105209 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=153892
[junit4:junit4]   2> 105564 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=153537
[junit4:junit4]   2> 105919 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=153182
[junit4:junit4]   2> 106274 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=152827
[junit4:junit4]   2> 106664 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=152437
[junit4:junit4]   2> 107054 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=152047
[junit4:junit4]   2> 107445 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=151656
[junit4:junit4]   2> 107836 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=151265
[junit4:junit4]   2> 108226 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=150875
[junit4:junit4]   2> 108617 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=150484
[junit4:junit4]   2> 109008 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=150093
[junit4:junit4]   2> 109398 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=149703
[junit4:junit4]   2> 109789 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=149312
[junit4:junit4]   2> 110180 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=148921
[junit4:junit4]   2> 110570 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=148531
[junit4:junit4]   2> 110961 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=148140
[junit4:junit4]   2> 111352 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=147749
[junit4:junit4]   2> 111742 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=147359
[junit4:junit4]   2> 112133 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=146968
[junit4:junit4]   2> 112524 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=146577
[junit4:junit4]   2> 112914 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=146187
[junit4:junit4]   2> 113305 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=145796
[junit4:junit4]   2> 113696 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=145405
[junit4:junit4]   2> 114086 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=145015
[junit4:junit4]   2> 114515 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=144586
[junit4:junit4]   2> 114944 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=144157
[junit4:junit4]   2> 115374 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=143727
[junit4:junit4]   2> 115804 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=143297
[junit4:junit4]   2> 116234 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=142867
[junit4:junit4]   2> 116663 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=142438
[junit4:junit4]   2> 117093 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=142008
[junit4:junit4]   2> 117523 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=141578
[junit4:junit4]   2> 117952 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=141149
[junit4:junit4]   2> 118382 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=140719
[junit4:junit4]   2> 118812 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=140289
[junit4:junit4]   2> 119242 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=139859
[junit4:junit4]   2> 119671 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=139430
[junit4:junit4]   2> 120101 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=139000
[junit4:junit4]   2> 120531 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=138570
[junit4:junit4]   2> 120961 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=138140
[junit4:junit4]   2> 121390 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=137711
[junit4:junit4]   2> 121820 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=137281
[junit4:junit4]   2> 122250 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=136851
[junit4:junit4]   2> 122679 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=136422
[junit4:junit4]   2> 123151 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=135950
[junit4:junit4]   2> 123623 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=135478
[junit4:junit4]   2> 124096 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=135005
[junit4:junit4]   2> 124569 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=134532
[junit4:junit4]   2> 125042 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=134059
[junit4:junit4]   2> 125514 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=133587
[junit4:junit4]   2> 125987 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=133114
[junit4:junit4]   2> 126460 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=132641
[junit4:junit4]   2> 126932 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=132169
[junit4:junit4]   2> 127405 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=131696
[junit4:junit4]   2> 127878 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=131223
[junit4:junit4]   2> 128350 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=130751
[junit4:junit4]   2> 128823 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=130278
[junit4:junit4]   2> 129296 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=129805
[junit4:junit4]   2> 129769 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=129332
[junit4:junit4]   2> 130241 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=128860
[junit4:junit4]   2> 130714 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=128387
[junit4:junit4]   2> 131187 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=127914
[junit4:junit4]   2> 131659 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=127442
[junit4:junit4]   2> 132132 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=126969
[junit4:junit4]   2> 132650 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=126451
[junit4:junit4]   2> 133170 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=125931
[junit4:junit4]   2> 133690 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=125411
[junit4:junit4]   2> 134210 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=124891
[junit4:junit4]   2> 134730 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=124371
[junit4:junit4]   2> 135250 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=123851
[junit4:junit4]   2> 135770 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=123331
[junit4:junit4]   2> 136290 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=122811
[junit4:junit4]   2> 136810 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=122291
[junit4:junit4]   2> 137330 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=121771
[junit4:junit4]   2> 137850 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=121251
[junit4:junit4]   2> 138370 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=120731
[junit4:junit4]   2> 138890 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=120211
[junit4:junit4]   2> 139410 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=119691
[junit4:junit4]   2> 139930 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=119171
[junit4:junit4]   2> 140450 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=118651
[junit4:junit4]   2> 140970 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=118131
[junit4:junit4]   2> 141490 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=117611
[junit4:junit4]   2> 142010 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=117091
[junit4:junit4]   2> 142530 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=116571
[junit4:junit4]   2> 143100 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=116001
[junit4:junit4]   2> 143672 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=115429
[junit4:junit4]   2> 144244 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=114857
[junit4:junit4]   2> 144816 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=114285
[junit4:junit4]   2> 145388 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=113713
[junit4:junit4]   2> 145960 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=113141
[junit4:junit4]   2> 146532 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=112569
[junit4:junit4]   2> 147104 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=111997
[junit4:junit4]   2> 147676 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=111425
[junit4:junit4]   2> 148248 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=110853
[junit4:junit4]   2> 148820 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=110281
[junit4:junit4]   2> 149392 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=109709
[junit4:junit4]   2> 149964 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=109137
[junit4:junit4]   2> 150535 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=108566
[junit4:junit4]   2> 151107 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=107994
[junit4:junit4]   2> 151679 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=107422
[junit4:junit4]   2> 152251 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=106850
[junit4:junit4]   2> 152823 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=106278
[junit4:junit4]   2> 153395 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=105706
[junit4:junit4]   2> 153967 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=105134
[junit4:junit4]   2> 154595 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=104506
[junit4:junit4]   2> 155224 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=103877
[junit4:junit4]   2> 155853 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=103248
[junit4:junit4]   2> 156482 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=102619
[junit4:junit4]   2> 157111 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=101990
[junit4:junit4]   2> 157740 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=101361
[junit4:junit4]   2> 158369 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=100732
[junit4:junit4]   2> 158999 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=100102
[junit4:junit4]   2> 159628 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=99473
[junit4:junit4]   2> 160257 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=98844
[junit4:junit4]   2> 160886 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=98215
[junit4:junit4]   2> 161515 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=97586
[junit4:junit4]   2> 162144 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=96957
[junit4:junit4]   2> 162774 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=96327
[junit4:junit4]   2> 163403 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=95698
[junit4:junit4]   2> 164032 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=95069
[junit4:junit4]   2> 164661 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=94440
[junit4:junit4]   2> 165290 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=93811
[junit4:junit4]   2> 165919 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=93182
[junit4:junit4]   2> 166548 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=92553
[junit4:junit4]   2> 167238 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=91863
[junit4:junit4]   2> 167931 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=91170
[junit4:junit4]   2> 168623 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=90478
[junit4:junit4]   2> 169315 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=89786
[junit4:junit4]   2> 170007 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=89094
[junit4:junit4]   2> 170699 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=88402
[junit4:junit4]   2> 171391 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=87710
[junit4:junit4]   2> 172083 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=87018
[junit4:junit4]   2> 172775 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=86326
[junit4:junit4]   2> 173467 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=85634
[junit4:junit4]   2> 174159 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=84942
[junit4:junit4]   2> 174851 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=84250
[junit4:junit4]   2> 175543 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=83558
[junit4:junit4]   2> 176235 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=82866
[junit4:junit4]   2> 176927 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=82174
[junit4:junit4]   2> 177619 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=81482
[junit4:junit4]   2> 178311 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=80790
[junit4:junit4]   2> 179004 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=80097
[junit4:junit4]   2> 179696 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=79405
[junit4:junit4]   2> 180388 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=78713
[junit4:junit4]   2> 181136 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=77965
[junit4:junit4]   2> 181886 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=77215
[junit4:junit4]   2> 182636 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=76465
[junit4:junit4]   2> 183386 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=75715
[junit4:junit4]   2> 184136 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=74965
[junit4:junit4]   2> 184886 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=74215
[junit4:junit4]   2> 185636 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=73465
[junit4:junit4]   2> 186386 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=72715
[junit4:junit4]   2> 187136 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=71965
[junit4:junit4]   2> 187886 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=71215
[junit4:junit4]   2> 188636 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=70465
[junit4:junit4]   2> 189386 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=69715
[junit4:junit4]   2> 190136 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=68965
[junit4:junit4]   2> 190886 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=68215
[junit4:junit4]   2> 191636 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=67465
[junit4:junit4]   2> 192386 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=66715
[junit4:junit4]   2> 193136 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=65965
[junit4:junit4]   2> 193886 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=65215
[junit4:junit4]   2> 194636 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=64465
[junit4:junit4]   2> 195386 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=63715
[junit4:junit4]   2> 196063 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=63038
[junit4:junit4]   2> 196738 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=62363
[junit4:junit4]   2> 197413 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=61688
[junit4:junit4]   2> 198088 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=61013
[junit4:junit4]   2> 198763 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=60338
[junit4:junit4]   2> 199438 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=59663
[junit4:junit4]   2> 200113 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=58988
[junit4:junit4]   2> 200788 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=58313
[junit4:junit4]   2> 201463 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=57638
[junit4:junit4]   2> 202138 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=56963
[junit4:junit4]   2> 202813 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=56288
[junit4:junit4]   2> 203488 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=55613
[junit4:junit4]   2> 204163 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=54938
[junit4:junit4]   2> 204838 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=54263
[junit4:junit4]   2> 205513 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=53588
[junit4:junit4]   2> 206188 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=52913
[junit4:junit4]   2> 206863 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=52238
[junit4:junit4]   2> 207538 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=51563
[junit4:junit4]   2> 208213 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=50888
[junit4:junit4]   2> 208888 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=50213
[junit4:junit4]   2> 209498 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=49603
[junit4:junit4]   2> 210105 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=48996
[junit4:junit4]   2> 210713 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=48388
[junit4:junit4]   2> 211320 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=47781
[junit4:junit4]   2> 211928 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=47173
[junit4:junit4]   2> 212535 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=46566
[junit4:junit4]   2> 213143 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=45958
[junit4:junit4]   2> 213750 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=45351
[junit4:junit4]   2> 214358 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=44743
[junit4:junit4]   2> 214965 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=44136
[junit4:junit4]   2> 215573 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=43528
[junit4:junit4]   2> 216180 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=42921
[junit4:junit4]   2> 216788 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=42313
[junit4:junit4]   2> 217395 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=41706
[junit4:junit4]   2> 218003 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=41098
[junit4:junit4]   2> 218610 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=40491
[junit4:junit4]   2> 219218 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=39883
[junit4:junit4]   2> 219825 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=39276
[junit4:junit4]   2> 220433 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=38668
[junit4:junit4]   2> 221040 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=38061
[junit4:junit4]   2> 221589 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=37512
[junit4:junit4]   2> 222136 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=36965
[junit4:junit4]   2> 222683 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=36418
[junit4:junit4]   2> 223229 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=35872
[junit4:junit4]   2> 223776 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=35325
[junit4:junit4]   2> 224323 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=34778
[junit4:junit4]   2> 224870 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=34231
[junit4:junit4]   2> 225416 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=33685
[junit4:junit4]   2> 225963 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=33138
[junit4:junit4]   2> 226510 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=32591
[junit4:junit4]   2> 227057 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=32044
[junit4:junit4]   2> 227603 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=31498
[junit4:junit4]   2> 228150 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=30951
[junit4:junit4]   2> 228697 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=30404
[junit4:junit4]   2> 229244 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=29857
[junit4:junit4]   2> 229790 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=29311
[junit4:junit4]   2> 230337 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=28764
[junit4:junit4]   2> 230884 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=28217
[junit4:junit4]   2> 231431 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=27670
[junit4:junit4]   2> 231977 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=27124
[junit4:junit4]   2> 232471 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=26630
[junit4:junit4]   2> 232963 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=26138
[junit4:junit4]   2> 233455 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=25646
[junit4:junit4]   2> 233947 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=25154
[junit4:junit4]   2> 234440 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=24661
[junit4:junit4]   2> 234932 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=24169
[junit4:junit4]   2> 235424 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=23677
[junit4:junit4]   2> 235916 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=23185
[junit4:junit4]   2> 236408 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=22693
[junit4:junit4]   2> 236900 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=22201
[junit4:junit4]   2> 237392 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=21709
[junit4:junit4]   2> 237884 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=21217
[junit4:junit4]   2> 238376 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=20725
[junit4:junit4]   2> 238868 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=20233
[junit4:junit4]   2> 239360 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=19741
[junit4:junit4]   2> 239852 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=19249
[junit4:junit4]   2> 240344 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=18757
[junit4:junit4]   2> 240837 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=18264
[junit4:junit4]   2> 241329 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=17772
[junit4:junit4]   2> 241821 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=17280
[junit4:junit4]   2> 242265 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=16836
[junit4:junit4]   2> 242708 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=16393
[junit4:junit4]   2> 243151 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=15950
[junit4:junit4]   2> 243594 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=15507
[junit4:junit4]   2> 244037 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=15064
[junit4:junit4]   2> 244479 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=14622
[junit4:junit4]   2> 244922 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=14179
[junit4:junit4]   2> 245365 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=13736
[junit4:junit4]   2> 245808 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=13293
[junit4:junit4]   2> 246251 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=12850
[junit4:junit4]   2> 246694 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=12407
[junit4:junit4]   2> 247137 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=11964
[junit4:junit4]   2> 247580 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=11521
[junit4:junit4]   2> 248022 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=11079
[junit4:junit4]   2> 248465 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=10636
[junit4:junit4]   2> 248908 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=10193
[junit4:junit4]   2> 249351 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=9750
[junit4:junit4]   2> 249794 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=9307
[junit4:junit4]   2> 250237 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=8864
[junit4:junit4]   2> 250680 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=8421
[junit4:junit4]   2> 251080 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=8021
[junit4:junit4]   2> 251478 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=7623
[junit4:junit4]   2> 251877 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=7224
[junit4:junit4]   2> 252275 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=6826
[junit4:junit4]   2> 252674 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=6427
[junit4:junit4]   2> 253073 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=6028
[junit4:junit4]   2> 253471 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=5630
[junit4:junit4]   2> 253870 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=5231
[junit4:junit4]   2> 254268 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=4833
[junit4:junit4]   2> 254667 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=4434
[junit4:junit4]   2> 255066 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=4035
[junit4:junit4]   2> 255464 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=3637
[junit4:junit4]   2> 255863 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=3238
[junit4:junit4]   2> 256261 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=2840
[junit4:junit4]   2> 256660 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=2441
[junit4:junit4]   2> 257059 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=2042
[junit4:junit4]   2> 257457 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=1644
[junit4:junit4]   2> 257856 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=1245
[junit4:junit4]   2> 258254 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=847
[junit4:junit4]   2> 258653 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=448
[junit4:junit4]   2> 259013 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=88
[junit4:junit4]   2> 259372 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=-271
[junit4:junit4]   2> 259372 T196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Was waiting for replicas to come up, but they are taking too long - assuming they won't come back till later
[junit4:junit4]   2> 259372 T196 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 259372 T196 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54818/solr/collection1/
[junit4:junit4]   2> 259372 T196 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 259394 T196 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:54818/solr START replicas=[http://127.0.0.1:54812/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 259394 T196 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:54818/solr DONE.  We have no versions.  sync failed.
[junit4:junit4]   2> 259394 T196 oasc.SolrException.log SEVERE Sync Failed
[junit4:junit4]   2> 259394 T196 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4]   2> 259394 T196 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54818/solr/collection1/
[junit4:junit4]   2> 259394 T196 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 259405 T201 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13acbc6e6ad0005 type:create cxid:0x1b6 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 259730 T218 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 259730 T217 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 259730 T245 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 259730 T222 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 259775 T196 oasc.ZkController.register We are http://127.0.0.1:54818/solr/collection1/ and leader is http://127.0.0.1:54818/solr/collection1/
[junit4:junit4]   2> 259775 T196 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54818/solr
[junit4:junit4]   2> 259775 T196 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 259775 T196 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 259775 T196 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 259775 T196 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 259775 T196 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 259775 T196 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 259798 T196 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 260092 T218 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 260093 T218 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54818_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54818/solr"}
[junit4:junit4]   2> 260101 T217 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 260101 T245 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 260102 T222 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> ASYNC  NEW_CORE C11 name=collection1 org.apache.solr.core.SolrCore@175c06 url=http://127.0.0.1:54803/solr/collection1 node=127.0.0.1:54803_solr
[junit4:junit4]   2> 260273 T214 C11 P54803 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16
[junit4:junit4]   2> 260302 T212 C11 P54803 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\control\data
[junit4:junit4]   2> 260310 T212 C11 P54803 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@11e07f lockFactory=org.apache.lucene.store.NativeFSLockFactory@130646),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 260311 T212 C11 P54803 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 260335 T212 C11 P54803 /update {wt=javabin&version=2} {add=[10001 (1417715438060568576)]} 0 82
[junit4:junit4]   2> 260346 T214 C11 P54803 /update {wt=javabin&version=2} {add=[1 (1417715438071054336)]} 0 93
[junit4:junit4]   2> ASYNC  NEW_CORE C12 name=collection1 org.apache.solr.core.SolrCore@911b9f url=http://127.0.0.1:54818/solr/collection1 node=127.0.0.1:54818_solr
[junit4:junit4]   2> 260382 T238 C12 P54818 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\jetty2
[junit4:junit4]   2> 260385 T238 C12 P54818 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10d2cf0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@725f5),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 260385 T238 C12 P54818 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 260389 T238 C12 P54818 /update {wt=javabin&version=2} {add=[1 (1417715438143406081)]} 0 8
[junit4:junit4]   2> 260389 T243 C12 P54818 /update {wt=javabin&version=2} {add=[10001 (1417715438143406080)]} 0 8
[junit4:junit4]   2> 260395 T215 C11 P54803 /update {wt=javabin&version=2} {add=[2 (1417715438157037568)]} 0 2
[junit4:junit4]   2> 260395 T213 C11 P54803 /update {wt=javabin&version=2} {add=[10002 (1417715438157037569)]} 0 2
[junit4:junit4]   2> 260399 T239 C12 P54818 /update {wt=javabin&version=2} {add=[2 (1417715438160183296)]} 0 2
[junit4:junit4]   2> 260402 T240 C12 P54818 /update {wt=javabin&version=2} {add=[10002 (1417715438164377600)]} 0 2
[junit4:junit4]   2> 260404 T210 C11 P54803 /update {wt=javabin&version=2} {add=[3 (1417715438167523328)]} 0 1
[junit4:junit4]   2> 260406 T212 C11 P54803 /update {wt=javabin&version=2} {add=[10003 (1417715438168571904)]} 0 1
[junit4:junit4]   2> 260408 T241 C12 P54818 /update {wt=javabin&version=2} {add=[3 (1417715438170669056)]} 0 1
[junit4:junit4]   2> 260411 T242 C12 P54818 /update {wt=javabin&version=2} {add=[10003 (1417715438173814784)]} 0 2
[junit4:junit4]   2> 260412 T211 C11 P54803 /update {wt=javabin&version=2} {add=[4 (1417715438174863360)]} 0 1
[junit4:junit4]   2> 260415 T214 C11 P54803 /update {wt=javabin&version=2} {add=[10004 (1417715438178009088)]} 0 1
[junit4:junit4]   2> 260416 T243 C12 P54818 /update {wt=javabin&version=2} {add=[4 (1417715438180106240)]} 0 1
[junit4:junit4]   2> 260418 T238 C12 P54818 /update {wt=javabin&version=2} {add=[10004 (1417715438182203392)]} 0 0
[junit4:junit4]   2> 260421 T215 C11 P54803 /update {wt=javabin&version=2} {add=[5 (1417715438183251968)]} 0 2
[junit4:junit4]   2> 260444 T239 C12 P54818 /update {wt=javabin&version=2} {add=[5 (1417715438208417792)]} 0 19
[junit4:junit4]   2> 260447 T213 C11 P54803 /update {wt=javabin&version=2} {add=[10005 (1417715438187446272)]} 0 24
[junit4:junit4]   2> 260451 T210 C11 P54803 /update {wt=javabin&version=2} {add=[6 (1417715438214709248)]} 0 2
[junit4:junit4]   2> 260456 T240 C12 P54818 /update {wt=javabin&version=2} {add=[10005 (1417715438218903552)]} 0 5
[junit4:junit4]   2> 260460 T241 C12 P54818 /update {wt=javabin&version=2} {add=[6 (1417715438224146432)]} 0 2
[junit4:junit4]   2> 260463 T212 C11 P54803 /update {wt=javabin&version=2} {add=[10006 (1417715438228340736)]} 0 1
[junit4:junit4]   2> 260465 T211 C11 P54803 /update {wt=javabin&version=2} {add=[7 (1417715438231486464)]} 0 1
[junit4:junit4]   2> 260545 T242 C12 P54818 /update {wt=javabin&version=2} {add=[10006 (1417715438233583616)]} 0 78
[junit4:junit4]   2> 260547 T243 C12 P54818 /update {wt=javabin&version=2} {add=[7 (1417715438316421120)]} 0 2
[junit4:junit4]   2> 260549 T214 C11 P54803 /update {wt=javabin&version=2} {add=[10007 (1417715438318518272)]} 0 1
[junit4:junit4]   2> 260552 T215 C11 P54803 /update {wt=javabin&version=2} {add=[8 (1417715438321664000)]} 0 2
[junit4:junit4]   2> 260554 T238 C12 P54818 /update {wt=javabin&version=2} {add=[10007 (1417715438323761152)]} 0 1
[junit4:junit4]   2> 260556 T240 C12 P54818 /update {wt=javabin&version=2} {add=[8 (1417715438325858304)]} 0 1
[junit4:junit4]   2> 260559 T213 C11 P54803 /update {wt=javabin&version=2} {add=[10008 (1417715438329004032)]} 0 2
[junit4:junit4]   2> 260561 T241 C12 P54818 /update {wt=javabin&version=2} {add=[10008 (1417715438332149760)]} 0 0
[junit4:junit4]   2> 260563 T210 C11 P54803 /update {wt=javabin&version=2} {add=[9 (1417715438334246912)]} 0 0
[junit4:junit4]   2> 260566 T210 C11 P54803 /update {wt=javabin&version=2} {add=[10009 (1417715438336344064)]} 0 1
[junit4:junit4]   2> 260569 T242 C12 P54818 /update {wt=javabin&version=2} {add=[9 (1417715438339489792)]} 0 1
[junit4:junit4]   2> 260571 T243 C12 P54818 /update {wt=javabin&version=2} {add=[10009 (1417715438341586944)]} 0 1
[junit4:junit4]   2> 260573 T211 C11 P54803 /update {wt=javabin&version=2} {delete=[8 (-1417715438344732672)]} 0 0
[junit4:junit4]   2> 260577 T214 C11 P54803 /update {wt=javabin&version=2} {delete=[10008 (-1417715438347878400)]} 0 2
[junit4:junit4]   2> 260579 T239 C12 P54818 /update {wt=javabin&version=2} {delete=[8 (-1417715438351024128)]} 0 1
[junit4:junit4]   2> 260582 T238 C12 P54818 /update {wt=javabin&version=2} {delete=[10008 (-1417715438354169856)]} 0 0
[junit4:junit4]   2> 260587 T215 C11 P54803 /update {wt=javabin&version=2} {add=[10 (1417715438357315584)]} 0 2
[junit4:junit4]   2> 260592 T240 C12 P54818 /update {wt=javabin&version=2} {add=[10 (1417715438361509888)]} 0 3
[junit4:junit4]   2> 260599 T213 C11 P54803 /update {wt=javabin&version=2} {add=[10010 (1417715438366752768)]} 0 5
[junit4:junit4]   2> 260603 T213 C11 P54803 /update {wt=javabin&version=2} {add=[11 (1417715438374092800)]} 0 2
[junit4:junit4]   2> 260613 T242 C12 P54818 /update {wt=javabin&version=2} {add=[10010 (1417715438386675712)]} 0 0
[junit4:junit4]   2> 260769 T241 C12 P54818 /update {wt=javabin&version=2} {add=[11 (1417715438379335680)]} 0 163
[junit4:junit4]   2> 260771 T212 C11 P54803 /update {wt=javabin&version=2} {add=[10011 (1417715438551302144)]} 0 2
[junit4:junit4]   2> 260772 T212 C11 P54803 /update {wt=javabin&version=2} {delete=[9 (-1417715438553399296)]} 0 0
[junit4:junit4]   2> 260776 T243 C12 P54818 /update {wt=javabin&version=2} {delete=[9 (-1417715438557593600)]} 0 0
[junit4:junit4]   2> 260780 T239 C12 P54818 /update {wt=javabin&version=2} {add=[10011 (1417715438560739328)]} 0 1
[junit4:junit4]   2> 260783 T215 C11 P54803 /update {wt=javabin&version=2} {add=[12 (1417715438562836480)]} 0 2
[junit4:junit4]   2> 260786 T213 C11 P54803 /update {wt=javabin&version=2} {delete=[10009 (-1417715438568079360)]} 0 0
[junit4:junit4]   2> 260789 T238 C12 P54818 /update {wt=javabin&version=2} {add=[12 (1417715438570176512)]} 0 1
[junit4:junit4]   2> 260792 T210 C11 P54803 /update {wt=javabin&version=2} {delete=[10 (-1417715438574370816)]} 0 0
[junit4:junit4]   2> 260795 T240 C12 P54818 /update {wt=javabin&version=2} {delete=[10 (-1417715438577516544)]} 0 0
[junit4:junit4]   2> 260799 T212 C11 P54803 /update {wt=javabin&version=2} {add=[13 (1417715438580662272)]} 0 2
[junit4:junit4]   2> 260800 T242 C12 P54818 /update {wt=javabin&version=2} {delete=[10009 (-1417715438582759424)]} 0 0
[junit4:junit4]   2> 260802 T242 C12 P54818 /update {wt=javabin&version=2} {add=[13 (1417715438584856576)]} 0 0
[junit4:junit4]   2> 260807 T211 C11 P54803 /update {wt=javabin&version=2} {add=[14 (1417715438589050880)]} 0 1
[junit4:junit4]   2> 260808 T211 C11 P54803 /update {wt=javabin&version=2} {add=[10012 (1417715438591148032)]} 0 1
[junit4:junit4]   2> 260812 T243 C12 P54818 /update {wt=javabin&version=2} {add=[14 (1417715438594293760)]} 0 3
[junit4:junit4]   2> 260812 T239 C12 P54818 /update {wt=javabin&version=2} {add=[10012 (1417715438595342336)]} 0 1
[junit4:junit4]   2> 260816 T215 C11 P54803 /update {wt=javabin&version=2} {add=[15 (1417715438598488064)]} 0 1
[junit4:junit4]   2> 260817 T213 C11 P54803 /update {wt=javabin&version=2} {delete=[10010 (-1417715438600585216)]} 0 0
[junit4:junit4]   2> 260820 T240 C12 P54818 /update {wt=javabin&version=2} {delete=[10010 (-1417715438603730944)]} 0 0
[junit4:junit4]   2> 260821 T238 C12 P54818 /update {wt=javabin&version=2} {add=[15 (1417715438603730945)]} 0 1
[junit4:junit4]   2> 260824 T210 C11 P54803 /update {wt=javabin&version=2} {add=[10013 (1417715438606876672)]} 0 1
[junit4:junit4]   2> 260826 T210 C11 P54803 /update {wt=javabin&version=2} {delete=[15 (-1417715438610022400)]} 0 0
[junit4:junit4]   2> 260828 T242 C12 P54818 /update {wt=javabin&version=2} {delete=[15 (-1417715438612119552)]} 0 0
[junit4:junit4]   2> 260831 T241 C12 P54818 /update {wt=javabin&version=2} {add=[10013 (1417715438614216704)]} 0 1
[junit4:junit4]   2> 260833 T211 C11 P54803 /update {wt=javabin&version=2} {add=[16 (1417715438617362432)]} 0 1
[junit4:junit4]   2> 260840 T214 C11 P54803 /update {wt=javabin&version=2} {add=[10014 (1417715438619459584)]} 0 5
[junit4:junit4]   2> 260842 T243 C12 P54818 /update {wt=javabin&version=2} {add=[16 (1417715438625751040)]} 0 1
[junit4:junit4]   2> 260846 T215 C11 P54803 /update {wt=javabin&version=2} {delete=[16 (-1417715438630993920)]} 0 0
[junit4:junit4]   2> 260854 T240 C12 P54818 /update {wt=javabin&version=2} {delete=[16 (-1417715438639382528)]} 0 0
[junit4:junit4]   2> 260859 T239 C12 P54818 /update {wt=javabin&version=2} {add=[10014 (1417715438632042496)]} 0 12
[junit4:junit4]   2> 260863 T213 C11 P54803 /update {wt=javabin&version=2} {add=[17 (1417715438646722560)]} 0 2
[junit4:junit4]   2> 260866 T210 C11 P54803 /update {wt=javabin&version=2} {add=[10015 (1417715438650916864)]} 0 1
[junit4:junit4]   2> 260868 T238 C12 P54818 /update {wt=javabin&version=2} {add=[17 (1417715438654062592)]} 0 1
[junit4:junit4]   2> 260872 T212 C11 P54803 /update {wt=javabin&version=2} {add=[18 (1417715438658256896)]} 0 1
[junit4:junit4]   2> 260877 T242 C12 P54818 /update {wt=javabin&version=2} {add=[18 (1417715438663499776)]} 0 1
[junit4:junit4]   2> 260881 T211 C11 P54803 /update {wt=javabin&version=2} {delete=[18 (-1417715438667694080)]} 0 1
[junit4:junit4]   2> 260884 T241 C12 P54818 /update {wt=javabin&version=2} {add=[10015 (1417715438668742656)]} 0 2
[junit4:junit4]   2> 260884 T241 C12 P54818 /update {wt=javabin&version=2} {delete=[18 (-1417715438670839808)]} 0 0
[junit4:junit4]   2> 260889 T214 C11 P54803 /update {wt=javabin&version=2} {add=[19 (1417715438675034112)]} 0 2
[junit4:junit4]   2> 260891 T215 C11 P54803 /update {wt=javabin&version=2} {delete=[10015 (-1417715438678179840)]} 0 0
[junit4:junit4]   2> 260894 T240 C12 P54818 /update {wt=javabin&version=2} {add=[19 (1417715438680276992)]} 0 1
[junit4:junit4]   2> 260898 T213 C11 P54803 /update {wt=javabin&version=2} {delete=[19 (-1417715438685519872)]} 0 0
[junit4:junit4]   2> 260900 T239 C12 P54818 /update {wt=javabin&version=2} {delete=[10015 (-1417715438687617024)]} 0 0
[junit4:junit4]   2> 260902 T239 C12 P54818 /update {wt=javabin&version=2} {delete=[19 (-1417715438689714176)]} 0 0
[junit4:junit4]   2> 260908 T210 C11 P54803 /update {wt=javabin&version=2} {add=[20 (1417715438692859904)]} 0 3
[junit4:junit4]   2> 260925 T242 C12 P54818 /update {wt=javabin&version=2} {add=[20 (1417715438712782848)]} 0 1
[junit4:junit4]   2> 260927 T212 C11 P54803 /update {wt=javabin&version=2} {delete=[20 (-1417715438715928576)]} 0 0
[junit4:junit4]   2> 260931 T241 C12 P54818 /update {wt=javabin&version=2} {delete=[20 (-1417715438720122880)]} 0 0
[junit4:junit4]   2> 260935 T214 C11 P54803 /update {wt=javabin&version=2} {add=[21 (1417715438723268608)]} 0 1
[junit4:junit4]   2> 260937 T211 C11 P54803 /update {wt=javabin&version=2} {add=[10016 (1417715438722220032)]} 0 4
[junit4:junit4]   2> 260939 T243 C12 P54818 /update {wt=javabin&version=2} {add=[21 (1417715438727462912)]} 0 1
[junit4:junit4]   2> 260959 T240 C12 P54818 /update {wt=javabin&version=2} {add=[10016 (1417715438748434432)]} 0 17
[junit4:junit4]   2> 260966 T215 C11 P54803 /update {wt=javabin&version=2} {add=[22 (1417715438756823040)]} 0 1
[junit4:junit4]   2> 260969 T213 C11 P54803 /update {wt=javabin&version=2} {delete=[10016 (-1417715438759968768)]} 0 1
[junit4:junit4]   2> 260971 T238 C12 P54818 /update {wt=javabin&version=2} {add=[22 (1417715438762065920)]} 0 0
[junit4:junit4]   2> 260975 T210 C11 P54803 /update {wt=javabin&version=2} {add=[23 (1417715438765211648)]} 0 1
[junit4:junit4]   2> 260978 T242 C12 P54818 /update {wt=javabin&version=2} {delete=[10016 (-1417715438769405952)]} 0 0
[junit4:junit4]   2> 260980 T242 C12 P54818 /update {wt=javabin&version=2} {add=[23 (1417715438770454528)]} 0 1
[junit4:junit4]   2> 260987 T212 C11 P54803 /update {wt=javabin&version=2} {add=[24 (1417715438774648832)]} 0 5
[junit4:junit4]   2> 260992 T214 C11 P54803 /update {wt=javabin&version=2} {add=[10017 (1417715438780940288)]} 0 3
[junit4:junit4]   2> 261025 T243 C12 P54818 /update {wt=javabin&version=2} {add=[24 (1417715438786183168)]} 0 33
[junit4:junit4]   2> 261028 T240 C12 P54818 /update {wt=javabin&version=2} {add=[10017 (1417715438820786176)]} 0 1
[junit4:junit4]   2> 261039 T211 C11 P54803 /update {wt=javabin&version=2} {add=[25 (1417715438823931904)]} 0 9
[junit4:junit4]   2> 261041 T215 C11 P54803 /update {wt=javabin&version=2} {add=[10018 (1417715438835466240)]} 0 1
[junit4:junit4]   2> 261044 T239 C12 P54818 /update {wt=javabin&version=2} {add=[25 (1417715438837563392)]} 0 1
[junit4:junit4]   2> 261046 T238 C12 P54818 /update {wt=javabin&version=2} {add=[10018 (1417715438840709120)]} 0 0
[junit4:junit4]   2> 261053 T213 C11 P54803 /update {wt=javabin&version=2} {add=[26 (1417715438847000576)]} 0 2
[junit4:junit4]   2> 261054 T210 C11 P54803 /update {wt=javabin&version=2} {delete=[10018 (-1417715438849097728)]} 0 0
[junit4:junit4]   2> 261062 T242 C12 P54818 /update {wt=javabin&version=2} {add=[26 (1417715438856437760)]} 0 1
[junit4:junit4]   2> 261064 T241 C12 P54818 /update {wt=javabin&version=2} {delete=[10018 (-1417715438858534912)]} 0 1
[junit4:junit4]   2> 261064 T212 C11 P54803 /update {wt=javabin&version=2} {delete=[25 (-1417715438859583488)]} 0 0
[junit4:junit4]   2> 261068 T214 C11 P54803 /update {wt=javabin&version=2} {add=[10019 (1417715438862729216)]} 0 1
[junit4:junit4]   2> 261071 T243 C12 P54818 /update {wt=javabin&version=2} {delete=[25 (-1417715438865874944)]} 0 2
[junit4:junit4]   2> 261073 T240 C12 P54818 /update {wt=javabin&version=2} {add=[10019 (1417715438867972096)]} 0 1
[junit4:junit4]   2> 261077 T211 C11 P54803 /update {wt=javabin&version=2} {delete=[10019 (-1417715438873214976)]} 0 0
[junit4:junit4]   2> 261080 T215 C11 P54803 /update {wt=javabin&version=2} {add=[27 (1417715438875312128)]} 0 2
[junit4:junit4]   2> 261081 T239 C12 P54818 /update {wt=javabin&version=2} {delete=[10019 (-1417715438877409280)]} 0 0
[junit4:junit4]   2> 261084 T238 C12 P54818 /update {wt=javabin&version=2} {add=[27 (1417715438879506432)]} 0 1
[junit4:junit4]   2> 261086 T213 C11 P54803 /update {wt=javabin&version=2} {add=[10020 (1417715438881603584)]} 0 1
[junit4:junit4]   2> 261088 T210 C11 P54803 /update {wt=javabin&version=2} {add=[28 (1417715438884749312)]} 0 0
[junit4:junit4]   2> 261091 T242 C12 P54818 /update {wt=javabin&version=2} {add=[10020 (1417715438886846464)]} 0 1
[junit4:junit4]   2> 261107 T241 C12 P54818 /update {wt=javabin&version=2} {add=[28 (1417715438901526528)]} 0 15
[junit4:junit4]   2> 261107 T212 C11 P54803 /update {wt=javabin&version=2} {delete=[10020 (-1417715438904672256)]} 0 0
[junit4:junit4]   2> 261110 T214 C11 P54803 /update {wt=javabin&version=2} {add=[29 (1417715438906769408)]} 0 1
[junit4:junit4]   2> 261112 T243 C12 P54818 /update {wt=javabin&version=2} {delete=[10020 (-1417715438909915136)]} 0 0
[junit4:junit4]   2> 261116 T240 C12 P54818 /update {wt=javabin&version=2} {add=[29 (1417715438912012288)]} 0 2
[junit4:junit4]   2> 261131 T211 C11 P54803 /update {wt=javabin&version=2} {add=[10021 (1417715438915158016)]} 0 14
[junit4:junit4]   2> 261135 T215 C11 P54803 /update {wt=javabin&version=2} {add=[30 (1417715438931935232)]} 0 2
[junit4:junit4]   2> 261151 T239 C12 P54818 /update {wt=javabin&version=2} {add=[10021 (1417715438936129536)]} 0 14
[junit4:junit4]   2> 261154 T238 C12 P54818 /update {wt=javabin&version=2} {add=[30 (1417715438951858176)]} 0 2
[junit4:junit4]   2> 261159 T213 C11 P54803 /update {wt=javabin&version=2} {add=[10022 (1417715438958149632)]} 0 1
[junit4:junit4]   2> 261162 T213 C11 P54803 /update {wt=javabin&version=2} {add=[31 (1417715438960246784)]} 0 2
[junit4:junit4]   2> 261166 T242 C12 P54818 /update {wt=javabin&version=2} {add=[31 (1417715438965489664)]} 0 2
[junit4:junit4]   2> 261169 T212 C11 P54803 /update {wt=javabin&version=2} {delete=[29 (-1417715438969683968)]} 0 1
[junit4:junit4]   2> 261173 T241 C12 P54818 /update {wt=javabin&version=2} {add=[10022 (1417715438972829696)]} 0 1
[junit4:junit4]   2> 261174 T241 C12 P54818 /update {wt=javabin&version=2} {delete=[29 (-1417715438974926848)]} 0 1
[junit4:junit4]   2> 261181 T211 C11 P54803 /update {wt=javabin&version=2} {add=[32 (1417715438981218304)]} 0 2
[junit4:junit4]   2> 261183 T215 C11 P54803 /update {wt=javabin&version=2} {add=[10023 (1417715438983315456)]} 0 1
[junit4:junit4]   2> 261185 T240 C12 P54818 /update {wt=javabin&version=2} {add=[32 (1417715438985412608)]} 0 1
[junit4:junit4]   2> 261188 T239 C12 P54818 /update {wt=javabin&version=2} {add=[10023 (1417715438988558336)]} 0 1
[junit4:junit4]   2> 261194 T213 C11 P54803 /update {wt=javabin&version=2} {add=[33 (1417715438992752640)]} 0 3
[junit4:junit4]   2> 261195 T210 C11 P54803 /update {wt=javabin&version=2} {add=[10024 (1417715438996946944)]} 0 0
[junit4:junit4]   2> 261198 T238 C12 P54818 /update {wt=javabin&version=2} {add=[33 (1417715438997995520)]} 0 2
[junit4:junit4]   2> 261200 T214 C11 P54803 /update {wt=javabin&version=2} {delete=[30 (-1417715439002189824)]} 0 0
[junit4:junit4]   2> 261202 T242 C12 P54818 /update {wt=javabin&version=2} {add=[10024 (1417715439004286976)]} 0 0
[junit4:junit4]   2> 261203 T242 C12 P54818 /update {wt=javabin&version=2} {delete=[30 (-1417715439005335552)]} 0 0
[junit4:junit4]   2> 261206 T212 C11 P54803 /update {wt=javabin&version=2} {add=[34 (1417715439007432704)]} 0 1
[junit4:junit4]   2> 261207 T211 C11 P54803 /update {wt=javabin&version=2} {add=[10025 (1417715439009529856)]} 0 0
[junit4:junit4]   2> 261209 T243 C12 P54818 /update {wt=javabin&version=2} {add=[34 (1417715439010578432)]} 0 1
[junit4:junit4]   2> 261211 T240 C12 P54818 /update {wt=javabin&version=2} {add=[10025 (1417715439013724160)]} 0 1
[junit4:junit4]   2> 261214 T213 C11 P54803 /update {wt=javabin&version=2} {add=[10026 (1417715439016869888)]} 0 1
[junit4:junit4]   2> 261215 T215 C11 P54803 /update {wt=javabin&version=2} {add=[35 (1417715439014772736)]} 0 3
[junit4:junit4]   2> 261219 T238 C12 P54818 /update {wt=javabin&version=2} {add=[35 (1417715439021064192)]} 0 1
[junit4:junit4]   2> 261219 T239 C12 P54818 /update {wt=javabin&version=2} {add=[10026 (1417715439020015616)]} 0 2
[junit4:junit4]   2> 261221 T210 C11 P54803 /update {wt=javabin&version=2} {add=[36 (1417715439024209920)]} 0 1
[junit4:junit4]   2> 261222 T214 C11 P54803 /update {wt=javabin&version=2} {delete=[10025 (-1417715439025258496)]} 0 0
[junit4:junit4]   2> 261224 T242 C12 P54818 /update {wt=javabin&version=2} {add=[36 (1417715439026307072)]} 0 1
[junit4:junit4]   2> 261226 T241 C12 P54818 /update {wt=javabin&version=2} {delete=[10025 (-1417715439029452800)]} 0 0
[junit4:junit4]   2> 261228 T212 C11 P54803 /update {wt=javabin&version=2} {add=[37 (1417715439030501376)]} 0 2
[junit4:junit4]   2> 261228 T211 C11 P54803 /update {wt=javabin&version=2} {add=[10027 (1417715439031549952)]} 0 0
[junit4:junit4]   2> 261231 T243 C12 P54818 /update {wt=javabin&version=2} {add=[37 (1417715439034695680)]} 0 1
[junit4:junit4]   2> 261232 T240 C12 P54818 /update {wt=javabin&version=2} {add=[10027 (1417715439034695681)]} 0 1
[junit4:junit4]   2> 261233 T213 C11 P54803 /update {wt=javabin&version=2} {delete=[32 (-1417715439036792832)]} 0 0
[junit4:junit4]   2> 261241 T215 C11 P54803 /update {wt=javabin&version=2} {add=[10028 (1417715439038889984)]} 0 6
[junit4:junit4]   2> 261242 T238 C12 P54818 /update {wt=javabin&version=2} {delete=[32 (-1417715439046230016)]} 0 0
[junit4:junit4]   2> 261245 T210 C11 P54803 /update {wt=javabin&version=2} {add=[38 (1417715439048327168)]} 0 1
[junit4:junit4]   2> 261249 T239 C12 P54818 /update {wt=javabin&version=2} {add=[10028 (1417715439051472896)]} 0 2
[junit4:junit4]   2> 261252 T239 C12 P54818 /update {wt=javabin&version=2} {add=[38 (1417715439054618624)]} 0 2
[junit4:junit4]   2> 261254 T214 C11 P54803 /update {wt=javabin&version=2} {delete=[35 (-1417715439058812928)]} 0 0
[junit4:junit4]   2> 261256 T212 C11 P54803 /update {wt=javabin&version=2} {add=[10029 (1417715439060910080)]} 0 0
[junit4:junit4]   2> 261258 T241 C12 P54818 /update {wt=javabin&version=2} {delete=[35 (-1417715439063007232)]} 0 0
[junit4:junit4]   2> 261261 T243 C12 P54818 /update {wt=javabin&version=2} {add=[10029 (1417715439065104384)]} 0 1
[junit4:junit4]   2> 261261 T211 C11 P54803 /update {wt=javabin&version=2} {add=[39 (1417715439066152960)]} 0 0
[junit4:junit4]   2> 261264 T213 C11 P54803 /update {wt=javabin&version=2} {add=[10030 (1417715439068250112)]} 0 1
[junit4:junit4]   2> 261264 T240 C12 P54818 /update {wt=javabin&version=2} {add=[39 (1417715439068250112)]} 0 1
[junit4:junit4]   2> 261267 T215 C11 P54803 /update {wt=javabin&version=2} {delete=[39 (-1417715439072444416)]} 0 0
[junit4:junit4]   2> 261268 T238 C12 P54818 /update {wt=javabin&version=2} {add=[10030 (1417715439072444416)]} 0 1
[junit4:junit4]   2> 261270 T242 C12 P54818 /update {wt=javabin&version=2} {delete=[39 (-1417715439075590144)]} 0 0
[junit4:junit4]   2> 261275 T210 C11 P54803 /update {wt=javabin&version=2} {add=[10031 (1417715439075590144)]} 0 5
[junit4:junit4]   2> 261275 T214 C11 P54803 /update {wt=javabin&version=2} {add=[40 (1417715439080833024)]} 0 1
[junit4:junit4]   2> 261279 T241 C12 P54818 /update {wt=javabin&version=2} {add=[40 (1417715439083978752)]} 0 2
[junit4:junit4]   2> 261280 T239 C12 P54818 /update {wt=javabin&version=2} {add=[10031 (1417715439082930176)]} 0 3
[junit4:junit4]   2> 261282 T211 C11 P54803 /update {wt=javabin&version=2} {delete=[10029 (-1417715439088173057)]} 0 0
[junit4:junit4]   2> 261282 T212 C11 P54803 /update {wt=javabin&version=2} {add=[41 (1417715439088173056)]} 0 1
[junit4:junit4]   2> 261285 T243 C12 P54818 /update {wt=javabin&version=2} {delete=[10029 (-1417715439091318784)]} 0 1
[junit4:junit4]   2> 261287 T240 C12 P54818 /update {wt=javabin&version=2} {add=[41 (1417715439091318785)]} 0 3
[junit4:junit4]   2> 261289 T213 C11 P54803 /update {wt=javabin&version=2} {add=[10032 (1417715439095513088)]} 0 0
[junit4:junit4]   2> 261291 T215 C11 P54803 /update {wt=javabin&version=2} {add=[42 (1417715439095513089)]} 0 2
[junit4:junit4]   2> 261293 T238 C12 P54818 /update {wt=javabin&version=2} {add=[10032 (1417715439098658816)]} 0 1
[junit4:junit4]   2> 261294 T242 C12 P54818 /update {wt=javabin&version=2} {add=[42 (1417715439099707392)]} 0 1
[junit4:junit4]   2> 261296 T210 C11 P54803 /update {wt=javabin&version=2} {add=[10033 (1417715439102853120)]} 0 1
[junit4:junit4]   2> 261297 T214 C11 P54803 /update {wt=javabin&version=2} {add=[43 (1417715439102853121)]} 0 1
[junit4:junit4]   2> 261299 T241 C12 P54818 /update {wt=javabin&version=2} {add=[10033 (1417715439104950272)]} 0 1
[junit4:junit4]   2> 261301 T239 C12 P54818 /update {wt=javabin&version=2} {add=[43 (1417715439105998848)]} 0 2
[junit4:junit4]   2> 261302 T211 C11 P54803 /update {wt=javabin&version=2} {delete=[10030 (-1417715439109144576)]} 0 0
[junit4:junit4]   2> 261305 T212 C11 P54803 /update {wt=javabin&version=2} {add=[44 (1417715439111241728)]} 0 2
[junit4:junit4]   2> 261305 T243 C12 P54818 /update {wt=javabin&version=2} {delete=[10030 (-1417715439112290304)]} 0 0
[junit4:junit4]   2> 261307 T240 C12 P54818 /update {wt=javabin&version=2} {add=[44 (1417715439113338880)]} 0 1
[junit4:junit4]   2> 261308 T213 C11 P54803 /update {wt=javabin&version=2} {add=[10034 (1417715439114387456)]} 0 1
[junit4:junit4]   2> 261309 T215 C11 P54803 /update {wt=javabin&version=2} {delete=[42 (-1417715439116484608)]} 0 0
[junit4:junit4]   2> 261311 T238 C12 P54818 /update {wt=javabin&version=2} {add=[10034 (1417715439117533184)]} 0 1
[junit4:junit4]   2> 261312 T242 C12 P54818 /update {wt=javabin&version=2} {delete=[42 (-1417715439119630336)]} 0 0
[junit4:junit4]   2> 261314 T210 C11 P54803 /update {wt=javabin&version=2} {add=[10035 (1417715439120678912)]} 0 1
[junit4:junit4]   2> 261438 T241 C12 P54818 /update {wt=javabin&version=2} {add=[10035 (1417715439250702336)]} 0 1
[junit4:junit4]   2> 261441 T214 C11 P54803 /update {wt=javabin&version=2} {add=[45 (1417715439121727488)]} 0 127
[junit4:junit4]   2> 261444 T214 C11 P54803 /update {wt=javabin&version=2} {add=[10036 (1417715439254896640)]} 0 3
[junit4:junit4]   2> 261490 T240 C12 P54818 /update {wt=javabin&version=2} {add=[10036 (1417715439304179712)]} 0 2
[junit4:junit4]   2> 261501 T212 C11 P54803 /update {wt=javabin&version=2} {add=[10037 (1417715439316762624)]} 0 1
[junit4:junit4]   2> 261503 T243 C12 P54818 /update {wt=javabin&version=2} {add=[45 (1417715439258042368)]} 0 59
[junit4:junit4]   2> 261506 T238 C12 P54818 /update {wt=javabin&version=2} {add=[10037 (1417715439322005504)]} 0 1
[junit4:junit4]   2> 261516 T213 C11 P54803 /update {wt=javabin&version=2} {add=[46 (1417715439333539840)]} 0 0
[junit4:junit4]   2> 261519 T215 C11 P54803 /update {wt=javabin&version=2} {delete=[10032 (-1417715439335636992)]} 0 1
[junit4:junit4]   2> 261544 T242 C12 P54818 /update {wt=javabin&version=2} {add=[46 (1417715439360802816)]} 0 12
[junit4:junit4]   2> 261554 T210 C11 P54803 /update {wt=javabin&version=2} {delete=[46 (-1417715439373385728)]} 0 0
[junit4:junit4]   2> 261558 T241 C12 P54818 /update {wt=javabin&version=2} {delete=[46 (-1417715439377580032)]} 0 0
[junit4:junit4]   2> 261565 T214 C11 P54803 /update {wt=javabin&version=2} {add=[47 (1417715439383871488)]} 0 1
[junit4:junit4]   2> 261566 T239 C12 P54818 /update {wt=javabin&version=2} {delete=[10032 (-1417715439385968640)]} 0 0
[junit4:junit4]   2> 261569 T239 C12 P54818 /update {wt=javabin&version=2} {add=[47 (1417715439388065792)]} 0 1
[junit4:junit4]   2> 261573 T211 C11 P54803 /update {wt=javabin&version=2} {add=[48 (1417715439392260096)]} 0 1
[junit4:junit4]   2> 261576 T211 C11 P54803 /update {wt=javabin&version=2} {add=[10038 (1417715439395405824)]} 0 1
[junit4:junit4]   2> 261596 T243 C12 P54818 /update {wt=javabin&version=2} {add=[48 (1417715439411134464)]} 0 14
[junit4:junit4]   2> 261598 T243 C12 P54818 /update {wt=javabin&version=2} {add=[10038 (1417715439418474496)]} 0 1
[junit4:junit4]   2> 261600 T213 C11 P54803 /update {wt=javabin&version=2} {add=[49 (1417715439421620224)]} 0 0
[junit4:junit4]   2> 261602 T215 C11 P54803 /update {wt=javabin&version=2} {delete=[10035 (-1417715439423717376)]} 0 1
[junit4:junit4]   2> 261603 T242 C12 P54818 /update {wt=javabin&version=2} {add=[49 (1417715439424765952)]} 0 0
[junit4:junit4]   2> 261607 T214 C11 P54803 /update {wt=javabin&version=2} {add=[50 (1417715439426863104)]} 0 2
[junit4:junit4]   2> 261610 T196 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 54818
[junit4:junit4]   2> 261610 T196 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=28666635
[junit4:junit4]   2> 261610 T196 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@911b9f
[junit4:junit4]   2> 261633 T196 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=87,adds=87,deletesById=28,deletesByQuery=0,errors=0,cumulative_adds=87,cumulative_deletesById=28,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 261633 T196 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 261633 T196 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 261633 T196 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 261644 T196 C12 P54818 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10d2cf0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@725f5),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10d2cf0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@725f5),segFN=segments_2,generation=2,filenames=[_5_nrm.cfe, _7.si, _3.fdt, _8.tim, _8.tip, _2.tim, _8.si, _7.fnm, _7.tim, _7.tip, _5_2.del, _2.fdt, _5.doc, _7.fdx, _2.fdx, _7.fdt, _2.tip, _1.fdx, _1.fdt, _5_nrm.cfs, _3.si, _6.fdt, _2.pos, _2.si, _8.doc, _6.fdx, _3.fnm, _3_1.del, _2_nrm.cfe, _6.tip, _6.tim, _2_nrm.cfs, _0.doc, _1.tip, _1.tim, _2_2.del, _7.pos, _2.fnm, _3.fdx, _8.pos, _1.si, _6.fnm, _6.si, _3_nrm.cfe, _1.doc, _8_nrm.cfe, _5.fdt, _4.fnm, _4_nrm.cfe, _1.fnm, _2.doc, _8_1.del, _4.fdx, _4.doc, _5.tip, _6.pos, _5.tim, _6_2.del, _0.fnm, _3.doc, _5.si, _8_nrm.cfs, _3_nrm.cfs, _1_2.del, _8.fnm, _6.doc, _4_nrm.cfs, _0.tim, _0.tip, _7.doc, _7_2.del, _3.tim, _3.pos, _4_2.del, _6_nrm.cfs, _1.pos, _7_nrm.cfs, _4.tip, _0.si, _1_nrm.cfs, _5.fnm, _7_nrm.cfe, _4.tim, _5.pos, _6_nrm.cfe, _4.pos, _0_nrm.cfs, _4.fdt, _4.si, _1_nrm.cfe, _0.pos, _0_nrm.cfe, segments_2, _5.fdx, _3.tip, _0.fdx, _8.fdx, _0.fdt, _8.fdt]
[junit4:junit4]   2> 261644 T196 C12 P54818 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_5_nrm.cfe, _7.si, _3.fdt, _8.tim, _8.tip, _2.tim, _8.si, _7.fnm, _7.tim, _7.tip, _5_2.del, _2.fdt, _5.doc, _7.fdx, _2.fdx, _7.fdt, _2.tip, _1.fdx, _1.fdt, _5_nrm.cfs, _3.si, _6.fdt, _2.pos, _2.si, _8.doc, _6.fdx, _3.fnm, _3_1.del, _2_nrm.cfe, _6.tip, _6.tim, _2_nrm.cfs, _0.doc, _1.tip, _1.tim, _2_2.del, _7.pos, _2.fnm, _3.fdx, _8.pos, _1.si, _6.fnm, _6.si, _3_nrm.cfe, _1.doc, _8_nrm.cfe, _5.fdt, _4.fnm, _4_nrm.cfe, _1.fnm, _2.doc, _8_1.del, _4.fdx, _4.doc, _5.tip, _6.pos, _5.tim, _6_2.del, _0.fnm, _3.doc, _5.si, _8_nrm.cfs, _3_nrm.cfs, _1_2.del, _8.fnm, _6.doc, _4_nrm.cfs, _0.tim, _0.tip, _7.doc, _7_2.del, _3.tim, _3.pos, _4_2.del, _6_nrm.cfs, _1.pos, _7_nrm.cfs, _4.tip, _0.si, _1_nrm.cfs, _5.fnm, _7_nrm.cfe, _4.tim, _5.pos, _6_nrm.cfe, _4.pos, _0_nrm.cfs, _4.fdt, _4.si, _1_nrm.cfe, _0.pos, _0_nrm.cfe, segments_2, _5.fdx, _3.tip, _0.fdx, _8.fdx, _0.fdt, _8.fdt]
[junit4:junit4]   2> 261678 T196 C12 P54818 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10d2cf0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@725f5),segFN=segments_2,generation=2,filenames=[_5_nrm.cfe, _7.si, _3.fdt, _8.tim, _8.tip, _2.tim, _8.si, _7.fnm, _7.tim, _7.tip, _5_2.del, _2.fdt, _5.doc, _7.fdx, _2.fdx, _7.fdt, _2.tip, _1.fdx, _1.fdt, _5_nrm.cfs, _3.si, _6.fdt, _2.pos, _2.si, _8.doc, _6.fdx, _3.fnm, _3_1.del, _2_nrm.cfe, _6.tip, _6.tim, _2_nrm.cfs, _0.doc, _1.tip, _1.tim, _2_2.del, _7.pos, _2.fnm, _3.fdx, _8.pos, _1.si, _6.fnm, _6.si, _3_nrm.cfe, _1.doc, _8_nrm.cfe, _5.fdt, _4.fnm, _4_nrm.cfe, _1.fnm, _2.doc, _8_1.del, _4.fdx, _4.doc, _5.tip, _6.pos, _5.tim, _6_2.del, _0.fnm, _3.doc, _5.si, _8_nrm.cfs, _3_nrm.cfs, _1_2.del, _8.fnm, _6.doc, _4_nrm.cfs, _0.tim, _0.tip, _7.doc, _7_2.del, _3.tim, _3.pos, _4_2.del, _6_nrm.cfs, _1.pos, _7_nrm.cfs, _4.tip, _0.si, _1_nrm.cfs, _5.fnm, _7_nrm.cfe, _4.tim, _5.pos, _6_nrm.cfe, _4.pos, _0_nrm.cfs, _4.fdt, _4.si, _1_nrm.cfe, _0.pos, _0_nrm.cfe, segments_2, _5.fdx, _3.tip, _0.fdx, _8.fdx, _0.fdt, _8.fdt]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10d2cf0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@725f5),segFN=segments_3,generation=3,filenames=[_8_nrm.cfe, _8.doc, _9_nrm.cfe, _9.fnm, _9.fdt, _8.tim, _9.tip, _9.pos, _9.fdx, _8.tip, _8_1.del, _9.tim, _8_nrm.cfs, _8.si, _8.fnm, _8.pos, _9.doc, _9_nrm.cfs, _9.si, _8.fdx, segments_3, _8.fdt]
[junit4:junit4]   2> 261678 T196 C12 P54818 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_8_nrm.cfe, _8.doc, _9_nrm.cfe, _9.fnm, _9.fdt, _8.tim, _9.tip, _9.pos, _9.fdx, _8.tip, _8_1.del, _9.tim, _8_nrm.cfs, _8.si, _8.fnm, _8.pos, _9.doc, _9_nrm.cfs, _9.si, _8.fdx, segments_3, _8.fdt]
[junit4:junit4]   2> 261678 T196 C12 P54818 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\jetty2\index
[junit4:junit4]   2> 261678 T196 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 261678 T196 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352038540954\jetty2\index
[junit4:junit4]   2> 261689 T201 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13acbc6e6ad0005
[junit4:junit4]   2> REQUEST FAILED:
[junit4:junit4]   2> org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:54818/solr/collection1]
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:324)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:269)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.SolrServer.deleteById(SolrServer.java:239)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.SolrServer.deleteById(SolrServer.java:225)
[junit4:junit4]   2> 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase$StopableIndexingThread.run(AbstractFullDistribZkTestBase.java:1034)
[junit4:junit4]   2> Caused by: org.apache.solr.common.SolrException: Server at http://127.0.0.1:54818/solr/collection1 returned non ok status:404, message:Can not find: /solr/collection1/update
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:255)
[junit4:junit4]   2> 	... 5 more
[junit4:junit4]   2> ROOT CAUSE:
[junit4:junit4]   2> org.apache.solr.common.SolrException: Server at http://127.0.0.1:54818/solr/collection1 returned non ok status:404, message:Can not find: /solr/collection1/update
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:255)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:269)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.SolrServer.deleteById(SolrServer.java:239)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.SolrServer.deleteById(SolrServer.java:225)
[junit4:junit4]   2> 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase$StopableIndexingThread.run(AbstractFullDistribZkTestBase.java:1034)
[junit4:junit4]   2> REQUEST FAILED:
[junit4:junit4]   2> org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:54818/solr/collection1]
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:324)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:269)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4:junit4]   2> 	at org.apache.solr.cloud.RecoveryZkTest.indexDoc(RecoveryZkTest.java:110)
[junit4:junit4]   2> 	at org.apache.solr.cloud.RecoveryZkTest.indexr(RecoveryZkTest.java:131)
[junit4:junit4]   2> 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.access$200(AbstractFullDistribZkTestBase.java:69)
[junit4:junit4]   2> 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase$StopableIndexingThread.run(AbstractFullDistribZkTestBase.java:1048)
[junit4:junit4]   2> Caused by: org.apache.solr.common.SolrException: Server at http://127.0.0.1:54818/solr/collection1 returned non ok status:404, message:Can not find: /solr/collection1/update
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:255)
[junit4:junit4]   2> 	... 8 more
[junit4:junit4]   2> ROOT CAUSE:
[junit4:junit4]   2> org.apache.solr.common.SolrException: Server at http://127.0.0.1:54818/solr/collection1 returned non ok status:404, message:Can not find: /solr/collection1/update
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:255)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:269)
[junit4:junit4]   2> 	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit

[...truncated too long message...]

te.json (0)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       {
[junit4:junit4]   1>         "collection1":{"shard1":{
[junit4:junit4]   1>             "range":"80000000-7fffffff",
[junit4:junit4]   1>             "replicas":{
[junit4:junit4]   1>               "127.0.0.1:54812_solr_collection1":{
[junit4:junit4]   1>                 "shard":null,
[junit4:junit4]   1>                 "roles":null,
[junit4:junit4]   1>                 "state":"down",
[junit4:junit4]   1>                 "core":"collection1",
[junit4:junit4]   1>                 "collection":"collection1",
[junit4:junit4]   1>                 "node_name":"127.0.0.1:54812_solr",
[junit4:junit4]   1>                 "base_url":"http://127.0.0.1:54812/solr"},
[junit4:junit4]   1>               "127.0.0.1:54818_solr_collection1":{
[junit4:junit4]   1>                 "shard":"shard1",
[junit4:junit4]   1>                 "roles":null,
[junit4:junit4]   1>                 "state":"active",
[junit4:junit4]   1>                 "core":"collection1",
[junit4:junit4]   1>                 "collection":"collection1",
[junit4:junit4]   1>                 "node_name":"127.0.0.1:54818_solr",
[junit4:junit4]   1>                 "base_url":"http://127.0.0.1:54818/solr",
[junit4:junit4]   1>                 "leader":"true"}}}},
[junit4:junit4]   1>         "control_collection":{"control_shard":{"replicas":{"127.0.0.1:54803_solr_collection1":{
[junit4:junit4]   1>                 "shard":"control_shard",
[junit4:junit4]   1>                 "roles":null,
[junit4:junit4]   1>                 "state":"active",
[junit4:junit4]   1>                 "core":"collection1",
[junit4:junit4]   1>                 "collection":"control_collection",
[junit4:junit4]   1>                 "node_name":"127.0.0.1:54803_solr",
[junit4:junit4]   1>                 "base_url":"http://127.0.0.1:54803/solr",
[junit4:junit4]   1>                 "leader":"true"}}}}}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=RecoveryZkTest -Dtests.method=testDistribSearch -Dtests.seed=7590DF627C07359D -Dtests.slow=true -Dtests.locale=sr_CS -Dtests.timezone=Asia/Beirut -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE  636s | RecoveryZkTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 180 seconds
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([7590DF627C07359D:F476517A0B5855A1]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:166)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:116)
[junit4:junit4]    > 	at org.apache.solr.cloud.RecoveryZkTest.doTest(RecoveryZkTest.java:76)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:695)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:597)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 636391 T196 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=sr_CS, timezone=Asia/Beirut
[junit4:junit4]   2> NOTE: Windows 7 6.1 x86/Sun Microsystems Inc. 1.6.0_37 (32-bit)/cpus=2,threads=2,free=24540136,total=154009600
[junit4:junit4]   2> NOTE: All tests run in this JVM: [SolrCoreTest, TimeZoneUtilsTest, TestFoldingMultitermQuery, ZkNodePropsTest, BadComponentTest, SimplePostToolTest, TestPropInject, ReturnFieldsTest, TestPropInjectDefaults, TestStressVersions, SuggesterTest, TestMergePolicyConfig, ZkCLITest, WordBreakSolrSpellCheckerTest, TestWriterPerf, TestSurroundQueryParser, TestStressRecovery, TestFunctionQuery, RecoveryZkTest]
[junit4:junit4] Completed in 636.42s, 1 test, 1 failure <<< FAILURES!

[...truncated 663 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:335: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:178: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\module-build.xml:61: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1163: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:827: There were test failures: 233 suites, 965 tests, 1 failure, 12 ignored (7 assumptions)

Total time: 50 minutes 16 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.6.0_37 -server -XX:+UseParallelGC
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message