lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1327 - Failure
Date Sun, 10 Feb 2013 23:38:40 GMT
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java6/1327/

1 tests failed.
REGRESSION:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:40381/collection1skip list:[org.apache.solr.cloud.AbstractFullDistribZkTestBase$CloudJettyRunner@c9bcdec9, org.apache.solr.cloud.AbstractFullDistribZkTestBase$CloudJettyRunner@5f759eab]

Stack Trace:
java.lang.AssertionError: Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:40381/collection1skip list:[org.apache.solr.cloud.AbstractFullDistribZkTestBase$CloudJettyRunner@c9bcdec9, org.apache.solr.cloud.AbstractFullDistribZkTestBase$CloudJettyRunner@5f759eab]
	at __randomizedtesting.SeedInfo.seed([F00AC301D9327D42:71EC4D19AE6D1D7E]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:216)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:794)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:616)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:679)




Build Log:
[...truncated 8745 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4]   2> 1 T2696 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4]   2> 4 T2696 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1360538600978
[junit4:junit4]   2> 5 T2696 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 6 T2697 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 9 T2697 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 9 T2697 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 9 T2697 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 10 T2697 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 10 T2697 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 107 T2696 oasc.ZkTestServer.run start zk server on port:40340
[junit4:junit4]   2> 107 T2696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40340 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@530eec08
[junit4:junit4]   2> 108 T2696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 108 T2702 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40340. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 109 T2702 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40340, initiating session
[junit4:junit4]   2> 109 T2698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:40341
[junit4:junit4]   2> 110 T2698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:40341
[junit4:junit4]   2> 110 T2700 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 112 T2700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cc66b86180000 with negotiated timeout 10000 for client /140.211.11.196:40341
[junit4:junit4]   2> 112 T2702 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40340, sessionid = 0x13cc66b86180000, negotiated timeout = 10000
[junit4:junit4]   2> 112 T2703 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@530eec08 name:ZooKeeperConnection Watcher:127.0.0.1:40340 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 112 T2696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 113 T2696 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 116 T2701 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cc66b86180000
[junit4:junit4]   2> 123 T2703 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 123 T2698 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:40341 which had sessionid 0x13cc66b86180000
[junit4:junit4]   2> 123 T2696 oaz.ZooKeeper.close Session: 0x13cc66b86180000 closed
[junit4:junit4]   2> 124 T2696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40340/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4402789
[junit4:junit4]   2> 125 T2696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 125 T2704 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40340. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 125 T2704 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40340, initiating session
[junit4:junit4]   2> 126 T2698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:40342
[junit4:junit4]   2> 126 T2698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:40342
[junit4:junit4]   2> 127 T2700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cc66b86180001 with negotiated timeout 10000 for client /140.211.11.196:40342
[junit4:junit4]   2> 127 T2704 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40340, sessionid = 0x13cc66b86180001, negotiated timeout = 10000
[junit4:junit4]   2> 127 T2705 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4402789 name:ZooKeeperConnection Watcher:127.0.0.1:40340/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 127 T2696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 128 T2696 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 138 T2696 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 140 T2696 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 143 T2696 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 152 T2696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 153 T2696 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 165 T2696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 166 T2696 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 292 T2696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 293 T2696 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 315 T2696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 316 T2696 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 336 T2696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 337 T2696 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 341 T2696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 342 T2696 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 369 T2696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 370 T2696 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 413 T2696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 414 T2696 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 471 T2696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 472 T2696 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 525 T2701 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cc66b86180001
[junit4:junit4]   2> 568 T2705 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 568 T2698 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:40342 which had sessionid 0x13cc66b86180001
[junit4:junit4]   2> 568 T2696 oaz.ZooKeeper.close Session: 0x13cc66b86180001 closed
[junit4:junit4]   2> 731 T2696 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 735 T2696 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:40346
[junit4:junit4]   2> 736 T2696 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 736 T2696 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 737 T2696 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1360538601541
[junit4:junit4]   2> 737 T2696 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1360538601541/solr.xml
[junit4:junit4]   2> 737 T2696 oasc.CoreContainer.<init> New CoreContainer 426102109
[junit4:junit4]   2> 738 T2696 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1360538601541/'
[junit4:junit4]   2> 739 T2696 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1360538601541/'
[junit4:junit4]   2> 786 T2696 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4]   2> 786 T2696 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 787 T2696 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 787 T2696 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 788 T2696 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 788 T2696 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 789 T2696 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 789 T2696 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 789 T2696 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 790 T2696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4]   2> 810 T2696 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 829 T2696 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:40340/solr
[junit4:junit4]   2> 830 T2696 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 830 T2696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40340 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7872a21d
[junit4:junit4]   2> 831 T2696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 832 T2715 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40340. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 832 T2715 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40340, initiating session
[junit4:junit4]   2> 832 T2698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:40347
[junit4:junit4]   2> 833 T2698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:40347
[junit4:junit4]   2> 837 T2700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cc66b86180002 with negotiated timeout 20000 for client /140.211.11.196:40347
[junit4:junit4]   2> 837 T2715 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40340, sessionid = 0x13cc66b86180002, negotiated timeout = 20000
[junit4:junit4]   2> 837 T2716 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7872a21d name:ZooKeeperConnection Watcher:127.0.0.1:40340 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 838 T2696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 839 T2701 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cc66b86180002
[junit4:junit4]   2> 840 T2716 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 841 T2698 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:40347 which had sessionid 0x13cc66b86180002
[junit4:junit4]   2> 840 T2696 oaz.ZooKeeper.close Session: 0x13cc66b86180002 closed
[junit4:junit4]   2> 841 T2696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4]   2> 852 T2696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40340/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@4b2c205c
[junit4:junit4]   2> 853 T2696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 853 T2717 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40340. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 853 T2717 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40340, initiating session
[junit4:junit4]   2> 854 T2698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:40348
[junit4:junit4]   2> 854 T2698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:40348
[junit4:junit4]   2> 855 T2700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cc66b86180003 with negotiated timeout 20000 for client /140.211.11.196:40348
[junit4:junit4]   2> 855 T2717 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40340, sessionid = 0x13cc66b86180003, negotiated timeout = 20000
[junit4:junit4]   2> 856 T2718 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b2c205c name:ZooKeeperConnection Watcher:127.0.0.1:40340/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 856 T2696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 858 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b86180003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 867 T2696 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 869 T2696 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40346_
[junit4:junit4]   2> 870 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b86180003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:40346_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:40346_
[junit4:junit4]   2> 871 T2696 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40346_
[junit4:junit4]   2> 880 T2696 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 892 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b86180003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 893 T2696 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 900 T2696 oasc.Overseer.start Overseer (id=89164257754087427-127.0.0.1:40346_-n_0000000000) starting
[junit4:junit4]   2> 901 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b86180003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 902 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b86180003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 904 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b86180003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 913 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b86180003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 914 T2720 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 915 T2696 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 925 T2696 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 927 T2719 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 932 T2721 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1360538601541/collection1
[junit4:junit4]   2> 932 T2721 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 933 T2721 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 933 T2721 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 934 T2721 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1360538601541/collection1/'
[junit4:junit4]   2> 935 T2721 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1360538601541/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 936 T2721 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1360538601541/collection1/lib/README' to classloader
[junit4:junit4]   2> 989 T2721 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 1061 T2721 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1162 T2721 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 1168 T2721 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1773 T2721 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1781 T2721 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1784 T2721 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1795 T2721 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1799 T2721 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1802 T2721 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1803 T2721 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1804 T2721 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1360538601541/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1360538600977/control/data/
[junit4:junit4]   2> 1804 T2721 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2031688f
[junit4:junit4]   2> 1804 T2721 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 1805 T2721 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/control/data forceNew:false
[junit4:junit4]   2> 1806 T2721 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/control/data
[junit4:junit4]   2> 1806 T2721 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1360538600977/control/data/index/
[junit4:junit4]   2> 1806 T2721 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1360538600977/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1807 T2721 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/control/data/index forceNew:false
[junit4:junit4]   2> 1837 T2721 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6dc1d598; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1837 T2721 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1838 T2721 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/control/data/index
[junit4:junit4]   2> 1838 T2721 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1839 T2721 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1840 T2721 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1840 T2721 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1840 T2721 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1840 T2721 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1841 T2721 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1841 T2721 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1841 T2721 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1841 T2721 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1842 T2721 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1842 T2721 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1842 T2721 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1843 T2721 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1843 T2721 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1843 T2721 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1843 T2721 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1843 T2721 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1844 T2721 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1844 T2721 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1844 T2721 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1845 T2721 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1845 T2721 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1845 T2721 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1845 T2721 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1846 T2721 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1846 T2721 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1851 T2721 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1853 T2721 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1854 T2721 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1856 T2721 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/control/data
[junit4:junit4]   2> 1857 T2721 oass.SolrIndexSearcher.<init> Opening Searcher@7d209145 main
[junit4:junit4]   2> 1858 T2721 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1858 T2721 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1858 T2721 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1872 T2721 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1912 T2722 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7d209145 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1914 T2721 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1914 T2721 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1915 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b86180003 type:create cxid:0x51 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 2430 T2719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2431 T2719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40346_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40346"}
[junit4:junit4]   2> 2431 T2719 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 2431 T2719 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2431 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b86180003 type:create cxid:0x59 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 2452 T2718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2926 T2721 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2926 T2721 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40346 collection:control_collection shard:shard1
[junit4:junit4]   2> 2927 T2721 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 2943 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b86180003 type:delete cxid:0x73 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2944 T2721 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2944 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b86180003 type:create cxid:0x74 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2946 T2721 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2946 T2721 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2947 T2721 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40346/collection1/
[junit4:junit4]   2> 2947 T2721 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2947 T2721 oasc.SyncStrategy.syncToMe http://127.0.0.1:40346/collection1/ has no replicas
[junit4:junit4]   2> 2947 T2721 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40346/collection1/
[junit4:junit4]   2> 2948 T2721 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 2951 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b86180003 type:create cxid:0x7e zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3955 T2719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3976 T2718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 4024 T2721 oasc.ZkController.register We are http://127.0.0.1:40346/collection1/ and leader is http://127.0.0.1:40346/collection1/
[junit4:junit4]   2> 4024 T2721 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40346
[junit4:junit4]   2> 4024 T2721 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 4024 T2721 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 4025 T2721 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4027 T2721 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4028 T2696 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 4028 T2696 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 4029 T2696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 4042 T2696 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 4050 T2696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40340/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2c6a309a
[junit4:junit4]   2> 4051 T2696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4052 T2723 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40340. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4052 T2723 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40340, initiating session
[junit4:junit4]   2> 4052 T2698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:40352
[junit4:junit4]   2> 4053 T2698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:40352
[junit4:junit4]   2> 4054 T2700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cc66b86180004 with negotiated timeout 10000 for client /140.211.11.196:40352
[junit4:junit4]   2> 4054 T2723 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40340, sessionid = 0x13cc66b86180004, negotiated timeout = 10000
[junit4:junit4]   2> 4054 T2724 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c6a309a name:ZooKeeperConnection Watcher:127.0.0.1:40340/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4055 T2696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4056 T2696 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4058 T2696 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 4220 T2696 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 4223 T2696 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:40353
[junit4:junit4]   2> 4224 T2696 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 4224 T2696 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4225 T2696 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1360538605031
[junit4:junit4]   2> 4225 T2696 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1360538605031/solr.xml
[junit4:junit4]   2> 4226 T2696 oasc.CoreContainer.<init> New CoreContainer 1526277919
[junit4:junit4]   2> 4227 T2696 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1360538605031/'
[junit4:junit4]   2> 4227 T2696 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1360538605031/'
[junit4:junit4]   2> 4274 T2696 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4]   2> 4274 T2696 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4275 T2696 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 4275 T2696 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4275 T2696 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4276 T2696 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4276 T2696 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4277 T2696 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4277 T2696 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4278 T2696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4]   2> 4296 T2696 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4315 T2696 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:40340/solr
[junit4:junit4]   2> 4316 T2696 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4316 T2696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40340 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@474c4184
[junit4:junit4]   2> 4317 T2696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4318 T2734 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40340. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4318 T2734 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40340, initiating session
[junit4:junit4]   2> 4318 T2698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:40354
[junit4:junit4]   2> 4319 T2698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:40354
[junit4:junit4]   2> 4320 T2700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cc66b86180005 with negotiated timeout 20000 for client /140.211.11.196:40354
[junit4:junit4]   2> 4321 T2734 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40340, sessionid = 0x13cc66b86180005, negotiated timeout = 20000
[junit4:junit4]   2> 4321 T2735 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@474c4184 name:ZooKeeperConnection Watcher:127.0.0.1:40340 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4321 T2696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4323 T2701 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cc66b86180005
[junit4:junit4]   2> 4324 T2735 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4324 T2698 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:40354 which had sessionid 0x13cc66b86180005
[junit4:junit4]   2> 4324 T2696 oaz.ZooKeeper.close Session: 0x13cc66b86180005 closed
[junit4:junit4]   2> 4324 T2696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4]   2> 4333 T2696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40340/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3a2a05b6
[junit4:junit4]   2> 4334 T2696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4334 T2736 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40340. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4335 T2736 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40340, initiating session
[junit4:junit4]   2> 4335 T2698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:40355
[junit4:junit4]   2> 4336 T2698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:40355
[junit4:junit4]   2> 4337 T2700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cc66b86180006 with negotiated timeout 20000 for client /140.211.11.196:40355
[junit4:junit4]   2> 4337 T2736 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40340, sessionid = 0x13cc66b86180006, negotiated timeout = 20000
[junit4:junit4]   2> 4337 T2737 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a2a05b6 name:ZooKeeperConnection Watcher:127.0.0.1:40340/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4337 T2696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4338 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b86180006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4340 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b86180006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4348 T2696 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4350 T2696 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40353_
[junit4:junit4]   2> 4351 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b86180006 type:delete cxid:0x9 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:40353_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:40353_
[junit4:junit4]   2> 4352 T2696 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40353_
[junit4:junit4]   2> 4359 T2718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 4360 T2724 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4360 T2737 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4361 T2718 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4368 T2738 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1360538605031/collection1
[junit4:junit4]   2> 4368 T2738 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 4369 T2738 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 4369 T2738 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 4370 T2738 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1360538605031/collection1/'
[junit4:junit4]   2> 4371 T2738 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1360538605031/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 4372 T2738 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1360538605031/collection1/lib/README' to classloader
[junit4:junit4]   2> 4426 T2738 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 4497 T2738 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4598 T2738 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4604 T2738 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5305 T2738 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5318 T2738 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5323 T2738 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5337 T2738 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5343 T2738 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5350 T2738 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5351 T2738 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5353 T2738 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1360538605031/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1/
[junit4:junit4]   2> 5353 T2738 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2031688f
[junit4:junit4]   2> 5353 T2738 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 5354 T2738 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1 forceNew:false
[junit4:junit4]   2> 5355 T2738 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1
[junit4:junit4]   2> 5355 T2738 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1/index/
[junit4:junit4]   2> 5356 T2738 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5357 T2738 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1/index forceNew:false
[junit4:junit4]   2> 5417 T2738 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10d65e73; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5418 T2738 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 5419 T2738 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1/index
[junit4:junit4]   2> 5420 T2738 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5421 T2738 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5422 T2738 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5422 T2738 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5422 T2738 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5423 T2738 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5423 T2738 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5423 T2738 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5424 T2738 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5424 T2738 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5425 T2738 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 5425 T2738 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 5426 T2738 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5426 T2738 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 5426 T2738 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 5427 T2738 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 5427 T2738 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5428 T2738 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5428 T2738 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5429 T2738 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5429 T2738 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5430 T2738 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5430 T2738 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5431 T2738 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5431 T2738 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5432 T2738 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 5432 T2738 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 5443 T2738 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5449 T2738 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 5450 T2738 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 5453 T2738 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1
[junit4:junit4]   2> 5455 T2738 oass.SolrIndexSearcher.<init> Opening Searcher@5fdf3826 main
[junit4:junit4]   2> 5456 T2738 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5456 T2738 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5456 T2738 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5491 T2719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5492 T2719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40346_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40346"}
[junit4:junit4]   2> 5498 T2738 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5534 T2737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5534 T2724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5534 T2718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5587 T2739 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5fdf3826 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5591 T2738 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5592 T2738 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7045 T2719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7046 T2719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40353_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40353"}
[junit4:junit4]   2> 7046 T2719 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 7046 T2719 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 7070 T2737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7070 T2718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7070 T2724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7595 T2738 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 7595 T2738 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40353 collection:collection1 shard:shard1
[junit4:junit4]   2> 7596 T2738 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 7610 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b86180006 type:delete cxid:0x47 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 7616 T2738 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 7616 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b86180006 type:create cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7619 T2738 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 7619 T2738 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 7619 T2738 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40353/collection1/
[junit4:junit4]   2> 7620 T2738 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 7620 T2738 oasc.SyncStrategy.syncToMe http://127.0.0.1:40353/collection1/ has no replicas
[junit4:junit4]   2> 7620 T2738 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40353/collection1/
[junit4:junit4]   2> 7620 T2738 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 7629 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b86180006 type:create cxid:0x52 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8574 T2719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8627 T2718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8627 T2737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8627 T2724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8657 T2738 oasc.ZkController.register We are http://127.0.0.1:40353/collection1/ and leader is http://127.0.0.1:40353/collection1/
[junit4:junit4]   2> 8657 T2738 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40353
[junit4:junit4]   2> 8657 T2738 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 8657 T2738 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 8658 T2738 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8659 T2738 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8660 T2696 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 8661 T2696 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 8662 T2696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8992 T2696 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 8996 T2696 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:40381
[junit4:junit4]   2> 8997 T2696 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 8998 T2696 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 8998 T2696 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1360538609650
[junit4:junit4]   2> 8999 T2696 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1360538609650/solr.xml
[junit4:junit4]   2> 8999 T2696 oasc.CoreContainer.<init> New CoreContainer 226885312
[junit4:junit4]   2> 9000 T2696 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1360538609650/'
[junit4:junit4]   2> 9001 T2696 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1360538609650/'
[junit4:junit4]   2> 9128 T2696 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4]   2> 9129 T2696 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 9130 T2696 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 9130 T2696 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 9131 T2696 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 9132 T2696 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 9132 T2696 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 9133 T2696 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 9134 T2696 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 9135 T2696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4]   2> 9177 T2696 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 9215 T2696 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:40340/solr
[junit4:junit4]   2> 9216 T2696 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 9217 T2696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40340 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@d23b4d8
[junit4:junit4]   2> 9219 T2696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9219 T2749 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40340. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 9220 T2749 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40340, initiating session
[junit4:junit4]   2> 9221 T2698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:40382
[junit4:junit4]   2> 9221 T2698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:40382
[junit4:junit4]   2> 9225 T2700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cc66b86180007 with negotiated timeout 20000 for client /140.211.11.196:40382
[junit4:junit4]   2> 9225 T2749 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40340, sessionid = 0x13cc66b86180007, negotiated timeout = 20000
[junit4:junit4]   2> 9226 T2750 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d23b4d8 name:ZooKeeperConnection Watcher:127.0.0.1:40340 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9226 T2696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9232 T2701 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cc66b86180007
[junit4:junit4]   2> 9234 T2750 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 9234 T2698 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:40382 which had sessionid 0x13cc66b86180007
[junit4:junit4]   2> 9234 T2696 oaz.ZooKeeper.close Session: 0x13cc66b86180007 closed
[junit4:junit4]   2> 9235 T2696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4]   2> 9250 T2696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40340/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@5138cd49
[junit4:junit4]   2> 9253 T2751 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40340. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 9253 T2696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9253 T2751 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40340, initiating session
[junit4:junit4]   2> 9254 T2698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:40383
[junit4:junit4]   2> 9254 T2698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:40383
[junit4:junit4]   2> 9257 T2700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cc66b86180008 with negotiated timeout 20000 for client /140.211.11.196:40383
[junit4:junit4]   2> 9257 T2751 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40340, sessionid = 0x13cc66b86180008, negotiated timeout = 20000
[junit4:junit4]   2> 9258 T2752 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5138cd49 name:ZooKeeperConnection Watcher:127.0.0.1:40340/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9258 T2696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9262 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b86180008 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9264 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b86180008 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9278 T2696 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 9286 T2696 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40381_
[junit4:junit4]   2> 9289 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b86180008 type:delete cxid:0x9 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:40381_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:40381_
[junit4:junit4]   2> 9290 T2696 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40381_
[junit4:junit4]   2> 9297 T2724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9297 T2718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9297 T2737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9300 T2752 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9302 T2718 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9302 T2737 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9304 T2724 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9321 T2753 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1360538609650/collection1
[junit4:junit4]   2> 9321 T2753 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 9322 T2753 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 9323 T2753 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 9326 T2753 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1360538609650/collection1/'
[junit4:junit4]   2> 9330 T2753 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1360538609650/collection1/lib/README' to classloader
[junit4:junit4]   2> 9332 T2753 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1360538609650/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 9450 T2753 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 9569 T2753 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 9670 T2753 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 9681 T2753 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 10143 T2719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10144 T2719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40353_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40353"}
[junit4:junit4]   2> 10171 T2718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10171 T2752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10171 T2737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10171 T2724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11181 T2753 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 11206 T2753 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 11211 T2753 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 11229 T2753 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 11238 T2753 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 11243 T2753 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 11244 T2753 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 11245 T2753 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1360538609650/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2/
[junit4:junit4]   2> 11245 T2753 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2031688f
[junit4:junit4]   2> 11246 T2753 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 11248 T2753 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2 forceNew:false
[junit4:junit4]   2> 11250 T2753 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2
[junit4:junit4]   2> 11250 T2753 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2/index/
[junit4:junit4]   2> 11251 T2753 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 11252 T2753 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2/index forceNew:false
[junit4:junit4]   2> 11267 T2753 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d8aea1f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 11268 T2753 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 11269 T2753 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2/index
[junit4:junit4]   2> 11270 T2753 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 11271 T2753 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 11272 T2753 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 11272 T2753 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 11272 T2753 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 11273 T2753 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 11273 T2753 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 11273 T2753 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 11274 T2753 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 11275 T2753 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 11275 T2753 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 11276 T2753 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 11276 T2753 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 11276 T2753 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 11277 T2753 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 11277 T2753 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 11278 T2753 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 11279 T2753 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11279 T2753 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11280 T2753 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11280 T2753 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11281 T2753 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11281 T2753 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11282 T2753 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11282 T2753 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11283 T2753 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 11283 T2753 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 11292 T2753 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 11297 T2753 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 11299 T2753 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 11302 T2753 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2
[junit4:junit4]   2> 11304 T2753 oass.SolrIndexSearcher.<init> Opening Searcher@360b058d main
[junit4:junit4]   2> 11305 T2753 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 11305 T2753 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 11305 T2753 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 11327 T2753 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 11397 T2754 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@360b058d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 11401 T2753 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 11401 T2753 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11683 T2719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11684 T2719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40381_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40381"}
[junit4:junit4]   2> 11685 T2719 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 11685 T2719 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 11728 T2718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11728 T2752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11728 T2737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11728 T2724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12404 T2753 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 12404 T2753 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40381 collection:collection1 shard:shard1
[junit4:junit4]   2> 12407 T2753 oasc.ZkController.register We are http://127.0.0.1:40381/collection1/ and leader is http://127.0.0.1:40353/collection1/
[junit4:junit4]   2> 12407 T2753 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40381
[junit4:junit4]   2> 12408 T2753 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 12408 T2753 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C168 name=collection1 org.apache.solr.core.SolrCore@35d4cbb2 url=http://127.0.0.1:40381/collection1 node=127.0.0.1:40381_ C168_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:40381_, base_url=http://127.0.0.1:40381}
[junit4:junit4]   2> 12408 T2755 C168 P40381 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 12409 T2753 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12409 T2755 C168 P40381 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 12410 T2755 C168 P40381 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 12410 T2755 C168 P40381 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 12410 T2696 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 12410 T2696 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 12411 T2696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 12474 T2755 C168 P40381 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 12525 T2696 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 12527 T2696 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:40386
[junit4:junit4]   2> 12528 T2696 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 12528 T2696 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 12529 T2696 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1360538613392
[junit4:junit4]   2> 12529 T2696 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1360538613392/solr.xml
[junit4:junit4]   2> 12529 T2696 oasc.CoreContainer.<init> New CoreContainer 849281969
[junit4:junit4]   2> 12530 T2696 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1360538613392/'
[junit4:junit4]   2> 12530 T2696 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1360538613392/'
[junit4:junit4]   2> 12561 T2696 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4]   2> 12561 T2696 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 12561 T2696 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 12562 T2696 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 12562 T2696 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 12562 T2696 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 12563 T2696 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 12563 T2696 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 12563 T2696 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 12564 T2696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4]   2> 12575 T2696 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 12588 T2696 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:40340/solr
[junit4:junit4]   2> 12588 T2696 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 12589 T2696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40340 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5b272d40
[junit4:junit4]   2> 12590 T2696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12590 T2765 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40340. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 12590 T2765 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40340, initiating session
[junit4:junit4]   2> 12591 T2698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:40387
[junit4:junit4]   2> 12591 T2698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:40387
[junit4:junit4]   2> 12592 T2700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cc66b86180009 with negotiated timeout 20000 for client /140.211.11.196:40387
[junit4:junit4]   2> 12592 T2765 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40340, sessionid = 0x13cc66b86180009, negotiated timeout = 20000
[junit4:junit4]   2> 12593 T2766 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b272d40 name:ZooKeeperConnection Watcher:127.0.0.1:40340 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12593 T2696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12594 T2701 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cc66b86180009
[junit4:junit4]   2> 12595 T2766 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 12595 T2698 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:40387 which had sessionid 0x13cc66b86180009
[junit4:junit4]   2> 12595 T2696 oaz.ZooKeeper.close Session: 0x13cc66b86180009 closed
[junit4:junit4]   2> 12596 T2696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4]   2> 12601 T2696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40340/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@19b0d594
[junit4:junit4]   2> 12602 T2696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12602 T2767 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40340. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 12602 T2767 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40340, initiating session
[junit4:junit4]   2> 12603 T2698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:40388
[junit4:junit4]   2> 12603 T2698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:40388
[junit4:junit4]   2> 12604 T2700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cc66b8618000a with negotiated timeout 20000 for client /140.211.11.196:40388
[junit4:junit4]   2> 12604 T2767 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40340, sessionid = 0x13cc66b8618000a, negotiated timeout = 20000
[junit4:junit4]   2> 12604 T2768 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19b0d594 name:ZooKeeperConnection Watcher:127.0.0.1:40340/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12605 T2696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12605 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b8618000a type:create cxid:0x1 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12606 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b8618000a type:create cxid:0x2 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12616 T2696 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 12617 T2696 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40386_
[junit4:junit4]   2> 12618 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b8618000a type:delete cxid:0x9 zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:40386_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:40386_
[junit4:junit4]   2> 12619 T2696 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40386_
[junit4:junit4]   2> 12626 T2718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12626 T2724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12626 T2737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12626 T2768 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 12626 T2752 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 12626 T2752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12627 T2718 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 12628 T2724 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 12628 T2737 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 12632 T2769 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1360538613392/collection1
[junit4:junit4]   2> 12632 T2769 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 12633 T2769 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 12633 T2769 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 12634 T2769 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1360538613392/collection1/'
[junit4:junit4]   2> 12635 T2769 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1360538613392/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 12635 T2769 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1360538613392/collection1/lib/README' to classloader
[junit4:junit4]   2> 12677 T2769 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 12728 T2769 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 12829 T2769 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 12836 T2769 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 13233 T2719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13234 T2719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40381_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40381"}
[junit4:junit4]   2> 13248 T2752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13248 T2737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13248 T2724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13248 T2718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13248 T2768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13530 T2769 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 13548 T2769 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 13554 T2769 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 13566 T2769 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 13570 T2769 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 13573 T2769 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 13574 T2769 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 13575 T2769 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1360538613392/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3/
[junit4:junit4]   2> 13575 T2769 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2031688f
[junit4:junit4]   2> 13575 T2769 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 13576 T2769 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3 forceNew:false
[junit4:junit4]   2> 13577 T2769 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3
[junit4:junit4]   2> 13577 T2769 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3/index/
[junit4:junit4]   2> 13577 T2769 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 13578 T2769 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3/index forceNew:false
[junit4:junit4]   2> 13582 T2769 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5dbc8725; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 13583 T2769 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 13583 T2769 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3/index
[junit4:junit4]   2> 13584 T2769 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 13585 T2769 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 13585 T2769 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 13585 T2769 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 13586 T2769 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 13586 T2769 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 13586 T2769 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 13586 T2769 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 13587 T2769 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 13587 T2769 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 13587 T2769 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 13588 T2769 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 13588 T2769 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 13588 T2769 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 13589 T2769 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 13589 T2769 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 13589 T2769 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 13589 T2769 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13590 T2769 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13590 T2769 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13590 T2769 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13591 T2769 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13591 T2769 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13591 T2769 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13592 T2769 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13592 T2769 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 13592 T2769 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 13597 T2769 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 13600 T2769 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 13601 T2769 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 13603 T2769 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3
[junit4:junit4]   2> 13604 T2769 oass.SolrIndexSearcher.<init> Opening Searcher@2aefbff9 main
[junit4:junit4]   2> 13605 T2769 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 13605 T2769 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 13605 T2769 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 13611 T2769 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 13693 T2770 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2aefbff9 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 13696 T2769 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 13696 T2769 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 14754 T2719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14755 T2719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40386_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40386"}
[junit4:junit4]   2> 14755 T2719 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 14755 T2719 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 14799 T2718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14799 T2724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14800 T2737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14803 T2752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14803 T2768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2>  C168_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:40381_, base_url=http://127.0.0.1:40381}
[junit4:junit4]   2> 15483 T2755 C168 P40381 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:40353/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 15483 T2755 C168 P40381 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40381 START replicas=[http://127.0.0.1:40353/collection1/] nUpdates=100
[junit4:junit4]   2> 15483 T2755 C168 P40381 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 15484 T2755 C168 P40381 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 15484 T2755 C168 P40381 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 15484 T2755 C168 P40381 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 15484 T2755 C168 P40381 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 15484 T2755 C168 P40381 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:40353/collection1/. core=collection1
[junit4:junit4]   2> 15484 T2755 C168 P40381 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C169 name=collection1 org.apache.solr.core.SolrCore@3b7b3381 url=http://127.0.0.1:40353/collection1 node=127.0.0.1:40353_ C169_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:40353_, base_url=http://127.0.0.1:40353, leader=true}
[junit4:junit4]   2> 15498 T2728 C169 P40353 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 15517 T2729 C169 P40353 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 15518 T2729 C169 P40353 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1
[junit4:junit4]   2> 15521 T2729 C169 P40353 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10d65e73; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15521 T2729 C169 P40353 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15534 T2729 C169 P40353 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10d65e73; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10d65e73; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 15535 T2729 C169 P40353 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 15538 T2729 C169 P40353 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1
[junit4:junit4]   2> 15538 T2729 C169 P40353 oass.SolrIndexSearcher.<init> Opening Searcher@7746a823 realtime
[junit4:junit4]   2> 15539 T2729 C169 P40353 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 15539 T2729 C169 P40353 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 23
[junit4:junit4]   2> 15540 T2755 C168 P40381 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 15540 T2755 C168 P40381 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 15542 T2730 C169 P40353 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 15542 T2730 C169 P40353 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 15543 T2755 C168 P40381 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 15543 T2755 C168 P40381 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 15543 T2755 C168 P40381 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 15546 T2730 C169 P40353 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1
[junit4:junit4]   2> 15547 T2730 C169 P40353 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1/index
[junit4:junit4]   2> 15547 T2730 C169 P40353 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1 
[junit4:junit4]   2> 15548 T2755 C168 P40381 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 15549 T2755 C168 P40381 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2/index.20130211050836521 forceNew:false
[junit4:junit4]   2> 15549 T2755 C168 P40381 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2
[junit4:junit4]   2> 15550 T2755 C168 P40381 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2/index.20130211050836521 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e4bf46a; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4]   2> 15553 T2730 C169 P40353 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
[junit4:junit4]   2> 15554 T2755 C168 P40381 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2/index
[junit4:junit4]   2> 15554 T2755 C168 P40381 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 15556 T2755 C168 P40381 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130211050836521
[junit4:junit4]   2> 15557 T2755 C168 P40381 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2
[junit4:junit4]   2> 15558 T2755 C168 P40381 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2
[junit4:junit4]   2> 15558 T2755 C168 P40381 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2/index/ new=./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2/index.20130211050836521
[junit4:junit4]   2> 15561 T2755 C168 P40381 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2/index.20130211050836521 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e4bf46a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 15561 T2755 C168 P40381 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 15562 T2755 C168 P40381 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2
[junit4:junit4]   2> 15562 T2755 C168 P40381 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 15562 T2755 C168 P40381 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 15563 T2755 C168 P40381 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 15563 T2755 C168 P40381 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2/index.20130211050836521
[junit4:junit4]   2> 15564 T2755 C168 P40381 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2
[junit4:junit4]   2> 15568 T2755 C168 P40381 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2/index.20130211050836521 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e4bf46a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 15568 T2755 C168 P40381 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 15569 T2755 C168 P40381 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 15569 T2755 C168 P40381 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2
[junit4:junit4]   2> 15569 T2755 C168 P40381 oass.SolrIndexSearcher.<init> Opening Searcher@284aa700 main
[junit4:junit4]   2> 15570 T2754 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@284aa700 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 15571 T2754 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2/index
[junit4:junit4]   2> 15571 T2755 C168 P40381 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 15582 T2755 C168 P40381 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2/index.20130211050836521 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e4bf46a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2/index.20130211050836521 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e4bf46a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 15582 T2755 C168 P40381 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 15584 T2755 C168 P40381 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2
[junit4:junit4]   2> 15584 T2755 C168 P40381 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 15584 T2755 C168 P40381 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2/index.20130211050836521
[junit4:junit4]   2> 15584 T2755 C168 P40381 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty2/index
[junit4:junit4]   2> 15584 T2755 C168 P40381 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 15584 T2755 C168 P40381 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 15585 T2755 C168 P40381 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 15585 T2755 C168 P40381 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15591 T2755 C168 P40381 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 15700 T2769 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 15700 T2769 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40386 collection:collection1 shard:shard1
[junit4:junit4]   2> 15703 T2769 oasc.ZkController.register We are http://127.0.0.1:40386/collection1/ and leader is http://127.0.0.1:40353/collection1/
[junit4:junit4]   2> 15703 T2769 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40386
[junit4:junit4]   2> 15703 T2769 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 15703 T2769 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C170 name=collection1 org.apache.solr.core.SolrCore@3770c0a1 url=http://127.0.0.1:40386/collection1 node=127.0.0.1:40386_ C170_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:40386_, base_url=http://127.0.0.1:40386}
[junit4:junit4]   2> 15704 T2773 C170 P40386 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 15704 T2769 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15704 T2773 C170 P40386 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 15705 T2773 C170 P40386 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 15705 T2773 C170 P40386 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15705 T2696 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 15705 T2696 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 15706 T2773 C170 P40386 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 15706 T2696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 15879 T2696 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 15882 T2696 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:40410
[junit4:junit4]   2> 15883 T2696 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 15883 T2696 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 15884 T2696 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1360538616697
[junit4:junit4]   2> 15884 T2696 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1360538616697/solr.xml
[junit4:junit4]   2> 15885 T2696 oasc.CoreContainer.<init> New CoreContainer 1888018945
[junit4:junit4]   2> 15885 T2696 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1360538616697/'
[junit4:junit4]   2> 15886 T2696 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1360538616697/'
[junit4:junit4]   2> 15932 T2696 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4]   2> 15933 T2696 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 15933 T2696 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 15934 T2696 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 15934 T2696 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 15935 T2696 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 15935 T2696 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 15936 T2696 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 15936 T2696 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 15937 T2696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4]   2> 15957 T2696 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 15976 T2696 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:40340/solr
[junit4:junit4]   2> 15977 T2696 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 15977 T2696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40340 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7fb471dc
[junit4:junit4]   2> 15978 T2696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15979 T2783 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40340. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 15979 T2783 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40340, initiating session
[junit4:junit4]   2> 15979 T2698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:40411
[junit4:junit4]   2> 15980 T2698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:40411
[junit4:junit4]   2> 15985 T2700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cc66b8618000b with negotiated timeout 20000 for client /140.211.11.196:40411
[junit4:junit4]   2> 15985 T2783 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40340, sessionid = 0x13cc66b8618000b, negotiated timeout = 20000
[junit4:junit4]   2> 15985 T2784 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7fb471dc name:ZooKeeperConnection Watcher:127.0.0.1:40340 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15986 T2696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15987 T2701 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cc66b8618000b
[junit4:junit4]   2> 15997 T2784 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 15997 T2698 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:40411 which had sessionid 0x13cc66b8618000b
[junit4:junit4]   2> 15997 T2696 oaz.ZooKeeper.close Session: 0x13cc66b8618000b closed
[junit4:junit4]   2> 15998 T2696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4]   2> 16009 T2696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40340/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@675b1483
[junit4:junit4]   2> 16010 T2696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 16010 T2785 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40340. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 16011 T2785 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40340, initiating session
[junit4:junit4]   2> 16011 T2698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:40412
[junit4:junit4]   2> 16011 T2698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:40412
[junit4:junit4]   2> 16012 T2700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cc66b8618000c with negotiated timeout 20000 for client /140.211.11.196:40412
[junit4:junit4]   2> 16012 T2785 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40340, sessionid = 0x13cc66b8618000c, negotiated timeout = 20000
[junit4:junit4]   2> 16013 T2786 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@675b1483 name:ZooKeeperConnection Watcher:127.0.0.1:40340/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 16013 T2696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 16014 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b8618000c type:create cxid:0x1 zxid:0x94 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16016 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b8618000c type:create cxid:0x2 zxid:0x95 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16023 T2696 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 16025 T2696 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40410_
[junit4:junit4]   2> 16026 T2701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cc66b8618000c type:delete cxid:0x9 zxid:0x96 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:40410_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:40410_
[junit4:junit4]   2> 16027 T2696 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40410_
[junit4:junit4]   2> 16029 T2718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16030 T2724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16030 T2737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16030 T2768 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16030 T2752 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16030 T2768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16030 T2786 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16030 T2752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16031 T2718 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16037 T2737 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16037 T2724 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16043 T2787 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1360538616697/collection1
[junit4:junit4]   2> 16044 T2787 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 16044 T2787 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 16044 T2787 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 16046 T2787 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1360538616697/collection1/'
[junit4:junit4]   2> 16047 T2787 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1360538616697/collection1/lib/README' to classloader
[junit4:junit4]   2> 16047 T2787 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1360538616697/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 16102 T2787 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 16169 T2787 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 16270 T2787 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 16276 T2787 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 16308 T2719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16309 T2719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40381_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40381"}
[junit4:junit4]   2> 16314 T2719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40386_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40386"}
[junit4:junit4]   2> 16330 T2718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16330 T2768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16330 T2786 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16330 T2737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16330 T2752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16330 T2724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16876 T2787 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 16887 T2787 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 16891 T2787 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 16904 T2787 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 16908 T2787 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 16912 T2787 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 16913 T2787 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 16915 T2787 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1360538616697/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty4/
[junit4:junit4]   2> 16915 T2787 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2031688f
[junit4:junit4]   2> 16915 T2787 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 16916 T2787 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty4 forceNew:false
[junit4:junit4]   2> 16917 T2787 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty4
[junit4:junit4]   2> 16917 T2787 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty4/index/
[junit4:junit4]   2> 16917 T2787 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 16918 T2787 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty4/index forceNew:false
[junit4:junit4]   2> 16950 T2787 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@211aab63; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 16950 T2787 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 16951 T2787 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty4/index
[junit4:junit4]   2> 16951 T2787 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 16953 T2787 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 16953 T2787 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 16953 T2787 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 16954 T2787 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 16954 T2787 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 16955 T2787 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 16955 T2787 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 16955 T2787 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 16956 T2787 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 16956 T2787 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 16957 T2787 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 16957 T2787 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 16958 T2787 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 16958 T2787 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 16958 T2787 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 16959 T2787 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 16959 T2787 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 16959 T2787 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 16960 T2787 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 16960 T2787 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 16961 T2787 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 16961 T2787 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 16962 T2787 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 16962 T2787 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 16963 T2787 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 16963 T2787 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 16970 T2787 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 16974 T2787 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 16975 T2787 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 16977 T2787 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty4
[junit4:junit4]   2> 16979 T2787 oass.SolrIndexSearcher.<init> Opening Searcher@5a343c1e main
[junit4:junit4]   2> 16980 T2787 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 16980 T2787 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 16980 T2787 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 16995 T2787 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 17048 T2788 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5a343c1e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 17051 T2787 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 17052 T2787 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 17842 T2719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17843 T2719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40410_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40410"}
[junit4:junit4]   2> 17843 T2719 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 17844 T2719 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 17856 T2786 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17856 T2718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17856 T2768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17856 T2737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17856 T2724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17856 T2752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18054 T2787 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 18054 T2787 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40410 collection:collection1 shard:shard1
[junit4:junit4]   2> 18057 T2787 oasc.ZkController.register We are http://127.0.0.1:40410/collection1/ and leader is http://127.0.0.1:40353/collection1/
[junit4:junit4]   2> 18057 T2787 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40410
[junit4:junit4]   2> 18057 T2787 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 18058 T2787 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C171 name=collection1 org.apache.solr.core.SolrCore@51677560 url=http://127.0.0.1:40410/collection1 node=127.0.0.1:40410_ C171_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:40410_, base_url=http://127.0.0.1:40410}
[junit4:junit4]   2> 18058 T2789 C171 P40410 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 18059 T2787 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18059 T2789 C171 P40410 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 18059 T2789 C171 P40410 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 18060 T2789 C171 P40410 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 18060 T2696 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 18061 T2696 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 18061 T2789 C171 P40410 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 18061 T2696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 18081 T2696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18082 T2696 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4]   2> 18082 T2696 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4]   2> 18083 T2696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C170_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:40386_, base_url=http://127.0.0.1:40386}
[junit4:junit4]   2> 18727 T2773 C170 P40386 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:40353/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 18727 T2773 C170 P40386 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40386 START replicas=[http://127.0.0.1:40353/collection1/] nUpdates=100
[junit4:junit4]   2> 18728 T2773 C170 P40386 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 18728 T2773 C170 P40386 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 18728 T2773 C170 P40386 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 18728 T2773 C170 P40386 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 18728 T2773 C170 P40386 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 18729 T2773 C170 P40386 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:40353/collection1/. core=collection1
[junit4:junit4]   2> 18729 T2773 C170 P40386 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 18730 T2728 C169 P40353 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 18739 T2733 C169 P40353 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 18767 T2733 C169 P40353 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10d65e73; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10d65e73; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 18768 T2733 C169 P40353 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 18768 T2733 C169 P40353 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1
[junit4:junit4]   2> 18769 T2733 C169 P40353 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 18769 T2733 C169 P40353 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 30
[junit4:junit4]   2> 18770 T2773 C170 P40386 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 18770 T2773 C170 P40386 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 18773 T2730 C169 P40353 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 18774 T2773 C170 P40386 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4]   2> 18774 T2773 C170 P40386 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 18774 T2773 C170 P40386 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 18776 T2730 C169 P40353 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1
[junit4:junit4]   2> 18777 T2730 C169 P40353 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1/index
[junit4:junit4]   2> 18777 T2730 C169 P40353 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=1 
[junit4:junit4]   2> 18778 T2773 C170 P40386 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 18779 T2773 C170 P40386 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3/index.20130211050839751 forceNew:false
[junit4:junit4]   2> 18779 T2773 C170 P40386 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3
[junit4:junit4]   2> 18780 T2773 C170 P40386 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3/index.20130211050839751 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c9b1cdf; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4]   2> 18783 T2730 C169 P40353 REQ /replication {file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0 
[junit4:junit4]   2> 18784 T2773 C170 P40386 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3/index
[junit4:junit4]   2> 18784 T2773 C170 P40386 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 18785 T2773 C170 P40386 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130211050839751
[junit4:junit4]   2> 18786 T2773 C170 P40386 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3
[junit4:junit4]   2> 18787 T2773 C170 P40386 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3
[junit4:junit4]   2> 18787 T2773 C170 P40386 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3/index/ new=./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3/index.20130211050839751
[junit4:junit4]   2> 18790 T2773 C170 P40386 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3/index.20130211050839751 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c9b1cdf; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 18791 T2773 C170 P40386 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 18792 T2773 C170 P40386 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3
[junit4:junit4]   2> 18792 T2773 C170 P40386 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 18793 T2773 C170 P40386 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 18793 T2773 C170 P40386 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 18794 T2773 C170 P40386 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3/index.20130211050839751
[junit4:junit4]   2> 18794 T2773 C170 P40386 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3
[junit4:junit4]   2> 18797 T2773 C170 P40386 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3/index.20130211050839751 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c9b1cdf; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 18797 T2773 C170 P40386 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 18798 T2773 C170 P40386 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 18798 T2773 C170 P40386 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3
[junit4:junit4]   2> 18798 T2773 C170 P40386 oass.SolrIndexSearcher.<init> Opening Searcher@4f3a8aa main
[junit4:junit4]   2> 18800 T2770 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4f3a8aa main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4]   2> 18800 T2770 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3/index
[junit4:junit4]   2> 18801 T2773 C170 P40386 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 18804 T2773 C170 P40386 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3/index.20130211050839751 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c9b1cdf; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3/index.20130211050839751 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c9b1cdf; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 18804 T2773 C170 P40386 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 18805 T2773 C170 P40386 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3
[junit4:junit4]   2> 18805 T2773 C170 P40386 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 18805 T2773 C170 P40386 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3/index.20130211050839751
[junit4:junit4]   2> 18806 T2773 C170 P40386 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty3/index
[junit4:junit4]   2> 18806 T2773 C170 P40386 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 18806 T2773 C170 P40386 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 18806 T2773 C170 P40386 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 18806 T2773 C170 P40386 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 18813 T2773 C170 P40386 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 19085 T2696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19361 T2719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19362 T2719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40410_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40410"}
[junit4:junit4]   2> 19366 T2719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40386_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40386"}
[junit4:junit4]   2> 19378 T2718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19378 T2786 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19378 T2752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19378 T2768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19378 T2737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19378 T2724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20088 T2696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 21090 T2696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C171_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:40410_, base_url=http://127.0.0.1:40410}
[junit4:junit4]   2> 22084 T2789 C171 P40410 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:40353/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 22084 T2789 C171 P40410 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40410 START replicas=[http://127.0.0.1:40353/collection1/] nUpdates=100
[junit4:junit4]   2> 22085 T2789 C171 P40410 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 22085 T2789 C171 P40410 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 22085 T2789 C171 P40410 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 22085 T2789 C171 P40410 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 22085 T2789 C171 P40410 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 22086 T2789 C171 P40410 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:40353/collection1/. core=collection1
[junit4:junit4]   2> 22086 T2789 C171 P40410 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 22087 T2728 C169 P40353 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 22092 T2696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 22100 T2727 C169 P40353 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 22105 T2727 C169 P40353 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10d65e73; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10d65e73; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10d65e73; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 22105 T2727 C169 P40353 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 22106 T2727 C169 P40353 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1
[junit4:junit4]   2> 22106 T2727 C169 P40353 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22107 T2727 C169 P40353 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4]   2> 22108 T2789 C171 P40410 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 22108 T2789 C171 P40410 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 22110 T2730 C169 P40353 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 22111 T2789 C171 P40410 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4]   2> 22111 T2789 C171 P40410 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 22111 T2789 C171 P40410 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 22113 T2730 C169 P40353 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1
[junit4:junit4]   2> 22114 T2730 C169 P40353 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty1/index
[junit4:junit4]   2> 22114 T2730 C169 P40353 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=1 
[junit4:junit4]   2> 22115 T2789 C171 P40410 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 22116 T2789 C171 P40410 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty4/index.20130211050843088 forceNew:false
[junit4:junit4]   2> 22116 T2789 C171 P40410 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty4
[junit4:junit4]   2> 22117 T2789 C171 P40410 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty4/index.20130211050843088 lockFactory=org.apache.lucene.store.NativeFSLockFactory@495949ca; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4]   2> 22120 T2730 C169 P40353 REQ /replication {file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 22121 T2789 C171 P40410 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty4/index
[junit4:junit4]   2> 22121 T2789 C171 P40410 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 22122 T2789 C171 P40410 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130211050843088
[junit4:junit4]   2> 22123 T2789 C171 P40410 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty4
[junit4:junit4]   2> 22124 T2789 C171 P40410 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty4
[junit4:junit4]   2> 22124 T2789 C171 P40410 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty4/index/ new=./org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty4/index.20130211050843088
[junit4:junit4]   2> 22127 T2789 C171 P40410 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1360538600977/jetty4/index.20130211050843088 lockFactory=org.apache.lucene.store.NativeFSLockFactory@495949ca; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 22127 T2789 C171 P40410 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 22129 T2789 C171 P40410 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud

[...truncated too long message...]

DistribZkTestBase$CloudJettyRunner@c9bcdec9, org.apache.solr.cloud.AbstractFullDistribZkTestBase$CloudJettyRunner@5f759eab]
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([F00AC301D9327D42:71EC4D19AE6D1D7E]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.junit.Assert.assertTrue(Assert.java:43)
[junit4:junit4]    > 	at org.junit.Assert.assertNotNull(Assert.java:526)
[junit4:junit4]    > 	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:216)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:794)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:616)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:679)
[junit4:junit4]   2> 908465 T2696 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene3x, sim=DefaultSimilarity, locale=sr, timezone=Asia/Kathmandu
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=2,free=136685384,total=374341632
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestElisionMultitermQuery, SampleTest, BadComponentTest, AutoCommitTest, TestPerFieldSimilarity, TestRangeQuery, FileBasedSpellCheckerTest, CSVRequestHandlerTest, QueryElevationComponentTest, TestCollationField, TestStressVersions, CopyFieldTest, SystemInfoHandlerTest, ShardRoutingCustomTest, SolrPluginUtilsTest, CacheHeaderTest, TestBinaryResponseWriter, RegexBoostProcessorTest, BinaryUpdateRequestHandlerTest, HighlighterConfigTest, SearchHandlerTest, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, TestConfig, TestPostingsSolrHighlighter, TestSolrIndexConfig, SimplePostToolTest, CoreContainerCoreInitFailuresTest, TestExtendedDismaxParser, SortByFunctionTest, TestFiltering, NoCacheHeaderTest, TestXIncludeConfig, LoggingHandlerTest, ZkControllerTest, PreAnalyzedFieldTest, BasicDistributedZkTest, TestPHPSerializedResponseWriter, ChaosMonkeySafeLeaderTest, SpellCheckComponentTest, SolrRequestParserTest, TestDefaultSimilarityFactory, DirectSolrConnectionTest, UpdateRequestProcessorFactoryTest, WordBreakSolrSpellCheckerTest, ScriptEngineTest, TestLMDirichletSimilarityFactory, DefaultValueUpdateProcessorTest, ChaosMonkeyNothingIsSafeTest, PluginInfoTest, TestLuceneMatchVersion, MBeansHandlerTest, TestSolrQueryParser, TestFastOutputStream, NumericFieldsTest, SimpleFacetsTest, TestGroupingSearch, SOLR749Test, TestIBSimilarityFactory, DirectUpdateHandlerOptimizeTest, ResourceLoaderTest, LeaderElectionTest, TestRealTimeGet, TestRandomFaceting, IndexBasedSpellCheckerTest, TestCoreContainer, LukeRequestHandlerTest, DirectSolrSpellCheckerTest, ConvertedLegacyTest, PeerSyncTest, BasicFunctionalityTest, SignatureUpdateProcessorFactoryTest, HighlighterTest, TestIndexSearcher, CoreAdminHandlerTest, TestRemoteStreaming, QueryEqualityTest, TestWordDelimiterFilterFactory, PolyFieldTest, SpatialFilterTest, MoreLikeThisHandlerTest, DistributedQueryElevationComponentTest, CurrencyFieldTest, TestPseudoReturnFields, QueryParsingTest, TermsComponentTest, DistanceFunctionTest, SolrInfoMBeanTest, XsltUpdateRequestHandlerTest, MinimalSchemaTest, TestQueryTypes, XmlUpdateRequestHandlerTest, FieldAnalysisRequestHandlerTest, PingRequestHandlerTest, SuggesterWFSTTest, JsonLoaderTest, TestSurroundQueryParser, TestValueSourceCache, TestReversedWildcardFilterFactory, JSONWriterTest, RequestHandlersTest, SuggesterFSTTest, SuggesterTSTTest, UniqFieldsUpdateProcessorFactoryTest, SuggesterTest, TestSearchPerf, TestFoldingMultitermQuery, TestSolrDeletionPolicy1, AlternateDirectoryTest, TestLFUCache, SolrIndexConfigTest, IndexReaderFactoryTest, TestPhraseSuggestions, LegacyHTMLStripCharFilterTest, TestCodecSupport, DateMathParserTest, FileUtilsTest, TestSystemIdResolver, DateFieldTest, TestBadConfig, TestDocumentBuilder, ClusterStateTest, ClusterStateUpdateTest, OverseerCollectionProcessorTest, SyncSliceTest]
[junit4:junit4] Completed on J0 in 908.49s, 1 test, 1 failure <<< FAILURES!

[...truncated 10 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:381: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/common-build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:1202: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:865: There were test failures: 251 suites, 1043 tests, 1 failure, 22 ignored (4 assumptions)

Total time: 53 minutes 25 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message