lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-Tests-4.2.1-Java6 - Build # 1 - Failure
Date Wed, 20 Mar 2013 00:16:46 GMT
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.2.1-Java6/1/

1 tests failed.
FAILED:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:25250/collection1skip list:[CloudJettyRunner [url=http://127.0.0.1:50311/collection1], CloudJettyRunner [url=http://127.0.0.1:38734/collection1]]

Stack Trace:
java.lang.AssertionError: Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:25250/collection1skip list:[CloudJettyRunner [url=http://127.0.0.1:50311/collection1], CloudJettyRunner [url=http://127.0.0.1:38734/collection1]]
	at __randomizedtesting.SeedInfo.seed([747B01E0C8F17287:F59D8FF8BFAE12BB]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:212)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:616)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:679)




Build Log:
[...truncated 16136 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4]   2> 0 T490 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4]   2> 6 T490 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1363737598471
[junit4:junit4]   2> 7 T490 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 8 T491 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 11 T491 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 11 T491 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 11 T491 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 11 T491 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 12 T491 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1363737598470/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 109 T490 oasc.ZkTestServer.run start zk server on port:13928
[junit4:junit4]   2> 109 T490 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13928 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@5f9332d
[junit4:junit4]   2> 110 T490 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 111 T496 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13928. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 111 T496 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13928, initiating session
[junit4:junit4]   2> 112 T492 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:48474
[junit4:junit4]   2> 112 T492 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:48474
[junit4:junit4]   2> 113 T494 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 119 T494 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85185a0d0000 with negotiated timeout 10000 for client /140.211.11.196:48474
[junit4:junit4]   2> 119 T496 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13928, sessionid = 0x13d85185a0d0000, negotiated timeout = 10000
[junit4:junit4]   2> 120 T497 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5f9332d name:ZooKeeperConnection Watcher:127.0.0.1:13928 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 120 T490 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 120 T490 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 124 T495 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d85185a0d0000
[junit4:junit4]   2> 133 T497 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 134 T492 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:48474 which had sessionid 0x13d85185a0d0000
[junit4:junit4]   2> 133 T490 oaz.ZooKeeper.close Session: 0x13d85185a0d0000 closed
[junit4:junit4]   2> 134 T490 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13928/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@59956cd
[junit4:junit4]   2> 135 T490 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 136 T498 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13928. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 136 T498 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13928, initiating session
[junit4:junit4]   2> 136 T492 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:55502
[junit4:junit4]   2> 137 T492 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:55502
[junit4:junit4]   2> 138 T494 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85185a0d0001 with negotiated timeout 10000 for client /140.211.11.196:55502
[junit4:junit4]   2> 138 T498 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13928, sessionid = 0x13d85185a0d0001, negotiated timeout = 10000
[junit4:junit4]   2> 138 T499 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@59956cd name:ZooKeeperConnection Watcher:127.0.0.1:13928/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 138 T490 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 139 T490 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 149 T490 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 153 T490 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 156 T490 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 160 T490 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 161 T490 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 174 T490 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 175 T490 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 280 T490 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 281 T490 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 284 T490 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 285 T490 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 294 T490 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 295 T490 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 298 T490 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 299 T490 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 302 T490 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 303 T490 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 307 T490 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 307 T490 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 311 T490 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 311 T490 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 315 T495 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d85185a0d0001
[junit4:junit4]   2> 316 T499 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 316 T492 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:55502 which had sessionid 0x13d85185a0d0001
[junit4:junit4]   2> 316 T490 oaz.ZooKeeper.close Session: 0x13d85185a0d0001 closed
[junit4:junit4]   2> 506 T490 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 511 T490 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:45630
[junit4:junit4]   2> 511 T490 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 512 T490 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 512 T490 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363737598781
[junit4:junit4]   2> 513 T490 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363737598781/solr.xml
[junit4:junit4]   2> 513 T490 oasc.CoreContainer.<init> New CoreContainer 1878447015
[junit4:junit4]   2> 514 T490 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363737598781/'
[junit4:junit4]   2> 514 T490 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363737598781/'
[junit4:junit4]   2> 560 T490 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 561 T490 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 561 T490 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 561 T490 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 562 T490 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 562 T490 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 563 T490 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 563 T490 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 563 T490 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 564 T490 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 584 T490 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 601 T490 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:13928/solr
[junit4:junit4]   2> 602 T490 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 602 T490 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13928 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@67417940
[junit4:junit4]   2> 603 T490 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 604 T509 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13928. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 604 T509 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13928, initiating session
[junit4:junit4]   2> 605 T492 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:28058
[junit4:junit4]   2> 605 T492 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:28058
[junit4:junit4]   2> 632 T494 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85185a0d0002 with negotiated timeout 20000 for client /140.211.11.196:28058
[junit4:junit4]   2> 632 T509 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13928, sessionid = 0x13d85185a0d0002, negotiated timeout = 20000
[junit4:junit4]   2> 633 T510 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@67417940 name:ZooKeeperConnection Watcher:127.0.0.1:13928 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 633 T490 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 637 T495 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d85185a0d0002
[junit4:junit4]   2> 643 T510 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 643 T492 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:28058 which had sessionid 0x13d85185a0d0002
[junit4:junit4]   2> 643 T490 oaz.ZooKeeper.close Session: 0x13d85185a0d0002 closed
[junit4:junit4]   2> 648 T490 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 666 T490 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13928/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@56edcaa3
[junit4:junit4]   2> 673 T511 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13928. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 667 T490 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 674 T511 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13928, initiating session
[junit4:junit4]   2> 674 T492 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:39078
[junit4:junit4]   2> 675 T492 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:39078
[junit4:junit4]   2> 676 T494 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85185a0d0003 with negotiated timeout 20000 for client /140.211.11.196:39078
[junit4:junit4]   2> 676 T511 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13928, sessionid = 0x13d85185a0d0003, negotiated timeout = 20000
[junit4:junit4]   2> 677 T512 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@56edcaa3 name:ZooKeeperConnection Watcher:127.0.0.1:13928/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 677 T490 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 688 T490 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4]   2> 697 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d0003 type:create cxid:0x7 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 699 T490 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4]   2> 717 T490 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 719 T490 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45630_
[junit4:junit4]   2> 720 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d0003 type:delete cxid:0x12 zxid:0x1e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45630_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45630_
[junit4:junit4]   2> 721 T490 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45630_
[junit4:junit4]   2> 725 T490 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 745 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d0003 type:delete cxid:0x20 zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 747 T490 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 750 T490 oasc.Overseer.start Overseer (id=89373907253788675-127.0.0.1:45630_-n_0000000000) starting
[junit4:junit4]   2> 750 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d0003 type:create cxid:0x25 zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 780 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d0003 type:create cxid:0x26 zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 782 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d0003 type:create cxid:0x28 zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 784 T490 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4]   2> 797 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d0003 type:create cxid:0x2e zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 799 T514 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 800 T490 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 803 T490 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 805 T490 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 827 T513 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 836 T515 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363737598781/collection1
[junit4:junit4]   2> 836 T515 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 837 T515 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 837 T515 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 839 T515 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363737598781/collection1/'
[junit4:junit4]   2> 840 T515 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1363737598781/collection1/lib/README' to classloader
[junit4:junit4]   2> 840 T515 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1363737598781/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 909 T515 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 964 T515 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1065 T515 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 1071 T515 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1644 T515 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1652 T515 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1654 T515 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1667 T515 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1670 T515 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1674 T515 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1675 T515 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1675 T515 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 1675 T515 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1676 T515 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1676 T515 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 1676 T515 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1676 T515 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363737598781/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363737598470/control/data/
[junit4:junit4]   2> 1677 T515 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1958015a
[junit4:junit4]   2> 1677 T515 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1678 T515 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363737598470/control/data forceNew: false
[junit4:junit4]   2> 1678 T515 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363737598470/control/data/index/
[junit4:junit4]   2> 1678 T515 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363737598470/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1678 T515 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363737598470/control/data/index forceNew: false
[junit4:junit4]   2> 1680 T515 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@44a72b69 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ecd3c45),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1681 T515 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1716 T515 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1716 T515 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1717 T515 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1717 T515 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1717 T515 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1717 T515 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1718 T515 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1718 T515 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1718 T515 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1723 T515 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1726 T515 oass.SolrIndexSearcher.<init> Opening Searcher@26152008 main
[junit4:junit4]   2> 1727 T515 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363737598470/control/data/tlog
[junit4:junit4]   2> 1727 T515 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1727 T515 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1730 T516 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@26152008 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1731 T515 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1731 T515 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2336 T513 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2337 T513 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45630_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45630"}
[junit4:junit4]   2> 2337 T513 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 2382 T513 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2389 T512 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2734 T515 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2734 T515 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45630 collection:control_collection shard:shard1
[junit4:junit4]   2> 2750 T515 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 2769 T515 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 2792 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d0003 type:delete cxid:0x82 zxid:0x35 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2800 T515 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2801 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d0003 type:create cxid:0x83 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2804 T515 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2804 T515 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2811 T515 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45630/collection1/
[junit4:junit4]   2> 2812 T515 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2812 T515 oasc.SyncStrategy.syncToMe http://127.0.0.1:45630/collection1/ has no replicas
[junit4:junit4]   2> 2812 T515 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45630/collection1/
[junit4:junit4]   2> 2813 T515 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 2819 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d0003 type:create cxid:0x8e zxid:0x3a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3895 T513 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3912 T512 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3950 T515 oasc.ZkController.register We are http://127.0.0.1:45630/collection1/ and leader is http://127.0.0.1:45630/collection1/
[junit4:junit4]   2> 3950 T515 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45630
[junit4:junit4]   2> 3950 T515 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3950 T515 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3951 T515 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3953 T515 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3954 T490 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3955 T490 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3955 T490 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3969 T490 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 3978 T490 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13928/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@c0c71e1
[junit4:junit4]   2> 3979 T490 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3979 T517 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13928. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3980 T517 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13928, initiating session
[junit4:junit4]   2> 3980 T492 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:53488
[junit4:junit4]   2> 3981 T492 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:53488
[junit4:junit4]   2> 3982 T494 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85185a0d0004 with negotiated timeout 10000 for client /140.211.11.196:53488
[junit4:junit4]   2> 3982 T517 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13928, sessionid = 0x13d85185a0d0004, negotiated timeout = 10000
[junit4:junit4]   2> 3982 T518 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c0c71e1 name:ZooKeeperConnection Watcher:127.0.0.1:13928/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3982 T490 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3984 T490 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3990 T490 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 4191 T490 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 4194 T490 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:19119
[junit4:junit4]   2> 4195 T490 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 4195 T490 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4195 T490 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363737602454
[junit4:junit4]   2> 4196 T490 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363737602454/solr.xml
[junit4:junit4]   2> 4196 T490 oasc.CoreContainer.<init> New CoreContainer 1072544731
[junit4:junit4]   2> 4197 T490 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363737602454/'
[junit4:junit4]   2> 4197 T490 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363737602454/'
[junit4:junit4]   2> 4249 T490 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 4250 T490 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4250 T490 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 4251 T490 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4251 T490 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4252 T490 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4252 T490 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4253 T490 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4253 T490 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4253 T490 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 4276 T490 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4294 T490 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:13928/solr
[junit4:junit4]   2> 4295 T490 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4295 T490 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13928 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4cd82d8c
[junit4:junit4]   2> 4312 T490 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4313 T528 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13928. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4314 T528 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13928, initiating session
[junit4:junit4]   2> 4314 T492 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:51178
[junit4:junit4]   2> 4314 T492 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:51178
[junit4:junit4]   2> 4316 T494 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85185a0d0005 with negotiated timeout 20000 for client /140.211.11.196:51178
[junit4:junit4]   2> 4316 T528 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13928, sessionid = 0x13d85185a0d0005, negotiated timeout = 20000
[junit4:junit4]   2> 4316 T529 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4cd82d8c name:ZooKeeperConnection Watcher:127.0.0.1:13928 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4316 T490 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4318 T495 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d85185a0d0005
[junit4:junit4]   2> 4319 T529 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4319 T492 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:51178 which had sessionid 0x13d85185a0d0005
[junit4:junit4]   2> 4319 T490 oaz.ZooKeeper.close Session: 0x13d85185a0d0005 closed
[junit4:junit4]   2> 4319 T490 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 4332 T490 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13928/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2f87156c
[junit4:junit4]   2> 4334 T490 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4334 T530 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13928. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4335 T530 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13928, initiating session
[junit4:junit4]   2> 4335 T492 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:53699
[junit4:junit4]   2> 4335 T492 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:53699
[junit4:junit4]   2> 4337 T494 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85185a0d0006 with negotiated timeout 20000 for client /140.211.11.196:53699
[junit4:junit4]   2> 4337 T530 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13928, sessionid = 0x13d85185a0d0006, negotiated timeout = 20000
[junit4:junit4]   2> 4337 T531 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f87156c name:ZooKeeperConnection Watcher:127.0.0.1:13928/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4337 T490 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4338 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d0006 type:create cxid:0x1 zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4340 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d0006 type:create cxid:0x3 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4355 T490 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5359 T490 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:19119_
[junit4:junit4]   2> 5361 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d0006 type:delete cxid:0xd zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:19119_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:19119_
[junit4:junit4]   2> 5366 T490 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:19119_
[junit4:junit4]   2> 5369 T512 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 5370 T531 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5370 T518 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5371 T512 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5390 T532 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363737602454/collection1
[junit4:junit4]   2> 5390 T532 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5391 T532 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5391 T532 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5393 T532 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363737602454/collection1/'
[junit4:junit4]   2> 5394 T532 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1363737602454/collection1/lib/README' to classloader
[junit4:junit4]   2> 5395 T532 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1363737602454/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5427 T513 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5427 T513 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:45630__collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45630_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45630"}
[junit4:junit4]   2> 5433 T531 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5433 T512 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5434 T518 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5441 T532 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 5497 T532 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5598 T532 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5604 T532 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 6175 T532 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 6184 T532 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 6187 T532 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 6205 T532 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6209 T532 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6213 T532 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6215 T532 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 6215 T532 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 6215 T532 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6216 T532 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 6216 T532 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 6217 T532 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 6217 T532 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363737602454/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty1/
[junit4:junit4]   2> 6217 T532 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1958015a
[junit4:junit4]   2> 6217 T532 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 6218 T532 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty1 forceNew: false
[junit4:junit4]   2> 6218 T532 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty1/index/
[junit4:junit4]   2> 6218 T532 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 6218 T532 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty1/index forceNew: false
[junit4:junit4]   2> 6220 T532 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2a8025a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25647d72),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 6221 T532 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 6222 T532 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 6223 T532 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 6223 T532 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 6224 T532 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 6224 T532 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 6224 T532 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 6224 T532 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 6225 T532 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 6225 T532 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 6229 T532 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 6233 T532 oass.SolrIndexSearcher.<init> Opening Searcher@65e3e184 main
[junit4:junit4]   2> 6234 T532 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty1/tlog
[junit4:junit4]   2> 6234 T532 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 6234 T532 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 6238 T533 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@65e3e184 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 6239 T532 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 6240 T532 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6940 T513 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6941 T513 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:19119_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:19119"}
[junit4:junit4]   2> 6941 T513 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 6942 T513 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6957 T531 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6957 T512 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6957 T518 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7242 T532 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 7242 T532 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:19119 collection:collection1 shard:shard1
[junit4:junit4]   2> 7243 T532 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 7277 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d0006 type:delete cxid:0x4a zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 7278 T532 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 7279 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d0006 type:create cxid:0x4b zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7289 T532 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 7289 T532 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 7290 T532 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:19119/collection1/
[junit4:junit4]   2> 7290 T532 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 7290 T532 oasc.SyncStrategy.syncToMe http://127.0.0.1:19119/collection1/ has no replicas
[junit4:junit4]   2> 7290 T532 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:19119/collection1/
[junit4:junit4]   2> 7291 T532 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 7295 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d0006 type:create cxid:0x56 zxid:0x5f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8463 T513 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8488 T531 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8488 T518 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8488 T512 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8531 T532 oasc.ZkController.register We are http://127.0.0.1:19119/collection1/ and leader is http://127.0.0.1:19119/collection1/
[junit4:junit4]   2> 8531 T532 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:19119
[junit4:junit4]   2> 8531 T532 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 8531 T532 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 8531 T532 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8533 T532 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8534 T490 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 8535 T490 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 8535 T490 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8669 T490 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 8672 T490 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:25250
[junit4:junit4]   2> 8672 T490 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 8673 T490 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 8673 T490 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363737607009
[junit4:junit4]   2> 8673 T490 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363737607009/solr.xml
[junit4:junit4]   2> 8674 T490 oasc.CoreContainer.<init> New CoreContainer 1067322144
[junit4:junit4]   2> 8674 T490 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363737607009/'
[junit4:junit4]   2> 8674 T490 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363737607009/'
[junit4:junit4]   2> 8706 T490 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 8706 T490 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 8706 T490 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 8707 T490 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 8707 T490 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 8707 T490 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 8708 T490 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 8708 T490 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 8708 T490 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 8708 T490 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 8722 T490 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 8734 T490 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:13928/solr
[junit4:junit4]   2> 8734 T490 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 8735 T490 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13928 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@76bf40a
[junit4:junit4]   2> 8736 T490 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8736 T543 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13928. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 8737 T543 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13928, initiating session
[junit4:junit4]   2> 8737 T492 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:15777
[junit4:junit4]   2> 8737 T492 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:15777
[junit4:junit4]   2> 8743 T494 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85185a0d0007 with negotiated timeout 20000 for client /140.211.11.196:15777
[junit4:junit4]   2> 8743 T543 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13928, sessionid = 0x13d85185a0d0007, negotiated timeout = 20000
[junit4:junit4]   2> 8743 T544 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76bf40a name:ZooKeeperConnection Watcher:127.0.0.1:13928 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8744 T490 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8745 T495 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d85185a0d0007
[junit4:junit4]   2> 8754 T544 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8754 T492 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:15777 which had sessionid 0x13d85185a0d0007
[junit4:junit4]   2> 8754 T490 oaz.ZooKeeper.close Session: 0x13d85185a0d0007 closed
[junit4:junit4]   2> 8755 T490 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 8762 T490 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13928/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@6134c8f3
[junit4:junit4]   2> 8763 T490 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8763 T545 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13928. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 8764 T545 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13928, initiating session
[junit4:junit4]   2> 8764 T492 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:31669
[junit4:junit4]   2> 8764 T492 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:31669
[junit4:junit4]   2> 8765 T494 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85185a0d0008 with negotiated timeout 20000 for client /140.211.11.196:31669
[junit4:junit4]   2> 8765 T545 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13928, sessionid = 0x13d85185a0d0008, negotiated timeout = 20000
[junit4:junit4]   2> 8766 T546 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6134c8f3 name:ZooKeeperConnection Watcher:127.0.0.1:13928/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8766 T490 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8767 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d0008 type:create cxid:0x1 zxid:0x6c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8769 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d0008 type:create cxid:0x3 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8777 T490 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 9780 T490 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25250_
[junit4:junit4]   2> 9781 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d0008 type:delete cxid:0xd zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:25250_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:25250_
[junit4:junit4]   2> 9782 T490 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:25250_
[junit4:junit4]   2> 9794 T512 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9795 T518 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9795 T531 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9795 T518 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9795 T546 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9795 T531 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9797 T512 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9805 T547 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363737607009/collection1
[junit4:junit4]   2> 9805 T547 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 9806 T547 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 9806 T547 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 9807 T547 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363737607009/collection1/'
[junit4:junit4]   2> 9809 T547 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1363737607009/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 9809 T547 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1363737607009/collection1/lib/README' to classloader
[junit4:junit4]   2> 9859 T547 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 9915 T547 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 10002 T513 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10003 T513 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:19119__collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:19119_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:19119"}
[junit4:junit4]   2> 10016 T547 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 10022 T547 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 10029 T518 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10029 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10029 T531 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10029 T512 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10616 T547 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 10624 T547 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 10627 T547 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 10640 T547 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10644 T547 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10647 T547 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10648 T547 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10648 T547 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10649 T547 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10649 T547 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10650 T547 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10650 T547 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 10650 T547 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363737607009/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty2/
[junit4:junit4]   2> 10650 T547 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1958015a
[junit4:junit4]   2> 10651 T547 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 10651 T547 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty2 forceNew: false
[junit4:junit4]   2> 10651 T547 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty2/index/
[junit4:junit4]   2> 10651 T547 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 10652 T547 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty2/index forceNew: false
[junit4:junit4]   2> 10654 T547 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@41254de4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2829abfd),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10654 T547 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 10656 T547 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 10656 T547 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 10656 T547 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 10657 T547 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 10657 T547 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 10657 T547 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 10658 T547 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 10658 T547 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 10658 T547 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 10664 T547 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 10668 T547 oass.SolrIndexSearcher.<init> Opening Searcher@793172b2 main
[junit4:junit4]   2> 10668 T547 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty2/tlog
[junit4:junit4]   2> 10669 T547 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 10669 T547 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 10672 T548 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@793172b2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 10674 T547 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 10674 T547 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11540 T513 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11541 T513 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:25250_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:25250"}
[junit4:junit4]   2> 11541 T513 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 11541 T513 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 11554 T518 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11554 T512 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11554 T531 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11554 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11676 T547 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 11676 T547 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:25250 collection:collection1 shard:shard1
[junit4:junit4]   2> 11680 T547 oasc.ZkController.register We are http://127.0.0.1:25250/collection1/ and leader is http://127.0.0.1:19119/collection1/
[junit4:junit4]   2> 11680 T547 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:25250
[junit4:junit4]   2> 11681 T547 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 11681 T547 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C22 name=collection1 org.apache.solr.core.SolrCore@2a36cc7e url=http://127.0.0.1:25250/collection1 node=127.0.0.1:25250_ C22_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:25250_, base_url=http://127.0.0.1:25250}
[junit4:junit4]   2> 11689 T549 C22 P25250 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 11689 T547 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11689 T549 C22 P25250 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 11690 T549 C22 P25250 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 11690 T549 C22 P25250 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11690 T490 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 11691 T490 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 11691 T490 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11692 T549 C22 P25250 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11837 T490 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 11839 T490 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:38734
[junit4:junit4]   2> 11840 T490 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 11840 T490 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 11840 T490 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363737610168
[junit4:junit4]   2> 11841 T490 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363737610168/solr.xml
[junit4:junit4]   2> 11841 T490 oasc.CoreContainer.<init> New CoreContainer 1476997284
[junit4:junit4]   2> 11841 T490 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363737610168/'
[junit4:junit4]   2> 11842 T490 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363737610168/'
[junit4:junit4]   2> 11874 T490 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 11875 T490 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 11875 T490 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 11875 T490 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 11876 T490 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 11876 T490 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 11876 T490 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 11876 T490 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 11877 T490 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 11877 T490 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 11891 T490 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 11904 T490 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:13928/solr
[junit4:junit4]   2> 11905 T490 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 11905 T490 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13928 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6a58705f
[junit4:junit4]   2> 11906 T490 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11906 T559 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13928. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 11907 T559 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13928, initiating session
[junit4:junit4]   2> 11907 T492 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:15579
[junit4:junit4]   2> 11908 T492 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:15579
[junit4:junit4]   2> 11910 T494 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85185a0d0009 with negotiated timeout 20000 for client /140.211.11.196:15579
[junit4:junit4]   2> 11910 T559 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13928, sessionid = 0x13d85185a0d0009, negotiated timeout = 20000
[junit4:junit4]   2> 11910 T560 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6a58705f name:ZooKeeperConnection Watcher:127.0.0.1:13928 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11910 T490 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11912 T495 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d85185a0d0009
[junit4:junit4]   2> 11923 T560 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 11923 T492 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:15579 which had sessionid 0x13d85185a0d0009
[junit4:junit4]   2> 11923 T490 oaz.ZooKeeper.close Session: 0x13d85185a0d0009 closed
[junit4:junit4]   2> 11924 T490 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 11931 T490 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13928/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2cf46549
[junit4:junit4]   2> 11932 T490 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11932 T561 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13928. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 11932 T561 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13928, initiating session
[junit4:junit4]   2> 11933 T492 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:64701
[junit4:junit4]   2> 11933 T492 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:64701
[junit4:junit4]   2> 11934 T494 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85185a0d000a with negotiated timeout 20000 for client /140.211.11.196:64701
[junit4:junit4]   2> 11934 T561 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13928, sessionid = 0x13d85185a0d000a, negotiated timeout = 20000
[junit4:junit4]   2> 11935 T562 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2cf46549 name:ZooKeeperConnection Watcher:127.0.0.1:13928/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11935 T490 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11936 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d000a type:create cxid:0x1 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11980 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d000a type:create cxid:0x3 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11983 T490 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 12988 T490 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38734_
[junit4:junit4]   2> 12990 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d000a type:delete cxid:0xd zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:38734_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:38734_
[junit4:junit4]   2> 13019 T490 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38734_
[junit4:junit4]   2> 13023 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13024 T512 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13025 T562 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13025 T531 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13025 T531 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13025 T518 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13025 T518 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13026 T546 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13053 T512 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13062 T513 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13062 T563 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363737610168/collection1
[junit4:junit4]   2> 13062 T563 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 13064 T563 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 13064 T513 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:25250__collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:25250_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:25250"}
[junit4:junit4]   2> 13064 T563 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 13097 T563 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363737610168/collection1/'
[junit4:junit4]   2> 13098 T563 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1363737610168/collection1/lib/README' to classloader
[junit4:junit4]   2> 13099 T563 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1363737610168/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 13186 T512 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13186 T518 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13186 T562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13186 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13186 T531 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13210 T563 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 13256 T563 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 13357 T563 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 13362 T563 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 13732 T521 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:25250__collection1&state=recovering&nodeName=127.0.0.1:25250_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2011 
[junit4:junit4]   2> 14071 T563 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 14117 T563 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 14127 T563 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 14173 T563 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 14185 T563 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 14192 T563 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 14194 T563 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 14195 T563 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 14195 T563 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 14197 T563 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 14197 T563 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 14197 T563 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 14198 T563 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363737610168/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty3/
[junit4:junit4]   2> 14198 T563 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1958015a
[junit4:junit4]   2> 14198 T563 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 14199 T563 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty3 forceNew: false
[junit4:junit4]   2> 14200 T563 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty3/index/
[junit4:junit4]   2> 14200 T563 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 14200 T563 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty3/index forceNew: false
[junit4:junit4]   2> 14204 T563 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@709161eb lockFactory=org.apache.lucene.store.NativeFSLockFactory@d117580),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 14205 T563 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 14210 T563 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 14211 T563 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 14212 T563 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 14213 T563 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 14214 T563 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 14214 T563 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 14215 T563 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 14215 T563 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 14216 T563 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 14232 T563 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 14244 T563 oass.SolrIndexSearcher.<init> Opening Searcher@47b6030c main
[junit4:junit4]   2> 14245 T563 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty3/tlog
[junit4:junit4]   2> 14246 T563 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 14247 T563 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 14254 T564 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@47b6030c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 14257 T563 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 14257 T563 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 14720 T513 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14722 T513 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:38734_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38734"}
[junit4:junit4]   2> 14722 T513 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 14723 T513 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 14736 T531 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14736 T518 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14736 T512 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14736 T562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14736 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15262 T563 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 15262 T563 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:38734 collection:collection1 shard:shard1
[junit4:junit4]   2> 15277 T563 oasc.ZkController.register We are http://127.0.0.1:38734/collection1/ and leader is http://127.0.0.1:19119/collection1/
[junit4:junit4]   2> 15277 T563 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38734
[junit4:junit4]   2> 15278 T563 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 15278 T563 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C23 name=collection1 org.apache.solr.core.SolrCore@2758160f url=http://127.0.0.1:38734/collection1 node=127.0.0.1:38734_ C23_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:38734_, base_url=http://127.0.0.1:38734}
[junit4:junit4]   2> 15279 T565 C23 P38734 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 15280 T565 C23 P38734 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 15280 T565 C23 P38734 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 15281 T563 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15281 T565 C23 P38734 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15282 T490 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 15283 T490 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 15284 T565 C23 P38734 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 15284 T490 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 15578 T490 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 15581 T490 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:50311
[junit4:junit4]   2> 15582 T490 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 15582 T490 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 15583 T490 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363737613777
[junit4:junit4]   2> 15583 T490 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363737613777/solr.xml
[junit4:junit4]   2> 15584 T490 oasc.CoreContainer.<init> New CoreContainer 1981785222
[junit4:junit4]   2> 15584 T490 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363737613777/'
[junit4:junit4]   2> 15585 T490 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363737613777/'
[junit4:junit4]   2> 15662 T490 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 15663 T490 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 15664 T490 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 15664 T490 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 15665 T490 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 15665 T490 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 15666 T490 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 15667 T490 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 15667 T490 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 15668 T490 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 15702 T490 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 15726 T490 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:13928/solr
[junit4:junit4]   2> 15727 T490 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 15728 T490 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13928 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1867b9bb
[junit4:junit4]   2> 15729 T490 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15730 T575 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13928. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 15731 T575 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13928, initiating session
[junit4:junit4]   2> 15731 T492 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:44646
[junit4:junit4]   2> 15731 T492 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:44646
[junit4:junit4]   2> 15734 T494 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85185a0d000b with negotiated timeout 20000 for client /140.211.11.196:44646
[junit4:junit4]   2> 15734 T575 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13928, sessionid = 0x13d85185a0d000b, negotiated timeout = 20000
[junit4:junit4]   2> 15734 T576 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1867b9bb name:ZooKeeperConnection Watcher:127.0.0.1:13928 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2>  C22_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:25250_, base_url=http://127.0.0.1:25250}
[junit4:junit4]   2> 15735 T549 C22 P25250 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:19119/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 15735 T490 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15737 T495 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d85185a0d000b
[junit4:junit4]   2> 15745 T576 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 15745 T492 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:44646 which had sessionid 0x13d85185a0d000b
[junit4:junit4]   2> 15745 T490 oaz.ZooKeeper.close Session: 0x13d85185a0d000b closed
[junit4:junit4]   2> 15746 T490 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 15755 T549 C22 P25250 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 15767 T490 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13928/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@494fe908
[junit4:junit4]   2> 15770 T490 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15771 T577 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13928. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 15772 T577 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13928, initiating session
[junit4:junit4]   2> 15772 T492 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:43091
[junit4:junit4]   2> 15773 T492 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:43091
[junit4:junit4]   2> 15775 T494 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85185a0d000c with negotiated timeout 20000 for client /140.211.11.196:43091
[junit4:junit4]   2> 15775 T577 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13928, sessionid = 0x13d85185a0d000c, negotiated timeout = 20000
[junit4:junit4]   2> 15776 T578 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@494fe908 name:ZooKeeperConnection Watcher:127.0.0.1:13928/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15776 T490 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15778 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d000c type:create cxid:0x1 zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 15781 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d000c type:create cxid:0x3 zxid:0x93 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 15785 T490 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15791 T549 C22 P25250 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:25250 START replicas=[http://127.0.0.1:19119/collection1/] nUpdates=100
[junit4:junit4]   2> 15816 T549 C22 P25250 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 15817 T549 C22 P25250 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 15817 T549 C22 P25250 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 15818 T549 C22 P25250 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 15818 T549 C22 P25250 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 15818 T549 C22 P25250 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:19119/collection1/. core=collection1
[junit4:junit4]   2> 15819 T549 C22 P25250 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C24 name=collection1 org.apache.solr.core.SolrCore@369b99fa url=http://127.0.0.1:19119/collection1 node=127.0.0.1:19119_ C24_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:19119_, base_url=http://127.0.0.1:19119, leader=true}
[junit4:junit4]   2> 15859 T523 C24 P19119 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> 15944 T524 C24 P19119 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 15950 T524 C24 P19119 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2a8025a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25647d72),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15951 T524 C24 P19119 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15952 T524 C24 P19119 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2a8025a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25647d72),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2a8025a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25647d72),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 15953 T524 C24 P19119 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 15954 T524 C24 P19119 oass.SolrIndexSearcher.<init> Opening Searcher@60efaf24 realtime
[junit4:junit4]   2> 15955 T524 C24 P19119 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 15955 T524 C24 P19119 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 39
[junit4:junit4]   2> 15957 T549 C22 P25250 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 15958 T549 C22 P25250 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 16003 T549 C22 P25250 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 16008 T525 C24 P19119 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 16009 T525 C24 P19119 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 16011 T549 C22 P25250 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 16011 T549 C22 P25250 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 16012 T549 C22 P25250 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 16015 T525 C24 P19119 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0 
[junit4:junit4]   2> 16017 T549 C22 P25250 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 16019 T549 C22 P25250 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty2/index.20130319210014482 forceNew: false
[junit4:junit4]   2> 16020 T549 C22 P25250 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@14f65802 lockFactory=org.apache.lucene.store.NativeFSLockFactory@136c834) fullCopy=false
[junit4:junit4]   2> 16044 T525 C24 P19119 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=10 
[junit4:junit4]   2> 16057 T549 C22 P25250 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 16060 T549 C22 P25250 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 16060 T549 C22 P25250 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 16063 T549 C22 P25250 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@41254de4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2829abfd),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@41254de4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2829abfd),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 16064 T549 C22 P25250 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 16064 T549 C22 P25250 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 16065 T549 C22 P25250 oass.SolrIndexSearcher.<init> Opening Searcher@10aae3ec main
[junit4:junit4]   2> 16067 T548 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@10aae3ec main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 16067 T549 C22 P25250 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 16068 T549 C22 P25250 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 16068 T549 C22 P25250 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 16068 T549 C22 P25250 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 16073 T549 C22 P25250 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 16249 T513 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16250 T513 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:38734__collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:38734_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38734"}
[junit4:junit4]   2> 16260 T513 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:25250__collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:25250_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:25250"}
[junit4:junit4]   2> 16270 T531 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16270 T578 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16271 T518 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16270 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16271 T512 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16271 T562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16317 T522 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:38734__collection1&state=recovering&nodeName=127.0.0.1:38734_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001 
[junit4:junit4]   2> 16791 T490 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50311_
[junit4:junit4]   2> 16792 T495 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85185a0d000c type:delete cxid:0xf zxid:0x9c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50311_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50311_
[junit4:junit4]   2> 16793 T490 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50311_
[junit4:junit4]   2> 16798 T512 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16798 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16799 T562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16799 T518 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16800 T578 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16800 T531 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16800 T518 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16800 T578 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16800 T531 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16803 T546 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16804 T562 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16808 T512 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16814 T581 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363737613777/collection1
[junit4:junit4]   2> 16815 T581 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 16816 T581 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 16816 T581 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 16819 T581 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363737613777/collection1/'
[junit4:junit4]   2> 16821 T581 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1363737613777/collection1/lib/README' to classloader
[junit4:junit4]   2> 16821 T581 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1363737613777/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 16892 T581 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 17034 T581 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 17135 T581 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 17145 T581 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 17987 T581 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 18004 T581 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 18010 T581 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 18045 T581 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 18053 T581 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 18061 T581 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 18063 T581 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 18064 T581 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 18064 T581 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 18065 T581 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 18066 T581 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 18066 T581 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 18067 T581 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363737613777/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty4/
[junit4:junit4]   2> 18067 T581 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1958015a
[junit4:junit4]   2> 18068 T581 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 18069 T581 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty4 forceNew: false
[junit4:junit4]   2> 18069 T581 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty4/index/
[junit4:junit4]   2> 18070 T581 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 18070 T581 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty4/index forceNew: false
[junit4:junit4]   2> 18074 T581 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2040be7a lockFactory=org.apache.lucene.store.NativeFSLockFactory@58704463),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 18075 T581 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 18078 T581 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 18079 T581 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 18080 T581 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 18080 T581 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 18081 T581 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 18082 T581 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 18082 T581 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 18083 T581 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 18083 T581 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 18093 T581 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 18102 T581 oass.SolrIndexSearcher.<init> Opening Searcher@15012ff6 main
[junit4:junit4]   2> 18102 T581 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty4/tlog
[junit4:junit4]   2> 18104 T581 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 18104 T581 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 18110 T582 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@15012ff6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 18112 T581 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 18112 T581 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2>  C23_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:38734_, base_url=http://127.0.0.1:38734}
[junit4:junit4]   2> 18319 T565 C23 P38734 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:19119/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 18319 T565 C23 P38734 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:38734 START replicas=[http://127.0.0.1:19119/collection1/] nUpdates=100
[junit4:junit4]   2> 18320 T565 C23 P38734 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 18320 T565 C23 P38734 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 18320 T565 C23 P38734 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 18320 T565 C23 P38734 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 18321 T565 C23 P38734 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 18321 T565 C23 P38734 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:19119/collection1/. core=collection1
[junit4:junit4]   2> 18321 T565 C23 P38734 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 18324 T523 C24 P19119 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> 18344 T526 C24 P19119 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 18345 T526 C24 P19119 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2a8025a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25647d72),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2a8025a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25647d72),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 18346 T526 C24 P19119 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 18346 T526 C24 P19119 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 18347 T526 C24 P19119 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 3
[junit4:junit4]   2> 18348 T565 C23 P38734 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 18348 T565 C23 P38734 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 18351 T525 C24 P19119 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 18352 T565 C23 P38734 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4]   2> 18353 T565 C23 P38734 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 18353 T565 C23 P38734 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 18355 T525 C24 P19119 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=0 
[junit4:junit4]   2> 18356 T565 C23 P38734 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 18357 T565 C23 P38734 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty3/index.20130319210016821 forceNew: false
[junit4:junit4]   2> 18357 T565 C23 P38734 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@1a224782 lockFactory=org.apache.lucene.store.NativeFSLockFactory@20c72b20) fullCopy=false
[junit4:junit4]   2> 18360 T525 C24 P19119 REQ /replication {file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0 
[junit4:junit4]   2> 18362 T565 C23 P38734 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 18363 T565 C23 P38734 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 18363 T565 C23 P38734 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 18365 T565 C23 P38734 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@709161eb lockFactory=org.apache.lucene.store.NativeFSLockFactory@d117580),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@709161eb lockFactory=org.apache.lucene.store.NativeFSLockFactory@d117580),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 18365 T565 C23 P38734 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 18366 T565 C23 P38734 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 18366 T565 C23 P38734 oass.SolrIndexSearcher.<init> Opening Searcher@549a4267 main
[junit4:junit4]   2> 18367 T564 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@549a4267 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4]   2> 18368 T565 C23 P38734 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 18368 T565 C23 P38734 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 18369 T565 C23 P38734 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 18369 T565 C23 P38734 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 18371 T565 C23 P38734 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 19291 T513 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19292 T513 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50311_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50311"}
[junit4:junit4]   2> 19293 T513 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 19293 T513 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 19310 T513 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:38734__collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:38734_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38734"}
[junit4:junit4]   2> 19325 T531 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19325 T578 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19325 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19325 T562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19325 T512 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19325 T518 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20136 T581 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 20136 T581 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50311 collection:collection1 shard:shard1
[junit4:junit4]   2> 20144 T581 oasc.ZkController.register We are http://127.0.0.1:50311/collection1/ and leader is http://127.0.0.1:19119/collection1/
[junit4:junit4]   2> 20144 T581 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50311
[junit4:junit4]   2> 20145 T581 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 20145 T581 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C25 name=collection1 org.apache.solr.core.SolrCore@549154f9 url=http://127.0.0.1:50311/collection1 node=127.0.0.1:50311_ C25_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:50311_, base_url=http://127.0.0.1:50311}
[junit4:junit4]   2> 20146 T585 C25 P50311 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 20147 T581 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20147 T585 C25 P50311 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 20148 T585 C25 P50311 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 20148 T585 C25 P50311 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 20150 T490 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 20151 T585 C25 P50311 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 20150 T490 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 20151 T490 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 20170 T490 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20174 T490 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4]   2> 20175 T490 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4]   2> 20176 T490 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20844 T513 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20845 T513 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:50311__collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50311_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50311"}
[junit4:junit4]   2> 20858 T531 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20858 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20858 T562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20858 T512 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20858 T518 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20859 T578 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21172 T527 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:50311__collection1&state=recovering&nodeName=127.0.0.1:50311_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001 
[junit4:junit4]   2> 21180 T490 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 22184 T490 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C25_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:50311_, base_url=http://127.0.0.1:50311}
[junit4:junit4]   2> 23175 T585 C25 P50311 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:19119/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 23175 T585 C25 P50311 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50311 START replicas=[http://127.0.0.1:19119/collection1/] nUpdates=100
[junit4:junit4]   2> 23176 T585 C25 P50311 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 23176 T585 C25 P50311 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 23176 T585 C25 P50311 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 23176 T585 C25 P50311 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 23177 T585 C25 P50311 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 23177 T585 C25 P50311 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:19119/collection1/. core=collection1
[junit4:junit4]   2> 23177 T585 C25 P50311 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 23180 T523 C24 P19119 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 23188 T490 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 23194 T521 C24 P19119 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 23195 T521 C24 P19119 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2a8025a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25647d72),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2a8025a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25647d72),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2a8025a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25647d72),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 23196 T521 C24 P19119 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 23196 T521 C24 P19119 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 23197 T521 C24 P19119 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 3
[junit4:junit4]   2> 23199 T585 C25 P50311 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 23199 T585 C25 P50311 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 23203 T525 C24 P19119 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 23205 T585 C25 P50311 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4]   2> 23205 T585 C25 P50311 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 23205 T585 C25 P50311 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 23209 T525 C24 P19119 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=0 
[junit4:junit4]   2> 23210 T585 C25 P50311 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 23212 T585 C25 P50311 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty4/index.20130319210021675 forceNew: false
[junit4:junit4]   2> 23212 T585 C25 P50311 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@745bfa24 lockFactory=org.apache.lucene.store.NativeFSLockFactory@15af2cc0) fullCopy=false
[junit4:junit4]   2> 23216 T525 C24 P19119 REQ /replication {file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 23218 T585 C25 P50311 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 23219 T585 C25 P50311 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 23219 T585 C25 P50311 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 23221 T585 C25 P50311 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2040be7a lockFactory=org.apache.lucene.store.NativeFSLockFactory@58704463),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2040be7a lockFactory=org.apache.lucene.store.NativeFSLockFactory@58704463),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 23221 T585 C25 P50311 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 23221 T585 C25 P50311 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 23222 T585 C25 P50311 oass.SolrIndexSearcher.<init> Opening Searcher@50f4109e main
[junit4:junit4]   2> 23223 T582 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@50f4109e main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4]   2> 23223 T585 C25 P50311 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 23223 T585 C25 P50311 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 23224 T585 C25 P50311 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 23224 T585 C25 P50311 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 23226 T585 C25 P50311 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 23880 T513 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 23881 T513 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:50311__collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50311_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50311"}
[junit4:junit4]   2> 23898 T578 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23898 T531 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23898 T562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23898 T512 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23898 T518 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23898 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24191 T490 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 24193 T490 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> ASYNC  NEW_CORE C26 name=collection1 org.apache.solr.core.SolrCore@51bf5c22 url=http://127.0.0.1:45630/collection1 node=127.0.0.1:45630_ C26_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:45630_, base_url=http://127.0.0.1:45630, leader=true}
[junit4:junit4]   2> 24204 T502 C26 P45630 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 24207 T502 C26 P45630 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@44a72b69 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ecd3c45),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 24208 T502 C26 P45630 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 24209 T502 C26 P45630 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@44a72b69 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ecd3c45),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@44a72b69 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ecd3c45),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 24210 T502 C26 P45630 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 24210 T502 C26 P45630 oass.SolrIndexSearcher.<init> Opening Searcher@3494c225 main
[junit4:junit4]   2> 24211 T502 C26 P45630 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 24212 T516 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3494c225 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 24212 T502 C26 P45630 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 9
[junit4:junit4]   2> 24237 T524 C24 P19119 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 24238 T524 C24 P19119 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=4
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2a8025a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25647d72),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2a8025a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25647d72),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2a8025a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25647d72),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2a8025a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25647d72),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4]   2> 24239 T524 C24 P19119 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4]   2> 24239 T524 C24 P19119 oass.SolrIndexSearcher.<init> Opening Searcher@67a0a5fc main
[junit4:junit4]   2> 24239 T524 C24 P19119 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 24240 T533 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@67a0a5fc main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 24249 T524 C24 P19119 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:25250/collection1/, StdNode: http://127.0.0.1:38734/collection1/, StdNode: http://127.0.0.1:50311/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2>  C25_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:50311_, base_url=http://127.0.0.1:50311}
[junit4:junit4]   2> 24263 T568 C25 P50311 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 24264 T568 C25 P50311 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2040be7a lockFactory=org.apache.lucene.store.NativeFSLockFactory@58704463),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2040be7a lockFactory=org.apache.lucene.store.NativeFSLockFactory@58704463),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4]   2> 24264 T568 C25 P50311 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4]   2> 24264 T568 C25 P50311 oass.SolrIndexSearcher.<init> Opening Searcher@1484b8d5 main
[junit4:junit4]   2> 24265 T568 C25 P50311 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 24266 T582 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1484b8d5 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4]   2> 24266 T568 C25 P50311 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 3
[junit4:junit4]   2>  C23_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:38734_, base_url=http://127.0.0.1:38734}
[junit4:junit4]   2> 24268 T552 C23 P38734 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2>  C22_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:25250_, base_url=http://127.0.0.1:25250}
[junit4:junit4]   2> 24267 T536 C22 P25250 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 24269 T552 C23 P38734 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@709161eb lockFactory=org.apache.lucene.store.NativeFSLockFactory@d117580),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@709161eb lockFactory=org.apache.lucene.store.NativeFSLockFactory@d117580),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 24269 T536 C22 P25250 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@41254de4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2829abfd),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@41254de4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2829abfd),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 24270 T552 C23 P38734 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 24270 T536 C22 P25250 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 24271 T552 C23 P38734 oass.SolrIndexSearcher.<init> Opening Searcher@3d709aa4 main
[junit4:junit4]   2> 24271 T536 C22 P25250 oass.SolrIndexSearcher.<init> Opening Searcher@2bb8a47f main
[junit4:junit4]   2> 24271 T552 C23 P38734 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 24271 T536 C22 P25250 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 24272 T548 oasc.JmxMonitoredMap.put WARNING Failed to register info bean: searcher javax.management.InstanceNotFoundException: solr/collection1:type=searcher,id=org.apache.solr.search.SolrIndexSearcher
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1118)
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:433)
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:421)
[junit4:junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:541)
[junit4:junit4]   2> 	at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:138)
[junit4:junit4]   2> 	at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4]   2> 	at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:239)
[junit4:junit4]   2> 	at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1764)
[junit4:junit4]   2> 	at org.apache.solr.core.SolrCore.access$000(SolrCore.java:129)
[junit4:junit4]   2> 	at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1641)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:679)
[junit4:junit4]   2> 
[junit4:junit4]   2> 24272 T564 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3d709aa4 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4]   2> 24273 T548 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2bb8a47f main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 24273 T552 C23 P38734 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4]   2> 24273 T536 C22 P25250 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4]   2> 24274 T524 C24 P19119 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 37
[junit4:junit4]   2> 24276 T490 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 24279 T522 C24 P19119 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 24282 T537 C22 P25250 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 24285 T553 C23 P38734 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1 
[junit4:junit4]   2> 24287 T569 C25 P50311 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 26346 T502 C26 P45630 oass.SolrIndexSearcher.<init> Opening Searcher@2ad1ff30 realtime
[junit4:junit4]   2> 26351 T502 C26 P45630 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1429982543622438912)} 0 59
[junit4:junit4]   2> 26364 T568 C25 P50311 /update {update.distrib=FROMLEADER&_version_=-1429982543682207744&update.from=http://127.0.0.1:19119/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1429982543682207744)} 0 1
[junit4:junit4]   2> 26365 T536 C22 P25250 /update {update.distrib=FROMLEADER&_version_=-1429982543682207744&update.from=http://127.0.0.1:19119/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1429982543682207744)} 0 2
[junit4:junit4]   2> 26365 T552 C23 P38734 /update {update.distrib=FROMLEADER&_version_=-1429982543682207744&update.from=http://127.0.0.1:19119/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1429982543682207744)} 0 2
[junit4:junit4]   2> 26366 T524 C24 P19119 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1429982543682207744)} 0 12
[junit4:junit4]   2> 26376 T502 C26 P45630 /update {wt=javabin&version=2} {add=[0 (1429982543702130688)]} 0 7
[junit4:junit4]   2> 26391 T568 C25 P50311 /update {distrib.from=http://127.0.0.1:19119/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1429982543708422144)]} 0 2
[junit4:junit4]   2> 26392 T552 C23 P38734 /update {distrib.from=http://127.0.0.1:19119/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1429982543708422144)]} 0 2
[junit4:junit4]   2> 26392 T536 C22 P25250 /update {distrib.from=http://127.0.0.1:19119/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1429982543708422144)]} 0 1
[junit4:junit4]   2> 26393 T524 C24 P19119 /update {wt=javabin&version=2} {add=[0 (1429982543708422144)]} 0 14
[junit4:junit4]   2> 26397 T502 C26 P45630 /update {wt=javabin&version=2} {add=[1 (1429982543726247936)]} 0 1
[junit4:junit4]   2> 26405 T536 C22 P25250 /update {distrib.from=http://127.0.0.1:19119/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429982543730442240)]} 0 1
[junit4:junit4]   2> 26406 T552 C23 P38734 /update {distrib.from=http://127.0.0.1:19119/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429982543730442240)]} 0 1
[junit4:junit4]   2> 26406 T568 C25 P50311 /update {distrib.from=http://127.0.0.1:19119/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429982543730442240)]} 0 1
[junit4:junit4]   2> 26407 T524 C24 P19119 /update {wt=javabin&version=2} {add=[1 (1429982543730442240)]} 0 7
[junit4:junit4]   2> 26413 T502 C26 P45630 /update {wt=javabin&version=2} {add=[2 (1429982543741976576)]} 0 1
[junit4:junit4]   2> 26421 T568 C25 P50311 /update {distrib.from=http://127.0.0.1:19119/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1429982543747219456)]} 0 1
[junit4:junit4]   2> 26422 T552 C23 P38734 /update {distrib.from=http://127.0.0.1:19119/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1429982543747219456)]} 0 1
[junit4:junit4]   2> 26422 T524 C24 P19119 /update {test.distrib.skip.servers=http://127.0.0.1:25250/collection1/&wt=javabin&version=2} {add=[2 (1429982543747219456)]} 0 6
[junit4:junit4]   2> 26426 T502 C26 P45630 /update {wt=javabin&version=2} {add=[3 (1429982543756656640)]} 0 1
[junit4:junit4]   2> 26434 T568 C25 P50311 /update {distrib.from=http://127.0.0.1:19119/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1429982543760850944)]} 0 1
[junit4:junit4]   2> 26435 T524 C24 P19119 /update {test.distrib.skip.servers=http://127.0.0.1:25250/collection1/&test.distrib.skip.servers=http://127.0.0.1:38734/collection1/&wt=javabin&version=2} {add=[3 (1429982543760850944)]} 0 6
[junit4:junit4]   2> 26441 T502 C26 P45630 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 26448 T502 C26 P45630 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@44a72b69 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ecd3c45),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@44a72b69 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ecd3c45),segFN=segments_3,generation=3,filenames=[_0.tis, _0.nrm, _0.fnm, _0.tii, _0.frq, _0.fdx, _0.si, _0.prx, _0.fdt, segments_3]
[junit4:junit4]   2> 26448 T502 C26 P45630 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0.tis, _0.nrm, _0.fnm, _0.tii, _0.frq, _0.fdx, _0.si, _0.prx, _0.fdt, segments_3]
[junit4:junit4]   2> 26450 T502 C26 P45630 oass.SolrIndexSearcher.<init> Opening Searcher@7d727888 main
[junit4:junit4]   2> 26451 T502 C26 P45630 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 26451 T516 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7d727888 main{StandardDirectoryReader(segments_3:3:nrt _0(4.2.1):C4)}
[junit4:junit4]   2> 26452 T502 C26 P45630 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 11
[junit4:junit4]   2> 26455 T524 C24 P19119 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 26458 T524 C24 P19119 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=5
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2a8025a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25647d72),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2a8025a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25647d72),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2a8025a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25647d72),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2a8025a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25647d72),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2a8025a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25647d72),segFN=segments_6,generation=6,filenames=[_0.tis, _0.nrm, _0.fnm, _0.tii, _0.frq, _0.fdx, _0.si, _0.prx, segments_6, _0.fdt]
[junit4:junit4]   2> 26458 T524 C24 P19119 oasc.SolrDeletionPolicy.updateCommits newest commit = 6[_0.tis, _0.nrm, _0.fnm, _0.tii, _0.frq, _0.fdx, _0.si, _0.prx, segments_6, _0.fdt]
[junit4:junit4]   2> 26459 T524 C24 P19119 oass.SolrIndexSearcher.<init> Opening Searcher@236f7565 main
[junit4:junit4]   2> 26459 T524 C24 P19119 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 26460 T533 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@236f7565 main{StandardDirectoryReader(segments_6:3:nrt _0(4.2.1):C4)}
[junit4:junit4]   2> 26460 T524 C24 P19119 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:25250/collection1/, StdNode: http://127.0.0.1:38734/collection1/, StdNode: http://127.0.0.1:50311/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 26463 T568 C25 P50311 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 26463 T536 C22 P25250 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 26463 T552 C23 P38734 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 26465 T536 C22 P25250 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@41254de4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2829abfd),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@41254de4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2829abfd),segFN=segments_4,generation=4,filenames=[_0.tis, _0.nrm, _0.fnm, _0.tii, _0.frq, _0.fdx, _0.si, _0.prx, _0.fdt, segments_4]
[junit4:junit4]   2> 26465 T536 C22 P25250 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[_0.tis, _0.nrm, _0.fnm, _0.tii, _0.frq, _0.fdx, _0.si, _0.prx, _0.fdt, segments_4]
[junit4:junit4]   2> 26465 T568 C25 P50311 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2040be7a lockFactory=org.apache.lucene.store.NativeFSLockFactory@58704463),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2040be7a lockFactory=org.apache.lucene.store.NativeFSLockFactory@58704463),segFN=segments_6,generation=6,filenames=[_0.tis, _0.nrm, _0.fnm, _0.tii, _0.frq, _0.fdx, _0.si, _0.prx, segments_6, _0.fdt]
[junit4:junit4]   2> 26466 T568 C25 P50311 oasc.SolrDeletionPolicy.updateCommits newest commit = 6[_0.tis, _0.nrm, _0.fnm, _0.tii, _0.frq, _0.fdx, _0.si, _0.prx, segments_6, _0.fdt]
[junit4:junit4]   2> 26466 T536 C22 P25250 oass.SolrIndexSearcher.<init> Opening Searcher@194b899d main
[junit4:junit4]   2> 26466 T552 C23 P38734 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@709161eb lockFactory=org.apache.lucene.store.NativeFSLockFactory@d117580),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@709161eb lockFactory=org.apache.lucene.store.NativeFSLockFactory@d117580),segFN=segments_5,generation=5,filenames=[_0.tis, _0.nrm, _0.fnm, _0.tii, _0.frq, _0.fdx, _0.si, segments_5, _0.prx, _0.fdt]
[junit4:junit4]   2> 26466 T568 C25 P50311 oass.SolrIndexSearcher.<init> Opening Searcher@3a0a3e5e main
[junit4:junit4]   2> 26466 T536 C22 P25250 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 26467 T552 C23 P38734 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[_0.tis, _0.nrm, _0.fnm, _0.tii, _0.frq, _0.fdx, _0.si, segments_5, _0.prx, _0.fdt]
[junit4:junit4]   2> 26467 T548 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@194b899d main{StandardDirectoryReader(segments_4:3:nrt _0(4.2.1):C2)}
[junit4:junit4]   2> 26467 T568 C25 P50311 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 26467 T582 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3a0a3e5e main{StandardDirectoryReader(segments_6:3:nrt _0(4.2.1):C4)}
[junit4:junit4]   2> 26468 T536 C22 P25250 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4]   2> 26468 T552 C23 P38734 oass.SolrIndexSearcher.<init> Opening Searcher@7b7302a3 main
[junit4:junit4]   2> 26468 T568 C25 P50311 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4]   2> 26468 T552 C23 P38734 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 26469 T564 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7b7302a3 main{StandardDirectoryReader(segments_5:3:nrt _0(4.2.1):C3)}
[junit4:junit4]   2> 26469 T552 C23 P38734 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4]   2> 26470 T524 C24 P19119 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 15
[junit4:junit4]   2> 26470 T490 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 26471 T490 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 26472 T490 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> 26475 T522 C24 P19119 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1 
[junit4:junit4]   2> 26477 T537 C22 P25250 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=2 status=0 QTime=0 
[junit4:junit4]   2> 26480 T553 C23 P38734 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=3 status=0 QTime=0 
[junit4:junit4]   2> 26483 T569 C25 P50311 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0 
[junit4:junit4]   2> 26489 T490 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 26506 T554 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2
[junit4:junit4]   2> 26506 T554 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 26518 T526 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
[junit4:junit4]   2> 26519 T526 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:19119/collection1/
[junit4:junit4]   2> 26519 T526 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:19119 START replicas=[http://127.0.0.1:25250/collection1/, http://127.0.0.1:38734/collection1/, http://127.0.0.1:50311/collection1/] nUpdates=100
[junit4:junit4]   2> 26536 T538 C22 P25250 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=10 
[junit4:junit4]   2> 26536 T570 C25 P50311 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=10 
[junit4:junit4]   2> 26536 T555 C23 P38734 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=10 
[junit4:junit4]   2> 26537 T526 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:19119  Received 3 versions from 127.0.0.1:25250/collection1/
[junit4:junit4]   2> 26537 T526 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:19119  Our versions are newer. ourLowThreshold=1429982543682207744 otherHigh=1429982543730442240
[junit4:junit4]   2> 26537 T526 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:19119  Received 5 versions from 127.0.0.1:50311/collection1/
[junit4:junit4]   2> 26538 T526 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:19119  Our versions are newer. ourLowThreshold=1429982543682207744 otherHigh=1429982543747219456
[junit4:junit4]   2> 26538 T526 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:19119  Received 4 versions from 127.0.0.1:38734/collection1/
[junit4:junit4]   2> 26538 T526 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:19119  Our versions are newer. ourLowThreshold=1429982543682207744 otherHigh=1429982543747219456
[junit4:junit4]   2> 26539 T526 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:19119 DONE. sync succeeded
[junit4:junit4]   2> 26539 T526 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 26539 T526 oasc.SyncStrategy.syncToMe http://127.0.0.1:19119/collection1/: try and ask http://127.0.0.1:25250/collection1/ to sync
[junit4:junit4]   2> 26540 T526 oasc.SyncStrategy.syncToMe http://127.0.0.1:19119/collection1/: try and ask http://127.0.0.1:38734/collection1/ to sync
[junit4:junit4]   2> 26540 T526 oasc.SyncStrategy.syncToMe http://127.0.0.1:19119/collection1/: try and ask http://127.0.0.1:50311/collection1/ to sync
[junit4:junit4]   2> 26543 T539 C22 P25250 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:25250 START replicas=[http://127.0.0.1:19119/collection1/] nUpdates=100
[junit4:junit4]   2> 26543 T571 C25 P50311 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50311 START replicas=[http://127.0.0.1:19119/collection1/] nUpdates=100
[junit4:junit4]   2> 26543 T556 C23 P38734 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:38734 START replicas=[http://127.0.0.1:19119/collection1/] nUpdates=100
[junit4:junit4]   2> 26546 T527 C24 P19119 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> 26546 T521 C24 P19119 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 26546 T571 C25 P50311 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50311  Received 5 versions from 127.0.0.1:19119/collection1/
[junit4:junit4]   2> 26546 T523 C24 P19119 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 26547 T571 C25 P50311 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50311  Our versions are newer. ourLowThreshold=1429982543682207744 otherHigh=1429982543747219456
[junit4:junit4]   2> 26547 T556 C23 P38734 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:38734  Received 5 versions from 127.0.0.1:19119/collection1/
[junit4:junit4]   2> 26547 T571 C25 P50311 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50311 DONE. sync succeeded
[junit4:junit4]   2> 26547 T539 C22 P25250 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:25250  Received 5 versions from 127.0.0.1:19119/collection1/
[junit4:junit4]   2> 26547 T571 C25 P50311 REQ /get {sync=http://127.0.0.1:19119/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=4 
[junit4:junit4]   2> 26547 T556 C23 P38734 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:38734 Requesting updates from 127.0.0.1:19119/collection1/n=1 versions=[1429982543760850944]
[junit4:junit4]   2> 26548 T539 C22 P25250 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:25250 Requesting updates from 127.0.0.1:19119/collection1/n=2 versions=[1429982543760850944, 1429982543747219456]
[junit4:junit4]   2> 26548 T526 oasc.SyncStrategy.syncToMe http://127.0.0.1:19119/collection1/:  sync completed with http://127.0.0.1:50311/collection1/
[junit4:junit4]   2> 26551 T523 C24 P19119 REQ /get {distrib=false&getUpdates=1429982543760850944&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> 26553 T521 C24 P19119 REQ /get {distrib=false&getUpdates=1429982543760850944,1429982543747219456&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> 26560 T556 C23 P38734 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:38734 DONE. sync succeeded
[junit4:junit4]   2> 26560 T556 C23 P38734 REQ /get {sync=http://127.0.0.1:19119/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=17 
[junit4:junit4]   2> 26561 T526 oasc.SyncStrategy.syncToMe http://127.0.0.1:19119/collection1/:  sync completed with http://127.0.0.1:38734/collection1/
[junit4:junit4]   2> 26561 T539 C22 P25250 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:25250 DONE. sync succeeded
[junit4:junit4]   2> 26561 T539 C22 P25250 REQ /get {sync=http://127.0.0.1:19119/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=18 
[junit4:junit4]   2> 26562 T526 oasc.SyncStrategy.syncToMe http://127.0.0.

[...truncated too long message...]

K
[junit4:junit4]   2> 168307 T562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 168307 T562 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 168308 T562 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 169220 T578 oasu.PeerSync.handleResponse WARNING PeerSync: core=collection1 url=http://127.0.0.1:50311  couldn't connect to http://127.0.0.1:38734/collection1/, counting as success
[junit4:junit4]   2> 169220 T578 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50311 DONE. sync succeeded
[junit4:junit4]   2> 169220 T578 oasc.SyncStrategy.syncReplicas We have been closed, won't attempt to sync replicas back to leader
[junit4:junit4]   2> 169222 T578 oasc.ShardLeaderElectionContext.runLeaderProcess Sync was not a success but no one else is active! I am the leader
[junit4:junit4]   2> 169222 T578 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50311/collection1/
[junit4:junit4]   2> 169223 T578 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@549154f9
[junit4:junit4]   2> 169224 T578 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=10,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=305,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4]   2> 169225 T578 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 169225 T578 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 169225 T578 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 169225 T578 C25 P50311 oasu.TransactionLog.forceClose SEVERE Error: Forcing close of tlog{file=./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty4/tlog/tlog.0000000000000000005 refcount=1}
[junit4:junit4]   2> 169228 T578 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 169228 T578 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty4/index.20130319210021675
[junit4:junit4]   2> 169228 T578 oasc.CachingDirectoryFactory.closeDirectory Removing directory: ./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty4/index.20130319210021675
[junit4:junit4]   2> 169228 T578 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty4/index.20130319210021675
[junit4:junit4]   2> 169229 T578 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty4
[junit4:junit4]   2> 169229 T578 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty4
[junit4:junit4]   2> 169229 T578 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty4/index
[junit4:junit4]   2> 169229 T578 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.SyncSliceTest-1363737598470/jetty4/index
[junit4:junit4]   2> 169229 T578 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 169230 T578 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election/89373907253788684-127.0.0.1:50311__collection1-n_0000000003
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:153)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:150)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:150)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:246)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 
[junit4:junit4]   2> 169230 T578 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 169231 T578 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 169231 T578 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 169231 T578 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:236)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:233)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:233)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 
[junit4:junit4]   2> 169231 T578 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> NOTE: test params are: codec=Lucene3x, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=hu_HU, timezone=America/Argentina/Rio_Gallegos
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=4,free=126567328,total=460390400
[junit4:junit4]   2> NOTE: All tests run in this JVM: [SolrCoreTest, TestSurroundQueryParser, TestPropInjectDefaults, ConvertedLegacyTest, TestPluginEnable, ShowFileRequestHandlerTest, TestPseudoReturnFields, TestRemoteStreaming, TestExtendedDismaxParser, TestSolrCoreProperties, TestFiltering, TestJmxIntegration, LukeRequestHandlerTest, BinaryUpdateRequestHandlerTest, TestQueryUtils, ZkCLITest, ZkSolrClientTest, TestSolrDeletionPolicy2, ExternalFileFieldSortTest, TestLazyCores, DocumentAnalysisRequestHandlerTest, ChaosMonkeyNothingIsSafeTest, TestDocumentBuilder, PluginInfoTest, CacheHeaderTest, SchemaVersionSpecificBehaviorTest, DirectSolrConnectionTest, SystemInfoHandlerTest, DirectUpdateHandlerOptimizeTest, TestFieldTypeResource, XmlUpdateRequestHandlerTest, SolrRequestParserTest, TestFastLRUCache, TestGroupingSearch, TestJoin, TestCollationKeyRangeQueries, TestIBSimilarityFactory, SearchHandlerTest, TestLFUCache, SyncSliceTest]
[junit4:junit4] Completed on J0 in 169.56s, 1 test, 1 failure <<< FAILURES!

[...truncated 573 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/build.xml:381: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/common-build.xml:449: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/lucene/common-build.xml:1213: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/lucene/common-build.xml:877: There were test failures: 269 suites, 1133 tests, 1 failure, 23 ignored (4 assumptions)

Total time: 45 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message