lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-4.x-MacOSX (64bit/jdk1.6.0) - Build # 1136 - Failure!
Date Sat, 28 Dec 2013 04:59:35 GMT
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-MacOSX/1136/
Java: 64bit/jdk1.6.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
collection already exists: halfdeletedcollection

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: collection already exists: halfdeletedcollection
	at __randomizedtesting.SeedInfo.seed([35CB16208875A577:B42D9838FF2AC54B]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:495)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deletePartiallyCreatedCollection(CollectionsAPIDistributedZkTest.java:357)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:199)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:849)
	at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:695)




Build Log:
[...truncated 9916 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> 1920168 T6372 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 1920177 T6372 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./solrtest-CollectionsAPIDistributedZkTest-1388205255089
   [junit4]   2> 1920179 T6372 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 1920181 T6373 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1920283 T6372 oasc.ZkTestServer.run start zk server on port:52654
   [junit4]   2> 1920289 T6372 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1920306 T6379 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@473342c4 name:ZooKeeperConnection Watcher:127.0.0.1:52654 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1920307 T6372 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1920308 T6372 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1920353 T6372 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1920363 T6381 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@77d78420 name:ZooKeeperConnection Watcher:127.0.0.1:52654/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1920363 T6372 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1920365 T6372 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1920380 T6372 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1920395 T6372 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1920412 T6372 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1920426 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1920428 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1920455 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1920457 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1920474 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1920475 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1920495 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1920497 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1920514 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1920515 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1920536 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1920537 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1920555 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1920557 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1920575 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1920578 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1920600 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1920601 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1920650 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1920652 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1920668 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1920669 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> Using new style solr.xml
   [junit4]   2> 1920689 T6372 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1920698 T6383 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6a71f08a name:ZooKeeperConnection Watcher:127.0.0.1:52654 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1920699 T6372 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1920700 T6372 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1920715 T6372 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1920720 T6385 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e3688b0 name:ZooKeeperConnection Watcher:127.0.0.1:52654/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1920721 T6372 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1920723 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf2/solrconfig.xml
   [junit4]   2> 1920724 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 1920767 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
   [junit4]   2> 1920769 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf2/schema.xml
   [junit4]   2> 1920790 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1920791 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1920804 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
   [junit4]   2> 1920805 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 1920820 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
   [junit4]   2> 1920821 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf2/protwords.txt
   [junit4]   2> 1920833 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
   [junit4]   2> 1920835 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf2/currency.xml
   [junit4]   2> 1920847 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1920848 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1920861 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1920862 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1920878 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
   [junit4]   2> 1920879 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 1920893 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
   [junit4]   2> 1920894 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 1920907 T6372 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
   [junit4]   2> 1920908 T6372 oascc.SolrZkClient.makePath makePath: /configs/conf2/elevate.xml
   [junit4]   2> 1921327 T6372 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1921351 T6372 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52659
   [junit4]   2> 1921352 T6372 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1921353 T6372 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1921354 T6372 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388205255835
   [junit4]   2> 1921355 T6372 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388205255835/'
   [junit4]   2> 1921408 T6372 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388205255835/solr.xml
   [junit4]   2> 1921511 T6372 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 1921512 T6372 oasc.CoreContainer.<init> New CoreContainer 2123118572
   [junit4]   2> 1921512 T6372 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388205255835/]
   [junit4]   2> 1921514 T6372 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1921515 T6372 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1921515 T6372 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1921516 T6372 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1921517 T6372 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1921518 T6372 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1921519 T6372 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1921519 T6372 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1921520 T6372 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1921594 T6372 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1921596 T6372 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1921596 T6372 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1921597 T6372 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52654/solr
   [junit4]   2> 1921598 T6372 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1921600 T6372 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1921605 T6396 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@769970dc name:ZooKeeperConnection Watcher:127.0.0.1:52654 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1921606 T6372 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1921615 T6372 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1921621 T6398 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e8505e2 name:ZooKeeperConnection Watcher:127.0.0.1:52654/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1921622 T6372 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1921629 T6372 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1921652 T6372 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1921686 T6372 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1921697 T6372 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52659_
   [junit4]   2> 1921702 T6372 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52659_
   [junit4]   2> 1921734 T6372 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1921759 T6372 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1921770 T6372 oasc.Overseer.start Overseer (id=90977419598102533-127.0.0.1:52659_-n_0000000000) starting
   [junit4]   2> 1921785 T6372 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1921807 T6400 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1921810 T6372 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1921824 T6372 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1921833 T6372 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1921849 T6399 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1921853 T6372 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388205255835
   [junit4]   2> 1922021 T6372 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388205255835/conf/
   [junit4]   2> 1922033 T6372 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1922035 T6372 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1922036 T6372 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1922046 T6372 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1922054 T6403 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68400ccd name:ZooKeeperConnection Watcher:127.0.0.1:52654/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1922055 T6372 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1922061 T6372 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1922078 T6372 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1922494 T6372 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1922502 T6372 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52663
   [junit4]   2> 1922503 T6372 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1922504 T6372 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1922505 T6372 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388205256989
   [junit4]   2> 1922505 T6372 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388205256989/'
   [junit4]   2> 1922595 T6372 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388205256989/solr.xml
   [junit4]   2> 1922692 T6372 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 1922694 T6372 oasc.CoreContainer.<init> New CoreContainer 193987524
   [junit4]   2> 1922695 T6372 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388205256989/]
   [junit4]   2> 1922698 T6372 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1922700 T6372 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1922701 T6372 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1922702 T6372 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1922702 T6372 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1922703 T6372 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1922704 T6372 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1922705 T6372 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1922706 T6372 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1922746 T6372 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1922748 T6372 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1922749 T6372 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1922750 T6372 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52654/solr
   [junit4]   2> 1922751 T6372 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1922753 T6372 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1922761 T6414 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1be73eca name:ZooKeeperConnection Watcher:127.0.0.1:52654 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1922762 T6372 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1922769 T6372 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1922774 T6416 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6a48b27f name:ZooKeeperConnection Watcher:127.0.0.1:52654/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1922776 T6372 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1922800 T6372 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1923814 T6372 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52663_
   [junit4]   2> 1923819 T6372 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52663_
   [junit4]   2> 1923832 T6403 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1923835 T6416 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1923836 T6398 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1923856 T6372 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388205256989
   [junit4]   2> 1924000 T6372 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388205256989/conf/
   [junit4]   2> 1924007 T6372 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1924009 T6372 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1924009 T6372 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1924442 T6372 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1924452 T6372 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52666
   [junit4]   2> 1924454 T6372 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1924455 T6372 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1924457 T6372 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388205258924
   [junit4]   2> 1924457 T6372 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388205258924/'
   [junit4]   2> 1924543 T6372 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388205258924/solr.xml
   [junit4]   2> 1924636 T6372 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 1924638 T6372 oasc.CoreContainer.<init> New CoreContainer 638560617
   [junit4]   2> 1924638 T6372 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388205258924/]
   [junit4]   2> 1924641 T6372 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1924643 T6372 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1924644 T6372 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1924644 T6372 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1924645 T6372 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1924647 T6372 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1924648 T6372 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1924648 T6372 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1924648 T6372 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1924686 T6372 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1924687 T6372 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1924689 T6372 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1924689 T6372 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52654/solr
   [junit4]   2> 1924691 T6372 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1924693 T6372 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1924700 T6428 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4e3b4004 name:ZooKeeperConnection Watcher:127.0.0.1:52654 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1924701 T6372 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1924709 T6372 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1924716 T6430 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b97317 name:ZooKeeperConnection Watcher:127.0.0.1:52654/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1924717 T6372 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1924740 T6372 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1925757 T6372 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52666_
   [junit4]   2> 1925762 T6372 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52666_
   [junit4]   2> 1925778 T6398 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1925779 T6416 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1925780 T6403 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1925783 T6430 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1925808 T6372 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388205258924
   [junit4]   2> 1925948 T6372 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388205258924/conf/
   [junit4]   2> 1925959 T6372 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1925962 T6372 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1925962 T6372 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1926349 T6372 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1926355 T6372 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52669
   [junit4]   2> 1926357 T6372 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1926358 T6372 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1926361 T6372 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388205260878
   [junit4]   2> 1926362 T6372 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388205260878/'
   [junit4]   2> 1926448 T6372 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388205260878/solr.xml
   [junit4]   2> 1926548 T6372 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 1926550 T6372 oasc.CoreContainer.<init> New CoreContainer 455255598
   [junit4]   2> 1926551 T6372 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388205260878/]
   [junit4]   2> 1926553 T6372 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1926554 T6372 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1926555 T6372 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1926556 T6372 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1926557 T6372 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1926558 T6372 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1926558 T6372 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1926559 T6372 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1926560 T6372 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1926601 T6372 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1926603 T6372 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1926603 T6372 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1926605 T6372 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52654/solr
   [junit4]   2> 1926606 T6372 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1926608 T6372 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1926614 T6442 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7fcc23ec name:ZooKeeperConnection Watcher:127.0.0.1:52654 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1926615 T6372 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1926622 T6372 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1926628 T6444 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3aacc57d name:ZooKeeperConnection Watcher:127.0.0.1:52654/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1926629 T6372 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1926648 T6372 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1927665 T6372 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52669_
   [junit4]   2> 1927669 T6372 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52669_
   [junit4]   2> 1927685 T6416 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1927687 T6398 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1927690 T6403 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1927690 T6430 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1927691 T6444 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1927710 T6372 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388205260878
   [junit4]   2> 1927901 T6372 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388205260878/conf/
   [junit4]   2> 1927912 T6372 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1927914 T6372 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1927915 T6372 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1928361 T6372 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1928369 T6372 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52672
   [junit4]   2> 1928370 T6372 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1928372 T6372 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1928373 T6372 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388205262831
   [junit4]   2> 1928373 T6372 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388205262831/'
   [junit4]   2> 1928427 T6372 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388205262831/solr.xml
   [junit4]   2> 1928522 T6372 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 1928524 T6372 oasc.CoreContainer.<init> New CoreContainer 1274041021
   [junit4]   2> 1928525 T6372 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388205262831/]
   [junit4]   2> 1928526 T6372 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1928527 T6372 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1928527 T6372 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1928528 T6372 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1928529 T6372 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1928530 T6372 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1928530 T6372 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1928531 T6372 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1928532 T6372 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1928562 T6372 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1928563 T6372 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1928563 T6372 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1928565 T6372 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52654/solr
   [junit4]   2> 1928565 T6372 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1928571 T6372 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1928579 T6456 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ec81d3e name:ZooKeeperConnection Watcher:127.0.0.1:52654 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1928580 T6372 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1928591 T6372 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1928600 T6458 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a131855 name:ZooKeeperConnection Watcher:127.0.0.1:52654/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1928600 T6372 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1928619 T6372 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1929634 T6372 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52672_
   [junit4]   2> 1929638 T6372 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52672_
   [junit4]   2> 1929654 T6398 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1929657 T6444 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1929658 T6430 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1929661 T6403 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1929662 T6416 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1929664 T6458 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1929682 T6372 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388205262831
   [junit4]   2> 1929818 T6372 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388205262831/conf/
   [junit4]   2> 1929827 T6372 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1929830 T6372 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1929830 T6372 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1929859 T6407 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&collection.configName=conf1&name=solrj_collection&replicationFactor=2&action=CREATE&router.field=myOwnField&wt=javabin&router.name=compositeId&version=2
   [junit4]   2> 1929865 T6398 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1929876 T6400 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"solrj_collection",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "collection.configName":"conf1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "router.field":"myOwnField",
   [junit4]   2> 	  "router.name":"compositeId"}
   [junit4]   2> 1929876 T6400 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"solrj_collection",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "collection.configName":"conf1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "router.field":"myOwnField",
   [junit4]   2> 	  "router.name":"compositeId"}
   [junit4]   2> 1929877 T6400 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection 
   [junit4]   2> 1929877 T6400 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
   [junit4]   2> 1929903 T6398 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1929916 T6399 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1929920 T6399 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
   [junit4]   2> 1929921 T6399 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
   [junit4]   2> 1929937 T6398 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1929943 T6403 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1929943 T6416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1929944 T6458 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1929945 T6444 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1929943 T6430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1929946 T6398 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1930006 T6400 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2] , repFactor : 2
   [junit4]   2> 1930007 T6400 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:52669_
   [junit4]   2> 1930008 T6400 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:52659_
   [junit4]   2> 1930010 T6400 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:52672_
   [junit4]   2> 1930019 T6400 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:52666_
   [junit4]   2> 1930025 T6391 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down
   [junit4]   2> 1930027 T6423 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down
   [junit4]   2> 1930025 T6453 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down
   [junit4]   2> 1930028 T6439 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down
   [junit4]   2> 1930034 T6423 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1930035 T6453 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1930036 T6439 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1930036 T6398 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1930038 T6391 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1930044 T6399 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1930048 T6399 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:52666",
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:52666_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1930096 T6398 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1930112 T6399 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:52659",
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:52659_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1930145 T6398 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1930152 T6399 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:52669",
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:52669_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1930164 T6398 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1930169 T6399 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:52672",
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:52672_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1930185 T6398 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1930297 T6444 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1930298 T6458 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1930298 T6403 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1930299 T6430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1930300 T6416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1930304 T6398 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1931038 T6453 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
   [junit4]   2> 1931040 T6453 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica1' using instanceDir: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388205262831/solrj_collection_shard2_replica1
   [junit4]   2> 1931041 T6391 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
   [junit4]   2> 1931041 T6423 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
   [junit4]   2> 1931041 T6439 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
   [junit4]   2> 1931047 T6423 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica2' using instanceDir: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388205258924/solrj_collection_shard2_replica2
   [junit4]   2> 1931048 T6423 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 1931041 T6453 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 1931050 T6439 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388205260878/solrj_collection_shard1_replica1
   [junit4]   2> 1931052 T6439 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 1931054 T6391 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica2' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388205255835/solrj_collection_shard1_replica2
   [junit4]   2> 1931054 T6391 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 1931058 T6453 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1931060 T6453 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 1931060 T6391 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1931061 T6391 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 1931059 T6423 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1931063 T6423 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 1931061 T6439 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1931065 T6439 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 1931069 T6453 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388205262831/solrj_collection_shard2_replica1/'
   [junit4]   2> 1931075 T6391 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388205255835/solrj_collection_shard1_replica2/'
   [junit4]   2> 1931076 T6439 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388205260878/solrj_collection_shard1_replica1/'
   [junit4]   2> 1931080 T6423 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388205258924/solrj_collection_shard2_replica2/'
   [junit4]   2> 1931250 T6453 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 1931458 T6391 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 1931460 T6439 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 1931475 T6423 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 1931602 T6453 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1931613 T6453 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1931671 T6453 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
   [junit4]   2> 1931693 T6391 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1931700 T6439 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1931743 T6391 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1931757 T6439 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1931766 T6391 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
   [junit4]   2> 1931775 T6439 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
   [junit4]   2> 1931838 T6423 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1931847 T6423 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1931914 T6423 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
   [junit4]   2> 1934552 T6453 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1934576 T6453 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1934578 T6453 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1934601 T6453 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1934641 T6453 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1934655 T6439 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1934656 T6439 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1934659 T6439 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1934675 T6439 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1934681 T6439 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1934737 T6391 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1934739 T6391 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1934744 T6391 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1934762 T6391 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1934771 T6423 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1934772 T6423 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1934773 T6391 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1934780 T6423 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1934792 T6423 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1934803 T6423 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1934871 T6453 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1934903 T6453 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1934906 T6439 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1934957 T6391 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1934958 T6453 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1934970 T6439 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1934971 T6391 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1934976 T6453 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1934977 T6453 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1934978 T6453 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1934986 T6391 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1934992 T6423 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1934992 T6439 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1935001 T6391 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1935002 T6391 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1935003 T6391 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1935005 T6423 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1935006 T6439 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1935008 T6439 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1935008 T6453 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1935010 T6453 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1935011 T6453 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1935013 T6453 oasc.SolrCore.<init> [solrj_collection_shard2_replica1] Opening new SolrCore at ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388205262831/solrj_collection_shard2_replica1/, dataDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388205262831/solrj_collection_shard2_replica1/data/
   [junit4]   2> 1935014 T6453 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5583d693
   [junit4]   2> 1935010 T6439 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1935018 T6453 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388205262831/solrj_collection_shard2_replica1/data
   [junit4]   2> 1935019 T6453 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388205262831/solrj_collection_shard2_replica1/data/index/
   [junit4]   2> 1935020 T6453 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica1] Solr index directory './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388205262831/solrj_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1935023 T6423 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1935024 T6453 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388205262831/solrj_collection_shard2_replica1/data/index
   [junit4]   2> 1935025 T6453 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=19.55859375, floorSegmentMB=0.431640625, forceMergeDeletesPctAllowed=7.323169279890554, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.46213636630054444
   [junit4]   2> 1935027 T6453 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3e722546 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3405d7cf),segFN=segments_1,generation=1}
   [junit4]   2> 1935028 T6453 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1935037 T6453 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1935041 T6453 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1935043 T6453 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1935044 T6453 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1935044 T6453 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1935046 T6453 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1935048 T6453 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1935048 T6453 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1935049 T6453 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1935054 T6453 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1935057 T6453 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1935058 T6453 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1935059 T6453 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1935062 T6453 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1935065 T6453 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1935067 T6453 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1935052 T6391 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1935073 T6391 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1935075 T6391 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1935076 T6391 oasc.SolrCore.<init> [solrj_collection_shard1_replica2] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388205255835/solrj_collection_shard1_replica2/, dataDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388205255835/solrj_collection_shard1_replica2/data/
   [junit4]   2> 1935078 T6391 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5583d693
   [junit4]   2> 1935090 T6391 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388205255835/solrj_collection_shard1_replica2/data
   [junit4]   2> 1935099 T6391 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388205255835/solrj_collection_shard1_replica2/data/index/
   [junit4]   2> 1935100 T6391 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica2] Solr index directory '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388205255835/solrj_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1935110 T6439 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1935111 T6439 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1935111 T6439 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1935113 T6439 oasc.SolrCore.<init> [solrj_collection_shard1_replica1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388205260878/solrj_collection_shard1_replica1/, dataDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388205260878/solrj_collection_shard1_replica1/data/
   [junit4]   2> 1935114 T6439 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5583d693
   [junit4]   2> 1935117 T6439 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388205260878/solrj_collection_shard1_replica1/data
   [junit4]   2> 1935118 T6439 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388205260878/solrj_collection_shard1_replica1/data/index/
   [junit4]   2> 1935119 T6439 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica1] Solr index directory '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388205260878/solrj_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1935121 T6439 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388205260878/solrj_collection_shard1_replica1/data/index
   [junit4]   2> 1935123 T6439 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=19.55859375, floorSegmentMB=0.431640625, forceMergeDeletesPctAllowed=7.323169279890554, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.46213636630054444
   [junit4]   2> 1935114 T6423 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1935127 T6423 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1935128 T6423 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1935114 T6391 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388205255835/solrj_collection_shard1_replica2/data/index
   [junit4]   2> 1935137 T6391 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=19.55859375, floorSegmentMB=0.431640625, forceMergeDeletesPctAllowed=7.323169279890554, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.46213636630054444
   [junit4]   2> 1935126 T6439 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2c4448a8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@783d324c),segFN=segments_1,generation=1}
   [junit4]   2> 1935141 T6439 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1935161 T6439 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1935163 T6439 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1935163 T6439 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1935164 T6439 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1935169 T6439 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1935173 T6439 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1935174 T6423 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1935175 T6423 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1935176 T6423 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1935178 T6423 oasc.SolrCore.<init> [solrj_collection_shard2_replica2] Opening new SolrCore at ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388205258924/solrj_collection_shard2_replica2/, dataDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388205258924/solrj_collection_shard2_replica2/data/
   [junit4]   2> 1935178 T6423 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5583d693
   [junit4]   2> 1935179 T6453 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1935182 T6423 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388205258924/solrj_collection_shard2_replica2/data
   [junit4]   2> 1935182 T6423 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388205258924/solrj_collection_shard2_replica2/data/index/
   [junit4]   2> 1935183 T6423 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica2] Solr index directory './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388205258924/solrj_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1935184 T6391 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@484dca32 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6cc108b1),segFN=segments_1,generation=1}
   [junit4]   2> 1935185 T6391 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1935188 T6453 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1935189 T6453 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1935175 T6439 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1935192 T6439 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1935193 T6439 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1935194 T6453 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1304627579, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1935185 T6423 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388205258924/solrj_collection_shard2_replica2/data/index
   [junit4]   2> 1935196 T6453 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3e722546 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3405d7cf),segFN=segments_1,generation=1}
   [junit4]   2> 1935197 T6453 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1935194 T6439 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1935193 T6391 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1935200 T6439 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1935201 T6439 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1935199 T6453 oass.SolrIndexSearcher.<init> Opening Searcher@440e29a0 main
   [junit4]   2> 1935196 T6423 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=19.55859375, floorSegmentMB=0.431640625, forceMergeDeletesPctAllowed=7.323169279890554, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.46213636630054444
   [junit4]   2> 1935202 T6439 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1935201 T6391 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1935206 T6439 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1935209 T6439 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1935211 T6439 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1935206 T6423 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@4cb2b817 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@99298a6),segFN=segments_1,generation=1}
   [junit4]   2> 1935215 T6423 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1935212 T6464 oasc.SolrCore.registerSearcher [solrj_collection_shard2_replica1] Registered new searcher Searcher@440e29a0 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1935218 T6453 oasc.CoreContainer.registerCore registering core: solrj_collection_shard2_replica1
   [junit4]   2> 1935219 T6453 oasc.ZkController.register Register replica - core:solrj_collection_shard2_replica1 address:http://127.0.0.1:52672 collection:solrj_collection shard:shard2
   [junit4]   2> 1935207 T6391 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1935221 T6391 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1935222 T6391 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1935218 T6439 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1935223 T6391 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1935266 T6391 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1935264 T6453 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leader_elect/shard2/election
   [junit4]   2> 1935263 T6423 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1935270 T6423 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1935272 T6423 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1935274 T6423 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1935275 T6423 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1935277 T6423 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1935279 T6423 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1935281 T6423 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1935283 T6423 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1935284 T6423 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1935268 T6391 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1935288 T6391 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1935290 T6391 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1935267 T6439 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1935293 T6439 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1935287 T6423 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1935298 T6423 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1935300 T6423 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1935293 T6391 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1935306 T6391 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1935306 T6453 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 1935306 T6423 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1935315 T6423 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1935302 T6439 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1304627579, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1935317 T6423 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1935308 T6391 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1935324 T6398 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1935328 T6398 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1935328 T6398 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1935327 T6423 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1935333 T6391 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1935328 T6453 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=179998
   [junit4]   2> 1935336 T6391 oasc.RequestHandlers.initHandlersFromConfig created /adm

[...truncated too long message...]

xecutor.java:65)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:409)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:378)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:365)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:102)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:263)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:165)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:109)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:138)
   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 	
   [junit4]   2> 2088872 T6444 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/awholynewcollection_0/leader_elect/shard1/election/90977419598102540-core_node3-n_0000000002
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:169)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:166)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:166)
   [junit4]   2> 	at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:66)
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:266)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:165)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:109)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:138)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 2088873 T6444 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2088875 T6444 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 2088876 T6444 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2088877 T6444 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2088877 T6444 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2088877 T6444 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2088878 T6444 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2088878 T6444 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2088879 T6444 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=tr_TR, timezone=Europe/Bratislava
   [junit4]   2> NOTE: Mac OS X 10.8.5 x86_64/Apple Inc. 1.6.0_65 (64-bit)/cpus=2,threads=1,free=264860744,total=471932928
   [junit4]   2> NOTE: All tests run in this JVM: [StressHdfsTest, TestUniqueKeyFieldResource, TestStressUserVersions, HdfsDirectoryTest, SearchHandlerTest, LukeRequestHandlerTest, SolrInfoMBeanTest, XsltUpdateRequestHandlerTest, TestFunctionQuery, TestDistributedSearch, LoggingHandlerTest, ParsingFieldUpdateProcessorsTest, TestDefaultSearchFieldResource, TestCoreContainer, ZkNodePropsTest, SuggesterFSTTest, ChangedSchemaMergeTest, LegacyHTMLStripCharFilterTest, DocValuesMultiTest, TestLazyCores, TestStressRecovery, TestReloadAndDeleteDocs, TestSchemaSimilarityResource, TestNoOpRegenerator, DeleteShardTest, BadCopyFieldTest, TestLFUCache, AddBlockUpdateTest, TestValueSourceCache, OutputWriterTest, TermVectorComponentDistributedTest, ExternalFileFieldSortTest, DirectSolrConnectionTest, TestReload, TestZkChroot, DeleteReplicaTest, CurrencyFieldOpenExchangeTest, TestWriterPerf, TestDistribDocBasedVersion, ChaosMonkeySafeLeaderTest, TestFieldResource, TestWordDelimiterFilterFactory, DateMathParserTest, TestRandomMergePolicy, TestSystemIdResolver, CoreMergeIndexesAdminHandlerTest, SortByFunctionTest, TestManagedSchemaFieldResource, TestXIncludeConfig, CopyFieldTest, QueryParsingTest, PreAnalyzedUpdateProcessorTest, HdfsCollectionsAPIDistributedZkTest, TestStressReorder, TriLevelCompositeIdRoutingTest, SolrCoreCheckLockOnStartupTest, OpenExchangeRatesOrgProviderTest, TestFieldTypeResource, DateFieldTest, TestMergePolicyConfig, TestAnalyzeInfixSuggestions, ShardRoutingCustomTest, TestQueryTypes, DirectUpdateHandlerOptimizeTest, HighlighterTest, TestRemoteStreaming, SpellingQueryConverterTest, TestSolrJ, SolrTestCaseJ4Test, HdfsBasicDistributedZk2Test, AssignTest, TestTrie, PrimUtilsTest, PluginInfoTest, FieldAnalysisRequestHandlerTest, TestJmxMonitoredMap, ResponseLogComponentTest, OverseerCollectionProcessorTest, TestFastLRUCache, UpdateParamsTest, TestCopyFieldCollectionResource, TestSerializedLuceneMatchVersion, MigrateRouteKeyTest, SpatialFilterTest, ReturnFieldsTest, TestFoldingMultitermQuery, SuggesterTSTTest, DOMUtilTest, TestSolrXmlPersistence, TestFuzzyAnalyzedSuggestions, BadIndexSchemaTest, ShowFileRequestHandlerTest, TestSurroundQueryParser, ZkCLITest, TestIBSimilarityFactory, ShardRoutingTest, PathHierarchyTokenizerFactoryTest, StatelessScriptUpdateProcessorFactoryTest, CoreAdminHandlerTest, TestPseudoReturnFields, TermVectorComponentTest, BlockDirectoryTest, TestSolrIndexConfig, TestDocSet, AliasIntegrationTest, TestCollationFieldDocValues, TestRangeQuery, TestConfig, TestBinaryField, DocumentBuilderTest, TestFastWriter, ShardSplitTest, StatsComponentTest, TestAddFieldRealTimeGet, ConvertedLegacyTest, TestReplicationHandler, TestReversedWildcardFilterFactory, SimplePostToolTest, DocValuesTest, JSONWriterTest, TestCollationKeyRangeQueries, SpellCheckCollatorTest, TestRandomDVFaceting, RAMDirectoryFactoryTest, QueryElevationComponentTest, SampleTest, ClusterStateTest, RecoveryZkTest, SoftAutoCommitTest, RequestHandlersTest, TestNonNRTOpen, TermsComponentTest, HdfsUnloadDistributedZkTest, SynonymTokenizerTest, TestRecovery, TestSolrXMLSerializer, TestDocumentBuilder, SuggestComponentTest, TestDistributedMissingSort, TestFieldTypeCollectionResource, TestPostingsSolrHighlighter, TestLMDirichletSimilarityFactory, ScriptEngineTest, LeaderElectionIntegrationTest, RequiredFieldsTest, StandardRequestHandlerTest, FieldMutatingUpdateProcessorTest, DefaultValueUpdateProcessorTest, SolrIndexSplitterTest, DistributedQueryElevationComponentTest, SolrPluginUtilsTest, OverseerTest, BJQParserTest, MBeansHandlerTest, SuggesterWFSTTest, TestJoin, TestImplicitCoreProperties, PolyFieldTest, TestSolrXml, MinimalSchemaTest, DirectSolrSpellCheckerTest, CircularListTest, SolrCmdDistributorTest, TestCoreDiscovery, NotRequiredUniqueKeyTest, BasicDistributedZkTest, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest]
   [junit4] Completed in 169.20s, 1 test, 1 error <<< FAILURES!

[...truncated 529 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:459: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:439: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/extra-targets.xml:37: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build.xml:189: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/common-build.xml:491: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:1307: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:940: There were test failures: 347 suites, 1518 tests, 1 error, 40 ignored (6 assumptions)

Total time: 94 minutes 57 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.6.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message