lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 1160 - Failure!
Date Fri, 27 Dec 2013 13:34:11 GMT
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/1160/
Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseSerialGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([827EFFDBF5C7F458:39871C382989464]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertFalse(Assert.java:68)
	at org.junit.Assert.assertFalse(Assert.java:79)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deleteCollectionWithDownNodes(CollectionsAPIDistributedZkTest.java:390)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:203)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:849)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)




Build Log:
[...truncated 10334 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> 1247683 T4052 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /ot/
   [junit4]   2> 1247692 T4052 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-CollectionsAPIDistributedZkTest-1388149499806
   [junit4]   2> 1247693 T4052 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 1247694 T4053 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1247798 T4052 oasc.ZkTestServer.run start zk server on port:50272
   [junit4]   2> 1247800 T4052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1247816 T4059 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@efc70c0 name:ZooKeeperConnection Watcher:127.0.0.1:50272 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1247817 T4052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1247817 T4052 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1247834 T4052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1247845 T4061 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@49072580 name:ZooKeeperConnection Watcher:127.0.0.1:50272/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1247846 T4052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1247846 T4052 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1247857 T4052 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1247865 T4052 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1247872 T4052 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1247878 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1247879 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1247889 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1247890 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1247899 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1247899 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1247908 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1247908 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1247919 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1247920 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1247930 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1247930 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1247942 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1247943 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1247958 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1247959 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1247975 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1247976 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1247993 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1247993 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1248008 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1248009 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> Using new style solr.xml
   [junit4]   2> 1248031 T4052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1248039 T4063 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5dfe7ff9 name:ZooKeeperConnection Watcher:127.0.0.1:50272 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1248039 T4052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1248040 T4052 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1248056 T4052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1248064 T4065 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@148ee8b1 name:ZooKeeperConnection Watcher:127.0.0.1:50272/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1248065 T4052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1248068 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf2/solrconfig.xml
   [junit4]   2> 1248084 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 1248105 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
   [junit4]   2> 1248106 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf2/schema.xml
   [junit4]   2> 1248120 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1248121 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1248136 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
   [junit4]   2> 1248137 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 1248152 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
   [junit4]   2> 1248153 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf2/protwords.txt
   [junit4]   2> 1248167 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
   [junit4]   2> 1248168 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf2/currency.xml
   [junit4]   2> 1248185 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1248185 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1248201 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1248201 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1248217 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
   [junit4]   2> 1248218 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 1248233 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
   [junit4]   2> 1248234 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 1248249 T4052 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
   [junit4]   2> 1248250 T4052 oascc.SolrZkClient.makePath makePath: /configs/conf2/elevate.xml
   [junit4]   2> 1248629 T4052 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1248634 T4052 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50277
   [junit4]   2> 1248635 T4052 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1248635 T4052 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1248635 T4052 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388149500382
   [junit4]   2> 1248635 T4052 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388149500382/'
   [junit4]   2> 1248667 T4052 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388149500382/solr.xml
   [junit4]   2> 1248750 T4052 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 1248752 T4052 oasc.CoreContainer.<init> New CoreContainer 1211081598
   [junit4]   2> 1248752 T4052 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388149500382/]
   [junit4]   2> 1248754 T4052 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1248754 T4052 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1248755 T4052 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1248755 T4052 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1248755 T4052 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1248755 T4052 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1248756 T4052 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1248756 T4052 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1248756 T4052 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1248770 T4052 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1248771 T4052 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1248771 T4052 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1248771 T4052 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50272/solr
   [junit4]   2> 1248772 T4052 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1248774 T4052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1248778 T4076 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fa37091 name:ZooKeeperConnection Watcher:127.0.0.1:50272 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1248779 T4052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1248784 T4052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1248787 T4078 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@204e355f name:ZooKeeperConnection Watcher:127.0.0.1:50272/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1248788 T4052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1248792 T4052 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1248802 T4052 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1248810 T4052 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1248815 T4052 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50277_ot
   [junit4]   2> 1248817 T4052 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50277_ot
   [junit4]   2> 1248828 T4052 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1248843 T4052 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1248851 T4052 oasc.Overseer.start Overseer (id=90973765619613701-127.0.0.1:50277_ot-n_0000000000) starting
   [junit4]   2> 1248859 T4052 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1248870 T4080 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1248871 T4052 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1248880 T4052 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1248886 T4052 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1248895 T4079 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1248898 T4052 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388149500382
   [junit4]   2> 1249046 T4052 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388149500382/conf/
   [junit4]   2> 1249053 T4052 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1249055 T4052 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1249055 T4052 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1249060 T4052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1249065 T4083 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7bbc66c6 name:ZooKeeperConnection Watcher:127.0.0.1:50272/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1249066 T4052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1249069 T4052 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1249077 T4052 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1249401 T4052 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1249417 T4052 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50281
   [junit4]   2> 1249418 T4052 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1249419 T4052 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1249419 T4052 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388149501190
   [junit4]   2> 1249420 T4052 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388149501190/'
   [junit4]   2> 1249456 T4052 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388149501190/solr.xml
   [junit4]   2> 1249533 T4052 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 1249534 T4052 oasc.CoreContainer.<init> New CoreContainer 685092336
   [junit4]   2> 1249534 T4052 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388149501190/]
   [junit4]   2> 1249535 T4052 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1249536 T4052 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1249536 T4052 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1249536 T4052 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1249537 T4052 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1249537 T4052 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1249537 T4052 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1249537 T4052 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1249538 T4052 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1249551 T4052 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1249552 T4052 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1249552 T4052 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1249552 T4052 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50272/solr
   [junit4]   2> 1249553 T4052 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1249554 T4052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1249558 T4094 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c8a449f name:ZooKeeperConnection Watcher:127.0.0.1:50272 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1249559 T4052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1249565 T4052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1249569 T4096 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d34a476 name:ZooKeeperConnection Watcher:127.0.0.1:50272/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1249570 T4052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1249580 T4052 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1250593 T4052 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50281_ot
   [junit4]   2> 1250599 T4052 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50281_ot
   [junit4]   2> 1250613 T4083 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1250614 T4096 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1250615 T4078 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1250650 T4052 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388149501190
   [junit4]   2> 1250811 T4052 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388149501190/conf/
   [junit4]   2> 1250818 T4052 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1250819 T4052 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1250819 T4052 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1251198 T4052 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1251201 T4052 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50284
   [junit4]   2> 1251202 T4052 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1251203 T4052 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1251203 T4052 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388149502935
   [junit4]   2> 1251204 T4052 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388149502935/'
   [junit4]   2> 1251236 T4052 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388149502935/solr.xml
   [junit4]   2> 1251328 T4052 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 1251329 T4052 oasc.CoreContainer.<init> New CoreContainer 923278915
   [junit4]   2> 1251329 T4052 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388149502935/]
   [junit4]   2> 1251331 T4052 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1251331 T4052 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1251331 T4052 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1251332 T4052 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1251332 T4052 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1251332 T4052 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1251333 T4052 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1251333 T4052 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1251334 T4052 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1251348 T4052 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1251348 T4052 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1251349 T4052 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1251349 T4052 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50272/solr
   [junit4]   2> 1251349 T4052 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1251351 T4052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1251355 T4108 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@73e5f31a name:ZooKeeperConnection Watcher:127.0.0.1:50272 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1251356 T4052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1251361 T4052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1251365 T4110 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14a2ff93 name:ZooKeeperConnection Watcher:127.0.0.1:50272/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1251365 T4052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1251375 T4052 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1252386 T4052 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50284_ot
   [junit4]   2> 1252391 T4052 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50284_ot
   [junit4]   2> 1252405 T4096 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1252406 T4083 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1252406 T4078 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1252406 T4110 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1252428 T4052 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388149502935
   [junit4]   2> 1252531 T4052 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388149502935/conf/
   [junit4]   2> 1252536 T4052 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1252537 T4052 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1252537 T4052 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1252883 T4052 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1252887 T4052 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50287
   [junit4]   2> 1252888 T4052 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1252888 T4052 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1252888 T4052 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388149504653
   [junit4]   2> 1252889 T4052 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388149504653/'
   [junit4]   2> 1252914 T4052 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388149504653/solr.xml
   [junit4]   2> 1252997 T4052 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 1252997 T4052 oasc.CoreContainer.<init> New CoreContainer 32552187
   [junit4]   2> 1252997 T4052 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388149504653/]
   [junit4]   2> 1252999 T4052 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1252999 T4052 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1252999 T4052 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1252999 T4052 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1253000 T4052 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1253000 T4052 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1253000 T4052 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1253000 T4052 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1253001 T4052 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1253013 T4052 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1253013 T4052 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1253013 T4052 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1253015 T4052 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50272/solr
   [junit4]   2> 1253015 T4052 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1253016 T4052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1253021 T4122 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5eaef588 name:ZooKeeperConnection Watcher:127.0.0.1:50272 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1253021 T4052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1253026 T4052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1253031 T4124 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b285e4f name:ZooKeeperConnection Watcher:127.0.0.1:50272/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1253031 T4052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1253041 T4052 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1254050 T4052 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50287_ot
   [junit4]   2> 1254053 T4052 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50287_ot
   [junit4]   2> 1254061 T4096 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1254061 T4078 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1254061 T4110 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1254061 T4124 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1254062 T4083 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1254072 T4052 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388149504653
   [junit4]   2> 1254210 T4052 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388149504653/conf/
   [junit4]   2> 1254217 T4052 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1254218 T4052 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1254218 T4052 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1254578 T4052 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1254582 T4052 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50290
   [junit4]   2> 1254582 T4052 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1254583 T4052 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1254583 T4052 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388149506334
   [junit4]   2> 1254583 T4052 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388149506334/'
   [junit4]   2> 1254615 T4052 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388149506334/solr.xml
   [junit4]   2> 1254708 T4052 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 1254708 T4052 oasc.CoreContainer.<init> New CoreContainer 1174869159
   [junit4]   2> 1254709 T4052 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388149506334/]
   [junit4]   2> 1254710 T4052 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1254711 T4052 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1254712 T4052 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1254712 T4052 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1254713 T4052 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1254714 T4052 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1254715 T4052 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1254715 T4052 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1254716 T4052 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1254737 T4052 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1254737 T4052 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1254737 T4052 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1254738 T4052 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50272/solr
   [junit4]   2> 1254738 T4052 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1254740 T4052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1254745 T4136 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14a1d3e2 name:ZooKeeperConnection Watcher:127.0.0.1:50272 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1254746 T4052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1254752 T4052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1254756 T4138 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c2ed1b9 name:ZooKeeperConnection Watcher:127.0.0.1:50272/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1254756 T4052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1254766 T4052 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1255778 T4052 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50290_ot
   [junit4]   2> 1255782 T4052 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50290_ot
   [junit4]   2> 1255796 T4083 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1255797 T4110 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1255799 T4078 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1255800 T4124 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1255800 T4096 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1255800 T4138 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1255828 T4052 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388149506334
   [junit4]   2> 1255978 T4052 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388149506334/conf/
   [junit4]   2> 1255985 T4052 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1255986 T4052 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1255986 T4052 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1255998 T4087 oasha.CollectionsHandler.handleCreateAction Creating Collection : collection.configName=conf1&version=2&router.name=compositeId&router.field=myOwnField&name=solrj_collection&wt=javabin&action=CREATE&numShards=2&replicationFactor=2
   [junit4]   2> 1256001 T4078 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1256005 T4080 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"solrj_collection",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "collection.configName":"conf1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "router.name":"compositeId",
   [junit4]   2> 	  "router.field":"myOwnField"}
   [junit4]   2> 1256005 T4080 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"solrj_collection",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "collection.configName":"conf1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "router.name":"compositeId",
   [junit4]   2> 	  "router.field":"myOwnField"}
   [junit4]   2> 1256006 T4080 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection 
   [junit4]   2> 1256006 T4080 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
   [junit4]   2> 1256020 T4078 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1256025 T4079 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1256027 T4079 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
   [junit4]   2> 1256027 T4079 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
   [junit4]   2> 1256036 T4078 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1256039 T4078 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1256039 T4096 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1256039 T4124 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1256040 T4083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1256040 T4110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1256040 T4138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1256122 T4080 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2] , repFactor : 2
   [junit4]   2> 1256122 T4080 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:50284_ot
   [junit4]   2> 1256123 T4080 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:50287_ot
   [junit4]   2> 1256124 T4080 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:50281_ot
   [junit4]   2> 1256126 T4080 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:50277_ot
   [junit4]   2> 1256140 T4085 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down
   [junit4]   2> 1256143 T4117 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down
   [junit4]   2> 1256146 T4069 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down
   [junit4]   2> 1256147 T4101 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down
   [junit4]   2> 1256150 T4085 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1256150 T4117 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1256151 T4078 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1256152 T4101 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1256153 T4069 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1256156 T4079 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1256158 T4079 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50281/ot",
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50281_ot",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1256165 T4078 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1256170 T4079 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50287/ot",
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50287_ot",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1256178 T4078 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1256181 T4079 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50284/ot",
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50284_ot",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1256189 T4078 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1256192 T4079 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50277/ot",
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50277_ot",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1256201 T4078 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1256307 T4138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1256308 T4078 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1256308 T4124 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1256308 T4083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1256308 T4096 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1256308 T4110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1257152 T4085 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
   [junit4]   2> 1257152 T4117 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
   [junit4]   2> 1257157 T4101 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
   [junit4]   2> 1257158 T4117 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica2' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388149504653/solrj_collection_shard1_replica2
   [junit4]   2> 1257159 T4117 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 1257159 T4069 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
   [junit4]   2> 1257160 T4101 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica1' using instanceDir: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388149502935/solrj_collection_shard1_replica1
   [junit4]   2> 1257161 T4101 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 1257162 T4085 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388149501190/solrj_collection_shard2_replica1
   [junit4]   2> 1257163 T4085 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 1257164 T4069 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica2' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388149500382/solrj_collection_shard2_replica2
   [junit4]   2> 1257164 T4069 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 1257170 T4101 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1257170 T4101 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 1257170 T4117 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1257171 T4117 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 1257170 T4085 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1257172 T4085 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 1257170 T4069 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1257173 T4069 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 1257173 T4101 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388149502935/solrj_collection_shard1_replica1/'
   [junit4]   2> 1257174 T4117 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388149504653/solrj_collection_shard1_replica2/'
   [junit4]   2> 1257176 T4085 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388149501190/solrj_collection_shard2_replica1/'
   [junit4]   2> 1257178 T4069 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388149500382/solrj_collection_shard2_replica2/'
   [junit4]   2> 1257290 T4101 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1257296 T4069 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1257360 T4085 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1257385 T4117 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1257402 T4101 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1257433 T4101 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1257451 T4101 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
   [junit4]   2> 1257460 T4069 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1257469 T4085 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1257476 T4069 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1257480 T4085 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1257511 T4085 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
   [junit4]   2> 1257519 T4069 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
   [junit4]   2> 1257532 T4117 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1257547 T4117 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1257559 T4117 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
   [junit4]   2> 1258736 T4085 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1258736 T4101 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1258751 T4085 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1258758 T4101 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1258761 T4101 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1258776 T4085 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1258795 T4069 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1258820 T4069 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1258825 T4069 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1258839 T4101 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1258856 T4101 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1258869 T4101 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1258870 T4085 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1258871 T4069 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1258873 T4101 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1258880 T4101 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1258881 T4101 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1258882 T4069 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1258884 T4085 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1258887 T4101 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1258888 T4101 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1258889 T4101 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1258889 T4101 oasc.SolrCore.<init> [solrj_collection_shard1_replica1] Opening new SolrCore at ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388149502935/solrj_collection_shard1_replica1/, dataDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388149502935/solrj_collection_shard1_replica1/data/
   [junit4]   2> 1258889 T4101 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@e06d6c
   [junit4]   2> 1258891 T4101 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388149502935/solrj_collection_shard1_replica1/data
   [junit4]   2> 1258891 T4101 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388149502935/solrj_collection_shard1_replica1/data/index/
   [junit4]   2> 1258892 T4101 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica1] Solr index directory './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388149502935/solrj_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1258892 T4101 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388149502935/solrj_collection_shard1_replica1/data/index
   [junit4]   2> 1258893 T4101 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=79.1181640625, floorSegmentMB=1.0947265625, forceMergeDeletesPctAllowed=13.555059582122452, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5356886327223281
   [junit4]   2> 1258893 T4069 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1258894 T4101 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@6dda3b6f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2d454403),segFN=segments_1,generation=1}
   [junit4]   2> 1258895 T4101 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1258898 T4069 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1258899 T4069 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1258899 T4069 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1258900 T4101 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1258900 T4101 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1258901 T4069 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1258901 T4069 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1258901 T4069 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1258902 T4069 oasc.SolrCore.<init> [solrj_collection_shard2_replica2] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388149500382/solrj_collection_shard2_replica2/, dataDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388149500382/solrj_collection_shard2_replica2/data/
   [junit4]   2> 1258902 T4069 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@e06d6c
   [junit4]   2> 1258901 T4101 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1258904 T4101 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1258904 T4101 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1258904 T4101 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1258905 T4101 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1258906 T4101 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1258906 T4101 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1258907 T4101 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1258907 T4101 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1258907 T4101 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1258908 T4101 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1258908 T4085 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1258909 T4069 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388149500382/solrj_collection_shard2_replica2/data
   [junit4]   2> 1258909 T4069 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388149500382/solrj_collection_shard2_replica2/data/index/
   [junit4]   2> 1258911 T4069 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica2] Solr index directory '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388149500382/solrj_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1258908 T4101 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1258912 T4101 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1258913 T4101 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1258913 T4101 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1258915 T4069 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388149500382/solrj_collection_shard2_replica2/data/index
   [junit4]   2> 1258916 T4069 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=79.1181640625, floorSegmentMB=1.0947265625, forceMergeDeletesPctAllowed=13.555059582122452, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5356886327223281
   [junit4]   2> 1258917 T4069 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@772945fb lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6fcfd302),segFN=segments_1,generation=1}
   [junit4]   2> 1258917 T4069 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1258921 T4085 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1258921 T4085 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1258922 T4085 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1258927 T4069 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1258928 T4069 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1258928 T4069 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1258928 T4069 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1258929 T4069 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1258929 T4069 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1258930 T4069 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1258930 T4069 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1258930 T4069 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1258927 T4101 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1258934 T4069 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1258935 T4069 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1258935 T4069 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1258935 T4069 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1258936 T4069 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1258936 T4069 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1258937 T4069 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1258938 T4069 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1258940 T4069 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1258945 T4101 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1258946 T4101 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1258959 T4117 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1258960 T4069 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1258960 T4069 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1258961 T4069 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=9.3515625, floorSegmentMB=1.4951171875, forceMergeDeletesPctAllowed=23.540589811828067, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1258962 T4085 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1258963 T4085 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1258963 T4101 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=9.3515625, floorSegmentMB=1.4951171875, forceMergeDeletesPctAllowed=23.540589811828067, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1258964 T4069 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@772945fb lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6fcfd302),segFN=segments_1,generation=1}
   [junit4]   2> 1258965 T4069 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1258966 T4069 oass.SolrIndexSearcher.<init> Opening Searcher@7c67465 main
   [junit4]   2> 1258964 T4085 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1258970 T4085 oasc.SolrCore.<init> [solrj_collection_shard2_replica1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388149501190/solrj_collection_shard2_replica1/, dataDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388149501190/solrj_collection_shard2_replica1/data/
   [junit4]   2> 1258971 T4085 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@e06d6c
   [junit4]   2> 1258973 T4145 oasc.SolrCore.registerSearcher [solrj_collection_shard2_replica2] Registered new searcher Searcher@7c67465 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1258973 T4101 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@6dda3b6f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2d454403),segFN=segments_1,generation=1}
   [junit4]   2> 1258974 T4101 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1258974 T4101 oass.SolrIndexSearcher.<init> Opening Searcher@6c7ed688 main
   [junit4]   2> 1258975 T4085 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388149501190/solrj_collection_shard2_replica1/data
   [junit4]   2> 1258984 T4085 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388149501190/solrj_collection_shard2_replica1/data/index/
   [junit4]   2> 1258984 T4085 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica1] Solr index directory '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388149501190/solrj_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1258985 T4117 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1258983 T4101 oasc.CoreContainer.registerCore registering core: solrj_collection_shard1_replica1
   [junit4]   2> 1258980 T4144 oasc.SolrCore.registerSearcher [solrj_collection_shard1_replica1] Registered new searcher Searcher@6c7ed688 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1258979 T4069 oasc.CoreContainer.registerCore registering core: solrj_collection_shard2_replica2
   [junit4]   2> 1258988 T4069 oasc.ZkController.register Register replica - core:solrj_collection_shard2_replica2 address:http://127.0.0.1:50277/ot collection:solrj_collection shard:shard2
   [junit4]   2> 1258987 T4101 oasc.ZkController.register Register replica - core:solrj_collection_shard1_replica1 address:http://127.0.0.1:50284/ot collection:solrj_collection shard:shard1
   [junit4]   2> 1258989 T4069 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leader_elect/shard2/election
   [junit4]   2> 1258985 T4085 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388149501190/solrj_collection_shard2_replica1/data/index
   [junit4]   2> 1258990 T4085 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=79.1181640625, floorSegmentMB=1.0947265625, forceMergeDeletesPctAllowed=13.555059582122452, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5356886327223281
   [junit4]   2> 1258993 T4101 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leader_elect/shard1/election
   [junit4]   2> 1258994 T4085 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@5bfbd604 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6e9ff829),segFN=segments_1,generation=1}
   [junit4]   2> 1258994 T4085 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1259006 T4085 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1259007 T4085 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1259008 T4085 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1259008 T4085 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1259010 T4085 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1259008 T4117 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1259011 T4085 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1259013 T4085 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1259013 T4085 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1259013 T4085 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1259014 T4085 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1259015 T4085 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1259015 T4085 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1259015 T4085 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1259016 T4101 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1259017 T4085 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1259019 T4069 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 1259021 T4085 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1259022 T4085 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1259023 T4085 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1259025 T4078 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1259025 T4078 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1259025 T4078 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1259026 T4101 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=179998
   [junit4]   2> 1259027 T4085 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1259029 T4078 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1259029 T4079 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1259037 T4085 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1259037 T4085 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1259038 T4085 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=9.3515625, floorSegmentMB=1.4951171875, forceMergeDeletesPctAllowed=23.540589811828067, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1259039 T4085 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@5bfbd604 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6e9ff829),segFN=segments_1,generation=1}
   [junit4]   2> 1259040 T4085 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1259040 T4085 oass.SolrIndexSearcher.<init> Opening Searcher@576fbf8f main
   [junit4]   2> 1259041 T4069 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=179991
   [junit4]   2> 1260041 T4148 oasc.SolrCore.registerSearcher [solrj_collection_shard2_replica1] Registered new searcher Searcher@576fbf8f main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1260044 T4085 oasc.CoreContainer.registerCore registering core: solrj_collection_shard2_replica1
   [junit4]   2> 1260045 T4085 oasc.ZkController.register Register replica - core:solrj_collection_shard2_replica1 address:http://127.0.0.1:50281/ot collection:solrj_collection shard:shard2
   [junit4]   2> 1260050 T4110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1260050 T4138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1260051 T4124 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1260051 T4083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1260051 T4096 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1260052 T4078 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:

[...truncated too long message...]

k-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388149506334/awholynewcollection_1_shard3_replica2/data/index
   [junit4]   2> 1422277 T4138 oasc.CachingDirectoryFactory.closeCacheValue looking to close ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388149506334/awholynewcollection_1_shard3_replica2/data [CachedDir<<refCount=0;path=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388149506334/awholynewcollection_1_shard3_replica2/data;done=false>>]
   [junit4]   2> 1422277 T4138 oasc.CachingDirectoryFactory.close Closing directory: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388149506334/awholynewcollection_1_shard3_replica2/data
   [junit4]   2> 1422277 T4138 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1/leaders/shard3
   [junit4]   2> 1422278 T4138 oasc.SolrException.log ERROR There was a problem trying to register as the leader:org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 		at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:201)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:198)
   [junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:409)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:378)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:365)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:102)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:263)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:165)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:109)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:138)
   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 	
   [junit4]   2> 1422278 T4138 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/awholynewcollection_1/leader_elect/shard3/election/90973765619613710-core_node8-n_0000000002
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:169)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:166)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:166)
   [junit4]   2> 	at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:66)
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:266)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:165)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:109)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:138)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 1422279 T4138 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1422279 T4138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1422279 T4138 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> NOTE: test params are: codec=Lucene45, sim=DefaultSimilarity, locale=ar_SD, timezone=Mideast/Riyadh88
   [junit4]   2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.7.0_45 (64-bit)/cpus=2,threads=2,free=65306488,total=368988160
   [junit4]   2> NOTE: All tests run in this JVM: [TestSolr4Spatial, TestHashPartitioner, AliasIntegrationTest, TestSolrIndexConfig, TestShardHandlerFactory, SolrTestCaseJ4Test, TestReloadAndDeleteDocs, UnloadDistributedZkTest, AlternateDirectoryTest, TestRealTimeGet, TestSolrXMLSerializer, JsonLoaderTest, DirectSolrSpellCheckerTest, TestSchemaSimilarityResource, XmlUpdateRequestHandlerTest, TestPartialUpdateDeduplication, TestManagedSchemaFieldResource, SearchHandlerTest, EnumFieldTest, TestNRTOpen, TestSolrQueryParserResource, FunctionTest, TestUtils, TermVectorComponentTest, SchemaVersionSpecificBehaviorTest, SpellCheckComponentTest, AddBlockUpdateTest, TestFieldTypeCollectionResource, DistributedQueryComponentCustomSortTest, BadCopyFieldTest, TestCustomSort, TestSchemaVersionResource, AnalysisAfterCoreReloadTest, TestFunctionQuery, SoftAutoCommitTest, MultiTermTest, PeerSyncTest, ChaosMonkeySafeLeaderTest, DirectUpdateHandlerTest, IndexSchemaRuntimeFieldTest, HdfsChaosMonkeySafeLeaderTest, SliceStateUpdateTest, SimplePostToolTest, DocValuesMultiTest, TestCSVLoader, CacheHeaderTest, ShardSplitTest, UUIDFieldTest, NotRequiredUniqueKeyTest, BasicDistributedZk2Test, OverseerTest, TestDFRSimilarityFactory, ChangedSchemaMergeTest, TestSchemaResource, TestLMDirichletSimilarityFactory, DocValuesTest, InfoHandlerTest, PathHierarchyTokenizerFactoryTest, TestAnalyzeInfixSuggestions, TestUniqueKeyFieldResource, TestSolrQueryParser, TestLuceneMatchVersion, TestRemoteStreaming, ConvertedLegacyTest, DirectSolrConnectionTest, TestFaceting, CoreContainerCoreInitFailuresTest, StatelessScriptUpdateProcessorFactoryTest, FastVectorHighlighterTest, TestWordDelimiterFilterFactory, TestSimpleQParserPlugin, TestQuerySenderNoQuery, BinaryUpdateRequestHandlerTest, TestFieldTypeResource, ShardRoutingCustomTest, LoggingHandlerTest, UniqFieldsUpdateProcessorFactoryTest, TestDocSet, TestStressRecovery, TestCloudManagedSchema, StressHdfsTest, ResourceLoaderTest, SolrIndexSplitterTest, TestRecoveryHdfs, TestReplicationHandler, TestQueryUtils, TestHighFrequencyDictionaryFactory, DistributedQueryElevationComponentTest, QueryFacetTest, CopyFieldTest, TestXIncludeConfig, TermVectorComponentDistributedTest, RequiredFieldsTest, FullSolrCloudDistribCmdsTest, TestFieldResource, BasicFunctionalityTest, ZkControllerTest, WordBreakSolrSpellCheckerTest, TestBM25SimilarityFactory, TestLRUCache, UpdateRequestProcessorFactoryTest, TestJmxMonitoredMap, TestMaxScoreQueryParser, TestStressReorder, RequestHandlersTest, TestDynamicFieldResource, PingRequestHandlerTest, SynonymTokenizerTest, HdfsCollectionsAPIDistributedZkTest, OutputWriterTest, NoCacheHeaderTest, TestFastOutputStream, TestRandomMergePolicy, TestAtomicUpdateErrorCases, TestRandomDVFaceting, TestRandomFaceting, SimpleFacetsTest, CoreAdminCreateDiscoverTest, BadIndexSchemaTest, DefaultValueUpdateProcessorTest, SOLR749Test, RegexBoostProcessorTest, TestSurroundQueryParser, CollectionsAPIDistributedZkTest]
   [junit4] Completed in 175.31s, 1 test, 1 failure <<< FAILURES!

[...truncated 711 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:453: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:433: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:37: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:189: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:491: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1304: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:937: There were test failures: 357 suites, 1573 tests, 1 failure, 39 ignored (5 assumptions)

Total time: 82 minutes 4 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message