lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-4.x-MacOSX (64bit/jdk1.7.0) - Build # 953 - Still Failing!
Date Sun, 03 Nov 2013 22:06:30 GMT
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-MacOSX/953/
Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseG1GC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
createcollection the collection time out:60s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: createcollection the collection time out:60s
	at __randomizedtesting.SeedInfo.seed([B22F2E20CA6577D2:33C9A038BD3A17EE]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:464)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:818)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:197)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)




Build Log:
[...truncated 9869 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> 167843 T290 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /ncx/
   [junit4]   2> 167872 T290 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./solrtest-CollectionsAPIDistributedZkTest-1383513182648
   [junit4]   2> 167880 T290 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 167886 T291 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 168088 T290 oasc.ZkTestServer.run start zk server on port:49429
   [junit4]   2> 168224 T290 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 168326 T297 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@513676bb name:ZooKeeperConnection Watcher:127.0.0.1:49429 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 168327 T290 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 168330 T290 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 168399 T290 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 168404 T299 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d6255f2 name:ZooKeeperConnection Watcher:127.0.0.1:49429/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 168404 T290 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 168409 T290 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 168419 T290 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 168428 T290 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 168435 T290 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 168444 T290 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 168467 T290 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 168481 T290 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 168481 T290 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 168490 T290 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 168491 T290 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 168500 T290 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 168500 T290 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 168509 T290 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 168510 T290 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 168518 T290 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 168519 T290 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 168527 T290 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 168528 T290 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 168537 T290 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 168537 T290 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 168547 T290 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 168547 T290 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 168556 T290 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 168556 T290 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> Using old style solr.xml
   [junit4]   2> 168568 T290 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 168572 T301 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@60ee590c name:ZooKeeperConnection Watcher:127.0.0.1:49429 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 168573 T290 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 168573 T290 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 168591 T290 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 168595 T303 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@286738b6 name:ZooKeeperConnection Watcher:127.0.0.1:49429/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 168596 T290 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 168597 T290 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf2/solrconfig.xml
   [junit4]   2> 168598 T290 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 168610 T290 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
   [junit4]   2> 168610 T290 oascc.SolrZkClient.makePath makePath: /configs/conf2/schema.xml
   [junit4]   2> 168619 T290 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 168619 T290 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 168628 T290 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
   [junit4]   2> 168629 T290 oascc.SolrZkClient.makePath makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 168638 T290 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
   [junit4]   2> 168638 T290 oascc.SolrZkClient.makePath makePath: /configs/conf2/protwords.txt
   [junit4]   2> 168647 T290 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
   [junit4]   2> 168648 T290 oascc.SolrZkClient.makePath makePath: /configs/conf2/currency.xml
   [junit4]   2> 168657 T290 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 168657 T290 oascc.SolrZkClient.makePath makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 168666 T290 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 168666 T290 oascc.SolrZkClient.makePath makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 168675 T290 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
   [junit4]   2> 168676 T290 oascc.SolrZkClient.makePath makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 168684 T290 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
   [junit4]   2> 168685 T290 oascc.SolrZkClient.makePath makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 168694 T290 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
   [junit4]   2> 168694 T290 oascc.SolrZkClient.makePath makePath: /configs/conf2/elevate.xml
   [junit4]   2> 169008 T290 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 169014 T290 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49434
   [junit4]   2> 169014 T290 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 169015 T290 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 169015 T290 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1383513183478
   [junit4]   2> 169015 T290 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1383513183478/'
   [junit4]   2> 169047 T290 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1383513183478/solr.xml
   [junit4]   2> 169116 T290 oasc.CoreContainer.<init> New CoreContainer 1423537106
   [junit4]   2> 169116 T290 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1383513183478/]
   [junit4]   2> 169118 T290 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 169118 T290 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 169118 T290 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 169120 T290 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 169120 T290 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 169120 T290 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 169120 T290 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 169121 T290 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 169121 T290 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 169125 T290 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 169126 T290 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 169126 T290 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49429/solr
   [junit4]   2> 169144 T290 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 169146 T290 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 169150 T314 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f530409 name:ZooKeeperConnection Watcher:127.0.0.1:49429 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 169151 T290 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 169165 T290 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 169169 T316 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c9d7893 name:ZooKeeperConnection Watcher:127.0.0.1:49429/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 169169 T290 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 169181 T290 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 169198 T290 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 169218 T290 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 169223 T290 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49434_ncx
   [junit4]   2> 169230 T290 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49434_ncx
   [junit4]   2> 169240 T290 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 169267 T290 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 169274 T290 oasc.Overseer.start Overseer (id=90669919952502789-127.0.0.1:49434_ncx-n_0000000000) starting
   [junit4]   2> 169304 T290 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 169326 T318 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 169328 T290 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 169335 T290 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 169343 T290 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 169364 T317 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 169370 T290 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 169371 T290 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 169394 T290 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 169399 T321 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@384ef344 name:ZooKeeperConnection Watcher:127.0.0.1:49429/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 169399 T290 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 169403 T290 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 169412 T290 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 169714 T290 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 169719 T290 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49438
   [junit4]   2> 169720 T290 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 169720 T290 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 169721 T290 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1383513184186
   [junit4]   2> 169721 T290 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1383513184186/'
   [junit4]   2> 169751 T290 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1383513184186/solr.xml
   [junit4]   2> 169842 T290 oasc.CoreContainer.<init> New CoreContainer 1604026562
   [junit4]   2> 169843 T290 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1383513184186/]
   [junit4]   2> 169844 T290 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 169845 T290 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 169845 T290 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 169845 T290 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 169845 T290 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 169846 T290 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 169846 T290 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 169846 T290 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 169847 T290 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 169850 T290 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 169850 T290 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 169851 T290 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49429/solr
   [junit4]   2> 169851 T290 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 169853 T290 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 169858 T332 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@183e4e71 name:ZooKeeperConnection Watcher:127.0.0.1:49429 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 169859 T290 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 169866 T290 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 169870 T334 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@109e7b6d name:ZooKeeperConnection Watcher:127.0.0.1:49429/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 169870 T290 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 169883 T290 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 170895 T290 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49438_ncx
   [junit4]   2> 170898 T290 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49438_ncx
   [junit4]   2> 170912 T334 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 170913 T316 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 170914 T321 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 170929 T290 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 170929 T290 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 171225 T290 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 171230 T290 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49441
   [junit4]   2> 171231 T290 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 171231 T290 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 171232 T290 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1383513185704
   [junit4]   2> 171232 T290 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1383513185704/'
   [junit4]   2> 171264 T290 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1383513185704/solr.xml
   [junit4]   2> 171336 T290 oasc.CoreContainer.<init> New CoreContainer 894964204
   [junit4]   2> 171336 T290 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1383513185704/]
   [junit4]   2> 171338 T290 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 171339 T290 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 171339 T290 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 171339 T290 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 171340 T290 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 171340 T290 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 171340 T290 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 171340 T290 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 171341 T290 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 171345 T290 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 171345 T290 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 171345 T290 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49429/solr
   [junit4]   2> 171347 T290 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 171348 T290 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 171353 T346 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5bb45a6f name:ZooKeeperConnection Watcher:127.0.0.1:49429 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 171353 T290 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 171360 T290 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 171364 T348 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24946b86 name:ZooKeeperConnection Watcher:127.0.0.1:49429/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 171364 T290 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 171376 T290 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 172387 T290 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49441_ncx
   [junit4]   2> 172389 T290 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49441_ncx
   [junit4]   2> 172399 T334 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 172400 T316 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 172400 T321 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 172401 T348 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 172416 T290 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 172416 T290 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 172710 T290 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 172714 T290 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49444
   [junit4]   2> 172716 T290 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 172716 T290 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 172716 T290 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1383513187192
   [junit4]   2> 172717 T290 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1383513187192/'
   [junit4]   2> 172744 T290 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1383513187192/solr.xml
   [junit4]   2> 172815 T290 oasc.CoreContainer.<init> New CoreContainer 1130757670
   [junit4]   2> 172815 T290 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1383513187192/]
   [junit4]   2> 172840 T290 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 172841 T290 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 172841 T290 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 172841 T290 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 172842 T290 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 172842 T290 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 172842 T290 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 172843 T290 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 172843 T290 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 172847 T290 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 172847 T290 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 172848 T290 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49429/solr
   [junit4]   2> 172848 T290 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 172852 T290 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 172854 T360 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4ef1392c name:ZooKeeperConnection Watcher:127.0.0.1:49429 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 172855 T290 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 172861 T290 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 172867 T362 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6085861c name:ZooKeeperConnection Watcher:127.0.0.1:49429/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 172867 T290 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 172881 T290 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 173891 T290 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49444_ncx
   [junit4]   2> 173894 T290 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49444_ncx
   [junit4]   2> 173905 T334 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 173906 T316 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 173908 T362 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 173908 T348 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 173913 T321 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 173923 T290 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 173923 T290 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 174233 T290 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 174238 T290 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49447
   [junit4]   2> 174241 T290 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 174241 T290 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 174242 T290 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698
   [junit4]   2> 174242 T290 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/'
   [junit4]   2> 174270 T290 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/solr.xml
   [junit4]   2> 174340 T290 oasc.CoreContainer.<init> New CoreContainer 1527607624
   [junit4]   2> 174340 T290 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/]
   [junit4]   2> 174341 T290 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 174342 T290 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 174342 T290 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 174342 T290 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 174343 T290 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 174343 T290 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 174344 T290 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 174344 T290 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 174344 T290 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 174348 T290 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 174348 T290 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 174349 T290 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49429/solr
   [junit4]   2> 174349 T290 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 174351 T290 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 174355 T374 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75c6232a name:ZooKeeperConnection Watcher:127.0.0.1:49429 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 174356 T290 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 174363 T290 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 174367 T376 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7aca53ab name:ZooKeeperConnection Watcher:127.0.0.1:49429/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 174368 T290 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 174381 T290 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 175391 T290 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49447_ncx
   [junit4]   2> 175395 T290 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49447_ncx
   [junit4]   2> 175406 T362 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 175407 T348 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 175407 T376 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 175406 T321 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 175408 T316 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 175407 T334 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 175420 T290 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 175420 T290 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 175459 T327 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&collection.configName=conf1&name=solrj_collection&replicationFactor=2&action=CREATE&router.field=myOwnField&wt=javabin&router.name=compositeId&version=2
   [junit4]   2> 175463 T316 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 175470 T318 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"solrj_collection",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "collection.configName":"conf1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "router.field":"myOwnField",
   [junit4]   2> 	  "router.name":"compositeId"}
   [junit4]   2> 175470 T318 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"solrj_collection",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "collection.configName":"conf1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "router.field":"myOwnField",
   [junit4]   2> 	  "router.name":"compositeId"}
   [junit4]   2> 176903 T317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 176905 T317 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
   [junit4]   2> 176905 T317 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
   [junit4]   2> 176943 T334 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 176943 T376 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 176943 T362 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 176943 T348 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 176943 T321 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 176943 T316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 177004 T318 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2] , repFactor : 2
   [junit4]   2> 177004 T318 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:49447_ncx
   [junit4]   2> 177008 T318 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:49444_ncx
   [junit4]   2> 177009 T318 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:49441_ncx
   [junit4]   2> 177010 T318 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:49438_ncx
   [junit4]   2> 177032 T341 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down
   [junit4]   2> 177032 T325 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down
   [junit4]   2> 177032 T367 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down
   [junit4]   2> 177032 T357 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down
   [junit4]   2> 177037 T341 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 177038 T325 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 177038 T357 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 177038 T367 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 178461 T317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 178462 T317 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49441/ncx",
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49441_ncx",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 178482 T317 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49438/ncx",
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49438_ncx",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 178492 T317 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49447/ncx",
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49447_ncx",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 178501 T317 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49444/ncx",
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49444_ncx",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 178510 T334 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 178511 T316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 178511 T348 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 178511 T321 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 178512 T376 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 178512 T362 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 179040 T325 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
   [junit4]   2> 179040 T357 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
   [junit4]   2> 179040 T341 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
   [junit4]   2> 179043 T357 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1383513187192/solr.xml
   [junit4]   2> 179044 T357 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica2' using instanceDir: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1383513187192/solrj_collection_shard1_replica2
   [junit4]   2> 179043 T341 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1383513185704/solr.xml
   [junit4]   2> 179046 T341 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1383513185704/solrj_collection_shard2_replica1
   [junit4]   2> 179046 T341 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 179046 T357 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 179046 T367 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
   [junit4]   2> 179049 T367 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/solr.xml
   [junit4]   2> 179049 T367 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica1' using instanceDir: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/solrj_collection_shard1_replica1
   [junit4]   2> 179049 T367 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 179044 T325 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1383513184186/solr.xml
   [junit4]   2> 179050 T325 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica2' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1383513184186/solrj_collection_shard2_replica2
   [junit4]   2> 179051 T325 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 179051 T341 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:solrj_collection
   [junit4]   2> 179052 T367 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:solrj_collection
   [junit4]   2> 179052 T357 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:solrj_collection
   [junit4]   2> 179054 T357 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
   [junit4]   2> 179052 T341 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
   [junit4]   2> 179054 T325 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:solrj_collection
   [junit4]   2> 179053 T367 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
   [junit4]   2> 179055 T325 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
   [junit4]   2> 179063 T341 oasc.ZkController.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 179064 T325 oasc.ZkController.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 179064 T367 oasc.ZkController.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 179065 T357 oasc.ZkController.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 179070 T325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1383513184186/solrj_collection_shard2_replica2/'
   [junit4]   2> 179070 T357 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1383513187192/solrj_collection_shard1_replica2/'
   [junit4]   2> 179070 T341 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1383513185704/solrj_collection_shard2_replica1/'
   [junit4]   2> 179073 T367 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/solrj_collection_shard1_replica1/'
   [junit4]   2> 179222 T357 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
   [junit4]   2> 179248 T325 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
   [junit4]   2> 179264 T341 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
   [junit4]   2> 179273 T367 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
   [junit4]   2> 179371 T325 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 179390 T325 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 179397 T357 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 179400 T357 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 179416 T367 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 179417 T325 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
   [junit4]   2> 179426 T357 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
   [junit4]   2> 179451 T367 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 179464 T341 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 179468 T367 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
   [junit4]   2> 179468 T341 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 179484 T341 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
   [junit4]   2> 181024 T357 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 181045 T357 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 181046 T357 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 181051 T367 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 181051 T367 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 181053 T367 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 181071 T357 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 181093 T367 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 181096 T357 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 181098 T367 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 181154 T325 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 181155 T325 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 181156 T325 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 181164 T341 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 181166 T341 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 181167 T325 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 181172 T325 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 181178 T341 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 181195 T341 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 181199 T341 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 181234 T357 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 181250 T357 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 181251 T367 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 181260 T325 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 181265 T357 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 181270 T367 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 181272 T357 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 181273 T357 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 181274 T357 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 181274 T341 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 181279 T357 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 181279 T357 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 181280 T357 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 181288 T357 oasc.SolrCore.<init> [solrj_collection_shard1_replica2] Opening new SolrCore at ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1383513187192/solrj_collection_shard1_replica2/, dataDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1383513187192/solrj_collection_shard1_replica2/data/
   [junit4]   2> 181297 T341 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 181298 T357 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@14d751d4
   [junit4]   2> 181298 T367 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 181299 T325 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 181309 T341 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 181313 T367 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 181315 T367 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 181316 T367 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 181313 T357 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1383513187192/solrj_collection_shard1_replica2/data
   [junit4]   2> 181316 T357 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1383513187192/solrj_collection_shard1_replica2/data/index/
   [junit4]   2> 181317 T357 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica2] Solr index directory './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1383513187192/solrj_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
   [junit4]   2> 181319 T341 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 181319 T341 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 181320 T341 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 181322 T325 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 181323 T357 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1383513187192/solrj_collection_shard1_replica2/data/index
   [junit4]   2> 181324 T357 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=29, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6857274377866711]
   [junit4]   2> 181324 T341 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 181325 T341 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 181324 T367 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 181326 T367 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 181327 T367 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 181326 T341 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 181328 T341 oasc.SolrCore.<init> [solrj_collection_shard2_replica1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1383513185704/solrj_collection_shard2_replica1/, dataDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1383513185704/solrj_collection_shard2_replica1/data/
   [junit4]   2> 181327 T367 oasc.SolrCore.<init> [solrj_collection_shard1_replica1] Opening new SolrCore at ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/solrj_collection_shard1_replica1/, dataDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/solrj_collection_shard1_replica1/data/
   [junit4]   2> 181327 T357 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@66df5ef4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@754a924f),segFN=segments_1,generation=1}
   [junit4]   2> 181329 T357 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 181329 T367 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@14d751d4
   [junit4]   2> 181328 T341 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@14d751d4
   [junit4]   2> 181328 T325 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 181338 T325 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 181339 T325 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 181334 T341 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1383513185704/solrj_collection_shard2_replica1/data
   [junit4]   2> 181340 T341 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1383513185704/solrj_collection_shard2_replica1/data/index/
   [junit4]   2> 181342 T341 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica1] Solr index directory '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1383513185704/solrj_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 181343 T357 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 181345 T325 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 181346 T325 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 181346 T325 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 181347 T325 oasc.SolrCore.<init> [solrj_collection_shard2_replica2] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1383513184186/solrj_collection_shard2_replica2/, dataDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1383513184186/solrj_collection_shard2_replica2/data/
   [junit4]   2> 181347 T325 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@14d751d4
   [junit4]   2> 181342 T367 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/solrj_collection_shard1_replica1/data
   [junit4]   2> 181350 T367 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/solrj_collection_shard1_replica1/data/index/
   [junit4]   2> 181350 T367 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica1] Solr index directory './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/solrj_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 181353 T341 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1383513185704/solrj_collection_shard2_replica1/data/index
   [junit4]   2> 181354 T341 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=29, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6857274377866711]
   [junit4]   2> 181356 T367 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/solrj_collection_shard1_replica1/data/index
   [junit4]   2> 181356 T325 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1383513184186/solrj_collection_shard2_replica2/data
   [junit4]   2> 181356 T325 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1383513184186/solrj_collection_shard2_replica2/data/index/
   [junit4]   2> 181357 T325 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica2] Solr index directory '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1383513184186/solrj_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
   [junit4]   2> 181358 T325 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1383513184186/solrj_collection_shard2_replica2/data/index
   [junit4]   2> 181358 T325 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=29, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6857274377866711]
   [junit4]   2> 181356 T367 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=29, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6857274377866711]
   [junit4]   2> 181363 T367 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@8a55cf3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@55ee2eb4),segFN=segments_1,generation=1}
   [junit4]   2> 181364 T367 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 181373 T367 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 181377 T325 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@37f191aa lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@446e2543),segFN=segments_1,generation=1}
   [junit4]   2> 181377 T325 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 181392 T325 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 181394 T357 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 181395 T357 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 181395 T357 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 181396 T357 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 181396 T357 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 181397 T357 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 181398 T357 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 181398 T357 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 181402 T367 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 181403 T367 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 181403 T367 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 181404 T367 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 181404 T367 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 181405 T357 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 181405 T325 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 181406 T325 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 181405 T341 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@45970cbb lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7542cca3),segFN=segments_1,generation=1}
   [junit4]   2> 181407 T341 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 181405 T367 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 181408 T367 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 181409 T367 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 181407 T325 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 181410 T325 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 181410 T325 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 181411 T325 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 181412 T325 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 181412 T325 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 181406 T357 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 181415 T357 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 181416 T357 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 181417 T357 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 181418 T325 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 181415 T367 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 181420 T325 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 181420 T325 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 181418 T357 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 181417 T341 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 181422 T341 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 181422 T341 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 181423 T341 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 181424 T341 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 181424 T341 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 181426 T341 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 181426 T341 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 181427 T341 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 181428 T341 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 181431 T341 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 181431 T341 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 181432 T341 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 181433 T357 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 181421 T325 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 181435 T325 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 181420 T367 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 181436 T367 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 181437 T367 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 181436 T325 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 181439 T367 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 181439 T367 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 181441 T325 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 181442 T367 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 181433 T341 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 181445 T341 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 181452 T341 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 181455 T357 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 181455 T357 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 181456 T367 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 181457 T367 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 181457 T357 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=40, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7361532777937067]
   [junit4]   2> 181459 T367 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=40, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7361532777937067]
   [junit4]   2> 181462 T325 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 181463 T325 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 181459 T357 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@66df5ef4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@754a924f),segFN=segments_1,generation=1}
   [junit4]   2> 181465 T357 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 181463 T367 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@8a55cf3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@55ee2eb4),segFN=segments_1,generation=1}
   [junit4]   2> 181466 T367 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 181467 T367 oass.SolrIndexSearcher.<init> Opening Searcher@3f71d892 main
   [junit4]   2> 181467 T341 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 181467 T341 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 181466 T357 oass.SolrIndexSearcher.<init> Opening Searcher@499198db main
   [junit4]   2> 181470 T341 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=40, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7361532777937067]
   [junit4]   2> 181466 T325 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=40, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7361532777937067]
   [junit4]   2> 181481 T325 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@37f191aa lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@446e2543),segFN=segments_1,generation=1}
   [junit4]   2> 181484 T325 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 181484 T382 oasc.SolrCore.registerSearcher [solrj_collection_shard1_replica2] Registered new searcher Searcher@499198db main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 181486 T325 oass.SolrIndexSearcher.<init> Opening Searcher@74888272 main
   [junit4]   2> 181488 T383 oasc.SolrCore.registerSearcher [solrj_collection_shard1_replica1] Registered new searcher Searcher@3f71d892 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 181523 T384 oasc.SolrCore.registerSearcher [solrj_collection_shard2_replica2] Registered new searcher Searcher@74888272 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 181526 T341 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@45970cbb lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7542cca3),segFN=segments_1,generation=1}
   [junit4]   2> 181526 T341 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 181527 T341 oass.SolrIndexSearcher.<init> Opening Searcher@4f4d438f main
   [junit4]   2> 181533 T325 oasc.CoreContainer.registerCore registering core: solrj_collection_shard2_replica2
   [junit4]   2> 181533 T325 oasc.ZkController.register Register replica - core:solrj_collection_shard2_replica2 address:http://127.0.0.1:49438/ncx collection:solrj_collection shard:shard2
   [junit4]   2> 181534 T367 oasc.CoreContainer.registerCore registering core: solrj_collection_shard1_replica1
   [junit4]   2> 181535 T367 oasc.ZkController.register Register replica - core:solrj_collection_shard1_replica1 address:http://127.0.0.1:49447/ncx collection:solrj_collection shard:shard1
   [junit4]   2> 181539 T357 oasc.CoreContainer.registerCore registering core: solrj_collection_shard1_replica2
   [junit4]   2> 181535 T385 oasc.SolrCore.registerSearcher [solrj_collection_shard2_replica1] Registered new searcher Searcher@4f4d438f main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 181545 T341 oasc.CoreContainer.registerCore registering core: solrj_collection_shard2_replica1
   [junit4]   2> 181545 T341 oasc.ZkController.register Register replica - core:solrj_collection_shard2_replica1 address:http://127.0.0.1:49441/ncx collection:solrj_collection shard:shard2
   [junit4]   2> 181546 T357 oasc.ZkController.register Register replica - core:solrj_collection_shard1_replica2 address:http://127.0.0.1:49444/ncx collection:solrj_collection shard:shard1
   [junit4]   2> 181577 T367 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leader_elect/shard1/election
   [junit4]   2> 181580 T341 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leader_elect/shard2/election
   [junit4]   2> 181591 T325 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leader_elect/shard2/election
   [junit4]   2> 181594 T357 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leader_elect/shard1/election
   [junit4]   2> 181621 T341 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 181627 T367 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 181632 T341 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 181633 T341 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 181633 T341 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49441/ncx/solrj_collection_shard2_replica1/
   [junit4]   2> 181636 T367 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 181636 T367 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 181637 T367 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49447/ncx/solrj_collection_shard1_replica1/
   [junit4]   2> 181649 T341 oasu.PeerSync.sync PeerSync: core=solrj_collection_shard2_replica1 url=http://127.0.0.1:49441/ncx START replicas=[http://127.0.0.1:49438/ncx/solrj_collection_shard2_replica2/] nUpdates=100
   [junit4]   2> 181649 T367 oasu.PeerSync.sync PeerSync: core=solrj_collection_shard1_replica1 url=http://127.0.0.1:49447/ncx START replicas=[http://127.0.0.1:49444/ncx/solrj_collection_shard1_replica2/] nUpdates=100
   [junit4]   2> 181652 T367 oasu.PeerSync.sync PeerSync: core=solrj_colle

[...truncated too long message...]

junit4]   2> 333609 T290 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 333609 T290 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 333609 T290 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 333610 T290 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard5_replica1] Closing main searcher on request.
   [junit4]   2> 333611 T290 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 333611 T290 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/awholynewcollection_0_shard5_replica1/data [CachedDir<<refCount=0;path=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/awholynewcollection_0_shard5_replica1/data;done=false>>]
   [junit4]   2> 333611 T290 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/awholynewcollection_0_shard5_replica1/data
   [junit4]   2> 333611 T290 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/awholynewcollection_0_shard5_replica1/data/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/awholynewcollection_0_shard5_replica1/data/index;done=false>>]
   [junit4]   2> 333612 T290 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/awholynewcollection_0_shard5_replica1/data/index
   [junit4]   2> 333612 T290 oasc.SolrCore.close [awholynewcollection_0_shard1_replica2]  CLOSING SolrCore org.apache.solr.core.SolrCore@58b19082
   [junit4]   2> 333628 T290 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 333629 T290 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 333629 T290 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 333629 T290 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 333630 T290 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard1_replica2] Closing main searcher on request.
   [junit4]   2> 333631 T290 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 333631 T290 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/awholynewcollection_0_shard1_replica2/data [CachedDir<<refCount=0;path=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/awholynewcollection_0_shard1_replica2/data;done=false>>]
   [junit4]   2> 333631 T290 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/awholynewcollection_0_shard1_replica2/data
   [junit4]   2> 333631 T290 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/awholynewcollection_0_shard1_replica2/data/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/awholynewcollection_0_shard1_replica2/data/index;done=false>>]
   [junit4]   2> 333632 T290 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1383513188698/awholynewcollection_0_shard1_replica2/data/index
   [junit4]   2> 333632 T290 oasc.SolrCore.close [acollectionafterbaddelete_shard1_replica1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3fbbe33f
   [junit4]   2> 333643 T290 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 333643 T290 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 333643 T290 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 333643 T290 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 333645 T290 oasc.SolrCore.closeSearcher [acollectionafterbaddelete_shard1_replica1] Closing main searcher on request.
   [junit4]   2> 333646 T290 oasc.CachingDirectoryFactory.close Closing RAMDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 333646 T290 oasc.CachingDirectoryFactory.closeCacheValue looking to close data [CachedDir<<refCount=0;path=data;done=false>>]
   [junit4]   2> 333646 T290 oasc.CachingDirectoryFactory.close Closing directory: data
   [junit4]   2> 333647 T290 oasc.CachingDirectoryFactory.closeCacheValue looking to close data/index [CachedDir<<refCount=0;path=data/index;done=false>>]
   [junit4]   2> 333647 T290 oasc.CachingDirectoryFactory.close Closing directory: data/index
   [junit4]   2> 333650 T580 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=90669919952502798-127.0.0.1:49447_ncx-n_0000000004) am no longer a leader.
   [junit4]   2> 333655 T376 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 333656 T534 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1421fcfd295000e, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 333668 T290 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/ncx,null}
   [junit4]   2> 333729 T290 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> 333733 T290 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:49429 49429
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   1> client port:0.0.0.0/0.0.0.0:49429
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=B22F2E20CA6577D2 -Dtests.slow=true -Dtests.locale=mk -Dtests.timezone=Etc/GMT-9 -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR    166s | CollectionsAPIDistributedZkTest.testDistribSearch <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: createcollection the collection time out:60s
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([B22F2E20CA6577D2:33C9A038BD3A17EE]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:464)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:818)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:197)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 333749 T290 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 165911 T289 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Appending, sim=DefaultSimilarity, locale=mk, timezone=Etc/GMT-9
   [junit4]   2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.7.0_45 (64-bit)/cpus=2,threads=3,free=72907680,total=535822336
   [junit4]   2> NOTE: All tests run in this JVM: [TestNRTOpen, TestDistributedSearch, QueryElevationComponentTest, TestRandomDVFaceting, HdfsSyncSliceTest, TestSolrQueryParserDefaultOperatorResource, HdfsUnloadDistributedZkTest, TestQuerySenderListener, CSVRequestHandlerTest, CollectionsAPIDistributedZkTest]
   [junit4] Completed in 166.46s, 1 test, 1 error <<< FAILURES!

[...truncated 1001 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:428: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:408: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build.xml:189: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/common-build.xml:483: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:1263: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:906: There were test failures: 333 suites, 1469 tests, 1 error, 40 ignored (5 assumptions)

Total time: 92 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message