lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Hostetter <hossman_luc...@fucit.org>
Subject Re: [JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.7.0_25) - Build # 6751 - Failure!
Date Thu, 01 Aug 2013 17:06:50 GMT

Noble,

This pattern of failure (CollectionsAPIDistributedZkTest.testDistribSearch 
inside the testCustomCollectionsAPI method) has been happenining a lot 
ever since your r1508968 commit that introduced the new 
testCustomCollectionsAPI method in this test...

https://svn.apache.org/viewvc/lucene/dev/trunk/solr/core/src/test/org/apache/solr/cloud/CollectionsAPIDistributedZkTest.java?r1=1478701&r2=1508968

I'm seeing lots of fairly consistent jenkins failures, on multiple OSes 
and java versions, as well as frequent local failures on my machine ... 

are you looking into this?



: Date: Thu, 1 Aug 2013 15:04:47 +0000 (UTC)
: From: Policeman Jenkins Server <jenkins@thetaphi.de>
: Reply-To: dev@lucene.apache.org
: To: dev@lucene.apache.org
: Subject: [JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.7.0_25) - Build # 6751 -
:     Failure!
: 
: Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/6751/
: Java: 32bit/jdk1.7.0_25 -server -XX:+UseParallelGC
: 
: 1 tests failed.
: FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
: 
: Error Message:
: Server refused connection at: http://127.0.0.1:33822/hz/en
: 
: Stack Trace:
: org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:33822/hz/en
: 	at __randomizedtesting.SeedInfo.seed([FBC67B6C64D67187:7A20F574138911BB]:0)
: 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:428)
: 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
: 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1535)
: 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCustomCollectionsAPI(CollectionsAPIDistributedZkTest.java:677)
: 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:159)
: 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
: 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
: 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
: 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
: 	at java.lang.reflect.Method.invoke(Method.java:606)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
: 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
: 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
: 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
: 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
: 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
: 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
: 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
: 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
: 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
: 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
: 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
: 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
: 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
: 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
: 	at java.lang.Thread.run(Thread.java:724)
: Caused by: org.apache.http.conn.HttpHostConnectException: Connection to http://127.0.0.1:33822 refused
: 	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:190)
: 	at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
: 	at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
: 	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
: 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
: 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
: 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
: 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
: 	... 45 more
: Caused by: java.net.ConnectException: Connection refused
: 	at java.net.PlainSocketImpl.socketConnect(Native Method)
: 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
: 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
: 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
: 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
: 	at java.net.Socket.connect(Socket.java:579)
: 	at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
: 	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
: 	... 52 more
: 
: 
: 
: 
: Build Log:
: [...truncated 9964 lines...]
:    [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
:    [junit4]   2> 586139 T2417 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /hz/en
:    [junit4]   2> 586143 T2417 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
:    [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-CollectionsAPIDistributedZkTest-1375368748401
:    [junit4]   2> 586144 T2417 oasc.ZkTestServer.run STARTING ZK TEST SERVER
:    [junit4]   2> 586144 T2418 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
:    [junit4]   2> 586244 T2417 oasc.ZkTestServer.run start zk server on port:57557
:    [junit4]   2> 586245 T2417 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 586371 T2424 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c859c1 name:ZooKeeperConnection Watcher:127.0.0.1:57557 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 586371 T2417 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 586371 T2417 oascc.SolrZkClient.makePath makePath: /solr
:    [junit4]   2> 586375 T2417 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 586376 T2426 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c07d2d name:ZooKeeperConnection Watcher:127.0.0.1:57557/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 586377 T2417 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 586377 T2417 oascc.SolrZkClient.makePath makePath: /collections/collection1
:    [junit4]   2> 586379 T2417 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
:    [junit4]   2> 586380 T2417 oascc.SolrZkClient.makePath makePath: /collections/control_collection
:    [junit4]   2> 586382 T2417 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
:    [junit4]   2> 586383 T2417 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
:    [junit4]   2> 586384 T2417 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
:    [junit4]   2> 586388 T2417 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
:    [junit4]   2> 586388 T2417 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
:    [junit4]   2> 586392 T2417 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
:    [junit4]   2> 586392 T2417 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
:    [junit4]   2> 586394 T2417 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
:    [junit4]   2> 586394 T2417 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
:    [junit4]   2> 586396 T2417 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
:    [junit4]   2> 586396 T2417 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
:    [junit4]   2> 586398 T2417 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
:    [junit4]   2> 586398 T2417 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
:    [junit4]   2> 586400 T2417 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
:    [junit4]   2> 586400 T2417 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
:    [junit4]   2> 586402 T2417 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
:    [junit4]   2> 586402 T2417 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
:    [junit4]   2> 586403 T2417 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
:    [junit4]   2> 586404 T2417 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
:    [junit4]   2> 586532 T2417 oejs.Server.doStart jetty-8.1.10.v20130312
:    [junit4]   2> 586536 T2417 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:37515
:    [junit4]   2> 586536 T2417 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
:    [junit4]   2> 586536 T2417 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
:    [junit4]   2> 586537 T2417 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1375368748663
:    [junit4]   2> 586537 T2417 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1375368748663/'
:    [junit4]   2> 586551 T2417 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1375368748663/solr.xml
:    [junit4]   2> 586582 T2417 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
:    [junit4]   2> 586582 T2417 oasc.CoreContainer.<init> New CoreContainer 29449411
:    [junit4]   2> 586582 T2417 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1375368748663/]
:    [junit4]   2> 586583 T2417 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
:    [junit4]   2> 586584 T2417 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
:    [junit4]   2> 586584 T2417 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
:    [junit4]   2> 586584 T2417 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
:    [junit4]   2> 586585 T2417 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
:    [junit4]   2> 586585 T2417 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
:    [junit4]   2> 586585 T2417 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
:    [junit4]   2> 586585 T2417 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
:    [junit4]   2> 586586 T2417 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
:    [junit4]   2> 586586 T2417 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
:    [junit4]   2> 586588 T2417 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:57557/solr
:    [junit4]   2> 586589 T2417 oasc.ZkController.checkChrootPath zkHost includes chroot
:    [junit4]   2> 586589 T2417 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 586590 T2437 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7bcbc8 name:ZooKeeperConnection Watcher:127.0.0.1:57557 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 586591 T2417 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 586591 T2417 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
:    [junit4]   2> 586595 T2417 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 586596 T2439 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1975884 name:ZooKeeperConnection Watcher:127.0.0.1:57557/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 586596 T2417 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 586598 T2417 oascc.SolrZkClient.makePath makePath: /overseer/queue
:    [junit4]   2> 586600 T2417 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
:    [junit4]   2> 586601 T2417 oascc.SolrZkClient.makePath makePath: /live_nodes
:    [junit4]   2> 586605 T2417 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37515_hz%2Fen
:    [junit4]   2> 586606 T2417 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37515_hz%2Fen
:    [junit4]   2> 586614 T2417 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
:    [junit4]   2> 586618 T2417 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
:    [junit4]   2> 586619 T2417 oasc.Overseer.start Overseer (id=90136166295404547-127.0.0.1:37515_hz%2Fen-n_0000000000) starting
:    [junit4]   2> 586622 T2417 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
:    [junit4]   2> 586625 T2441 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
:    [junit4]   2> 586625 T2417 oascc.SolrZkClient.makePath makePath: /clusterstate.json
:    [junit4]   2> 586627 T2417 oascc.SolrZkClient.makePath makePath: /aliases.json
:    [junit4]   2> 586628 T2417 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
:    [junit4]   2> 586630 T2440 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
:    [junit4]   2> 586633 T2417 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1375368748663
:    [junit4]   2> 586666 T2417 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1375368748663/conf/
:    [junit4]   2> 586667 T2417 oasc.CorePropertiesLocator.discover Found 1 core definitions
:    [junit4]   2> 586667 T2417 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
:    [junit4]   2> 586668 T2417 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
:    [junit4]   2> 586668 T2417 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
:    [junit4]   2> 586671 T2417 oascsi.HttpClientUtil.createClient Creating new http client, config:
:    [junit4]   2> 586672 T2417 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 586674 T2444 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b669d1 name:ZooKeeperConnection Watcher:127.0.0.1:57557/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 586674 T2417 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 586675 T2417 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
:    [junit4]   2> 586676 T2417 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
:    [junit4]   2> 586770 T2417 oejs.Server.doStart jetty-8.1.10.v20130312
:    [junit4]   2> 586772 T2417 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:33822
:    [junit4]   2> 586773 T2417 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
:    [junit4]   2> 586774 T2417 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
:    [junit4]   2> 586774 T2417 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1375368748934
:    [junit4]   2> 586775 T2417 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1375368748934/'
:    [junit4]   2> 586790 T2417 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1375368748934/solr.xml
:    [junit4]   2> 586837 T2417 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
:    [junit4]   2> 586837 T2417 oasc.CoreContainer.<init> New CoreContainer 17880774
:    [junit4]   2> 586838 T2417 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1375368748934/]
:    [junit4]   2> 586839 T2417 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
:    [junit4]   2> 586840 T2417 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
:    [junit4]   2> 586840 T2417 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
:    [junit4]   2> 586840 T2417 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
:    [junit4]   2> 586841 T2417 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
:    [junit4]   2> 586841 T2417 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
:    [junit4]   2> 586841 T2417 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
:    [junit4]   2> 586842 T2417 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
:    [junit4]   2> 586842 T2417 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
:    [junit4]   2> 586843 T2417 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
:    [junit4]   2> 586846 T2417 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:57557/solr
:    [junit4]   2> 586846 T2417 oasc.ZkController.checkChrootPath zkHost includes chroot
:    [junit4]   2> 586847 T2417 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 586848 T2455 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@301f3f name:ZooKeeperConnection Watcher:127.0.0.1:57557 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 586848 T2417 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 586850 T2417 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
:    [junit4]   2> 586852 T2417 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 586854 T2457 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d33e00 name:ZooKeeperConnection Watcher:127.0.0.1:57557/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 586854 T2417 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 586857 T2417 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
:    [junit4]   2> 587859 T2417 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33822_hz%2Fen
:    [junit4]   2> 587861 T2417 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33822_hz%2Fen
:    [junit4]   2> 587862 T2444 oascc.ZkStateReader$3.process Updating live nodes... (2)
:    [junit4]   2> 587862 T2439 oascc.ZkStateReader$3.process Updating live nodes... (2)
:    [junit4]   2> 587862 T2457 oascc.ZkStateReader$3.process Updating live nodes... (2)
:    [junit4]   2> 587867 T2417 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1375368748934
:    [junit4]   2> 587893 T2417 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1375368748934/conf/
:    [junit4]   2> 587893 T2417 oasc.CorePropertiesLocator.discover Found 1 core definitions
:    [junit4]   2> 587894 T2417 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
:    [junit4]   2> 587894 T2417 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
:    [junit4]   2> 587894 T2417 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
:    [junit4]   2> 587968 T2417 oejs.Server.doStart jetty-8.1.10.v20130312
:    [junit4]   2> 587970 T2417 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60639
:    [junit4]   2> 587971 T2417 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
:    [junit4]   2> 587971 T2417 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
:    [junit4]   2> 587971 T2417 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1375368750163
:    [junit4]   2> 587972 T2417 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1375368750163/'
:    [junit4]   2> 587981 T2417 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1375368750163/solr.xml
:    [junit4]   2> 588008 T2417 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
:    [junit4]   2> 588009 T2417 oasc.CoreContainer.<init> New CoreContainer 25318870
:    [junit4]   2> 588009 T2417 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1375368750163/]
:    [junit4]   2> 588010 T2417 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
:    [junit4]   2> 588010 T2417 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
:    [junit4]   2> 588010 T2417 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
:    [junit4]   2> 588011 T2417 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
:    [junit4]   2> 588011 T2417 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
:    [junit4]   2> 588011 T2417 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
:    [junit4]   2> 588011 T2417 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
:    [junit4]   2> 588012 T2417 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
:    [junit4]   2> 588012 T2417 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
:    [junit4]   2> 588012 T2417 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
:    [junit4]   2> 588015 T2417 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:57557/solr
:    [junit4]   2> 588015 T2417 oasc.ZkController.checkChrootPath zkHost includes chroot
:    [junit4]   2> 588016 T2417 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 588017 T2469 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b9de name:ZooKeeperConnection Watcher:127.0.0.1:57557 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 588018 T2417 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 588020 T2417 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
:    [junit4]   2> 588023 T2417 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 588024 T2471 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@46ec50 name:ZooKeeperConnection Watcher:127.0.0.1:57557/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 588024 T2417 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 588026 T2417 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
:    [junit4]   2> 589028 T2417 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60639_hz%2Fen
:    [junit4]   2> 589029 T2417 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60639_hz%2Fen
:    [junit4]   2> 589031 T2444 oascc.ZkStateReader$3.process Updating live nodes... (3)
:    [junit4]   2> 589031 T2457 oascc.ZkStateReader$3.process Updating live nodes... (3)
:    [junit4]   2> 589031 T2439 oascc.ZkStateReader$3.process Updating live nodes... (3)
:    [junit4]   2> 589031 T2471 oascc.ZkStateReader$3.process Updating live nodes... (3)
:    [junit4]   2> 589034 T2417 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1375368750163
:    [junit4]   2> 589057 T2417 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1375368750163/conf/
:    [junit4]   2> 589058 T2417 oasc.CorePropertiesLocator.discover Found 1 core definitions
:    [junit4]   2> 589058 T2417 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
:    [junit4]   2> 589059 T2417 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
:    [junit4]   2> 589059 T2417 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
:    [junit4]   2> 589123 T2417 oejs.Server.doStart jetty-8.1.10.v20130312
:    [junit4]   2> 589125 T2417 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49815
:    [junit4]   2> 589126 T2417 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
:    [junit4]   2> 589126 T2417 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
:    [junit4]   2> 589127 T2417 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1375368751318
:    [junit4]   2> 589127 T2417 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1375368751318/'
:    [junit4]   2> 589136 T2417 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1375368751318/solr.xml
:    [junit4]   2> 589164 T2417 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
:    [junit4]   2> 589164 T2417 oasc.CoreContainer.<init> New CoreContainer 14922430
:    [junit4]   2> 589164 T2417 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1375368751318/]
:    [junit4]   2> 589165 T2417 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
:    [junit4]   2> 589166 T2417 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
:    [junit4]   2> 589166 T2417 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
:    [junit4]   2> 589166 T2417 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
:    [junit4]   2> 589166 T2417 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
:    [junit4]   2> 589167 T2417 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
:    [junit4]   2> 589167 T2417 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
:    [junit4]   2> 589167 T2417 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
:    [junit4]   2> 589167 T2417 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
:    [junit4]   2> 589168 T2417 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
:    [junit4]   2> 589170 T2417 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:57557/solr
:    [junit4]   2> 589171 T2417 oasc.ZkController.checkChrootPath zkHost includes chroot
:    [junit4]   2> 589171 T2417 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 589172 T2483 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1320c28 name:ZooKeeperConnection Watcher:127.0.0.1:57557 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 589173 T2417 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 589174 T2417 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
:    [junit4]   2> 589176 T2417 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 589177 T2485 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bb83e3 name:ZooKeeperConnection Watcher:127.0.0.1:57557/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 589177 T2417 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 589180 T2417 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
:    [junit4]   2> 590182 T2417 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49815_hz%2Fen
:    [junit4]   2> 590183 T2417 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49815_hz%2Fen
:    [junit4]   2> 590184 T2457 oascc.ZkStateReader$3.process Updating live nodes... (4)
:    [junit4]   2> 590185 T2444 oascc.ZkStateReader$3.process Updating live nodes... (4)
:    [junit4]   2> 590185 T2471 oascc.ZkStateReader$3.process Updating live nodes... (4)
:    [junit4]   2> 590185 T2439 oascc.ZkStateReader$3.process Updating live nodes... (4)
:    [junit4]   2> 590185 T2485 oascc.ZkStateReader$3.process Updating live nodes... (4)
:    [junit4]   2> 590189 T2417 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1375368751318
:    [junit4]   2> 590212 T2417 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1375368751318/conf/
:    [junit4]   2> 590212 T2417 oasc.CorePropertiesLocator.discover Found 1 core definitions
:    [junit4]   2> 590213 T2417 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
:    [junit4]   2> 590213 T2417 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
:    [junit4]   2> 590213 T2417 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
:    [junit4]   2> 590279 T2417 oejs.Server.doStart jetty-8.1.10.v20130312
:    [junit4]   2> 590281 T2417 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:36140
:    [junit4]   2> 590282 T2417 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
:    [junit4]   2> 590282 T2417 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
:    [junit4]   2> 590283 T2417 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473
:    [junit4]   2> 590283 T2417 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473/'
:    [junit4]   2> 590292 T2417 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473/solr.xml
:    [junit4]   2> 590320 T2417 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
:    [junit4]   2> 590320 T2417 oasc.CoreContainer.<init> New CoreContainer 22021398
:    [junit4]   2> 590321 T2417 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473/]
:    [junit4]   2> 590321 T2417 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
:    [junit4]   2> 590322 T2417 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
:    [junit4]   2> 590322 T2417 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
:    [junit4]   2> 590322 T2417 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
:    [junit4]   2> 590322 T2417 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
:    [junit4]   2> 590323 T2417 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
:    [junit4]   2> 590323 T2417 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
:    [junit4]   2> 590323 T2417 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
:    [junit4]   2> 590323 T2417 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
:    [junit4]   2> 590324 T2417 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
:    [junit4]   2> 590326 T2417 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:57557/solr
:    [junit4]   2> 590327 T2417 oasc.ZkController.checkChrootPath zkHost includes chroot
:    [junit4]   2> 590327 T2417 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 590328 T2497 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a7c78d name:ZooKeeperConnection Watcher:127.0.0.1:57557 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 590329 T2417 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 590329 T2417 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
:    [junit4]   2> 590332 T2417 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 590333 T2499 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17ed7c2 name:ZooKeeperConnection Watcher:127.0.0.1:57557/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 590333 T2417 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 590335 T2417 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
:    [junit4]   2> 591337 T2417 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36140_hz%2Fen
:    [junit4]   2> 591339 T2417 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36140_hz%2Fen
:    [junit4]   2> 591341 T2444 oascc.ZkStateReader$3.process Updating live nodes... (5)
:    [junit4]   2> 591341 T2485 oascc.ZkStateReader$3.process Updating live nodes... (5)
:    [junit4]   2> 591341 T2439 oascc.ZkStateReader$3.process Updating live nodes... (5)
:    [junit4]   2> 591341 T2457 oascc.ZkStateReader$3.process Updating live nodes... (5)
:    [junit4]   2> 591341 T2499 oascc.ZkStateReader$3.process Updating live nodes... (5)
:    [junit4]   2> 591341 T2471 oascc.ZkStateReader$3.process Updating live nodes... (5)
:    [junit4]   2> 591345 T2417 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473
:    [junit4]   2> 591382 T2417 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473/conf/
:    [junit4]   2> 591383 T2417 oasc.CorePropertiesLocator.discover Found 1 core definitions
:    [junit4]   2> 591383 T2417 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
:    [junit4]   2> 591384 T2417 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
:    [junit4]   2> 591384 T2417 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
:    [junit4]   2> 591388 T2417 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
:    [junit4]   2> 591393 T2452 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2
:    [junit4]   2> 591394 T2439 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
:    [junit4]   2> 591395 T2439 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
:    [junit4]   2> 591395 T2441 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
:    [junit4]   2> 	  "operation":"createcollection",
:    [junit4]   2> 	  "numShards":"2",
:    [junit4]   2> 	  "name":"nodes_used_collection",
:    [junit4]   2> 	  "replicationFactor":"2"}
:    [junit4]   2> 591395 T2441 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
:    [junit4]   2> 	  "operation":"createcollection",
:    [junit4]   2> 	  "numShards":"2",
:    [junit4]   2> 	  "name":"nodes_used_collection",
:    [junit4]   2> 	  "replicationFactor":"2"}
:    [junit4]   2> 592638 T2440 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
:    [junit4]   2> 592639 T2440 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: nodes_used_collection
:    [junit4]   2> 592639 T2440 oasc.Overseer$ClusterStateUpdater.createCollection Create collection nodes_used_collection with shards [shard1, shard2]
:    [junit4]   2> 592641 T2444 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
:    [junit4]   2> 592641 T2457 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
:    [junit4]   2> 592642 T2485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
:    [junit4]   2> 592641 T2471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
:    [junit4]   2> 592641 T2499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
:    [junit4]   2> 592641 T2439 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
:    [junit4]   2> 592698 T2441 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2] , repFactor : 2
:    [junit4]   2> 592699 T2441 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica1 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:49815_hz%2Fen
:    [junit4]   2> 592699 T2441 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica2 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:36140_hz%2Fen
:    [junit4]   2> 592700 T2441 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica1 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:60639_hz%2Fen
:    [junit4]   2> 592700 T2441 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica2 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:33822_hz%2Fen
:    [junit4]   2> 592702 T2492 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=down
:    [junit4]   2> 592702 T2478 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=down
:    [junit4]   2> 592702 T2464 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=down
:    [junit4]   2> 592703 T2492 oasc.ZkController.waitForCoreNodeName look for our core node name
:    [junit4]   2> 592703 T2450 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=down
:    [junit4]   2> 592703 T2478 oasc.ZkController.waitForCoreNodeName look for our core node name
:    [junit4]   2> 592704 T2464 oasc.ZkController.waitForCoreNodeName look for our core node name
:    [junit4]   2> 592704 T2450 oasc.ZkController.waitForCoreNodeName look for our core node name
:    [junit4]   2> 594145 T2440 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
:    [junit4]   2> 594145 T2440 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for nodes_used_collection, skipping publish state
:    [junit4]   2> 594146 T2440 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
:    [junit4]   2> 	  "operation":"state",
:    [junit4]   2> 	  "core_node_name":"core_node1",
:    [junit4]   2> 	  "numShards":"2",
:    [junit4]   2> 	  "shard":"shard1",
:    [junit4]   2> 	  "roles":null,
:    [junit4]   2> 	  "state":"down",
:    [junit4]   2> 	  "shard_state":"active",
:    [junit4]   2> 	  "core":"nodes_used_collection_shard1_replica2",
:    [junit4]   2> 	  "collection":"nodes_used_collection",
:    [junit4]   2> 	  "shard_range":null,
:    [junit4]   2> 	  "node_name":"127.0.0.1:36140_hz%2Fen",
:    [junit4]   2> 	  "base_url":"http://127.0.0.1:36140/hz/en"}
:    [junit4]   2> 594149 T2440 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for nodes_used_collection, skipping publish state
:    [junit4]   2> 594149 T2440 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
:    [junit4]   2> 	  "operation":"state",
:    [junit4]   2> 	  "core_node_name":"core_node2",
:    [junit4]   2> 	  "numShards":"2",
:    [junit4]   2> 	  "shard":"shard1",
:    [junit4]   2> 	  "roles":null,
:    [junit4]   2> 	  "state":"down",
:    [junit4]   2> 	  "shard_state":"active",
:    [junit4]   2> 	  "core":"nodes_used_collection_shard1_replica1",
:    [junit4]   2> 	  "collection":"nodes_used_collection",
:    [junit4]   2> 	  "shard_range":null,
:    [junit4]   2> 	  "node_name":"127.0.0.1:49815_hz%2Fen",
:    [junit4]   2> 	  "base_url":"http://127.0.0.1:49815/hz/en"}
:    [junit4]   2> 594151 T2440 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for nodes_used_collection, skipping publish state
:    [junit4]   2> 594151 T2440 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
:    [junit4]   2> 	  "operation":"state",
:    [junit4]   2> 	  "core_node_name":"core_node3",
:    [junit4]   2> 	  "numShards":"2",
:    [junit4]   2> 	  "shard":"shard2",
:    [junit4]   2> 	  "roles":null,
:    [junit4]   2> 	  "state":"down",
:    [junit4]   2> 	  "shard_state":"active",
:    [junit4]   2> 	  "core":"nodes_used_collection_shard2_replica1",
:    [junit4]   2> 	  "collection":"nodes_used_collection",
:    [junit4]   2> 	  "shard_range":null,
:    [junit4]   2> 	  "node_name":"127.0.0.1:60639_hz%2Fen",
:    [junit4]   2> 	  "base_url":"http://127.0.0.1:60639/hz/en"}
:    [junit4]   2> 594312 T2440 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for nodes_used_collection, skipping publish state
:    [junit4]   2> 594313 T2440 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
:    [junit4]   2> 	  "operation":"state",
:    [junit4]   2> 	  "core_node_name":"core_node4",
:    [junit4]   2> 	  "numShards":"2",
:    [junit4]   2> 	  "shard":"shard2",
:    [junit4]   2> 	  "roles":null,
:    [junit4]   2> 	  "state":"down",
:    [junit4]   2> 	  "shard_state":"active",
:    [junit4]   2> 	  "core":"nodes_used_collection_shard2_replica2",
:    [junit4]   2> 	  "collection":"nodes_used_collection",
:    [junit4]   2> 	  "shard_range":null,
:    [junit4]   2> 	  "node_name":"127.0.0.1:33822_hz%2Fen",
:    [junit4]   2> 	  "base_url":"http://127.0.0.1:33822/hz/en"}
:    [junit4]   2> 594315 T2439 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
:    [junit4]   2> 594315 T2485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
:    [junit4]   2> 594315 T2499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
:    [junit4]   2> 594315 T2444 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
:    [junit4]   2> 594315 T2471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
:    [junit4]   2> 594315 T2457 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
:    [junit4]   2> 594703 T2492 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for nodes_used_collection_shard1_replica2
:    [junit4]   2> 594704 T2478 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for nodes_used_collection_shard1_replica1
:    [junit4]   2> 594704 T2492 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473/nodes_used_collection_shard1_replica2/core.properties: java.io.FileNotFoundException: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473/nodes_used_collection_shard1_replica2/core.properties (No such file or directory)
:    [junit4]   2> 594704 T2478 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1375368751318/nodes_used_collection_shard1_replica1/core.properties: java.io.FileNotFoundException: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1375368751318/nodes_used_collection_shard1_replica1/core.properties (No such file or directory)
:    [junit4]   2> 594704 T2492 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473/nodes_used_collection_shard1_replica2
:    [junit4]   2> 594705 T2492 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
:    [junit4]   2> 594704 T2464 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for nodes_used_collection_shard2_replica1
:    [junit4]   2> 594705 T2450 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for nodes_used_collection_shard2_replica2
:    [junit4]   2> 594705 T2478 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1375368751318/nodes_used_collection_shard1_replica1
:    [junit4]   2> 594706 T2478 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
:    [junit4]   2> 594706 T2450 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1375368748934/nodes_used_collection_shard2_replica2/core.properties: java.io.FileNotFoundException: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1375368748934/nodes_used_collection_shard2_replica2/core.properties (No such file or directory)
:    [junit4]   2> 594706 T2464 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1375368750163/nodes_used_collection_shard2_replica1/core.properties: java.io.FileNotFoundException: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1375368750163/nodes_used_collection_shard2_replica1/core.properties (No such file or directory)
:    [junit4]   2> 594705 T2492 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
:    [junit4]   2> 594707 T2464 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1375368750163/nodes_used_collection_shard2_replica1
:    [junit4]   2> 594707 T2464 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
:    [junit4]   2> 594707 T2478 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
:    [junit4]   2> 594707 T2450 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1375368748934/nodes_used_collection_shard2_replica2
:    [junit4]   2> 594708 T2450 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
:    [junit4]   2> 594708 T2464 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
:    [junit4]   2> 594708 T2450 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
:    [junit4]   2> 594708 T2478 oasc.ZkController.getConfName Looking for collection configName
:    [junit4]   2> 594707 T2492 oasc.ZkController.getConfName Looking for collection configName
:    [junit4]   2> 594709 T2450 oasc.ZkController.getConfName Looking for collection configName
:    [junit4]   2> 594709 T2464 oasc.ZkController.getConfName Looking for collection configName
:    [junit4]   2> 594710 T2478 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
:    [junit4]   2> 594710 T2478 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
:    [junit4]   2> 594710 T2464 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
:    [junit4]   2> 594711 T2492 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
:    [junit4]   2> 594711 T2450 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
:    [junit4]   2> 594711 T2492 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
:    [junit4]   2> 594711 T2464 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
:    [junit4]   2> 594711 T2450 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
:    [junit4]   2> 594713 T2492 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
:    [junit4]   2> 594713 T2450 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
:    [junit4]   2> 594713 T2464 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
:    [junit4]   2> 594713 T2478 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
:    [junit4]   2> 594714 T2492 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473/nodes_used_collection_shard1_replica2/'
:    [junit4]   2> 594715 T2478 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1375368751318/nodes_used_collection_shard1_replica1/'
:    [junit4]   2> 594717 T2450 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1375368748934/nodes_used_collection_shard2_replica2/'
:    [junit4]   2> 594717 T2464 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1375368750163/nodes_used_collection_shard2_replica1/'
:    [junit4]   2> 594749 T2492 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
:    [junit4]   2> 594765 T2450 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
:    [junit4]   2> 594768 T2464 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
:    [junit4]   2> 594771 T2478 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
:    [junit4]   2> 594804 T2492 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
:    [junit4]   2> 594806 T2492 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
:    [junit4]   2> 594812 T2464 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
:    [junit4]   2> 594813 T2450 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
:    [junit4]   2> 594814 T2464 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
:    [junit4]   2> 594814 T2450 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
:    [junit4]   2> 594817 T2492 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica2] Schema name=test
:    [junit4]   2> 594821 T2450 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica2] Schema name=test
:    [junit4]   2> 594823 T2464 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica1] Schema name=test
:    [junit4]   2> 594827 T2478 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
:    [junit4]   2> 594831 T2478 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
:    [junit4]   2> 594840 T2478 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica1] Schema name=test
:    [junit4]   2> 595332 T2492 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
:    [junit4]   2> 595333 T2492 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
:    [junit4]   2> 595333 T2492 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
:    [junit4]   2> 595339 T2492 oass.IndexSchema.readSchema default search field in schema is text
:    [junit4]   2> 595341 T2492 oass.IndexSchema.readSchema unique key field: id
:    [junit4]   2> 595348 T2478 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
:    [junit4]   2> 595348 T2478 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
:    [junit4]   2> 595349 T2478 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
:    [junit4]   2> 595351 T2492 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
:    [junit4]   2> 595352 T2450 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
:    [junit4]   2> 595353 T2450 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
:    [junit4]   2> 595353 T2492 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
:    [junit4]   2> 595354 T2450 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
:    [junit4]   2> 595356 T2492 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
:    [junit4]   2> 595356 T2478 oass.IndexSchema.readSchema default search field in schema is text
:    [junit4]   2> 595357 T2492 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
:    [junit4]   2> 595357 T2492 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
:    [junit4]   2> 595357 T2492 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
:    [junit4]   2> 595358 T2492 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
:    [junit4]   2> 595358 T2492 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
:    [junit4]   2> 595358 T2492 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
:    [junit4]   2> 595358 T2492 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473/nodes_used_collection_shard1_replica2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473//nodes_used_collection_shard1_replica2/data/
:    [junit4]   2> 595359 T2492 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@bd19b9
:    [junit4]   2> 595359 T2492 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473//nodes_used_collection_shard1_replica2/data
:    [junit4]   2> 595360 T2492 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473//nodes_used_collection_shard1_replica2/data/index/
:    [junit4]   2> 595359 T2478 oass.IndexSchema.readSchema unique key field: id
:    [junit4]   2> 595360 T2492 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473/nodes_used_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
:    [junit4]   2> 595361 T2492 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473//nodes_used_collection_shard1_replica2/data/index
:    [junit4]   2> 595362 T2450 oass.IndexSchema.readSchema default search field in schema is text
:    [junit4]   2> 595362 T2492 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
:    [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7b5b9f lockFactory=org.apache.lucene.store.NativeFSLockFactory@e1f839),segFN=segments_1,generation=1}
:    [junit4]   2> 595362 T2492 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
:    [junit4]   2> 595362 T2464 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
:    [junit4]   2> 595363 T2464 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
:    [junit4]   2> 595363 T2464 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
:    [junit4]   2> 595365 T2492 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
:    [junit4]   2> 595365 T2492 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
:    [junit4]   2> 595365 T2450 oass.IndexSchema.readSchema unique key field: id
:    [junit4]   2> 595366 T2492 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
:    [junit4]   2> 595366 T2492 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
:    [junit4]   2> 595367 T2492 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
:    [junit4]   2> 595367 T2492 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
:    [junit4]   2> 595367 T2492 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
:    [junit4]   2> 595368 T2492 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
:    [junit4]   2> 595368 T2492 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
:    [junit4]   2> 595371 T2492 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 595371 T2464 oass.IndexSchema.readSchema default search field in schema is text
:    [junit4]   2> 595373 T2492 oass.SolrIndexSearcher.<init> Opening Searcher@d9b0b6 main
:    [junit4]   2> 595374 T2492 oasu.CommitTracker.<init> Hard AutoCommit: disabled
:    [junit4]   2> 595374 T2464 oass.IndexSchema.readSchema unique key field: id
:    [junit4]   2> 595374 T2492 oasu.CommitTracker.<init> Soft AutoCommit: disabled
:    [junit4]   2> 595376 T2478 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
:    [junit4]   2> 595379 T2450 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
:    [junit4]   2> 595381 T2478 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
:    [junit4]   2> 595381 T2492 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica2
:    [junit4]   2> 595382 T2492 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica2 address:http://127.0.0.1:36140/hz/en collection:nodes_used_collection shard:shard1
:    [junit4]   2> 595382 T2492 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=15000&socketTimeout=30000&retry=false
:    [junit4]   2> 595383 T2478 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
:    [junit4]   2> 595384 T2478 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
:    [junit4]   2> 595384 T2478 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
:    [junit4]   2> 595384 T2450 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
:    [junit4]   2> 595385 T2478 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
:    [junit4]   2> 595386 T2505 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica2] Registered new searcher Searcher@d9b0b6 main{StandardDirectoryReader(segments_1:1)}
:    [junit4]   2> 595386 T2478 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
:    [junit4]   2> 595386 T2478 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
:    [junit4]   2> 595387 T2492 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard1/election
:    [junit4]   2> 595387 T2478 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
:    [junit4]   2> 595388 T2478 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1375368751318/nodes_used_collection_shard1_replica1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1375368751318//nodes_used_collection_shard1_replica1/data/
:    [junit4]   2> 595388 T2478 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@bd19b9
:    [junit4]   2> 595389 T2450 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
:    [junit4]   2> 595389 T2478 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1375368751318//nodes_used_collection_shard1_replica1/data
:    [junit4]   2> 595389 T2464 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
:    [junit4]   2> 595389 T2478 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1375368751318//nodes_used_collection_shard1_replica1/data/index/
:    [junit4]   2> 595390 T2478 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1375368751318/nodes_used_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
:    [junit4]   2> 595390 T2450 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
:    [junit4]   2> 595391 T2450 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
:    [junit4]   2> 595390 T2478 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1375368751318//nodes_used_collection_shard1_replica1/data/index
:    [junit4]   2> 595391 T2450 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
:    [junit4]   2> 595392 T2478 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
:    [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@ff199e lockFactory=org.apache.lucene.store.NativeFSLockFactory@192aed4),segFN=segments_1,generation=1}
:    [junit4]   2> 595392 T2478 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
:    [junit4]   2> 595394 T2464 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
:    [junit4]   2> 595395 T2478 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
:    [junit4]   2> 595395 T2450 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
:    [junit4]   2> 595396 T2450 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
:    [junit4]   2> 595395 T2478 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
:    [junit4]   2> 595396 T2450 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
:    [junit4]   2> 595396 T2478 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
:    [junit4]   2> 595396 T2450 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1375368748934/nodes_used_collection_shard2_replica2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1375368748934//nodes_used_collection_shard2_replica2/data/
:    [junit4]   2> 595397 T2478 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
:    [junit4]   2> 595397 T2478 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
:    [junit4]   2> 595398 T2478 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
:    [junit4]   2> 595398 T2478 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
:    [junit4]   2> 595398 T2478 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
:    [junit4]   2> 595399 T2478 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
:    [junit4]   2> 595400 T2464 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
:    [junit4]   2> 595401 T2478 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 595397 T2450 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@bd19b9
:    [junit4]   2> 595403 T2478 oass.SolrIndexSearcher.<init> Opening Searcher@b5339c main
:    [junit4]   2> 595402 T2464 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
:    [junit4]   2> 595404 T2450 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1375368748934//nodes_used_collection_shard2_replica2/data
:    [junit4]   2> 595404 T2478 oasu.CommitTracker.<init> Hard AutoCommit: disabled
:    [junit4]   2> 595402 T2492 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
:    [junit4]   2> 595404 T2478 oasu.CommitTracker.<init> Soft AutoCommit: disabled
:    [junit4]   2> 595404 T2450 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1375368748934//nodes_used_collection_shard2_replica2/data/index/
:    [junit4]   2> 595404 T2464 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
:    [junit4]   2> 595405 T2450 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1375368748934/nodes_used_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
:    [junit4]   2> 595406 T2464 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
:    [junit4]   2> 595406 T2450 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1375368748934//nodes_used_collection_shard2_replica2/data/index
:    [junit4]   2> 595407 T2492 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=180000
:    [junit4]   2> 595407 T2464 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
:    [junit4]   2> 595408 T2464 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
:    [junit4]   2> 595408 T2506 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica1] Registered new searcher Searcher@b5339c main{StandardDirectoryReader(segments_1:1)}
:    [junit4]   2> 595408 T2450 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
:    [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4eac63 lockFactory=org.apache.lucene.store.NativeFSLockFactory@c23984),segFN=segments_1,generation=1}
:    [junit4]   2> 595409 T2450 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
:    [junit4]   2> 595408 T2464 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
:    [junit4]   2> 595409 T2478 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica1
:    [junit4]   2> 595409 T2478 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica1 address:http://127.0.0.1:49815/hz/en collection:nodes_used_collection shard:shard1
:    [junit4]   2> 595409 T2464 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1375368750163/nodes_used_collection_shard2_replica1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1375368750163//nodes_used_collection_shard2_replica1/data/
:    [junit4]   2> 595410 T2478 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=15000&socketTimeout=30000&retry=false
:    [junit4]   2> 595410 T2464 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@bd19b9
:    [junit4]   2> 595411 T2464 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1375368750163//nodes_used_collection_shard2_replica1/data
:    [junit4]   2> 595418 T2464 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1375368750163//nodes_used_collection_shard2_replica1/data/index/
:    [junit4]   2> 595418 T2464 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1375368750163/nodes_used_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
:    [junit4]   2> 595418 T2450 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
:    [junit4]   2> 595419 T2464 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1375368750163//nodes_used_collection_shard2_replica1/data/index
:    [junit4]   2> 595419 T2450 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
:    [junit4]   2> 595420 T2450 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
:    [junit4]   2> 595421 T2464 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
:    [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@c9e6fc lockFactory=org.apache.lucene.store.NativeFSLockFactory@3ad861),segFN=segments_1,generation=1}
:    [junit4]   2> 595421 T2464 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
:    [junit4]   2> 595421 T2450 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
:    [junit4]   2> 595422 T2450 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
:    [junit4]   2> 595422 T2450 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
:    [junit4]   2> 595422 T2450 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
:    [junit4]   2> 595422 T2450 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
:    [junit4]   2> 595423 T2450 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
:    [junit4]   2> 595423 T2464 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
:    [junit4]   2> 595423 T2464 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
:    [junit4]   2> 595424 T2464 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
:    [junit4]   2> 595424 T2464 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
:    [junit4]   2> 595425 T2464 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
:    [junit4]   2> 595425 T2450 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 595425 T2464 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
:    [junit4]   2> 595425 T2464 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
:    [junit4]   2> 595426 T2464 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
:    [junit4]   2> 595426 T2464 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
:    [junit4]   2> 595427 T2450 oass.SolrIndexSearcher.<init> Opening Searcher@6765a main
:    [junit4]   2> 595427 T2464 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 595428 T2450 oasu.CommitTracker.<init> Hard AutoCommit: disabled
:    [junit4]   2> 595428 T2450 oasu.CommitTracker.<init> Soft AutoCommit: disabled
:    [junit4]   2> 595429 T2464 oass.SolrIndexSearcher.<init> Opening Searcher@aec58c main
:    [junit4]   2> 595430 T2464 oasu.CommitTracker.<init> Hard AutoCommit: disabled
:    [junit4]   2> 595430 T2464 oasu.CommitTracker.<init> Soft AutoCommit: disabled
:    [junit4]   2> 595431 T2507 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica2] Registered new searcher Searcher@6765a main{StandardDirectoryReader(segments_1:1)}
:    [junit4]   2> 595432 T2450 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica2
:    [junit4]   2> 595432 T2450 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica2 address:http://127.0.0.1:33822/hz/en collection:nodes_used_collection shard:shard2
:    [junit4]   2> 595432 T2450 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=15000&socketTimeout=30000&retry=false
:    [junit4]   2> 595433 T2508 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica1] Registered new searcher Searcher@aec58c main{StandardDirectoryReader(segments_1:1)}
:    [junit4]   2> 595433 T2464 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica1
:    [junit4]   2> 595434 T2464 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica1 address:http://127.0.0.1:60639/hz/en collection:nodes_used_collection shard:shard2
:    [junit4]   2> 595434 T2464 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=15000&socketTimeout=30000&retry=false
:    [junit4]   2> 595435 T2450 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard2/election
:    [junit4]   2> 595436 T2464 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard2/election
:    [junit4]   2> 595440 T2450 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
:    [junit4]   2> 595442 T2450 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
:    [junit4]   2> 595442 T2450 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
:    [junit4]   2> 595442 T2450 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:33822/hz/en/nodes_used_collection_shard2_replica2/
:    [junit4]   2> 595443 T2450 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:33822/hz/en START replicas=[http://127.0.0.1:60639/hz/en/nodes_used_collection_shard2_replica1/] nUpdates=100
:    [junit4]   2> 595443 T2450 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:33822/hz/en DONE.  We have no versions.  sync failed.
:    [junit4]   2> 595443 T2450 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
:    [junit4]   2> 595444 T2450 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
:    [junit4]   2> 595444 T2450 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:33822/hz/en/nodes_used_collection_shard2_replica2/ shard2
:    [junit4]   2> 595444 T2450 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard2
:    [junit4]   2> ASYNC  NEW_CORE C398 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@4fa21 url=http://127.0.0.1:60639/hz/en/nodes_used_collection_shard2_replica1 node=127.0.0.1:60639_hz%2Fen C398_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{state=down, core=nodes_used_collection_shard2_replica1, node_name=127.0.0.1:60639_hz%2Fen, base_url=http://127.0.0.1:60639/hz/en}
:    [junit4]   2> 595448 T2465 C398 P60639 oasc.SolrCore.execute [nodes_used_collection_shard2_replica1] webapp=/hz/en path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
:    [junit4]   2> 595820 T2440 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
:    [junit4]   2> 595930 T2444 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
:    [junit4]   2> 595930 T2485 oascc.ZkStateRead
: 
: [...truncated too long message...]
: 
: nt has reached 0 - closing IndexWriter
:    [junit4]   2> 752278 T2417 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
:    [junit4]   2> 752279 T2417 oasc.SolrCore.closeSearcher [new_implicit_coll_1_c_replica2] Closing main searcher on request.
:    [junit4]   2> 752279 T2417 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
:    [junit4]   2> 752279 T2417 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473//new_implicit_coll_1_c_replica2/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473//new_implicit_coll_1_c_replica2/data/index;done=false>>]
:    [junit4]   2> 752280 T2417 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473//new_implicit_coll_1_c_replica2/data/index
:    [junit4]   2> 752280 T2417 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473//new_implicit_coll_1_c_replica2/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473//new_implicit_coll_1_c_replica2/data;done=false>>]
:    [junit4]   2> 752280 T2417 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1375368752473//new_implicit_coll_1_c_replica2/data
:    [junit4]   2> 752282 T2976 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=90136166295404556-127.0.0.1:36140_hz%2Fen-n_0000000004) am no longer a leader.
:    [junit4]   2> 752282 T2499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
:    [junit4]   2> 752282 T2499 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
:    [junit4]   2> 752283 T2499 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
:    [junit4]   2> 752304 T2417 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/hz/en,null}
:    [junit4]   2> 752357 T2417 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
:    [junit4]   2> 752359 T2417 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:57557 57557
:    [junit4]   1> client port:0.0.0.0/0.0.0.0:0
:    [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=FBC67B6C64D67187 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=bg_BG -Dtests.timezone=Europe/Athens -Dtests.file.encoding=UTF-8
:    [junit4] ERROR    166s J0 | CollectionsAPIDistributedZkTest.testDistribSearch <<<
:    [junit4]    > Throwable #1: org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:33822/hz/en
:    [junit4]    > 	at __randomizedtesting.SeedInfo.seed([FBC67B6C64D67187:7A20F574138911BB]:0)
:    [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:428)
:    [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
:    [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1535)
:    [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCustomCollectionsAPI(CollectionsAPIDistributedZkTest.java:677)
:    [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:159)
:    [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
:    [junit4]    > 	at java.lang.Thread.run(Thread.java:724)
:    [junit4]    > Caused by: org.apache.http.conn.HttpHostConnectException: Connection to http://127.0.0.1:33822 refused
:    [junit4]    > 	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:190)
:    [junit4]    > 	at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
:    [junit4]    > 	at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
:    [junit4]    > 	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
:    [junit4]    > 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
:    [junit4]    > 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
:    [junit4]    > 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
:    [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
:    [junit4]    > 	... 45 more
:    [junit4]    > Caused by: java.net.ConnectException: Connection refused
:    [junit4]    > 	at java.net.PlainSocketImpl.socketConnect(Native Method)
:    [junit4]    > 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
:    [junit4]    > 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
:    [junit4]    > 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
:    [junit4]    > 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
:    [junit4]    > 	at java.net.Socket.connect(Socket.java:579)
:    [junit4]    > 	at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
:    [junit4]    > 	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
:    [junit4]    > 	... 52 more
:    [junit4]   2> 752373 T2417 oas.SolrTestCaseJ4.deleteCore ###deleteCore
:    [junit4]   2> 166239 T2416 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
:    [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=349), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=349)), sim=DefaultSimilarity, locale=bg_BG, timezone=Europe/Athens
:    [junit4]   2> NOTE: Linux 3.2.0-51-generic i386/Oracle Corporation 1.7.0_25 (32-bit)/cpus=8,threads=1,free=180364184,total=331546624
:    [junit4]   2> NOTE: All tests run in this JVM: [ScriptEngineTest, TestSort, SpellingQueryConverterTest, TestFaceting, TestCoreContainer, TestValueSourceCache, HdfsUnloadDistributedZkTest, BlockDirectoryTest, TestSearchPerf, LoggingHandlerTest, AliasIntegrationTest, TestPerFieldSimilarity, AlternateDirectoryTest, QueryElevationComponentTest, ExternalFileFieldSortTest, ZkControllerTest, TestCharFilters, SimpleFacetsTest, ShardRoutingTest, DirectSolrConnectionTest, StressHdfsTest, TestLMDirichletSimilarityFactory, SOLR749Test, SolrInfoMBeanTest, TestPHPSerializedResponseWriter, TestBadConfig, TestFieldResource, SystemInfoHandlerTest, TestStressRecovery, TestGroupingSearch, PrimitiveFieldTypeTest, PluginInfoTest, UnloadDistributedZkTest, HdfsDirectoryTest, SpatialFilterTest, IndexSchemaTest, TestLFUCache, SolrCoreTest, TestSolrDeletionPolicy2, TestRecoveryHdfs, TestDocSet, TestDefaultSearchFieldResource, UpdateRequestProcessorFactoryTest, DistributedQueryElevationComponentTest, Test
 SolrCoreProperties, ShowFileRequestHandlerTest, TestSweetSpotSimilarityFactory, SearchHandlerTest, TestDynamicFieldCollectionResource, SolrTestCaseJ4Test, ResourceLoaderTest, RegexBoostProcessorTest, DateFieldTest, FastVectorHighlighterTest, MBeansHandlerTest, TestSolrDeletionPolicy1, QueryParsingTest, AnalysisAfterCoreReloadTest, OverseerTest, CachingDirectoryFactoryTest, RAMDirectoryFactoryTest, QueryEqualityTest, TestPluginEnable, WordBreakSolrSpellCheckerTest, TestFuzzyAnalyzedSuggestions, SoftAutoCommitTest, CoreAdminHandlerTest, TestDocumentBuilder, ClusterStateUpdateTest, CircularListTest, BasicDistributedZkTest, TestPhraseSuggestions, TestFastLRUCache, TestConfig, DistributedSpellCheckComponentTest, TestFastWriter, CacheHeaderTest, CollectionsAPIDistributedZkTest]
:    [junit4] Completed on J0 in 166.77s, 1 test, 1 error <<< FAILURES!
: 
: [...truncated 487 lines...]
: BUILD FAILED
: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:395: The following error occurred while executing this line:
: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:375: The following error occurred while executing this line:
: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:181: The following error occurred while executing this line:
: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1233: The following error occurred while executing this line:
: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:876: There were test failures: 321 suites, 1350 tests, 1 error, 34 ignored (6 assumptions)
: 
: Total time: 41 minutes 30 seconds
: Build step 'Invoke Ant' marked build as failure
: Description set: Java: 32bit/jdk1.7.0_25 -server -XX:+UseParallelGC
: Archiving artifacts
: Recording test results
: Email was triggered for: Failure
: Sending email for trigger: Failure
: 
: 
: 

-Hoss

Mime
View raw message