Return-Path: X-Original-To: apmail-lucene-dev-archive@www.apache.org Delivered-To: apmail-lucene-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C375F10B2D for ; Tue, 27 Aug 2013 10:45:45 +0000 (UTC) Received: (qmail 80632 invoked by uid 500); 27 Aug 2013 10:45:40 -0000 Delivered-To: apmail-lucene-dev-archive@lucene.apache.org Received: (qmail 80538 invoked by uid 500); 27 Aug 2013 10:45:40 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 80427 invoked by uid 99); 27 Aug 2013 10:45:35 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Aug 2013 10:45:35 +0000 X-ASF-Spam-Status: No, hits=0.0 required=5.0 tests=NORMAL_HTTP_TO_IP,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jenkins@thetaphi.de designates 188.138.97.18 as permitted sender) Received: from [188.138.97.18] (HELO mail.sd-datasolutions.de) (188.138.97.18) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Aug 2013 10:45:23 +0000 Received: from serv1 (localhost.localdomain [127.0.0.1]) by mail.sd-datasolutions.de (Postfix) with ESMTP id 6E7D914AA10C; Tue, 27 Aug 2013 10:45:02 +0000 (UTC) Date: Tue, 27 Aug 2013 10:44:31 +0000 (UTC) From: Policeman Jenkins Server To: dev@lucene.apache.org, steffkes@apache.org Message-ID: <1812513463.1.1377600302257.JavaMail.jenkins@serv1.sd-datasolutions.de> Subject: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 771 - Failure! MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_0_1434402000.1377600273140" X-Jenkins-Job: Lucene-Solr-trunk-MacOSX X-Jenkins-Result: FAILURE X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_0_1434402000.1377600273140 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/771/ Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseParallelGC 1 tests failed. REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSea= rch Error Message: No live SolrServers available to handle this request:[http://127.0.0.1:4927= 8/collection1, http://127.0.0.1:49275/collection1, http://127.0.0.1:49311/c= ollection1, http://127.0.0.1:49272/collection1, http://127.0.0.1:49306/coll= ection1, http://127.0.0.1:49299/collection1, http://127.0.0.1:49326/collect= ion1, http://127.0.0.1:49292/collection1] Stack Trace: org.apache.solr.client.solrj.SolrServerException: No live SolrServers avail= able to handle this request:[http://127.0.0.1:49278/collection1, http://127= .0.0.1:49275/collection1, http://127.0.0.1:49311/collection1, http://127.0.= 0.1:49272/collection1, http://127.0.0.1:49306/collection1, http://127.0.0.1= :49299/collection1, http://127.0.0.1:49326/collection1, http://127.0.0.1:49= 292/collection1] =09at __randomizedtesting.SeedInfo.seed([8DDCD7B55E3817D8:C3A59AD296777E4]:= 0) =09at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolr= Server.java:333) =09at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrSe= rver.java:318) =09at org.apache.solr.client.solrj.request.QueryRequest.process(QueryReques= t.java:90) =09at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301) =09at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsist= ency(AbstractFullDistribZkTestBase.java:1138) =09at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySaf= eLeaderTest.java:137) =09at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseD= istributedSearchTestCase.java:835) =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.= java:57) =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces= sorImpl.java:43) =09at java.lang.reflect.Method.invoke(Method.java:606) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1559) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Random= izedRunner.java:79) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Random= izedRunner.java:737) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:773) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Random= izedRunner.java:787) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:53) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:50) =09at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFi= eldCacheSanity.java:51) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRul= e$1.evaluate(SystemPropertiesInvariantRule.java:55) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:49) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:70) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:358) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:782) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:442) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:746) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Random= izedRunner.java:648) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Random= izedRunner.java:682) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:693) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:53) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:42) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRul= e$1.evaluate(SystemPropertiesInvariantRule.java:55) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:43) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:70) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:55) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:358) =09at java.lang.Thread.run(Thread.java:724) Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrExcep= tion: Server at http://127.0.0.1:49272/collection1 returned non ok status:5= 00, message:Server Error =09at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServ= er.java:385) =09at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServ= er.java:180) =09at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolr= Server.java:298) =09... 46 more Build Log: [...truncated 9484 lines...] [junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest [junit4] 2> 186273 T426 oas.BaseDistributedSearchTestCase.initHostCont= ext Setting hostContext system property: / [junit4] 2> 186286 T426 oas.SolrTestCaseJ4.setUp ###Starting testDistr= ibSearch [junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-tru= nk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeySafeLeaderTest= -1377599469200 [junit4] 2> 186288 T426 oasc.ZkTestServer.run STARTING ZK TEST SERVER [junit4] 2> 186288 T427 oasc.ZkTestServer$ZKServerMain.runFromConfig S= tarting server [junit4] 2> 186389 T426 oasc.ZkTestServer.run start zk server on port:= 49265 [junit4] 2> 186392 T426 oascc.ConnectionManager.waitForConnected Waiti= ng for client to connect to ZooKeeper [junit4] 2> 186405 T433 oascc.ConnectionManager.process Watcher org.ap= ache.solr.common.cloud.ConnectionManager@1eb605e7 name:ZooKeeperConnection = Watcher:127.0.0.1:49265 got event WatchedEvent state:SyncConnected type:Non= e path:null path:null type:None [junit4] 2> 186405 T426 oascc.ConnectionManager.waitForConnected Clien= t is connected to ZooKeeper [junit4] 2> 186406 T426 oascc.SolrZkClient.makePath makePath: /solr [junit4] 2> 186416 T426 oascc.ConnectionManager.waitForConnected Waiti= ng for client to connect to ZooKeeper [junit4] 2> 186421 T435 oascc.ConnectionManager.process Watcher org.ap= ache.solr.common.cloud.ConnectionManager@16cebd92 name:ZooKeeperConnection = Watcher:127.0.0.1:49265/solr got event WatchedEvent state:SyncConnected typ= e:None path:null path:null type:None [junit4] 2> 186421 T426 oascc.ConnectionManager.waitForConnected Clien= t is connected to ZooKeeper [junit4] 2> 186422 T426 oascc.SolrZkClient.makePath makePath: /collect= ions/collection1 [junit4] 2> 186430 T426 oascc.SolrZkClient.makePath makePath: /collect= ions/collection1/shards [junit4] 2> 186437 T426 oascc.SolrZkClient.makePath makePath: /collect= ions/control_collection [junit4] 2> 186443 T426 oascc.SolrZkClient.makePath makePath: /collect= ions/control_collection/shards [junit4] 2> 186451 T426 oasc.AbstractZkTestCase.putConfig put /Users/j= enkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/s= olr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 186451 T426 oascc.SolrZkClient.makePath makePath: /configs= /conf1/solrconfig.xml [junit4] 2> 186464 T426 oasc.AbstractZkTestCase.putConfig put /Users/j= enkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/s= olr/collection1/conf/schema.xml to /configs/conf1/schema.xml [junit4] 2> 186465 T426 oascc.SolrZkClient.makePath makePath: /configs= /conf1/schema.xml [junit4] 2> 186474 T426 oasc.AbstractZkTestCase.putConfig put /Users/j= enkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/s= olr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/c= onf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 186476 T426 oascc.SolrZkClient.makePath makePath: /configs= /conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 186485 T426 oasc.AbstractZkTestCase.putConfig put /Users/j= enkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/s= olr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 186486 T426 oascc.SolrZkClient.makePath makePath: /configs= /conf1/stopwords.txt [junit4] 2> 186497 T426 oasc.AbstractZkTestCase.putConfig put /Users/j= enkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/s= olr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 186498 T426 oascc.SolrZkClient.makePath makePath: /configs= /conf1/protwords.txt [junit4] 2> 186510 T426 oasc.AbstractZkTestCase.putConfig put /Users/j= enkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/s= olr/collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4] 2> 186511 T426 oascc.SolrZkClient.makePath makePath: /configs= /conf1/currency.xml [junit4] 2> 186524 T426 oasc.AbstractZkTestCase.putConfig put /Users/j= enkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/s= olr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchan= ge-rates.json [junit4] 2> 186526 T426 oascc.SolrZkClient.makePath makePath: /configs= /conf1/open-exchange-rates.json [junit4] 2> 186538 T426 oasc.AbstractZkTestCase.putConfig put /Users/j= enkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/s= olr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-= ISOLatin1Accent.txt [junit4] 2> 186539 T426 oascc.SolrZkClient.makePath makePath: /configs= /conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 186554 T426 oasc.AbstractZkTestCase.putConfig put /Users/j= enkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/s= olr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 186557 T426 oascc.SolrZkClient.makePath makePath: /configs= /conf1/old_synonyms.txt [junit4] 2> 186572 T426 oasc.AbstractZkTestCase.putConfig put /Users/j= enkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/s= olr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 186574 T426 oascc.SolrZkClient.makePath makePath: /configs= /conf1/synonyms.txt [junit4] 2> 187003 T426 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 187019 T426 oejs.AbstractConnector.doStart Started SelectC= hannelConnector@127.0.0.1:49268 [junit4] 2> 187019 T426 oass.SolrDispatchFilter.init SolrDispatchFilte= r.init() [junit4] 2> 187020 T426 oasc.SolrResourceLoader.locateSolrHome JNDI no= t configured for solr (NoInitialContextEx) [junit4] 2> 187020 T426 oasc.SolrResourceLoader.locateSolrHome using s= ystem property solr.solr.home: ../../../../../../../../../Users/jenkins/wor= kspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.s= olr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1377599469512 [junit4] 2> 187020 T426 oasc.SolrResourceLoader. new SolrResourc= eLoader for directory: '../../../../../../../../../Users/jenkins/workspace/= Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.clo= ud.ChaosMonkeySafeLeaderTest-controljetty-1377599469512/' [junit4] 2> 187053 T426 oasc.ConfigSolr.fromFile Loading container con= figuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/buil= d/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Luce= ne-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.C= haosMonkeySafeLeaderTest-controljetty-1377599469512/solr.xml [junit4] 2> 187173 T426 oasc.CoreContainer. New CoreContainer 11= 30823356 [junit4] 2> 187174 T426 oasc.CoreContainer.load Loading cores into Cor= eContainer [instanceDir=3D../../../../../../../../../Users/jenkins/workspac= e/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.c= loud.ChaosMonkeySafeLeaderTest-controljetty-1377599469512/] [junit4] 2> 187176 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting socketTimeout to: 120000 [junit4] 2> 187177 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting urlScheme to: http:// [junit4] 2> 187178 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting connTimeout to: 15000 [junit4] 2> 187178 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting maxConnectionsPerHost to: 20 [junit4] 2> 187179 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting corePoolSize to: 0 [junit4] 2> 187180 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting maximumPoolSize to: 2147483647 [junit4] 2> 187180 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting maxThreadIdleTime to: 5 [junit4] 2> 187181 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting sizeOfQueue to: -1 [junit4] 2> 187182 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting fairnessPolicy to: false [junit4] 2> 187182 T426 oascsi.HttpClientUtil.createClient Creating ne= w http client, config:maxConnectionsPerHost=3D20&maxConnections=3D10000&soc= ketTimeout=3D120000&connTimeout=3D15000&retry=3Dfalse [junit4] 2> 187205 T426 oasc.ZkContainer.initZooKeeper Zookeeper clien= t=3D127.0.0.1:49265/solr [junit4] 2> 187206 T426 oasc.ZkController.checkChrootPath zkHost inclu= des chroot [junit4] 2> 187207 T426 oascc.ConnectionManager.waitForConnected Waiti= ng for client to connect to ZooKeeper [junit4] 2> 187213 T446 oascc.ConnectionManager.process Watcher org.ap= ache.solr.common.cloud.ConnectionManager@34ac9c51 name:ZooKeeperConnection = Watcher:127.0.0.1:49265 got event WatchedEvent state:SyncConnected type:Non= e path:null path:null type:None [junit4] 2> 187213 T426 oascc.ConnectionManager.waitForConnected Clien= t is connected to ZooKeeper [junit4] 2> 187218 T426 oascsi.HttpClientUtil.createClient Creating ne= w http client, config:maxConnections=3D500&maxConnectionsPerHost=3D16&socke= tTimeout=3D120000&connTimeout=3D15000 [junit4] 2> 187242 T426 oascc.ConnectionManager.waitForConnected Waiti= ng for client to connect to ZooKeeper [junit4] 2> 187250 T448 oascc.ConnectionManager.process Watcher org.ap= ache.solr.common.cloud.ConnectionManager@70956cca name:ZooKeeperConnection = Watcher:127.0.0.1:49265/solr got event WatchedEvent state:SyncConnected typ= e:None path:null path:null type:None [junit4] 2> 187251 T426 oascc.ConnectionManager.waitForConnected Clien= t is connected to ZooKeeper [junit4] 2> 187257 T426 oascc.SolrZkClient.makePath makePath: /oversee= r/queue [junit4] 2> 187280 T426 oascc.SolrZkClient.makePath makePath: /oversee= r/collection-queue-work [junit4] 2> 187329 T426 oascc.SolrZkClient.makePath makePath: /live_no= des [junit4] 2> 187342 T426 oasc.ZkController.createEphemeralLiveNode Regi= ster node as live in ZooKeeper:/live_nodes/127.0.0.1:49268_ [junit4] 2> 187344 T426 oascc.SolrZkClient.makePath makePath: /live_no= des/127.0.0.1:49268_ [junit4] 2> 187356 T426 oascc.SolrZkClient.makePath makePath: /oversee= r_elect/election [junit4] 2> 187371 T426 oascc.SolrZkClient.makePath makePath: /oversee= r_elect/leader [junit4] 2> 187377 T426 oasc.Overseer.start Overseer (id=3D90282358814= 932995-127.0.0.1:49268_-n_0000000000) starting [junit4] 2> 187387 T426 oascc.SolrZkClient.makePath makePath: /oversee= r/queue-work [junit4] 2> 187401 T450 oasc.OverseerCollectionProcessor.run Process c= urrent queue of collection creations [junit4] 2> 187404 T426 oascc.SolrZkClient.makePath makePath: /cluster= state.json [junit4] 2> 187413 T426 oascc.SolrZkClient.makePath makePath: /aliases= .json [junit4] 2> 187420 T426 oascc.ZkStateReader.createClusterStateWatchers= AndUpdate Updating cluster state from ZooKeeper...=20 [junit4] 2> 187433 T449 oasc.Overseer$ClusterStateUpdater.run Starting= to work on the main queue [junit4] 2> 187444 T451 oasc.ZkController.publish publishing core=3Dco= llection1 state=3Ddown [junit4] 2> 187444 T451 oasc.ZkController.publish numShards not found = on descriptor - reading it from system property [junit4] 2> 187447 T451 oasc.ZkController.waitForCoreNodeName look for= our core node name [junit4] 2> 188953 T449 oascc.ZkStateReader.updateClusterState Updatin= g cloud state from ZooKeeper...=20 [junit4] 2> 188957 T449 oasc.Overseer$ClusterStateUpdater.updateState = Update state numShards=3D1 message=3D{ [junit4] 2> =09 "operation":"state", [junit4] 2> =09 "core_node_name":"core_node1", [junit4] 2> =09 "numShards":"1", [junit4] 2> =09 "shard":null, [junit4] 2> =09 "roles":null, [junit4] 2> =09 "state":"down", [junit4] 2> =09 "shard_state":"active", [junit4] 2> =09 "core":"collection1", [junit4] 2> =09 "collection":"control_collection", [junit4] 2> =09 "shard_range":null, [junit4] 2> =09 "node_name":"127.0.0.1:49268_", [junit4] 2> =09 "base_url":"http://127.0.0.1:49268"} [junit4] 2> 188958 T449 oasc.Overseer$ClusterStateUpdater.createCollec= tion Create collection control_collection with shards [shard1] [junit4] 2> 188959 T449 oasc.Overseer$ClusterStateUpdater.updateState = Assigning new node to shard shard=3Dshard1 [junit4] 2> 188983 T448 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 189456 T451 oasc.ZkController.waitForShardId waiting to fi= nd shard id in clusterstate for collection1 [junit4] 2> 189457 T451 oasc.CoreContainer.create Creating SolrCore 'c= ollection1' using instanceDir: ../../../../../../../../../Users/jenkins/wor= kspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.s= olr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1377599469512/collection1 [junit4] 2> 189458 T451 oasc.ZkController.createCollectionZkNode Check= for collection zkNode:control_collection [junit4] 2> 189462 T451 oasc.ZkController.createCollectionZkNode Colle= ction zkNode exists [junit4] 2> 189463 T451 oasc.ZkController.readConfigName Load collecti= on config from:/collections/control_collection [junit4] 2> 189471 T451 oasc.SolrResourceLoader. new SolrResourc= eLoader for directory: '../../../../../../../../../Users/jenkins/workspace/= Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.clo= ud.ChaosMonkeySafeLeaderTest-controljetty-1377599469512/collection1/' [junit4] 2> 189475 T451 oasc.SolrResourceLoader.replaceClassLoader Add= ing 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr= -core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-= 1377599469512/collection1/lib/classes/' to classloader [junit4] 2> 189477 T451 oasc.SolrResourceLoader.replaceClassLoader Add= ing 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr= -core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-= 1377599469512/collection1/lib/README' to classloader [junit4] 2> 189553 T451 oasc.SolrConfig. Using Lucene MatchVersi= on: LUCENE_50 [junit4] 2> 189627 T451 oasc.SolrConfig. Loaded SolrConfig: solr= config.xml [junit4] 2> 189632 T451 oass.IndexSchema.readSchema Reading Solr Schem= a from schema.xml [junit4] 2> 189644 T451 oass.IndexSchema.readSchema [null] Schema name= =3Dtest [junit4] 2> 190668 T451 oass.OpenExchangeRatesOrgProvider.init Initial= ized with rates=3Dopen-exchange-rates.json, refreshInterval=3D1440. [junit4] 2> 190683 T451 oass.IndexSchema.readSchema default search fie= ld in schema is text [junit4] 2> 190688 T451 oass.IndexSchema.readSchema unique key field: = id [junit4] 2> 190725 T451 oass.FileExchangeRateProvider.reload Reloading= exchange rates from file currency.xml [junit4] 2> 190733 T451 oass.FileExchangeRateProvider.reload Reloading= exchange rates from file currency.xml [junit4] 2> 190740 T451 oass.OpenExchangeRatesOrgProvider.reload Reloa= ding exchange rates from open-exchange-rates.json [junit4] 2> 190743 T451 oass.OpenExchangeRatesOrgProvider$OpenExchange= Rates. WARN Unknown key IMPORTANT NOTE [junit4] 2> 190744 T451 oass.OpenExchangeRatesOrgProvider$OpenExchange= Rates. WARN Expected key, got STRING [junit4] 2> 190745 T451 oass.OpenExchangeRatesOrgProvider.reload Reloa= ding exchange rates from open-exchange-rates.json [junit4] 2> 190748 T451 oass.OpenExchangeRatesOrgProvider$OpenExchange= Rates. WARN Unknown key IMPORTANT NOTE [junit4] 2> 190748 T451 oass.OpenExchangeRatesOrgProvider$OpenExchange= Rates. WARN Expected key, got STRING [junit4] 2> 190749 T451 oasc.SolrCore.initDirectoryFactory solr.Standa= rdDirectoryFactory [junit4] 2> 190784 T451 oasc.SolrCore. [collection1] Opening new= SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr= -trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMon= keySafeLeaderTest-controljetty-1377599469512/collection1/, dataDir=3D./org.= apache.solr.cloud.ChaosMonkeySafeLeaderTest-1377599469200/control/data/ [junit4] 2> 190785 T451 oasc.JmxMonitoredMap. JMX monitoring is = enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBean= Server@2e13cd9c [junit4] 2> 190786 T451 oasc.CachingDirectoryFactory.get return new di= rectory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/so= lr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-13775994692= 00/control/data [junit4] 2> 190787 T451 oasc.SolrCore.getNewIndexDir New index directo= ry detected: old=3Dnull new=3D./org.apache.solr.cloud.ChaosMonkeySafeLeader= Test-1377599469200/control/data/index/ [junit4] 2> 190788 T451 oasc.SolrCore.initIndex WARN [collection1] Sol= r index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-137759= 9469200/control/data/index' doesn't exist. Creating new index... [junit4] 2> 190789 T451 oasc.CachingDirectoryFactory.get return new di= rectory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/so= lr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-13775994692= 00/control/data/index [junit4] 2> 190790 T451 oasu.RandomMergePolicy. RandomMergePolic= y wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePol= icy: maxMergeAtOnce=3D12, maxMergeAtOnceExplicit=3D26, maxMergedSegmentMB= =3D37.603515625, floorSegmentMB=3D1.1826171875, forceMergeDeletesPctAllowed= =3D16.29913977530185, segmentsPerTier=3D10.0, maxCFSSegmentSizeMB=3D8.79609= 3022207999E12, noCFSRatio=3D0.18176826910976562 [junit4] 2> 190795 T451 oasc.SolrDeletionPolicy.onCommit SolrDeletionP= olicy.onCommit: commits: num=3D1 [junit4] 2> =09=09commit{dir=3D/Users/jenkins/workspace/Lucene-Solr-tr= unk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySa= feLeaderTest-1377599469200/control/data/index,segFN=3Dsegments_1,generation= =3D1} [junit4] 2> 190795 T451 oasc.SolrDeletionPolicy.updateCommits newest c= ommit generation =3D 1 [junit4] 2> 190801 T451 oasup.UpdateRequestProcessorChain.init creatin= g updateRequestProcessorChain "nodistrib" [junit4] 2> 190803 T451 oasup.UpdateRequestProcessorChain.init creatin= g updateRequestProcessorChain "dedupe" [junit4] 2> 190804 T451 oasup.UpdateRequestProcessorChain.init inserti= ng DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedu= pe" [junit4] 2> 190804 T451 oasup.UpdateRequestProcessorChain.init creatin= g updateRequestProcessorChain "stored_sig" [junit4] 2> 190805 T451 oasup.UpdateRequestProcessorChain.init inserti= ng DistributedUpdateProcessorFactory into updateRequestProcessorChain "stor= ed_sig" [junit4] 2> 190805 T451 oasup.UpdateRequestProcessorChain.init creatin= g updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 190806 T451 oasup.UpdateRequestProcessorChain.init creatin= g updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 190807 T451 oasup.UpdateRequestProcessorChain.init inserti= ng DistributedUpdateProcessorFactory into updateRequestProcessorChain "dist= rib-dup-test-chain-implicit" [junit4] 2> 190807 T451 oasc.SolrCore.loadUpdateProcessorChains no upd= ateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 190808 T451 oasc.RequestHandlers.initHandlersFromConfig cr= eated standard: solr.StandardRequestHandler [junit4] 2> 190809 T451 oasc.RequestHandlers.initHandlersFromConfig cr= eated /get: solr.RealTimeGetHandler [junit4] 2> 190809 T451 oasc.RequestHandlers.initHandlersFromConfig ad= ding lazy requestHandler: solr.ReplicationHandler [junit4] 2> 190810 T451 oasc.RequestHandlers.initHandlersFromConfig cr= eated /replication: solr.ReplicationHandler [junit4] 2> 190811 T451 oasc.RequestHandlers.initHandlersFromConfig cr= eated /update: solr.UpdateRequestHandler [junit4] 2> 190811 T451 oasc.RequestHandlers.initHandlersFromConfig cr= eated /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4] 2> 190824 T451 oashl.XMLLoader.init xsltCacheLifetimeSeconds= =3D60 [junit4] 2> 190829 T451 oasu.CommitTracker. Hard AutoCommit: dis= abled [junit4] 2> 190830 T451 oasu.CommitTracker. Soft AutoCommit: dis= abled [junit4] 2> 190831 T451 oasu.RandomMergePolicy. RandomMergePolic= y wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePol= icy: maxMergeAtOnce=3D48, maxMergeAtOnceExplicit=3D29, maxMergedSegmentMB= =3D93.9140625, floorSegmentMB=3D0.810546875, forceMergeDeletesPctAllowed=3D= 16.91377151791715, segmentsPerTier=3D44.0, maxCFSSegmentSizeMB=3D8.79609302= 2207999E12, noCFSRatio=3D0.0 [junit4] 2> 190833 T451 oasc.SolrDeletionPolicy.onInit SolrDeletionPol= icy.onInit: commits: num=3D1 [junit4] 2> =09=09commit{dir=3D/Users/jenkins/workspace/Lucene-Solr-tr= unk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySa= feLeaderTest-1377599469200/control/data/index,segFN=3Dsegments_1,generation= =3D1} [junit4] 2> 190833 T451 oasc.SolrDeletionPolicy.updateCommits newest c= ommit generation =3D 1 [junit4] 2> 190834 T451 oass.SolrIndexSearcher. Opening Searcher= @160e10f5 main [junit4] 2> 190844 T452 oasc.SolrCore.registerSearcher [collection1] R= egistered new searcher Searcher@160e10f5 main{StandardDirectoryReader(segme= nts_1:1:nrt)} [junit4] 2> 190846 T451 oasc.CoreContainer.registerCore registering co= re: collection1 [junit4] 2> 190846 T451 oasc.ZkController.register Register replica - = core:collection1 address:http://127.0.0.1:49268 collection:control_collecti= on shard:shard1 [junit4] 2> 190847 T451 oascsi.HttpClientUtil.createClient Creating ne= w http client, config:maxConnections=3D10000&maxConnectionsPerHost=3D20&con= nTimeout=3D15000&socketTimeout=3D30000&retry=3Dfalse [junit4] 2> 190864 T451 oascc.SolrZkClient.makePath makePath: /collect= ions/control_collection/leader_elect/shard1/election [junit4] 2> 190882 T451 oasc.ShardLeaderElectionContext.runLeaderProce= ss Running the leader process for shard shard1 [junit4] 2> 190889 T451 oasc.ShardLeaderElectionContext.waitForReplica= sToComeUp Enough replicas found to continue. [junit4] 2> 190890 T451 oasc.ShardLeaderElectionContext.runLeaderProce= ss I may be the new leader - try and sync [junit4] 2> 190890 T451 oasc.SyncStrategy.sync Sync replicas to http:/= /127.0.0.1:49268/collection1/ [junit4] 2> 190891 T451 oasc.SyncStrategy.syncReplicas Sync Success - = now sync replicas to me [junit4] 2> 190891 T451 oasc.SyncStrategy.syncToMe http://127.0.0.1:49= 268/collection1/ has no replicas [junit4] 2> 190892 T451 oasc.ShardLeaderElectionContext.runLeaderProce= ss I am the new leader: http://127.0.0.1:49268/collection1/ shard1 [junit4] 2> 190892 T451 oascc.SolrZkClient.makePath makePath: /collect= ions/control_collection/leaders/shard1 [junit4] 2> 192073 T449 oascc.ZkStateReader.updateClusterState Updatin= g cloud state from ZooKeeper...=20 [junit4] 2> 192112 T448 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 192146 T451 oasc.ZkController.register We are http://127.0= .0.1:49268/collection1/ and leader is http://127.0.0.1:49268/collection1/ [junit4] 2> 192147 T451 oasc.ZkController.register No LogReplay needed= for core=3Dcollection1 baseURL=3Dhttp://127.0.0.1:49268 [junit4] 2> 192147 T451 oasc.ZkController.checkRecovery I am the leade= r, no recovery necessary [junit4] 2> 192147 T451 oasc.ZkController.publish publishing core=3Dco= llection1 state=3Dactive [junit4] 2> 192148 T451 oasc.ZkController.publish numShards not found = on descriptor - reading it from system property [junit4] 2> 192151 T451 oascc.ZkStateReader.updateClusterState Updatin= g cloud state from ZooKeeper...=20 [junit4] 2> 192153 T426 oass.SolrDispatchFilter.init user.dir=3D/Users= /jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0 [junit4] 2> 192154 T426 oass.SolrDispatchFilter.init SolrDispatchFilte= r.init() done [junit4] 2> 192154 T426 oascsi.HttpClientUtil.createClient Creating ne= w http client, config:maxConnections=3D128&maxConnectionsPerHost=3D32&follo= wRedirects=3Dfalse [junit4] 2> 192169 T426 oascsi.HttpClientUtil.createClient Creating ne= w http client, config: [junit4] 2> 192172 T426 oascc.ConnectionManager.waitForConnected Waiti= ng for client to connect to ZooKeeper [junit4] 2> 192177 T455 oascc.ConnectionManager.process Watcher org.ap= ache.solr.common.cloud.ConnectionManager@ed19861 name:ZooKeeperConnection W= atcher:127.0.0.1:49265/solr got event WatchedEvent state:SyncConnected type= :None path:null path:null type:None [junit4] 2> 192178 T426 oascc.ConnectionManager.waitForConnected Clien= t is connected to ZooKeeper [junit4] 2> 192182 T426 oascc.ZkStateReader.createClusterStateWatchers= AndUpdate Updating cluster state from ZooKeeper...=20 [junit4] 2> 192189 T426 oasc.ChaosMonkey.monkeyLog monkey: init - expi= re sessions:true cause connection loss:true [junit4] 2> 192569 T426 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 192576 T426 oejs.AbstractConnector.doStart Started SelectC= hannelConnector@127.0.0.1:49272 [junit4] 2> 192579 T426 oass.SolrDispatchFilter.init SolrDispatchFilte= r.init() [junit4] 2> 192580 T426 oasc.SolrResourceLoader.locateSolrHome JNDI no= t configured for solr (NoInitialContextEx) [junit4] 2> 192580 T426 oasc.SolrResourceLoader.locateSolrHome using s= ystem property solr.solr.home: ../../../../../../../../../Users/jenkins/wor= kspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.s= olr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1377599475103 [junit4] 2> 192581 T426 oasc.SolrResourceLoader. new SolrResourc= eLoader for directory: '../../../../../../../../../Users/jenkins/workspace/= Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.clo= ud.ChaosMonkeySafeLeaderTest-jetty1-1377599475103/' [junit4] 2> 192619 T426 oasc.ConfigSolr.fromFile Loading container con= figuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/buil= d/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Luce= ne-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.C= haosMonkeySafeLeaderTest-jetty1-1377599475103/solr.xml [junit4] 2> 192714 T426 oasc.CoreContainer. New CoreContainer 96= 8256266 [junit4] 2> 192715 T426 oasc.CoreContainer.load Loading cores into Cor= eContainer [instanceDir=3D../../../../../../../../../Users/jenkins/workspac= e/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.c= loud.ChaosMonkeySafeLeaderTest-jetty1-1377599475103/] [junit4] 2> 192717 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting socketTimeout to: 120000 [junit4] 2> 192717 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting urlScheme to: http:// [junit4] 2> 192718 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting connTimeout to: 15000 [junit4] 2> 192718 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting maxConnectionsPerHost to: 20 [junit4] 2> 192719 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting corePoolSize to: 0 [junit4] 2> 192719 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting maximumPoolSize to: 2147483647 [junit4] 2> 192720 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting maxThreadIdleTime to: 5 [junit4] 2> 192720 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting sizeOfQueue to: -1 [junit4] 2> 192721 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting fairnessPolicy to: false [junit4] 2> 192721 T426 oascsi.HttpClientUtil.createClient Creating ne= w http client, config:maxConnectionsPerHost=3D20&maxConnections=3D10000&soc= ketTimeout=3D120000&connTimeout=3D15000&retry=3Dfalse [junit4] 2> 192742 T426 oasc.ZkContainer.initZooKeeper Zookeeper clien= t=3D127.0.0.1:49265/solr [junit4] 2> 192743 T426 oasc.ZkController.checkChrootPath zkHost inclu= des chroot [junit4] 2> 192745 T426 oascc.ConnectionManager.waitForConnected Waiti= ng for client to connect to ZooKeeper [junit4] 2> 192749 T466 oascc.ConnectionManager.process Watcher org.ap= ache.solr.common.cloud.ConnectionManager@6b4d147d name:ZooKeeperConnection = Watcher:127.0.0.1:49265 got event WatchedEvent state:SyncConnected type:Non= e path:null path:null type:None [junit4] 2> 192750 T426 oascc.ConnectionManager.waitForConnected Clien= t is connected to ZooKeeper [junit4] 2> 192754 T426 oascsi.HttpClientUtil.createClient Creating ne= w http client, config:maxConnections=3D500&maxConnectionsPerHost=3D16&socke= tTimeout=3D120000&connTimeout=3D15000 [junit4] 2> 192772 T426 oascc.ConnectionManager.waitForConnected Waiti= ng for client to connect to ZooKeeper [junit4] 2> 192776 T468 oascc.ConnectionManager.process Watcher org.ap= ache.solr.common.cloud.ConnectionManager@262ad8e1 name:ZooKeeperConnection = Watcher:127.0.0.1:49265/solr got event WatchedEvent state:SyncConnected typ= e:None path:null path:null type:None [junit4] 2> 192777 T426 oascc.ConnectionManager.waitForConnected Clien= t is connected to ZooKeeper [junit4] 2> 192788 T426 oascc.ZkStateReader.createClusterStateWatchers= AndUpdate Updating cluster state from ZooKeeper...=20 [junit4] 2> 193636 T449 oascc.ZkStateReader.updateClusterState Updatin= g cloud state from ZooKeeper...=20 [junit4] 2> 193641 T449 oasc.Overseer$ClusterStateUpdater.updateState = Update state numShards=3D1 message=3D{ [junit4] 2> =09 "operation":"state", [junit4] 2> =09 "core_node_name":"core_node1", [junit4] 2> =09 "numShards":"1", [junit4] 2> =09 "shard":"shard1", [junit4] 2> =09 "roles":null, [junit4] 2> =09 "state":"active", [junit4] 2> =09 "shard_state":"active", [junit4] 2> =09 "core":"collection1", [junit4] 2> =09 "collection":"control_collection", [junit4] 2> =09 "shard_range":null, [junit4] 2> =09 "node_name":"127.0.0.1:49268_", [junit4] 2> =09 "base_url":"http://127.0.0.1:49268"} [junit4] 2> 193664 T468 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 193664 T455 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 193665 T448 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 193800 T426 oasc.ZkController.createEphemeralLiveNode Regi= ster node as live in ZooKeeper:/live_nodes/127.0.0.1:49272_ [junit4] 2> 193808 T426 oascc.SolrZkClient.makePath makePath: /live_no= des/127.0.0.1:49272_ [junit4] 2> 193826 T448 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/liv= e_nodes, has occurred - updating... (live nodes size: 1) [junit4] 2> 193832 T455 oascc.ZkStateReader$3.process Updating live no= des... (2) [junit4] 2> 193832 T455 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/liv= e_nodes, has occurred - updating... (live nodes size: 2) [junit4] 2> 193834 T468 oascc.ZkStateReader$3.process Updating live no= des... (2) [junit4] 2> 193834 T468 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/liv= e_nodes, has occurred - updating... (live nodes size: 2) [junit4] 2> 193844 T448 oascc.ZkStateReader$3.process Updating live no= des... (2) [junit4] 2> 193860 T469 oasc.ZkController.publish publishing core=3Dco= llection1 state=3Ddown [junit4] 2> 193860 T469 oasc.ZkController.publish numShards not found = on descriptor - reading it from system property [junit4] 2> 193863 T469 oasc.ZkController.waitForCoreNodeName look for= our core node name [junit4] 2> 195191 T449 oascc.ZkStateReader.updateClusterState Updatin= g cloud state from ZooKeeper...=20 [junit4] 2> 195193 T449 oasc.Overseer$ClusterStateUpdater.updateState = Update state numShards=3D3 message=3D{ [junit4] 2> =09 "operation":"state", [junit4] 2> =09 "core_node_name":"core_node1", [junit4] 2> =09 "numShards":"3", [junit4] 2> =09 "shard":null, [junit4] 2> =09 "roles":null, [junit4] 2> =09 "state":"down", [junit4] 2> =09 "shard_state":"active", [junit4] 2> =09 "core":"collection1", [junit4] 2> =09 "collection":"collection1", [junit4] 2> =09 "shard_range":null, [junit4] 2> =09 "node_name":"127.0.0.1:49272_", [junit4] 2> =09 "base_url":"http://127.0.0.1:49272"} [junit4] 2> 195193 T449 oasc.Overseer$ClusterStateUpdater.createCollec= tion Create collection collection1 with shards [shard1, shard2, shard3] [junit4] 2> 195193 T449 oasc.Overseer$ClusterStateUpdater.updateState = Assigning new node to shard shard=3Dshard1 [junit4] 2> 195203 T455 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 195204 T448 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 195204 T468 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 195869 T469 oasc.ZkController.waitForShardId waiting to fi= nd shard id in clusterstate for collection1 [junit4] 2> 195869 T469 oasc.CoreContainer.create Creating SolrCore 'c= ollection1' using instanceDir: ../../../../../../../../../Users/jenkins/wor= kspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.s= olr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1377599475103/collection1 [junit4] 2> 195870 T469 oasc.ZkController.createCollectionZkNode Check= for collection zkNode:collection1 [junit4] 2> 195873 T469 oasc.ZkController.createCollectionZkNode Colle= ction zkNode exists [junit4] 2> 195873 T469 oasc.ZkController.readConfigName Load collecti= on config from:/collections/collection1 [junit4] 2> 195879 T469 oasc.SolrResourceLoader. new SolrResourc= eLoader for directory: '../../../../../../../../../Users/jenkins/workspace/= Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.clo= ud.ChaosMonkeySafeLeaderTest-jetty1-1377599475103/collection1/' [junit4] 2> 195882 T469 oasc.SolrResourceLoader.replaceClassLoader Add= ing 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr= -core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-137759= 9475103/collection1/lib/classes/' to classloader [junit4] 2> 195883 T469 oasc.SolrResourceLoader.replaceClassLoader Add= ing 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr= -core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-137759= 9475103/collection1/lib/README' to classloader [junit4] 2> 195966 T469 oasc.SolrConfig. Using Lucene MatchVersi= on: LUCENE_50 [junit4] 2> 196047 T469 oasc.SolrConfig. Loaded SolrConfig: solr= config.xml [junit4] 2> 196051 T469 oass.IndexSchema.readSchema Reading Solr Schem= a from schema.xml [junit4] 2> 196065 T469 oass.IndexSchema.readSchema [null] Schema name= =3Dtest [junit4] 2> 196765 T469 oass.OpenExchangeRatesOrgProvider.init Initial= ized with rates=3Dopen-exchange-rates.json, refreshInterval=3D1440. [junit4] 2> 196779 T469 oass.IndexSchema.readSchema default search fie= ld in schema is text [junit4] 2> 196784 T469 oass.IndexSchema.readSchema unique key field: = id [junit4] 2> 196822 T469 oass.FileExchangeRateProvider.reload Reloading= exchange rates from file currency.xml [junit4] 2> 196832 T469 oass.FileExchangeRateProvider.reload Reloading= exchange rates from file currency.xml [junit4] 2> 196841 T469 oass.OpenExchangeRatesOrgProvider.reload Reloa= ding exchange rates from open-exchange-rates.json [junit4] 2> 196844 T469 oass.OpenExchangeRatesOrgProvider$OpenExchange= Rates. WARN Unknown key IMPORTANT NOTE [junit4] 2> 196844 T469 oass.OpenExchangeRatesOrgProvider$OpenExchange= Rates. WARN Expected key, got STRING [junit4] 2> 196845 T469 oass.OpenExchangeRatesOrgProvider.reload Reloa= ding exchange rates from open-exchange-rates.json [junit4] 2> 196848 T469 oass.OpenExchangeRatesOrgProvider$OpenExchange= Rates. WARN Unknown key IMPORTANT NOTE [junit4] 2> 196848 T469 oass.OpenExchangeRatesOrgProvider$OpenExchange= Rates. WARN Expected key, got STRING [junit4] 2> 196849 T469 oasc.SolrCore.initDirectoryFactory solr.Standa= rdDirectoryFactory [junit4] 2> 196849 T469 oasc.SolrCore. [collection1] Opening new= SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr= -trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMon= keySafeLeaderTest-jetty1-1377599475103/collection1/, dataDir=3D./org.apache= .solr.cloud.ChaosMonkeySafeLeaderTest-1377599469200/jetty1/ [junit4] 2> 196849 T469 oasc.JmxMonitoredMap. JMX monitoring is = enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBean= Server@2e13cd9c [junit4] 2> 196851 T469 oasc.CachingDirectoryFactory.get return new di= rectory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/so= lr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-13775994692= 00/jetty1 [junit4] 2> 196852 T469 oasc.SolrCore.getNewIndexDir New index directo= ry detected: old=3Dnull new=3D./org.apache.solr.cloud.ChaosMonkeySafeLeader= Test-1377599469200/jetty1/index/ [junit4] 2> 196853 T469 oasc.SolrCore.initIndex WARN [collection1] Sol= r index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-137759= 9469200/jetty1/index' doesn't exist. Creating new index... [junit4] 2> 196853 T469 oasc.CachingDirectoryFactory.get return new di= rectory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/so= lr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-13775994692= 00/jetty1/index [junit4] 2> 196854 T469 oasu.RandomMergePolicy. RandomMergePolic= y wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePol= icy: maxMergeAtOnce=3D12, maxMergeAtOnceExplicit=3D26, maxMergedSegmentMB= =3D37.603515625, floorSegmentMB=3D1.1826171875, forceMergeDeletesPctAllowed= =3D16.29913977530185, segmentsPerTier=3D10.0, maxCFSSegmentSizeMB=3D8.79609= 3022207999E12, noCFSRatio=3D0.18176826910976562 [junit4] 2> 196858 T469 oasc.SolrDeletionPolicy.onCommit SolrDeletionP= olicy.onCommit: commits: num=3D1 [junit4] 2> =09=09commit{dir=3D/Users/jenkins/workspace/Lucene-Solr-tr= unk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySa= feLeaderTest-1377599469200/jetty1/index,segFN=3Dsegments_1,generation=3D1} [junit4] 2> 196859 T469 oasc.SolrDeletionPolicy.updateCommits newest c= ommit generation =3D 1 [junit4] 2> 196867 T469 oasup.UpdateRequestProcessorChain.init creatin= g updateRequestProcessorChain "nodistrib" [junit4] 2> 196868 T469 oasup.UpdateRequestProcessorChain.init creatin= g updateRequestProcessorChain "dedupe" [junit4] 2> 196869 T469 oasup.UpdateRequestProcessorChain.init inserti= ng DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedu= pe" [junit4] 2> 196869 T469 oasup.UpdateRequestProcessorChain.init creatin= g updateRequestProcessorChain "stored_sig" [junit4] 2> 196869 T469 oasup.UpdateRequestProcessorChain.init inserti= ng DistributedUpdateProcessorFactory into updateRequestProcessorChain "stor= ed_sig" [junit4] 2> 196870 T469 oasup.UpdateRequestProcessorChain.init creatin= g updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 196871 T469 oasup.UpdateRequestProcessorChain.init creatin= g updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 196871 T469 oasup.UpdateRequestProcessorChain.init inserti= ng DistributedUpdateProcessorFactory into updateRequestProcessorChain "dist= rib-dup-test-chain-implicit" [junit4] 2> 196872 T469 oasc.SolrCore.loadUpdateProcessorChains no upd= ateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 196873 T469 oasc.RequestHandlers.initHandlersFromConfig cr= eated standard: solr.StandardRequestHandler [junit4] 2> 196875 T469 oasc.RequestHandlers.initHandlersFromConfig cr= eated /get: solr.RealTimeGetHandler [junit4] 2> 196876 T469 oasc.RequestHandlers.initHandlersFromConfig ad= ding lazy requestHandler: solr.ReplicationHandler [junit4] 2> 196877 T469 oasc.RequestHandlers.initHandlersFromConfig cr= eated /replication: solr.ReplicationHandler [junit4] 2> 196878 T469 oasc.RequestHandlers.initHandlersFromConfig cr= eated /update: solr.UpdateRequestHandler [junit4] 2> 196879 T469 oasc.RequestHandlers.initHandlersFromConfig cr= eated /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4] 2> 196892 T469 oashl.XMLLoader.init xsltCacheLifetimeSeconds= =3D60 [junit4] 2> 196897 T469 oasu.CommitTracker. Hard AutoCommit: dis= abled [junit4] 2> 196897 T469 oasu.CommitTracker. Soft AutoCommit: dis= abled [junit4] 2> 196899 T469 oasu.RandomMergePolicy. RandomMergePolic= y wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePol= icy: maxMergeAtOnce=3D48, maxMergeAtOnceExplicit=3D29, maxMergedSegmentMB= =3D93.9140625, floorSegmentMB=3D0.810546875, forceMergeDeletesPctAllowed=3D= 16.91377151791715, segmentsPerTier=3D44.0, maxCFSSegmentSizeMB=3D8.79609302= 2207999E12, noCFSRatio=3D0.0 [junit4] 2> 196901 T469 oasc.SolrDeletionPolicy.onInit SolrDeletionPol= icy.onInit: commits: num=3D1 [junit4] 2> =09=09commit{dir=3D/Users/jenkins/workspace/Lucene-Solr-tr= unk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySa= feLeaderTest-1377599469200/jetty1/index,segFN=3Dsegments_1,generation=3D1} [junit4] 2> 196901 T469 oasc.SolrDeletionPolicy.updateCommits newest c= ommit generation =3D 1 [junit4] 2> 196902 T469 oass.SolrIndexSearcher. Opening Searcher= @3f900a24 main [junit4] 2> 196912 T470 oasc.SolrCore.registerSearcher [collection1] R= egistered new searcher Searcher@3f900a24 main{StandardDirectoryReader(segme= nts_1:1:nrt)} [junit4] 2> 196917 T469 oasc.CoreContainer.registerCore registering co= re: collection1 [junit4] 2> 196917 T469 oasc.ZkController.register Register replica - = core:collection1 address:http://127.0.0.1:49272 collection:collection1 shar= d:shard1 [junit4] 2> 196918 T469 oascsi.HttpClientUtil.createClient Creating ne= w http client, config:maxConnections=3D10000&maxConnectionsPerHost=3D20&con= nTimeout=3D15000&socketTimeout=3D30000&retry=3Dfalse [junit4] 2> 196934 T469 oascc.SolrZkClient.makePath makePath: /collect= ions/collection1/leader_elect/shard1/election [junit4] 2> 196951 T469 oasc.ShardLeaderElectionContext.runLeaderProce= ss Running the leader process for shard shard1 [junit4] 2> 196958 T469 oasc.ShardLeaderElectionContext.waitForReplica= sToComeUp Enough replicas found to continue. [junit4] 2> 196958 T469 oasc.ShardLeaderElectionContext.runLeaderProce= ss I may be the new leader - try and sync [junit4] 2> 196959 T469 oasc.SyncStrategy.sync Sync replicas to http:/= /127.0.0.1:49272/collection1/ [junit4] 2> 196959 T469 oasc.SyncStrategy.syncReplicas Sync Success - = now sync replicas to me [junit4] 2> 196959 T469 oasc.SyncStrategy.syncToMe http://127.0.0.1:49= 272/collection1/ has no replicas [junit4] 2> 196960 T469 oasc.ShardLeaderElectionContext.runLeaderProce= ss I am the new leader: http://127.0.0.1:49272/collection1/ shard1 [junit4] 2> 196960 T469 oascc.SolrZkClient.makePath makePath: /collect= ions/collection1/leaders/shard1 [junit4] 2> 198230 T449 oascc.ZkStateReader.updateClusterState Updatin= g cloud state from ZooKeeper...=20 [junit4] 2> 198275 T455 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 198276 T468 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 198275 T448 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 198325 T469 oasc.ZkController.register We are http://127.0= .0.1:49272/collection1/ and leader is http://127.0.0.1:49272/collection1/ [junit4] 2> 198326 T469 oasc.ZkController.register No LogReplay needed= for core=3Dcollection1 baseURL=3Dhttp://127.0.0.1:49272 [junit4] 2> 198327 T469 oasc.ZkController.checkRecovery I am the leade= r, no recovery necessary [junit4] 2> 198328 T469 oasc.ZkController.publish publishing core=3Dco= llection1 state=3Dactive [junit4] 2> 198329 T469 oasc.ZkController.publish numShards not found = on descriptor - reading it from system property [junit4] 2> 198337 T469 oascc.ZkStateReader.updateClusterState Updatin= g cloud state from ZooKeeper...=20 [junit4] 2> 198344 T426 oass.SolrDispatchFilter.init user.dir=3D/Users= /jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0 [junit4] 2> 198346 T426 oass.SolrDispatchFilter.init SolrDispatchFilte= r.init() done [junit4] 2> 198348 T426 oascsi.HttpClientUtil.createClient Creating ne= w http client, config:maxConnections=3D128&maxConnectionsPerHost=3D32&follo= wRedirects=3Dfalse [junit4] 2> 198813 T426 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 198819 T426 oejs.AbstractConnector.doStart Started SelectC= hannelConnector@127.0.0.1:49275 [junit4] 2> 198821 T426 oass.SolrDispatchFilter.init SolrDispatchFilte= r.init() [junit4] 2> 198822 T426 oasc.SolrResourceLoader.locateSolrHome JNDI no= t configured for solr (NoInitialContextEx) [junit4] 2> 198822 T426 oasc.SolrResourceLoader.locateSolrHome using s= ystem property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeySafeLeade= rTest-jetty2-1377599481286 [junit4] 2> 198823 T426 oasc.SolrResourceLoader. new SolrResourc= eLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-j= etty2-1377599481286/' [junit4] 2> 198865 T426 oasc.ConfigSolr.fromFile Loading container con= figuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/buil= d/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty= 2-1377599481286/solr.xml [junit4] 2> 198983 T426 oasc.CoreContainer. New CoreContainer 44= 8095337 [junit4] 2> 198984 T426 oasc.CoreContainer.load Loading cores into Cor= eContainer [instanceDir=3D./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest= -jetty2-1377599481286/] [junit4] 2> 198986 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting socketTimeout to: 120000 [junit4] 2> 198987 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting urlScheme to: http:// [junit4] 2> 198987 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting connTimeout to: 15000 [junit4] 2> 198988 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting maxConnectionsPerHost to: 20 [junit4] 2> 198988 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting corePoolSize to: 0 [junit4] 2> 198989 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting maximumPoolSize to: 2147483647 [junit4] 2> 198989 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting maxThreadIdleTime to: 5 [junit4] 2> 198990 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting sizeOfQueue to: -1 [junit4] 2> 198990 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting fairnessPolicy to: false [junit4] 2> 198991 T426 oascsi.HttpClientUtil.createClient Creating ne= w http client, config:maxConnectionsPerHost=3D20&maxConnections=3D10000&soc= ketTimeout=3D120000&connTimeout=3D15000&retry=3Dfalse [junit4] 2> 199013 T426 oasc.ZkContainer.initZooKeeper Zookeeper clien= t=3D127.0.0.1:49265/solr [junit4] 2> 199014 T426 oasc.ZkController.checkChrootPath zkHost inclu= des chroot [junit4] 2> 199016 T426 oascc.ConnectionManager.waitForConnected Waiti= ng for client to connect to ZooKeeper [junit4] 2> 199021 T482 oascc.ConnectionManager.process Watcher org.ap= ache.solr.common.cloud.ConnectionManager@3e7607b6 name:ZooKeeperConnection = Watcher:127.0.0.1:49265 got event WatchedEvent state:SyncConnected type:Non= e path:null path:null type:None [junit4] 2> 199021 T426 oascc.ConnectionManager.waitForConnected Clien= t is connected to ZooKeeper [junit4] 2> 199029 T426 oascsi.HttpClientUtil.createClient Creating ne= w http client, config:maxConnections=3D500&maxConnectionsPerHost=3D16&socke= tTimeout=3D120000&connTimeout=3D15000 [junit4] 2> 199048 T426 oascc.ConnectionManager.waitForConnected Waiti= ng for client to connect to ZooKeeper [junit4] 2> 199053 T484 oascc.ConnectionManager.process Watcher org.ap= ache.solr.common.cloud.ConnectionManager@521c2cb9 name:ZooKeeperConnection = Watcher:127.0.0.1:49265/solr got event WatchedEvent state:SyncConnected typ= e:None path:null path:null type:None [junit4] 2> 199054 T426 oascc.ConnectionManager.waitForConnected Clien= t is connected to ZooKeeper [junit4] 2> 199074 T426 oascc.ZkStateReader.createClusterStateWatchers= AndUpdate Updating cluster state from ZooKeeper...=20 [junit4] 2> 199818 T449 oascc.ZkStateReader.updateClusterState Updatin= g cloud state from ZooKeeper...=20 [junit4] 2> 199823 T449 oasc.Overseer$ClusterStateUpdater.updateState = Update state numShards=3D3 message=3D{ [junit4] 2> =09 "operation":"state", [junit4] 2> =09 "core_node_name":"core_node1", [junit4] 2> =09 "numShards":"3", [junit4] 2> =09 "shard":"shard1", [junit4] 2> =09 "roles":null, [junit4] 2> =09 "state":"active", [junit4] 2> =09 "shard_state":"active", [junit4] 2> =09 "core":"collection1", [junit4] 2> =09 "collection":"collection1", [junit4] 2> =09 "shard_range":null, [junit4] 2> =09 "node_name":"127.0.0.1:49272_", [junit4] 2> =09 "base_url":"http://127.0.0.1:49272"} [junit4] 2> 199848 T448 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 199849 T468 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 199848 T455 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 199849 T484 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 200087 T426 oasc.ZkController.createEphemeralLiveNode Regi= ster node as live in ZooKeeper:/live_nodes/127.0.0.1:49275_ [junit4] 2> 200090 T426 oascc.SolrZkClient.makePath makePath: /live_no= des/127.0.0.1:49275_ [junit4] 2> 200095 T448 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/liv= e_nodes, has occurred - updating... (live nodes size: 2) [junit4] 2> 200095 T484 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/liv= e_nodes, has occurred - updating... (live nodes size: 2) [junit4] 2> 200097 T468 oascc.ZkStateReader$3.process Updating live no= des... (3) [junit4] 2> 200097 T468 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/liv= e_nodes, has occurred - updating... (live nodes size: 3) [junit4] 2> 200098 T455 oascc.ZkStateReader$3.process Updating live no= des... (3) [junit4] 2> 200098 T455 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/liv= e_nodes, has occurred - updating... (live nodes size: 3) [junit4] 2> 200103 T448 oascc.ZkStateReader$3.process Updating live no= des... (3) [junit4] 2> 200104 T484 oascc.ZkStateReader$3.process Updating live no= des... (3) [junit4] 2> 200115 T485 oasc.ZkController.publish publishing core=3Dco= llection1 state=3Ddown [junit4] 2> 200115 T485 oasc.ZkController.publish numShards not found = on descriptor - reading it from system property [junit4] 2> 200118 T485 oasc.ZkController.waitForCoreNodeName look for= our core node name [junit4] 2> 201388 T449 oascc.ZkStateReader.updateClusterState Updatin= g cloud state from ZooKeeper...=20 [junit4] 2> 201393 T449 oasc.Overseer$ClusterStateUpdater.updateState = Update state numShards=3D3 message=3D{ [junit4] 2> =09 "operation":"state", [junit4] 2> =09 "core_node_name":"core_node2", [junit4] 2> =09 "numShards":"3", [junit4] 2> =09 "shard":null, [junit4] 2> =09 "roles":null, [junit4] 2> =09 "state":"down", [junit4] 2> =09 "shard_state":"active", [junit4] 2> =09 "core":"collection1", [junit4] 2> =09 "collection":"collection1", [junit4] 2> =09 "shard_range":null, [junit4] 2> =09 "node_name":"127.0.0.1:49275_", [junit4] 2> =09 "base_url":"http://127.0.0.1:49275"} [junit4] 2> 201394 T449 oasc.Overseer$ClusterStateUpdater.updateState = Collection already exists with numShards=3D3 [junit4] 2> 201395 T449 oasc.Overseer$ClusterStateUpdater.updateState = Assigning new node to shard shard=3Dshard2 [junit4] 2> 201423 T455 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 201425 T448 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 201427 T468 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 201428 T484 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 202126 T485 oasc.ZkController.waitForShardId waiting to fi= nd shard id in clusterstate for collection1 [junit4] 2> 202127 T485 oasc.CoreContainer.create Creating SolrCore 'c= ollection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeySafeLeade= rTest-jetty2-1377599481286/collection1 [junit4] 2> 202127 T485 oasc.ZkController.createCollectionZkNode Check= for collection zkNode:collection1 [junit4] 2> 202130 T485 oasc.ZkController.createCollectionZkNode Colle= ction zkNode exists [junit4] 2> 202131 T485 oasc.ZkController.readConfigName Load collecti= on config from:/collections/collection1 [junit4] 2> 202137 T485 oasc.SolrResourceLoader. new SolrResourc= eLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-j= etty2-1377599481286/collection1/' [junit4] 2> 202140 T485 oasc.SolrResourceLoader.replaceClassLoader Add= ing 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr= -core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-137759= 9481286/collection1/lib/classes/' to classloader [junit4] 2> 202141 T485 oasc.SolrResourceLoader.replaceClassLoader Add= ing 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr= -core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-137759= 9481286/collection1/lib/README' to classloader [junit4] 2> 202243 T485 oasc.SolrConfig. Using Lucene MatchVersi= on: LUCENE_50 [junit4] 2> 202311 T485 oasc.SolrConfig. Loaded SolrConfig: solr= config.xml [junit4] 2> 202314 T485 oass.IndexSchema.readSchema Reading Solr Schem= a from schema.xml [junit4] 2> 202336 T485 oass.IndexSchema.readSchema [null] Schema name= =3Dtest [junit4] 2> 203064 T485 oass.OpenExchangeRatesOrgProvider.init Initial= ized with rates=3Dopen-exchange-rates.json, refreshInterval=3D1440. [junit4] 2> 203077 T485 oass.IndexSchema.readSchema default search fie= ld in schema is text [junit4] 2> 203081 T485 oass.IndexSchema.readSchema unique key field: = id [junit4] 2> 203122 T485 oass.FileExchangeRateProvider.reload Reloading= exchange rates from file currency.xml [junit4] 2> 203130 T485 oass.FileExchangeRateProvider.reload Reloading= exchange rates from file currency.xml [junit4] 2> 203137 T485 oass.OpenExchangeRatesOrgProvider.reload Reloa= ding exchange rates from open-exchange-rates.json [junit4] 2> 203140 T485 oass.OpenExchangeRatesOrgProvider$OpenExchange= Rates. WARN Unknown key IMPORTANT NOTE [junit4] 2> 203140 T485 oass.OpenExchangeRatesOrgProvider$OpenExchange= Rates. WARN Expected key, got STRING [junit4] 2> 203140 T485 oass.OpenExchangeRatesOrgProvider.reload Reloa= ding exchange rates from open-exchange-rates.json [junit4] 2> 203144 T485 oass.OpenExchangeRatesOrgProvider$OpenExchange= Rates. WARN Unknown key IMPORTANT NOTE [junit4] 2> 203144 T485 oass.OpenExchangeRatesOrgProvider$OpenExchange= Rates. WARN Expected key, got STRING [junit4] 2> 203144 T485 oasc.SolrCore.initDirectoryFactory solr.Standa= rdDirectoryFactory [junit4] 2> 203145 T485 oasc.SolrCore. [collection1] Opening new= SolrCore at ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-13775= 99481286/collection1/, dataDir=3D./org.apache.solr.cloud.ChaosMonkeySafeLea= derTest-1377599469200/jetty2/ [junit4] 2> 203145 T485 oasc.JmxMonitoredMap. JMX monitoring is = enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBean= Server@2e13cd9c [junit4] 2> 203147 T485 oasc.CachingDirectoryFactory.get return new di= rectory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/so= lr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-13775994692= 00/jetty2 [junit4] 2> 203148 T485 oasc.SolrCore.getNewIndexDir New index directo= ry detected: old=3Dnull new=3D./org.apache.solr.cloud.ChaosMonkeySafeLeader= Test-1377599469200/jetty2/index/ [junit4] 2> 203149 T485 oasc.SolrCore.initIndex WARN [collection1] Sol= r index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-137759= 9469200/jetty2/index' doesn't exist. Creating new index... [junit4] 2> 203149 T485 oasc.CachingDirectoryFactory.get return new di= rectory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/so= lr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-13775994692= 00/jetty2/index [junit4] 2> 203150 T485 oasu.RandomMergePolicy. RandomMergePolic= y wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePol= icy: maxMergeAtOnce=3D12, maxMergeAtOnceExplicit=3D26, maxMergedSegmentMB= =3D37.603515625, floorSegmentMB=3D1.1826171875, forceMergeDeletesPctAllowed= =3D16.29913977530185, segmentsPerTier=3D10.0, maxCFSSegmentSizeMB=3D8.79609= 3022207999E12, noCFSRatio=3D0.18176826910976562 [junit4] 2> 203155 T485 oasc.SolrDeletionPolicy.onCommit SolrDeletionP= olicy.onCommit: commits: num=3D1 [junit4] 2> =09=09commit{dir=3D/Users/jenkins/workspace/Lucene-Solr-tr= unk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySa= feLeaderTest-1377599469200/jetty2/index,segFN=3Dsegments_1,generation=3D1} [junit4] 2> 203155 T485 oasc.SolrDeletionPolicy.updateCommits newest c= ommit generation =3D 1 [junit4] 2> 203160 T485 oasup.UpdateRequestProcessorChain.init creatin= g updateRequestProcessorChain "nodistrib" [junit4] 2> 203161 T485 oasup.UpdateRequestProcessorChain.init creatin= g updateRequestProcessorChain "dedupe" [junit4] 2> 203161 T485 oasup.UpdateRequestProcessorChain.init inserti= ng DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedu= pe" [junit4] 2> 203161 T485 oasup.UpdateRequestProcessorChain.init creatin= g updateRequestProcessorChain "stored_sig" [junit4] 2> 203162 T485 oasup.UpdateRequestProcessorChain.init inserti= ng DistributedUpdateProcessorFactory into updateRequestProcessorChain "stor= ed_sig" [junit4] 2> 203162 T485 oasup.UpdateRequestProcessorChain.init creatin= g updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 203163 T485 oasup.UpdateRequestProcessorChain.init creatin= g updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 203163 T485 oasup.UpdateRequestProcessorChain.init inserti= ng DistributedUpdateProcessorFactory into updateRequestProcessorChain "dist= rib-dup-test-chain-implicit" [junit4] 2> 203164 T485 oasc.SolrCore.loadUpdateProcessorChains no upd= ateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 203164 T485 oasc.RequestHandlers.initHandlersFromConfig cr= eated standard: solr.StandardRequestHandler [junit4] 2> 203166 T485 oasc.RequestHandlers.initHandlersFromConfig cr= eated /get: solr.RealTimeGetHandler [junit4] 2> 203166 T485 oasc.RequestHandlers.initHandlersFromConfig ad= ding lazy requestHandler: solr.ReplicationHandler [junit4] 2> 203166 T485 oasc.RequestHandlers.initHandlersFromConfig cr= eated /replication: solr.ReplicationHandler [junit4] 2> 203167 T485 oasc.RequestHandlers.initHandlersFromConfig cr= eated /update: solr.UpdateRequestHandler [junit4] 2> 203168 T485 oasc.RequestHandlers.initHandlersFromConfig cr= eated /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4] 2> 203178 T485 oashl.XMLLoader.init xsltCacheLifetimeSeconds= =3D60 [junit4] 2> 203182 T485 oasu.CommitTracker. Hard AutoCommit: dis= abled [junit4] 2> 203182 T485 oasu.CommitTracker. Soft AutoCommit: dis= abled [junit4] 2> 203183 T485 oasu.RandomMergePolicy. RandomMergePolic= y wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePol= icy: maxMergeAtOnce=3D48, maxMergeAtOnceExplicit=3D29, maxMergedSegmentMB= =3D93.9140625, floorSegmentMB=3D0.810546875, forceMergeDeletesPctAllowed=3D= 16.91377151791715, segmentsPerTier=3D44.0, maxCFSSegmentSizeMB=3D8.79609302= 2207999E12, noCFSRatio=3D0.0 [junit4] 2> 203185 T485 oasc.SolrDeletionPolicy.onInit SolrDeletionPol= icy.onInit: commits: num=3D1 [junit4] 2> =09=09commit{dir=3D/Users/jenkins/workspace/Lucene-Solr-tr= unk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySa= feLeaderTest-1377599469200/jetty2/index,segFN=3Dsegments_1,generation=3D1} [junit4] 2> 203186 T485 oasc.SolrDeletionPolicy.updateCommits newest c= ommit generation =3D 1 [junit4] 2> 203186 T485 oass.SolrIndexSearcher. Opening Searcher= @1d1b8446 main [junit4] 2> 203194 T486 oasc.SolrCore.registerSearcher [collection1] R= egistered new searcher Searcher@1d1b8446 main{StandardDirectoryReader(segme= nts_1:1:nrt)} [junit4] 2> 203197 T485 oasc.CoreContainer.registerCore registering co= re: collection1 [junit4] 2> 203197 T485 oasc.ZkController.register Register replica - = core:collection1 address:http://127.0.0.1:49275 collection:collection1 shar= d:shard2 [junit4] 2> 203198 T485 oascsi.HttpClientUtil.createClient Creating ne= w http client, config:maxConnections=3D10000&maxConnectionsPerHost=3D20&con= nTimeout=3D15000&socketTimeout=3D30000&retry=3Dfalse [junit4] 2> 203212 T485 oascc.SolrZkClient.makePath makePath: /collect= ions/collection1/leader_elect/shard2/election [junit4] 2> 203228 T485 oasc.ShardLeaderElectionContext.runLeaderProce= ss Running the leader process for shard shard2 [junit4] 2> 203235 T485 oasc.ShardLeaderElectionContext.waitForReplica= sToComeUp Enough replicas found to continue. [junit4] 2> 203235 T485 oasc.ShardLeaderElectionContext.runLeaderProce= ss I may be the new leader - try and sync [junit4] 2> 203236 T485 oasc.SyncStrategy.sync Sync replicas to http:/= /127.0.0.1:49275/collection1/ [junit4] 2> 203236 T485 oasc.SyncStrategy.syncReplicas Sync Success - = now sync replicas to me [junit4] 2> 203236 T485 oasc.SyncStrategy.syncToMe http://127.0.0.1:49= 275/collection1/ has no replicas [junit4] 2> 203237 T485 oasc.ShardLeaderElectionContext.runLeaderProce= ss I am the new leader: http://127.0.0.1:49275/collection1/ shard2 [junit4] 2> 203237 T485 oascc.SolrZkClient.makePath makePath: /collect= ions/collection1/leaders/shard2 [junit4] 2> 204466 T449 oascc.ZkStateReader.updateClusterState Updatin= g cloud state from ZooKeeper...=20 [junit4] 2> 204508 T448 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 204509 T484 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 204509 T455 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 204509 T468 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 204553 T485 oasc.ZkController.register We are http://127.0= .0.1:49275/collection1/ and leader is http://127.0.0.1:49275/collection1/ [junit4] 2> 204553 T485 oasc.ZkController.register No LogReplay needed= for core=3Dcollection1 baseURL=3Dhttp://127.0.0.1:49275 [junit4] 2> 204554 T485 oasc.ZkController.checkRecovery I am the leade= r, no recovery necessary [junit4] 2> 204555 T485 oasc.ZkController.publish publishing core=3Dco= llection1 state=3Dactive [junit4] 2> 204556 T485 oasc.ZkController.publish numShards not found = on descriptor - reading it from system property [junit4] 2> 204564 T485 oascc.ZkStateReader.updateClusterState Updatin= g cloud state from ZooKeeper...=20 [junit4] 2> 204570 T426 oass.SolrDispatchFilter.init user.dir=3D/Users= /jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0 [junit4] 2> 204571 T426 oass.SolrDispatchFilter.init SolrDispatchFilte= r.init() done [junit4] 2> 204572 T426 oascsi.HttpClientUtil.createClient Creating ne= w http client, config:maxConnections=3D128&maxConnectionsPerHost=3D32&follo= wRedirects=3Dfalse [junit4] 2> 204974 T426 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 204979 T426 oejs.AbstractConnector.doStart Started SelectC= hannelConnector@127.0.0.1:49278 [junit4] 2> 204981 T426 oass.SolrDispatchFilter.init SolrDispatchFilte= r.init() [junit4] 2> 204981 T426 oasc.SolrResourceLoader.locateSolrHome JNDI no= t configured for solr (NoInitialContextEx) [junit4] 2> 204982 T426 oasc.SolrResourceLoader.locateSolrHome using s= ystem property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeySafeLeade= rTest-jetty3-1377599487518 [junit4] 2> 204982 T426 oasc.SolrResourceLoader. new SolrResourc= eLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-j= etty3-1377599487518/' [junit4] 2> 205020 T426 oasc.ConfigSolr.fromFile Loading container con= figuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/buil= d/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty= 3-1377599487518/solr.xml [junit4] 2> 205114 T426 oasc.CoreContainer. New CoreContainer 14= 39062241 [junit4] 2> 205115 T426 oasc.CoreContainer.load Loading cores into Cor= eContainer [instanceDir=3D./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest= -jetty3-1377599487518/] [junit4] 2> 205117 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting socketTimeout to: 120000 [junit4] 2> 205118 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting urlScheme to: http:// [junit4] 2> 205118 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting connTimeout to: 15000 [junit4] 2> 205119 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting maxConnectionsPerHost to: 20 [junit4] 2> 205119 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting corePoolSize to: 0 [junit4] 2> 205120 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting maximumPoolSize to: 2147483647 [junit4] 2> 205120 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting maxThreadIdleTime to: 5 [junit4] 2> 205121 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting sizeOfQueue to: -1 [junit4] 2> 205121 T426 oashc.HttpShardHandlerFactory.getParameter Set= ting fairnessPolicy to: false [junit4] 2> 205122 T426 oascsi.HttpClientUtil.createClient Creating ne= w http client, config:maxConnectionsPerHost=3D20&maxConnections=3D10000&soc= ketTimeout=3D120000&connTimeout=3D15000&retry=3Dfalse [junit4] 2> 205141 T426 oasc.ZkContainer.initZooKeeper Zookeeper clien= t=3D127.0.0.1:49265/solr [junit4] 2> 205142 T426 oasc.ZkController.checkChrootPath zkHost inclu= des chroot [junit4] 2> 205144 T426 oascc.ConnectionManager.waitForConnected Waiti= ng for client to connect to ZooKeeper [junit4] 2> 205149 T498 oascc.ConnectionManager.process Watcher org.ap= ache.solr.common.cloud.ConnectionManager@227f5ac9 name:ZooKeeperConnection = Watcher:127.0.0.1:49265 got event WatchedEvent state:SyncConnected type:Non= e path:null path:null type:None [junit4] 2> 205150 T426 oascc.ConnectionManager.waitForConnected Clien= t is connected to ZooKeeper [junit4] 2> 205156 T426 oascsi.HttpClientUtil.createClient Creating ne= w http client, config:maxConnections=3D500&maxConnectionsPerHost=3D16&socke= tTimeout=3D120000&connTimeout=3D15000 [junit4] 2> 205186 T426 oascc.ConnectionManager.waitForConnected Waiti= ng for client to connect to ZooKeeper [junit4] 2> 205190 T500 oascc.ConnectionManager.process Watcher org.ap= ache.solr.common.cloud.ConnectionManager@23b754a2 name:ZooKeeperConnection = Watcher:127.0.0.1:49265/solr got event WatchedEvent state:SyncConnected typ= e:None path:null path:null type:None [junit4] 2> 205191 T426 oascc.ConnectionManager.waitForConnected Clien= t is connected to ZooKeeper [junit4] 2> 205206 T426 oascc.ZkStateReader.createClusterStateWatchers= AndUpdate Updating cluster state from ZooKeeper...=20 [junit4] 2> 206035 T449 oascc.ZkStateReader.updateClusterState Updatin= g cloud state from ZooKeeper...=20 [junit4] 2> 206038 T449 oasc.Overseer$ClusterStateUpdater.updateState = Update state numShards=3D3 message=3D{ [junit4] 2> =09 "operation":"state", [junit4] 2> =09 "core_node_name":"core_node2", [junit4] 2> =09 "numShards":"3", [junit4] 2> =09 "shard":"shard2", [junit4] 2> =09 "roles":null, [junit4] 2> =09 "state":"active", [junit4] 2> =09 "shard_state":"active", [junit4] 2> =09 "core":"collection1", [junit4] 2> =09 "collection":"collection1", [junit4] 2> =09 "shard_range":null, [junit4] 2> =09 "node_name":"127.0.0.1:49275_", [junit4] 2> =09 "base_url":"http://127.0.0.1:49275"} [junit4] 2> 206048 T500 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 206049 T484 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 206048 T448 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 206049 T468 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 206049 T455 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 206218 T426 oasc.ZkController.createEphemeralLiveNode Regi= ster node as live in ZooKeeper:/live_nodes/127.0.0.1:49278_ [junit4] 2> 206220 T426 oascc.SolrZkClient.makePath makePath: /live_no= des/127.0.0.1:49278_ [junit4] 2> 206225 T448 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/liv= e_nodes, has occurred - updating... (live nodes size: 3) [junit4] 2> 206227 T484 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/liv= e_nodes, has occurred - updating... (live nodes size: 3) [junit4] 2> 206228 T500 oascc.ZkStateReader$3.process Updating live no= des... (4) [junit4] 2> 206229 T500 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/liv= e_nodes, has occurred - updating... (live nodes size: 4) [junit4] 2> 206228 T468 oascc.ZkStateReader$3.process Updating live no= des... (4) [junit4] 2> 206229 T468 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/liv= e_nodes, has occurred - updating... (live nodes size: 4) [junit4] 2> 206230 T455 oascc.ZkStateReader$3.process Updating live no= des... (4) [junit4] 2> 206230 T455 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/liv= e_nodes, has occurred - updating... (live nodes size: 4) [junit4] 2> 206234 T448 oascc.ZkStateReader$3.process Updating live no= des... (4) [junit4] 2> 206237 T484 oascc.ZkStateReader$3.process Updating live no= des... (4) [junit4] 2> 206250 T501 oasc.ZkController.publish publishing core=3Dco= llection1 state=3Ddown [junit4] 2> 206250 T501 oasc.ZkController.publish numShards not found = on descriptor - reading it from system property [junit4] 2> 206253 T501 oasc.ZkController.waitForCoreNodeName look for= our core node name [junit4] 2> 207567 T449 oascc.ZkStateReader.updateClusterState Updatin= g cloud state from ZooKeeper...=20 [junit4] 2> 207569 T449 oasc.Overseer$ClusterStateUpdater.updateState = Update state numShards=3D3 message=3D{ [junit4] 2> =09 "operation":"state", [junit4] 2> =09 "core_node_name":"core_node3", [junit4] 2> =09 "numShards":"3", [junit4] 2> =09 "shard":null, [junit4] 2> =09 "roles":null, [junit4] 2> =09 "state":"down", [junit4] 2> =09 "shard_state":"active", [junit4] 2> =09 "core":"collection1", [junit4] 2> =09 "collection":"collection1", [junit4] 2> =09 "shard_range":null, [junit4] 2> =09 "node_name":"127.0.0.1:49278_", [junit4] 2> =09 "base_url":"http://127.0.0.1:49278"} [junit4] 2> 207569 T449 oasc.Overseer$ClusterStateUpdater.updateState = Collection already exists with numShards=3D3 [junit4] 2> 207570 T449 oasc.Overseer$ClusterStateUpdater.updateState = Assigning new node to shard shard=3Dshard3 [junit4] 2> 207580 T500 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 4) [junit4] 2> 207581 T468 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 4) [junit4] 2> 207580 T448 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 4) [junit4] 2> 207581 T484 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 4) [junit4] 2> 207581 T455 oascc.ZkStateReader$2.process A cluster state = change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/cluster= state.json, has occurred - updating... (live nodes size: 4) [junit4] 2> 208257 T501 oasc.ZkController.waitForShardId waiting to fi= nd shard id in clusterstate for collection1 [junit4] 2> 208258 T501 oasc.CoreContainer.create Creating SolrCore 'c= ollection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeySafeLeade= rTest-jetty3-1377599487518/collection1 [junit4] 2> 208259 T501 oasc.ZkController.createCollectionZkNode Check= for collection zkNode:collection1 [junit4] 2> 208263 T501 oasc.ZkController.createCollectionZkNode Colle= ction zkNode exists [junit4] 2> 208264 T501 oasc.ZkController.readConfigName Load collecti= on config from:/collections/collection1 [junit4] 2> 208270 T501 oasc.SolrResourceLoader. new SolrResourc= eLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-j= etty3-1377599487518/collection1/' [junit4] 2> 208274 T501 oasc.SolrResourceLoader.replaceClassLoader Add= ing 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr= -core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-137759= 9487518/collection1/lib/classes/' to classloader [junit4] 2> 208277 T501 oasc.SolrResourceLoader.replaceClassLoader Add= ing 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr= -core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-137759= 9487518/collection1/lib/README' to classloader [junit4] 2> 208354 T501 oasc.SolrConfig. Using Lucene MatchVersi= on: LUCENE_50 [junit4] 2> 208427 T501 oasc.SolrConfig. Loaded SolrConfig: solr= config.xml [junit4] 2> 208430 T501 oass.IndexSchema.readSchema Reading Solr Schem= a from schema.xml [junit4] 2> 208451 T501 oass.IndexSchema.readSchema [null] Schema name= =3Dtest [junit4] 2> 209197 T501 oass.OpenExchangeRatesOrgProvider.init Initial= ized with rates=3Dopen-exchange-rates.json, refreshInterval=3D1440. [junit4] 2> 209212 T501 oass.IndexSchema.readSchema default search fie= ld in schema is text [junit4] 2> 209216 T501 oass.IndexSchema.readSchema unique key field: = id [junit4] 2> 209257 T501 oass.FileExchangeRateProvider.reload Reloading= exchange rates from file currency.xml [junit4] 2> 209263 T501 oass.FileExchangeRateProvider.reload Reloading= exchange rates from file currency.xml [junit4] 2> 209268 T501 oass.OpenExchangeRatesOrgProvider.reload Reloa= ding exchange rates from open-exchange-rates.json [junit4] 2> 209271 T501 oass.OpenExchangeRatesOrgProvider$OpenExchange= Rates. WARN Unknown key IMPORTANT NOTE [junit4] 2> 209271 T501 oass.OpenExchangeRatesOrgProvider$OpenExchange= Rates. WARN Expected key, got STRING [junit4] 2> 209271 T501 oass.OpenExchangeRatesOrgProvider.reload Reloa= ding exchange rates from open-exchange-rates.json [junit4] 2> 209274 T501 oass.OpenExchangeRatesOrgProvider$OpenExchange= Rates. WARN Unknown key IMPORTANT NOTE [junit4] 2> 209274 T501 oass.OpenExchangeRatesOrgProvider$OpenExchange= Rates. WARN Expected key, got STRING [junit4] 2> 209274 T501 oasc.SolrCore.initDirectoryFactory solr.Standa= rdDirectoryFactory [junit4] 2> 209275 T501 oasc.SolrCore. [collection1] Opening new= SolrCore at ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-13775= 99487518/collection1/, dataDir=3D./org.apache.solr.cloud.ChaosMonkeySafeLea= derTest-1377599469200/jetty3/ [junit4] 2> 209275 T501 oasc.JmxMonitoredMap. JMX monitoring is = enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBean= Server@2e13cd9c [junit4] 2> 209277 T501 oasc.CachingDirectoryFactory.get return new di= rectory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/so= lr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-13775994692= 00/jetty3 [junit4] 2> 209278 T501 oasc.SolrCore.getNewIndexDir New index directo= ry detected: old=3Dnull new=3D./org.apache.solr.cloud.ChaosMonkeySafeLeader= Test-1377599469200/jetty3/index/ [junit4] 2> 209278 T501 oasc.SolrCore.initIndex WARN [collection1] Sol= r index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-137759= 9469200/jetty3/index' doesn't exist. Creating new index... [junit4] 2> 209279 T501 oasc.CachingDirectoryFactory.get return new di= rectory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/so= lr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-13775994692= 00/jetty3/index [junit4] 2> 209280 T501 oasu.RandomMergePolicy. RandomMergePolic= y wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePol= icy: maxMergeAtOnce=3D12, maxMergeAtOnceExplicit=3D26, maxMergedSegmentMB= =3D37.603515625, floorSegmentMB=3D1.1826171875, forceMergeDeletesPctAllowed= =3D16.29913977530185, segmentsPerTier=3D10.0, maxCFSSegmentSizeMB=3D8.79609= 3022207999E12, noCFSRatio=3D0.18176826910976562 [junit4] 2> 209283 T501 oasc.SolrDeletionPolicy.onCommit SolrDeletionP= olicy.onCommit: commits: num=3D1 [junit4] 2> =09=09commit{dir=3D/Users/jenkins/workspace/Lucene-Solr-tr= unk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySa= feLeaderTest-1377599469200/jetty3/index,segFN=3Dsegments_1,generation=3D1} [junit4] 2> 209283 T501 oasc.SolrDeletionPolicy.updateCommits newest c= ommit generation =3D 1 [junit4] 2> 209289 T501 oasup.UpdateRequestProcessorChain.init creatin= g updateRequestProcessorChain "nodistrib" [junit4] 2> 209290 T501 oasup.UpdateRequestProcessorChain.init creatin= g updateRequestProcessorChain "dedupe" [junit4] 2> 209290 T501 oasup.UpdateRequestProcessorChain.init inserti= ng DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedu= pe" [junit4] 2> 209290 T501 oasup.UpdateRequestProcessorChain.init creatin= g updateRequestProcessorChain "stored_sig" [junit4] 2> 209292 T501 oasup.UpdateRequestProcessorChain.init inserti= ng DistributedUpdateProcessorFactory into updateRequestProcessorChain "stor= ed_sig" [junit4] 2> 209292 T501 oasup.UpdateRequestProcessorChain.init creatin= g updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 209293 T501 oasup.UpdateRequestProcessorChain.init creatin= g updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 209294 T501 oasup.UpdateRequestProcessorChain.init inserti= ng DistributedUpdateProcessorFactory into updateRequestProcessorChain "dist= rib-dup-test-chain-implicit" [junit4] 2> 209294 T501 oasc.SolrCore.loadUpdateProcessorChains no upd= ateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 209295 T501 oasc.RequestHandlers.initHandlersFromConfig cr= eated standard: solr.StandardRequestHandler [junit4] 2> 209296 T501 oasc.RequestHandlers.initHandlersFromConfig cr= eated /get: solr.RealTimeGetHandler [junit4] 2> 209296 T501 oasc.RequestHandlers.initHandlersFromConfig ad= ding lazy requestHandler: solr.ReplicationHandler [junit4] 2> 209297 T501 oasc.RequestHandlers.initHandlersFromConfig cr= eated /replication: solr.ReplicationHandler [junit4] 2> 209297 T501 oasc.RequestHandlers.initHandlersFromConfig cr= eated /update: solr.UpdateRequestHandler [junit4] 2> 209298 T501 oasc.RequestHandlers.initHandlersFromConfig cr= eated /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4] 2> 209311 T501 oashl.XMLLoader.init xsltCacheLifetimeSeconds= =3D60 [junit4] 2> 209315 T501 oasu.CommitTracker. Hard AutoCommit: dis= abled [junit4] 2> 209316 T501 oasu.CommitTracker. Soft AutoCommit: dis= abled [junit4] 2> 209317 T501 oasu.RandomMergePolicy. RandomMergePolic= y wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePol= icy: maxMergeAtOnce=3D48,=20 [...truncated too long message...] queryparser-5.0-SNAPSHOT.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-Mac= OSX/lucene/build/join/lucene-join-5.0-SNAPSHOT.jar:/Users/jenkins/workspace= /Lucene-Solr-trunk-MacOSX/solr/core/lib/commons-cli-1.2.jar:/Users/jenkins/= workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/commons-codec-1.7.jar:/Use= rs/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/commons-configu= ration-1.6.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/= lib/commons-fileupload-1.2.1.jar:/Users/jenkins/workspace/Lucene-Solr-trunk= -MacOSX/solr/core/lib/commons-lang-2.6.jar:/Users/jenkins/workspace/Lucene-= Solr-trunk-MacOSX/solr/core/lib/concurrentlinkedhashmap-lru-1.2.jar:/Users/= jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/dom4j-1.6.1.jar:/U= sers/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/guava-14.0.1.= jar:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/hadoop-= annotations-2.0.5-alpha.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-MacO= SX/solr/core/lib/hadoop-auth-2.0.5-alpha.jar:/Users/jenkins/workspace/Lucen= e-Solr-trunk-MacOSX/solr/core/lib/hadoop-common-2.0.5-alpha.jar:/Users/jenk= ins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/hadoop-hdfs-2.0.5-alph= a.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/joda-= time-2.2.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/li= b/org.restlet-2.1.1.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/s= olr/core/lib/org.restlet.ext.servlet-2.1.1.jar:/Users/jenkins/workspace/Luc= ene-Solr-trunk-MacOSX/solr/core/lib/protobuf-java-2.4.0a.jar:/Users/jenkins= /workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/spatial4j-0.3.jar:/Users/= jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/commons-io-2.1.ja= r:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/httpclie= nt-4.2.3.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/l= ib/httpcore-4.2.2.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/sol= r/solrj/lib/httpmime-4.2.3.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-M= acOSX/solr/solrj/lib/jcl-over-slf4j-1.6.6.jar:/Users/jenkins/workspace/Luce= ne-Solr-trunk-MacOSX/solr/solrj/lib/jul-to-slf4j-1.6.6.jar:/Users/jenkins/w= orkspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/log4j-1.2.16.jar:/Users/je= nkins/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/noggit-0.5.jar:/Use= rs/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/slf4j-api-1.6.= 6.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/slf4= j-log4j12-1.6.6.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/= solrj/lib/wstx-asl-3.2.7.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-Mac= OSX/solr/solrj/lib/zookeeper-3.4.5.jar:/Users/jenkins/workspace/Lucene-Solr= -trunk-MacOSX/solr/example/lib/jetty-continuation-8.1.10.v20130312.jar:/Use= rs/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-deploy= -8.1.10.v20130312.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/sol= r/example/lib/jetty-http-8.1.10.v20130312.jar:/Users/jenkins/workspace/Luce= ne-Solr-trunk-MacOSX/solr/example/lib/jetty-io-8.1.10.v20130312.jar:/Users/= jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-jmx-8.1.1= 0.v20130312.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/exam= ple/lib/jetty-security-8.1.10.v20130312.jar:/Users/jenkins/workspace/Lucene= -Solr-trunk-MacOSX/solr/example/lib/jetty-server-8.1.10.v20130312.jar:/User= s/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-servlet= -8.1.10.v20130312.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/sol= r/example/lib/jetty-util-8.1.10.v20130312.jar:/Users/jenkins/workspace/Luce= ne-Solr-trunk-MacOSX/solr/example/lib/jetty-webapp-8.1.10.v20130312.jar:/Us= ers/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-xml-8= .1.10.v20130312.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/= example/lib/servlet-api-3.0.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-= MacOSX/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/Users/jenki= ns/workspace/Lucene-Solr-trunk-MacOSX/solr/example/example-DIH/solr/db/lib/= hsqldb-1.8.0.10.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucen= e/build/core/classes/java:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX= /lucene/test-framework/lib/junit-4.10.jar:/Users/jenkins/workspace/Lucene-S= olr-trunk-MacOSX/lucene/test-framework/lib/randomizedtesting-runner-2.0.10.= jar:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/test-lib/cg= lib-nodep-2.2.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/co= re/test-lib/commons-collections-3.2.1.jar:/Users/jenkins/workspace/Lucene-S= olr-trunk-MacOSX/solr/core/test-lib/dom4j-1.6.1.jar:/Users/jenkins/workspac= e/Lucene-Solr-trunk-MacOSX/solr/core/test-lib/easymock-3.0.jar:/Users/jenki= ns/workspace/Lucene-Solr-trunk-MacOSX/solr/core/test-lib/hadoop-common-2.0.= 5-alpha-tests.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/co= re/test-lib/hadoop-hdfs-2.0.5-alpha-tests.jar:/Users/jenkins/workspace/Luce= ne-Solr-trunk-MacOSX/solr/core/test-lib/javax.servlet-api-3.0.1.jar:/Users/= jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/test-lib/jersey-core-1= .16.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/test-li= b/jetty-6.1.26.jar:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/c= ore/test-lib/jetty-util-6.1.26.jar:/Users/jenkins/workspace/Lucene-Solr-tru= nk-MacOSX/solr/core/test-lib/objenesis-1.2.jar:/Users/jenkins/tools/hudson.= tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-launcher.jar:/Users/jenkins/.an= t/lib/ivy-2.3.0.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/A= NT_1.8.2/lib/ant-antlr.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstall= ation/ANT_1.8.2/lib/ant-apache-bcel.jar:/Users/jenkins/tools/hudson.tasks.A= nt_AntInstallation/ANT_1.8.2/lib/ant-apache-bsf.jar:/Users/jenkins/tools/hu= dson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-log4j.jar:/Users/je= nkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-oro.j= ar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-= apache-regexp.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT= _1.8.2/lib/ant-apache-resolver.jar:/Users/jenkins/tools/hudson.tasks.Ant_An= tInstallation/ANT_1.8.2/lib/ant-apache-xalan2.jar:/Users/jenkins/tools/huds= on.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-logging.jar:/Users/j= enkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-net= .jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/an= t-jai.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/l= ib/ant-javamail.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/A= NT_1.8.2/lib/ant-jdepend.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInsta= llation/ANT_1.8.2/lib/ant-jmf.jar:/Users/jenkins/tools/hudson.tasks.Ant_Ant= Installation/ANT_1.8.2/lib/ant-jsch.jar:/Users/jenkins/tools/hudson.tasks.A= nt_AntInstallation/ANT_1.8.2/lib/ant-junit.jar:/Users/jenkins/tools/hudson.= tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit4.jar:/Users/jenkins/tools= /hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-netrexx.jar:/Users/jenk= ins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-swing.jar:/Use= rs/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-testuti= l.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/a= nt.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_25.jdk/Contents/Home/lib/= tools.jar:/Users/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/jun= it4-ant/jars/junit4-ant-2.0.10.jar -ea:org.apache.lucene... -ea:org.apache.= solr... com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -flush -event= sfile /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-cor= e/test/temp/junit4-J0-20130827_102758_671.events @/Users/jenkins/workspace/= Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/temp/junit4-J0-20130827_= 102758_671.suites [junit4] ERROR: JVM J0 ended with an exception: Forked process returned = with error code: 134. Very likely a JVM crash. Process output piped in log= s above. [junit4] =09at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUn= it4.java:1254) [junit4] =09at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit= 4.java:67) [junit4] =09at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.ja= va:822) [junit4] =09at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.ja= va:819) [junit4] =09at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.= java:334) [junit4] =09at java.util.concurrent.FutureTask.run(FutureTask.java:166) [junit4] =09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadP= oolExecutor.java:1145) [junit4] =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(Thread= PoolExecutor.java:615) [junit4] =09at java.lang.Thread.run(Thread.java:724) BUILD FAILED /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:389: The follow= ing error occurred while executing this line: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:369: The follow= ing error occurred while executing this line: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The followi= ng error occurred while executing this line: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:181: The f= ollowing error occurred while executing this line: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:450= : The following error occurred while executing this line: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1= 230: The following error occurred while executing this line: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:8= 73: At least one slave process threw an exception, first: Forked process re= turned with error code: 134. Very likely a JVM crash. Process output piped= in logs above. Total time: 51 minutes 25 seconds Build step 'Invoke Ant' marked build as failure Description set: Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseParall= elGC Archiving artifacts Recording test results Email was triggered for: Failure Sending email for trigger: Failure ------=_Part_0_1434402000.1377600273140 Content-Type: text/plain; charset=us-ascii --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org ------=_Part_0_1434402000.1377600273140--