Return-Path: X-Original-To: apmail-lucene-dev-archive@www.apache.org Delivered-To: apmail-lucene-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 46A0BF4A1 for ; Sat, 13 Apr 2013 06:39:41 +0000 (UTC) Received: (qmail 62213 invoked by uid 500); 13 Apr 2013 06:39:39 -0000 Delivered-To: apmail-lucene-dev-archive@lucene.apache.org Received: (qmail 61889 invoked by uid 500); 13 Apr 2013 06:39:39 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 61865 invoked by uid 99); 13 Apr 2013 06:39:38 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 13 Apr 2013 06:39:38 +0000 X-ASF-Spam-Status: No, hits=0.0 required=5.0 tests=NORMAL_HTTP_TO_IP,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jenkins@thetaphi.de designates 188.138.97.18 as permitted sender) Received: from [188.138.97.18] (HELO mail.sd-datasolutions.de) (188.138.97.18) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 13 Apr 2013 06:39:28 +0000 Received: from serv1 (localhost.localdomain [127.0.0.1]) by mail.sd-datasolutions.de (Postfix) with ESMTP id E5A0D14AA04B for ; Sat, 13 Apr 2013 06:39:05 +0000 (UTC) Date: Sat, 13 Apr 2013 06:38:50 +0000 (UTC) From: Policeman Jenkins Server To: dev@lucene.apache.org Message-ID: <1371045016.83.1365835145743.JavaMail.jenkins@serv1.sd-datasolutions.de> In-Reply-To: <113566964.79.1365830126786.JavaMail.jenkins@serv1.sd-datasolutions.de> References: <113566964.79.1365830126786.JavaMail.jenkins@serv1.sd-datasolutions.de> Subject: [JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0-ea-b84) - Build # 5089 - Still Failing! MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_82_1440731565.1365835130331" X-Jenkins-Job: Lucene-Solr-4.x-Linux X-Jenkins-Result: FAILURE X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_82_1440731565.1365835130331 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/5089/ Java: 64bit/jdk1.8.0-ea-b84 -XX:+UseSerialGC 2 tests failed. REGRESSION: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearc= h Error Message: Server at http://127.0.0.1:39057/gzx/q/onenodecollectioncore returned non o= k status:404, message:Can not find: /gzx/q/onenodecollectioncore/update Stack Trace: org.apache.solr.common.SolrException: Server at http://127.0.0.1:39057/gzx/= q/onenodecollectioncore returned non ok status:404, message:Can not find: /= gzx/q/onenodecollectioncore/update =09at __randomizedtesting.SeedInfo.seed([62541EEC90F7FD26:E3B290F4E7A89D1A]= :0) =09at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServ= er.java:375) =09at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServ= er.java:181) =09at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(Ab= stractUpdateRequest.java:117) =09at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116) =09at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102) =09at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollecti= onForwarding(BasicDistributedZk2Test.java:197) =09at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributed= Zk2Test.java:89) =09at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseD= istributedSearchTestCase.java:806) =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.= java:57) =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces= sorImpl.java:43) =09at java.lang.reflect.Method.invoke(Method.java:487) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1559) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Random= izedRunner.java:79) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Random= izedRunner.java:737) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:773) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Random= izedRunner.java:787) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:53) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:50) =09at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFi= eldCacheSanity.java:51) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRul= e$1.evaluate(SystemPropertiesInvariantRule.java:55) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:49) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:70) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:358) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:782) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:442) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:746) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Random= izedRunner.java:648) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Random= izedRunner.java:682) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:693) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:53) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:42) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRul= e$1.evaluate(SystemPropertiesInvariantRule.java:55) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:43) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:70) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:55) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:358) =09at java.lang.Thread.run(Thread.java:722) FAILED: org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch Error Message: Still found shard2 in collection test_unload_shard_and_collection Stack Trace: java.lang.AssertionError: Still found shard2 in collection test_unload_shar= d_and_collection =09at __randomizedtesting.SeedInfo.seed([62541EEC90F7FD26:E3B290F4E7A89D1A]= :0) =09at org.junit.Assert.fail(Assert.java:93) =09at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndColle= ction(UnloadDistributedZkTest.java:127) =09at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistribute= dZkTest.java:77) =09at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseD= istributedSearchTestCase.java:806) =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.= java:57) =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces= sorImpl.java:43) =09at java.lang.reflect.Method.invoke(Method.java:487) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1559) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Random= izedRunner.java:79) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Random= izedRunner.java:737) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:773) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Random= izedRunner.java:787) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:53) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:50) =09at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFi= eldCacheSanity.java:51) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRul= e$1.evaluate(SystemPropertiesInvariantRule.java:55) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:49) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:70) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:358) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:782) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:442) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:746) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Random= izedRunner.java:648) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Random= izedRunner.java:682) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:693) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:53) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:42) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRul= e$1.evaluate(SystemPropertiesInvariantRule.java:55) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:43) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:70) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:55) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:358) =09at java.lang.Thread.run(Thread.java:722) Build Log: [...truncated 9219 lines...] [junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.384; org.apache.solr.BaseD= istributedSearchTestCase; Setting hostContext system property: /gzx/q [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.388; org.apache.solr.SolrT= estCaseJ4; ###Starting testDistribSearch [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.388; org.apache.solr.cloud= .ZkTestServer; STARTING ZK TEST SERVER [junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0 [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.389; org.apache.solr.cloud= .ZkTestServer$ZKServerMain; Starting server [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.489; org.apache.solr.cloud= .ZkTestServer; start zk server on port:52571 [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.490; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.534; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@11c090d2 name:ZooKeeperConnection Watcher:127.0.0.1:52571 got event = WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.534; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.534; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /solr [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.538; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.539; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@1f076c9a name:ZooKeeperConnection Watcher:127.0.0.1:52571/solr got e= vent WatchedEvent state:SyncConnected type:None path:null path:null type:No= ne [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.540; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.540; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/collection1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.542; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/collection1/shards [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.544; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/control_collection [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.545; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/control_collection/shards [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.547; org.apache.solr.cloud= .AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/s= olr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to= /configs/conf1/solrconfig.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.548; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /configs/conf1/solrconfig.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.551; org.apache.solr.cloud= .AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/s= olr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs= /conf1/schema.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.552; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /configs/conf1/schema.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.555; org.apache.solr.cloud= .AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/s= olr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /conf= igs/conf1/stopwords.txt [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.555; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /configs/conf1/stopwords.txt [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.557; org.apache.solr.cloud= .AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/s= olr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /conf= igs/conf1/protwords.txt [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.558; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /configs/conf1/protwords.txt [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.560; org.apache.solr.cloud= .AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/s= olr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /confi= gs/conf1/currency.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.560; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /configs/conf1/currency.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.565; org.apache.solr.cloud= .AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/s= olr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.js= on to /configs/conf1/open-exchange-rates.json [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.566; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /configs/conf1/open-exchange-rates.json [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.568; org.apache.solr.cloud= .AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/s= olr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accen= t.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.568; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /configs/conf1/mapping-ISOLatin1Accent.txt [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.570; org.apache.solr.cloud= .AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/s= olr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /c= onfigs/conf1/old_synonyms.txt [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.571; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /configs/conf1/old_synonyms.txt [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.573; org.apache.solr.cloud= .AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/s= olr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /confi= gs/conf1/synonyms.txt [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.573; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /configs/conf1/synonyms.txt [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.637; org.eclipse.jetty.ser= ver.Server; jetty-8.1.8.v20121106 [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.640; org.eclipse.jetty.ser= ver.AbstractConnector; Started SelectChannelConnector@127.0.0.1:40591 [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.641; org.apache.solr.servl= et.SolrDispatchFilter; SolrDispatchFilter.init() [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.641; org.apache.solr.core.= SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx) [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.641; org.apache.solr.core.= SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/= workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.s= olr.cloud.BasicDistributedZk2Test-controljetty-1365833803576 [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.642; org.apache.solr.core.= CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/w= orkspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.so= lr.cloud.BasicDistributedZk2Test-controljetty-1365833803576/solr.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.642; org.apache.solr.core.= CoreContainer; New CoreContainer 1008972035 [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.642; org.apache.solr.core.= CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/wor= kspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr= .cloud.BasicDistributedZk2Test-controljetty-1365833803576/' [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.643; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-controljetty-1365833803576/' [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.660; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000 [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.661; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting urlScheme to: http:// [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.661; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting connTimeout to: 15000 [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.661; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.662; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting corePoolSize to: 0 [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.662; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 214748364= 7 [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.662; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5 [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.663; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.663; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.663; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= sPerHost=3D20&maxConnections=3D10000&socketTimeout=3D120000&connTimeout=3D1= 5000&retry=3Dfalse [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.673; org.apache.solr.core.= CoreContainer; Registering Log Listener [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.682; org.apache.solr.core.= CoreContainer; Zookeeper client=3D127.0.0.1:52571/solr [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.682; org.apache.solr.cloud= .ZkController; zkHost includes chroot [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.683; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.684; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@7d489706 name:ZooKeeperConnection Watcher:127.0.0.1:52571 got event = WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.685; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.686; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D500&maxConnectionsPerHost=3D16&socketTimeout=3D120000&connTimeout=3D150= 00 [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.690; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.691; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@501abc61 name:ZooKeeperConnection Watcher:127.0.0.1:52571/solr got e= vent WatchedEvent state:SyncConnected type:None path:null path:null type:No= ne [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.691; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.693; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /overseer/queue [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.695; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /overseer/collection-queue-work [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.698; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /live_nodes [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.699; org.apache.solr.cloud= .ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:405= 91_gzx%2Fq [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.700; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:40591_gzx%2Fq [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.703; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /overseer_elect/election [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.708; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /overseer_elect/leader [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.709; org.apache.solr.cloud= .Overseer; Overseer (id=3D89511284138967043-127.0.0.1:40591_gzx%2Fq-n_00000= 00000) starting [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.712; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /overseer/queue-work [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.715; org.apache.solr.cloud= .OverseerCollectionProcessor; Process current queue of collection creations [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.715; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /clusterstate.json [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.718; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /aliases.json [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.719; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cluster state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.722; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Starting to work on the main queue [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.724; org.apache.solr.core.= CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/= jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.= apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365833803576/collec= tion1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.724; org.apache.solr.cloud= .ZkController; Check for collection zkNode:control_collection [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.725; org.apache.solr.cloud= .ZkController; Collection zkNode exists [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.725; org.apache.solr.cloud= .ZkController; Load collection config from:/collections/control_collection [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.726; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-controljetty-1365833803576/collection1/' [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.727; org.apache.solr.core.= SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x= -Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZ= k2Test-controljetty-1365833803576/collection1/lib/README' to classloader [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.727; org.apache.solr.core.= SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x= -Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZ= k2Test-controljetty-1365833803576/collection1/lib/classes/' to classloader [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.765; org.apache.solr.core.= SolrConfig; Using Lucene MatchVersion: LUCENE_43 [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.792; org.apache.solr.core.= SolrConfig; Loaded SolrConfig: solrconfig.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.794; org.apache.solr.schem= a.IndexSchema; Reading Solr Schema from schema.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:43.797; org.apache.solr.schem= a.IndexSchema; Schema name=3Dtest [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.114; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Initialized with rates=3Dopen-exchange-rate= s.json, refreshInterval=3D1440. [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.118; org.apache.solr.schem= a.IndexSchema; default search field in schema is text [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.120; org.apache.solr.schem= a.IndexSchema; unique key field: id [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.132; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.134; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.137; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-13 06:16:44.138; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-13 06:16:44.138; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.138; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-13 06:16:44.139; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-13 06:16:44.139; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.139; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.139; org.apache.solr.core.= SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/= Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.= BasicDistributedZk2Test-controljetty-1365833803576/collection1/, dataDir=3D= ./org.apache.solr.cloud.BasicDistributedZk2Test-1365833803388/control/data/ [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.140; org.apache.solr.core.= JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Serve= r: com.sun.jmx.mbeanserver.JmxMBeanServer@2ed0fd36 [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.140; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.140; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1365833803388/control/data [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.141; org.apache.solr.core.= SolrCore; New index directory detected: old=3Dnull new=3D./org.apache.solr.= cloud.BasicDistributedZk2Test-1365833803388/control/data/index/ [junit4:junit4] 1> WARN - 2013-04-13 06:16:44.141; org.apache.solr.core.= SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.Basic= DistributedZk2Test-1365833803388/control/data/index' doesn't exist. Creatin= g new index... [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.141; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1365833803388/control/data/index [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.143; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=3D1 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(NRTCachingDirectory(org= .apache.lucene.store.RAMDirectory@3448506f lockFactory=3Dorg.apache.lucene.= store.NativeFSLockFactory@3b95ed15; maxCacheMB=3D0.158203125 maxMergeSizeMB= =3D0.8974609375)),segFN=3Dsegments_1,generation=3D1,filenames=3D[segments_1= ] [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.143; org.apache.solr.core.= SolrDeletionPolicy; newest commit =3D 1[segments_1] [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.144; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "dedupe" [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.144; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "stored_sig" [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.145; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit= " [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.145; org.apache.solr.core.= RequestHandlers; created standard: solr.StandardRequestHandler [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.146; org.apache.solr.core.= RequestHandlers; created /get: solr.RealTimeGetHandler [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.146; org.apache.solr.core.= RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.146; org.apache.solr.core.= RequestHandlers; created /replication: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.146; org.apache.solr.core.= RequestHandlers; created /update: solr.UpdateRequestHandler [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.147; org.apache.solr.core.= RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandle= rs [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.149; org.apache.solr.handl= er.loader.XMLLoader; xsltCacheLifetimeSeconds=3D60 [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.156; org.apache.solr.searc= h.SolrIndexSearcher; Opening Searcher@46f3322d main [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.157; org.apache.solr.updat= e.UpdateHandler; Clearing tlog files, tlogDir=3D./org.apache.solr.cloud.Bas= icDistributedZk2Test-1365833803388/control/data/tlog [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.157; org.apache.solr.updat= e.CommitTracker; Hard AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.158; org.apache.solr.updat= e.CommitTracker; Soft AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.160; org.apache.solr.core.= SolrCore; [collection1] Registered new searcher Searcher@46f3322d main{Stan= dardDirectoryReader(segments_1:1)} [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.162; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Ddown [junit4:junit4] 1> INFO - 2013-04-13 06:16:44.163; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-13 06:16:45.226; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:45.226; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D1 message=3D{ [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "shard":null, [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "numShards":"1", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "collection":"control_collection", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:40591_gzx%2Fq", [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "core_node_name":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:40591/gzx/q", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-13 06:16:45.227; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Create collection control_collection with nu= mShards 1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:45.227; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Assigning new node to shard=3Dshard1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:45.230; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 1) [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.164; org.apache.solr.core.= CoreContainer; registering core: collection1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.164; org.apache.solr.cloud= .ZkController; Register replica - core:collection1 address:http://127.0.0.1= :40591/gzx/q collection:control_collection shard:shard1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.166; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/control_collection/leader_elec= t/shard1/election [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.173; org.apache.solr.cloud= .ShardLeaderElectionContext; Running the leader process. [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.175; org.apache.solr.cloud= .ShardLeaderElectionContext; Enough replicas found to continue. [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.176; org.apache.solr.cloud= .ShardLeaderElectionContext; I may be the new leader - try and sync [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.176; org.apache.solr.cloud= .SyncStrategy; Sync replicas to http://127.0.0.1:40591/gzx/q/collection1/ [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.176; org.apache.solr.cloud= .SyncStrategy; Sync Success - now sync replicas to me [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.176; org.apache.solr.cloud= .SyncStrategy; http://127.0.0.1:40591/gzx/q/collection1/ has no replicas [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.177; org.apache.solr.cloud= .ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:40591/gz= x/q/collection1/ [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.177; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/control_collection/leaders/sha= rd1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.734; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.741; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 1) [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.784; org.apache.solr.cloud= .ZkController; We are http://127.0.0.1:40591/gzx/q/collection1/ and leader = is http://127.0.0.1:40591/gzx/q/collection1/ [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.784; org.apache.solr.cloud= .ZkController; No LogReplay needed for core=3Dcollection1 baseURL=3Dhttp://= 127.0.0.1:40591/gzx/q [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.784; org.apache.solr.cloud= .ZkController; I am the leader, no recovery necessary [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.784; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Dactive [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.784; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.786; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.787; org.apache.solr.servl= et.SolrDispatchFilter; user.dir=3D/mnt/ssd/jenkins/workspace/Lucene-Solr-4.= x-Linux/solr/build/solr-core/test/J1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.787; org.apache.solr.servl= et.SolrDispatchFilter; SolrDispatchFilter.init() done [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.788; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.791; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config: [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.792; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.794; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@3a577efa name:ZooKeeperConnection Watcher:127.0.0.1:52571/solr got e= vent WatchedEvent state:SyncConnected type:None path:null path:null type:No= ne [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.794; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.796; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cluster state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.798; org.apache.solr.cloud= .ChaosMonkey; monkey: init - expire sessions:true cause connection loss:tru= e [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.862; org.eclipse.jetty.ser= ver.Server; jetty-8.1.8.v20121106 [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.864; org.eclipse.jetty.ser= ver.AbstractConnector; Started SelectChannelConnector@127.0.0.1:48633 [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.865; org.apache.solr.servl= et.SolrDispatchFilter; SolrDispatchFilter.init() [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.865; org.apache.solr.core.= SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx) [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.866; org.apache.solr.core.= SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/= workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.s= olr.cloud.BasicDistributedZk2Test-jetty1-1365833806798 [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.866; org.apache.solr.core.= CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/w= orkspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.so= lr.cloud.BasicDistributedZk2Test-jetty1-1365833806798/solr.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.866; org.apache.solr.core.= CoreContainer; New CoreContainer 1842746786 [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.867; org.apache.solr.core.= CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/wor= kspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr= .cloud.BasicDistributedZk2Test-jetty1-1365833806798/' [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.867; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-jetty1-1365833806798/' [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.884; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000 [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.885; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting urlScheme to: http:// [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.885; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting connTimeout to: 15000 [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.885; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.886; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting corePoolSize to: 0 [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.886; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 214748364= 7 [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.886; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5 [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.887; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.887; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.887; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= sPerHost=3D20&maxConnections=3D10000&socketTimeout=3D120000&connTimeout=3D1= 5000&retry=3Dfalse [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.893; org.apache.solr.core.= CoreContainer; Registering Log Listener [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.901; org.apache.solr.core.= CoreContainer; Zookeeper client=3D127.0.0.1:52571/solr [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.901; org.apache.solr.cloud= .ZkController; zkHost includes chroot [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.902; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.903; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@f2dd167 name:ZooKeeperConnection Watcher:127.0.0.1:52571 got event W= atchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.904; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.906; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D500&maxConnectionsPerHost=3D16&socketTimeout=3D120000&connTimeout=3D150= 00 [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.909; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.910; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@5c2e0656 name:ZooKeeperConnection Watcher:127.0.0.1:52571/solr got e= vent WatchedEvent state:SyncConnected type:None path:null path:null type:No= ne [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.911; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:46.915; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cluster state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:47.918; org.apache.solr.cloud= .ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:486= 33_gzx%2Fq [junit4:junit4] 1> INFO - 2013-04-13 06:16:47.919; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:48633_gzx%2Fq [junit4:junit4] 1> INFO - 2013-04-13 06:16:47.923; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 1) [junit4:junit4] 1> INFO - 2013-04-13 06:16:47.924; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (2) [junit4:junit4] 1> INFO - 2013-04-13 06:16:47.924; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (2) [junit4:junit4] 1> INFO - 2013-04-13 06:16:47.926; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (2) [junit4:junit4] 1> INFO - 2013-04-13 06:16:47.929; org.apache.solr.core.= CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/= jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.= apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365833806798/collection1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:47.929; org.apache.solr.cloud= .ZkController; Check for collection zkNode:collection1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:47.929; org.apache.solr.cloud= .ZkController; Collection zkNode exists [junit4:junit4] 1> INFO - 2013-04-13 06:16:47.930; org.apache.solr.cloud= .ZkController; Load collection config from:/collections/collection1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:47.931; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-jetty1-1365833806798/collection1/' [junit4:junit4] 1> INFO - 2013-04-13 06:16:47.931; org.apache.solr.core.= SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x= -Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZ= k2Test-jetty1-1365833806798/collection1/lib/README' to classloader [junit4:junit4] 1> INFO - 2013-04-13 06:16:47.931; org.apache.solr.core.= SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x= -Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZ= k2Test-jetty1-1365833806798/collection1/lib/classes/' to classloader [junit4:junit4] 1> INFO - 2013-04-13 06:16:47.960; org.apache.solr.core.= SolrConfig; Using Lucene MatchVersion: LUCENE_43 [junit4:junit4] 1> INFO - 2013-04-13 06:16:47.986; org.apache.solr.core.= SolrConfig; Loaded SolrConfig: solrconfig.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:47.987; org.apache.solr.schem= a.IndexSchema; Reading Solr Schema from schema.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:47.991; org.apache.solr.schem= a.IndexSchema; Schema name=3Dtest [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.246; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.247; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D1 message=3D{ [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "numShards":"1", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "collection":"control_collection", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:40591_gzx%2Fq", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "core_node_name":"127.0.0.1:40591_gzx%2Fq_collection= 1", [junit4:junit4] 1> "base_url":"http://127.0.0.1:40591/gzx/q", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.251; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.251; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.259; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.299; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Initialized with rates=3Dopen-exchange-rate= s.json, refreshInterval=3D1440. [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.303; org.apache.solr.schem= a.IndexSchema; default search field in schema is text [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.305; org.apache.solr.schem= a.IndexSchema; unique key field: id [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.316; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.319; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.322; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-13 06:16:48.323; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-13 06:16:48.323; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.323; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-13 06:16:48.325; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-13 06:16:48.325; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.325; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.325; org.apache.solr.core.= SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/= Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.= BasicDistributedZk2Test-jetty1-1365833806798/collection1/, dataDir=3D./org.= apache.solr.cloud.BasicDistributedZk2Test-1365833803388/jetty1/ [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.325; org.apache.solr.core.= JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Serve= r: com.sun.jmx.mbeanserver.JmxMBeanServer@2ed0fd36 [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.326; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.326; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1365833803388/jetty1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.326; org.apache.solr.core.= SolrCore; New index directory detected: old=3Dnull new=3D./org.apache.solr.= cloud.BasicDistributedZk2Test-1365833803388/jetty1/index/ [junit4:junit4] 1> WARN - 2013-04-13 06:16:48.327; org.apache.solr.core.= SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.Basic= DistributedZk2Test-1365833803388/jetty1/index' doesn't exist. Creating new = index... [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.327; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1365833803388/jetty1/index [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.329; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=3D1 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(NRTCachingDirectory(org= .apache.lucene.store.RAMDirectory@15c425b4 lockFactory=3Dorg.apache.lucene.= store.NativeFSLockFactory@3c8d4227; maxCacheMB=3D0.158203125 maxMergeSizeMB= =3D0.8974609375)),segFN=3Dsegments_1,generation=3D1,filenames=3D[segments_1= ] [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.329; org.apache.solr.core.= SolrDeletionPolicy; newest commit =3D 1[segments_1] [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.330; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "dedupe" [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.331; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "stored_sig" [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.331; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit= " [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.332; org.apache.solr.core.= RequestHandlers; created standard: solr.StandardRequestHandler [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.332; org.apache.solr.core.= RequestHandlers; created /get: solr.RealTimeGetHandler [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.332; org.apache.solr.core.= RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.333; org.apache.solr.core.= RequestHandlers; created /replication: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.333; org.apache.solr.core.= RequestHandlers; created /update: solr.UpdateRequestHandler [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.333; org.apache.solr.core.= RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandle= rs [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.336; org.apache.solr.handl= er.loader.XMLLoader; xsltCacheLifetimeSeconds=3D60 [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.345; org.apache.solr.searc= h.SolrIndexSearcher; Opening Searcher@10262050 main [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.345; org.apache.solr.updat= e.UpdateHandler; Clearing tlog files, tlogDir=3D./org.apache.solr.cloud.Bas= icDistributedZk2Test-1365833803388/jetty1/tlog [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.346; org.apache.solr.updat= e.CommitTracker; Hard AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.346; org.apache.solr.updat= e.CommitTracker; Soft AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.350; org.apache.solr.core.= SolrCore; [collection1] Registered new searcher Searcher@10262050 main{Stan= dardDirectoryReader(segments_1:1)} [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.353; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Ddown [junit4:junit4] 1> INFO - 2013-04-13 06:16:48.353; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-13 06:16:49.764; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:49.765; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D2 message=3D{ [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "shard":null, [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:48633_gzx%2Fq", [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "core_node_name":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:48633/gzx/q", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-13 06:16:49.765; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Create collection collection1 with numShards= 2 [junit4:junit4] 1> INFO - 2013-04-13 06:16:49.765; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Assigning new node to shard=3Dshard2 [junit4:junit4] 1> INFO - 2013-04-13 06:16:49.769; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-13 06:16:49.769; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-13 06:16:49.769; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-13 06:16:50.374; org.apache.solr.core.= CoreContainer; registering core: collection1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:50.374; org.apache.solr.cloud= .ZkController; Register replica - core:collection1 address:http://127.0.0.1= :48633/gzx/q collection:collection1 shard:shard2 [junit4:junit4] 1> INFO - 2013-04-13 06:16:50.376; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard= 2/election [junit4:junit4] 1> INFO - 2013-04-13 06:16:50.386; org.apache.solr.cloud= .ShardLeaderElectionContext; Running the leader process. [junit4:junit4] 1> INFO - 2013-04-13 06:16:50.389; org.apache.solr.cloud= .ShardLeaderElectionContext; Enough replicas found to continue. [junit4:junit4] 1> INFO - 2013-04-13 06:16:50.389; org.apache.solr.cloud= .ShardLeaderElectionContext; I may be the new leader - try and sync [junit4:junit4] 1> INFO - 2013-04-13 06:16:50.389; org.apache.solr.cloud= .SyncStrategy; Sync replicas to http://127.0.0.1:48633/gzx/q/collection1/ [junit4:junit4] 1> INFO - 2013-04-13 06:16:50.389; org.apache.solr.cloud= .SyncStrategy; Sync Success - now sync replicas to me [junit4:junit4] 1> INFO - 2013-04-13 06:16:50.390; org.apache.solr.cloud= .SyncStrategy; http://127.0.0.1:48633/gzx/q/collection1/ has no replicas [junit4:junit4] 1> INFO - 2013-04-13 06:16:50.390; org.apache.solr.cloud= .ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:48633/gz= x/q/collection1/ [junit4:junit4] 1> INFO - 2013-04-13 06:16:50.390; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard2 [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.273; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.280; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.280; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.280; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.297; org.apache.solr.cloud= .ZkController; We are http://127.0.0.1:48633/gzx/q/collection1/ and leader = is http://127.0.0.1:48633/gzx/q/collection1/ [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.298; org.apache.solr.cloud= .ZkController; No LogReplay needed for core=3Dcollection1 baseURL=3Dhttp://= 127.0.0.1:48633/gzx/q [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.298; org.apache.solr.cloud= .ZkController; I am the leader, no recovery necessary [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.298; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Dactive [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.298; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.299; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.301; org.apache.solr.servl= et.SolrDispatchFilter; user.dir=3D/mnt/ssd/jenkins/workspace/Lucene-Solr-4.= x-Linux/solr/build/solr-core/test/J1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.301; org.apache.solr.servl= et.SolrDispatchFilter; SolrDispatchFilter.init() done [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.302; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.365; org.eclipse.jetty.ser= ver.Server; jetty-8.1.8.v20121106 [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.367; org.eclipse.jetty.ser= ver.AbstractConnector; Started SelectChannelConnector@127.0.0.1:39057 [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.367; org.apache.solr.servl= et.SolrDispatchFilter; SolrDispatchFilter.init() [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.368; org.apache.solr.core.= SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx) [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.368; org.apache.solr.core.= SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/= workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.s= olr.cloud.BasicDistributedZk2Test-jetty2-1365833811305 [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.368; org.apache.solr.core.= CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/w= orkspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.so= lr.cloud.BasicDistributedZk2Test-jetty2-1365833811305/solr.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.369; org.apache.solr.core.= CoreContainer; New CoreContainer 1132420439 [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.369; org.apache.solr.core.= CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/wor= kspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr= .cloud.BasicDistributedZk2Test-jetty2-1365833811305/' [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.369; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-jetty2-1365833811305/' [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.387; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000 [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.387; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting urlScheme to: http:// [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.387; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting connTimeout to: 15000 [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.388; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.388; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting corePoolSize to: 0 [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.388; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 214748364= 7 [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.389; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5 [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.389; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.389; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.389; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= sPerHost=3D20&maxConnections=3D10000&socketTimeout=3D120000&connTimeout=3D1= 5000&retry=3Dfalse [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.395; org.apache.solr.core.= CoreContainer; Registering Log Listener [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.402; org.apache.solr.core.= CoreContainer; Zookeeper client=3D127.0.0.1:52571/solr [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.403; org.apache.solr.cloud= .ZkController; zkHost includes chroot [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.404; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.405; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@7544ee02 name:ZooKeeperConnection Watcher:127.0.0.1:52571 got event = WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.406; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.408; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D500&maxConnectionsPerHost=3D16&socketTimeout=3D120000&connTimeout=3D150= 00 [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.412; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.413; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@3f137991 name:ZooKeeperConnection Watcher:127.0.0.1:52571/solr got e= vent WatchedEvent state:SyncConnected type:None path:null path:null type:No= ne [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.413; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:51.417; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cluster state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.420; org.apache.solr.cloud= .ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:390= 57_gzx%2Fq [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.421; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:39057_gzx%2Fq [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.424; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.424; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.424; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (3) [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.425; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (3) [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.425; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.426; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (3) [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.426; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (3) [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.430; org.apache.solr.core.= CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/= jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.= apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365833811305/collection1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.431; org.apache.solr.cloud= .ZkController; Check for collection zkNode:collection1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.432; org.apache.solr.cloud= .ZkController; Collection zkNode exists [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.432; org.apache.solr.cloud= .ZkController; Load collection config from:/collections/collection1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.434; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-jetty2-1365833811305/collection1/' [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.434; org.apache.solr.core.= SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x= -Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZ= k2Test-jetty2-1365833811305/collection1/lib/README' to classloader [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.434; org.apache.solr.core.= SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x= -Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZ= k2Test-jetty2-1365833811305/collection1/lib/classes/' to classloader [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.468; org.apache.solr.core.= SolrConfig; Using Lucene MatchVersion: LUCENE_43 [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.497; org.apache.solr.core.= SolrConfig; Loaded SolrConfig: solrconfig.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.499; org.apache.solr.schem= a.IndexSchema; Reading Solr Schema from schema.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.504; org.apache.solr.schem= a.IndexSchema; Schema name=3Dtest [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.785; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.787; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D2 message=3D{ [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "shard":"shard2", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:48633_gzx%2Fq", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "core_node_name":"127.0.0.1:48633_gzx%2Fq_collection= 1", [junit4:junit4] 1> "base_url":"http://127.0.0.1:48633/gzx/q", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.792; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.792; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.792; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.792; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.841; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Initialized with rates=3Dopen-exchange-rate= s.json, refreshInterval=3D1440. [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.846; org.apache.solr.schem= a.IndexSchema; default search field in schema is text [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.849; org.apache.solr.schem= a.IndexSchema; unique key field: id [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.860; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.863; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.866; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-13 06:16:52.867; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-13 06:16:52.868; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.868; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-13 06:16:52.869; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-13 06:16:52.869; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.869; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.869; org.apache.solr.core.= SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/= Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.= BasicDistributedZk2Test-jetty2-1365833811305/collection1/, dataDir=3D./org.= apache.solr.cloud.BasicDistributedZk2Test-1365833803388/jetty2/ [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.869; org.apache.solr.core.= JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Serve= r: com.sun.jmx.mbeanserver.JmxMBeanServer@2ed0fd36 [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.870; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.870; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1365833803388/jetty2 [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.871; org.apache.solr.core.= SolrCore; New index directory detected: old=3Dnull new=3D./org.apache.solr.= cloud.BasicDistributedZk2Test-1365833803388/jetty2/index/ [junit4:junit4] 1> WARN - 2013-04-13 06:16:52.871; org.apache.solr.core.= SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.Basic= DistributedZk2Test-1365833803388/jetty2/index' doesn't exist. Creating new = index... [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.871; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1365833803388/jetty2/index [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.872; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=3D1 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(NRTCachingDirectory(org= .apache.lucene.store.RAMDirectory@6d3ed0be lockFactory=3Dorg.apache.lucene.= store.NativeFSLockFactory@2345365c; maxCacheMB=3D0.158203125 maxMergeSizeMB= =3D0.8974609375)),segFN=3Dsegments_1,generation=3D1,filenames=3D[segments_1= ] [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.873; org.apache.solr.core.= SolrDeletionPolicy; newest commit =3D 1[segments_1] [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.874; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "dedupe" [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.875; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "stored_sig" [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.875; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit= " [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.876; org.apache.solr.core.= RequestHandlers; created standard: solr.StandardRequestHandler [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.876; org.apache.solr.core.= RequestHandlers; created /get: solr.RealTimeGetHandler [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.876; org.apache.solr.core.= RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.876; org.apache.solr.core.= RequestHandlers; created /replication: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.877; org.apache.solr.core.= RequestHandlers; created /update: solr.UpdateRequestHandler [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.877; org.apache.solr.core.= RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandle= rs [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.879; org.apache.solr.handl= er.loader.XMLLoader; xsltCacheLifetimeSeconds=3D60 [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.881; org.apache.solr.searc= h.SolrIndexSearcher; Opening Searcher@7b35b91a main [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.882; org.apache.solr.updat= e.UpdateHandler; Clearing tlog files, tlogDir=3D./org.apache.solr.cloud.Bas= icDistributedZk2Test-1365833803388/jetty2/tlog [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.882; org.apache.solr.updat= e.CommitTracker; Hard AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.882; org.apache.solr.updat= e.CommitTracker; Soft AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.887; org.apache.solr.core.= SolrCore; [collection1] Registered new searcher Searcher@7b35b91a main{Stan= dardDirectoryReader(segments_1:1)} [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.892; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Ddown [junit4:junit4] 1> INFO - 2013-04-13 06:16:52.893; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-13 06:16:54.307; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:54.308; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D2 message=3D{ [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "shard":null, [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:39057_gzx%2Fq", [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "core_node_name":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:39057/gzx/q", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-13 06:16:54.308; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Collection already exists with numShards=3D2 [junit4:junit4] 1> INFO - 2013-04-13 06:16:54.308; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Assigning new node to shard=3Dshard1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:54.311; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-13 06:16:54.311; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-13 06:16:54.311; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-13 06:16:54.311; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-13 06:16:54.904; org.apache.solr.core.= CoreContainer; registering core: collection1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:54.904; org.apache.solr.cloud= .ZkController; Register replica - core:collection1 address:http://127.0.0.1= :39057/gzx/q collection:collection1 shard:shard1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:54.905; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard= 1/election [junit4:junit4] 1> INFO - 2013-04-13 06:16:54.913; org.apache.solr.cloud= .ShardLeaderElectionContext; Running the leader process. [junit4:junit4] 1> INFO - 2013-04-13 06:16:54.915; org.apache.solr.cloud= .ShardLeaderElectionContext; Enough replicas found to continue. [junit4:junit4] 1> INFO - 2013-04-13 06:16:54.915; org.apache.solr.cloud= .ShardLeaderElectionContext; I may be the new leader - try and sync [junit4:junit4] 1> INFO - 2013-04-13 06:16:54.915; org.apache.solr.cloud= .SyncStrategy; Sync replicas to http://127.0.0.1:39057/gzx/q/collection1/ [junit4:junit4] 1> INFO - 2013-04-13 06:16:54.915; org.apache.solr.cloud= .SyncStrategy; Sync Success - now sync replicas to me [junit4:junit4] 1> INFO - 2013-04-13 06:16:54.916; org.apache.solr.cloud= .SyncStrategy; http://127.0.0.1:39057/gzx/q/collection1/ has no replicas [junit4:junit4] 1> INFO - 2013-04-13 06:16:54.916; org.apache.solr.cloud= .ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:39057/gz= x/q/collection1/ [junit4:junit4] 1> INFO - 2013-04-13 06:16:54.916; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.815; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.822; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.822; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.822; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.822; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.873; org.apache.solr.cloud= .ZkController; We are http://127.0.0.1:39057/gzx/q/collection1/ and leader = is http://127.0.0.1:39057/gzx/q/collection1/ [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.874; org.apache.solr.cloud= .ZkController; No LogReplay needed for core=3Dcollection1 baseURL=3Dhttp://= 127.0.0.1:39057/gzx/q [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.874; org.apache.solr.cloud= .ZkController; I am the leader, no recovery necessary [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.874; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Dactive [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.874; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.876; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.877; org.apache.solr.servl= et.SolrDispatchFilter; user.dir=3D/mnt/ssd/jenkins/workspace/Lucene-Solr-4.= x-Linux/solr/build/solr-core/test/J1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.878; org.apache.solr.servl= et.SolrDispatchFilter; SolrDispatchFilter.init() done [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.878; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.948; org.eclipse.jetty.ser= ver.Server; jetty-8.1.8.v20121106 [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.951; org.eclipse.jetty.ser= ver.AbstractConnector; Started SelectChannelConnector@127.0.0.1:46053 [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.952; org.apache.solr.servl= et.SolrDispatchFilter; SolrDispatchFilter.init() [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.952; org.apache.solr.core.= SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx) [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.953; org.apache.solr.core.= SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/= workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.s= olr.cloud.BasicDistributedZk2Test-jetty3-1365833815881 [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.953; org.apache.solr.core.= CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/w= orkspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.so= lr.cloud.BasicDistributedZk2Test-jetty3-1365833815881/solr.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.953; org.apache.solr.core.= CoreContainer; New CoreContainer 2079308329 [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.954; org.apache.solr.core.= CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/wor= kspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr= .cloud.BasicDistributedZk2Test-jetty3-1365833815881/' [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.954; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-jetty3-1365833815881/' [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.972; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000 [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.972; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting urlScheme to: http:// [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.972; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting connTimeout to: 15000 [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.973; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.973; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting corePoolSize to: 0 [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.973; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 214748364= 7 [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.974; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5 [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.974; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.974; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.975; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= sPerHost=3D20&maxConnections=3D10000&socketTimeout=3D120000&connTimeout=3D1= 5000&retry=3Dfalse [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.980; org.apache.solr.core.= CoreContainer; Registering Log Listener [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.988; org.apache.solr.core.= CoreContainer; Zookeeper client=3D127.0.0.1:52571/solr [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.989; org.apache.solr.cloud= .ZkController; zkHost includes chroot [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.990; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.991; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@795dfb18 name:ZooKeeperConnection Watcher:127.0.0.1:52571 got event = WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.992; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.994; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D500&maxConnectionsPerHost=3D16&socketTimeout=3D120000&connTimeout=3D150= 00 [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.997; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.999; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@41ab23ec name:ZooKeeperConnection Watcher:127.0.0.1:52571/solr got e= vent WatchedEvent state:SyncConnected type:None path:null path:null type:No= ne [junit4:junit4] 1> INFO - 2013-04-13 06:16:55.999; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:56.002; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cluster state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.005; org.apache.solr.cloud= .ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:460= 53_gzx%2Fq [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.008; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:46053_gzx%2Fq [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.012; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.012; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.014; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.014; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.014; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.014; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.014; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.016; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.017; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.023; org.apache.solr.core.= CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/= jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.= apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365833815881/collection1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.023; org.apache.solr.cloud= .ZkController; Check for collection zkNode:collection1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.024; org.apache.solr.cloud= .ZkController; Collection zkNode exists [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.024; org.apache.solr.cloud= .ZkController; Load collection config from:/collections/collection1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.025; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-jetty3-1365833815881/collection1/' [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.025; org.apache.solr.core.= SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x= -Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZ= k2Test-jetty3-1365833815881/collection1/lib/README' to classloader [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.025; org.apache.solr.core.= SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x= -Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZ= k2Test-jetty3-1365833815881/collection1/lib/classes/' to classloader [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.060; org.apache.solr.core.= SolrConfig; Using Lucene MatchVersion: LUCENE_43 [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.088; org.apache.solr.core.= SolrConfig; Loaded SolrConfig: solrconfig.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.090; org.apache.solr.schem= a.IndexSchema; Reading Solr Schema from schema.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.093; org.apache.solr.schem= a.IndexSchema; Schema name=3Dtest [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.327; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.328; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D2 message=3D{ [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:39057_gzx%2Fq", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "core_node_name":"127.0.0.1:39057_gzx%2Fq_collection= 1", [junit4:junit4] 1> "base_url":"http://127.0.0.1:39057/gzx/q", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.332; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.332; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.332; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.332; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.332; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.399; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Initialized with rates=3Dopen-exchange-rate= s.json, refreshInterval=3D1440. [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.404; org.apache.solr.schem= a.IndexSchema; default search field in schema is text [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.406; org.apache.solr.schem= a.IndexSchema; unique key field: id [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.418; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.421; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.423; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-13 06:16:57.425; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-13 06:16:57.425; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.425; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-13 06:16:57.426; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-13 06:16:57.427; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.427; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.427; org.apache.solr.core.= SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/= Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.= BasicDistributedZk2Test-jetty3-1365833815881/collection1/, dataDir=3D./org.= apache.solr.cloud.BasicDistributedZk2Test-1365833803388/jetty3/ [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.427; org.apache.solr.core.= JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Serve= r: com.sun.jmx.mbeanserver.JmxMBeanServer@2ed0fd36 [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.428; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.428; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1365833803388/jetty3 [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.428; org.apache.solr.core.= SolrCore; New index directory detected: old=3Dnull new=3D./org.apache.solr.= cloud.BasicDistributedZk2Test-1365833803388/jetty3/index/ [junit4:junit4] 1> WARN - 2013-04-13 06:16:57.428; org.apache.solr.core.= SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.Basic= DistributedZk2Test-1365833803388/jetty3/index' doesn't exist. Creating new = index... [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.429; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1365833803388/jetty3/index [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.430; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=3D1 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(NRTCachingDirectory(org= .apache.lucene.store.RAMDirectory@1a59831 lockFactory=3Dorg.apache.lucene.s= tore.NativeFSLockFactory@2fde7935; maxCacheMB=3D0.158203125 maxMergeSizeMB= =3D0.8974609375)),segFN=3Dsegments_1,generation=3D1,filenames=3D[segments_1= ] [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.430; org.apache.solr.core.= SolrDeletionPolicy; newest commit =3D 1[segments_1] [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.432; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "dedupe" [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.432; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "stored_sig" [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.433; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit= " [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.433; org.apache.solr.core.= RequestHandlers; created standard: solr.StandardRequestHandler [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.434; org.apache.solr.core.= RequestHandlers; created /get: solr.RealTimeGetHandler [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.434; org.apache.solr.core.= RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.434; org.apache.solr.core.= RequestHandlers; created /replication: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.434; org.apache.solr.core.= RequestHandlers; created /update: solr.UpdateRequestHandler [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.435; org.apache.solr.core.= RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandle= rs [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.437; org.apache.solr.handl= er.loader.XMLLoader; xsltCacheLifetimeSeconds=3D60 [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.439; org.apache.solr.searc= h.SolrIndexSearcher; Opening Searcher@40463aec main [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.439; org.apache.solr.updat= e.UpdateHandler; Clearing tlog files, tlogDir=3D./org.apache.solr.cloud.Bas= icDistributedZk2Test-1365833803388/jetty3/tlog [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.440; org.apache.solr.updat= e.CommitTracker; Hard AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.440; org.apache.solr.updat= e.CommitTracker; Soft AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.444; org.apache.solr.core.= SolrCore; [collection1] Registered new searcher Searcher@40463aec main{Stan= dardDirectoryReader(segments_1:1)} [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.445; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Ddown [junit4:junit4] 1> INFO - 2013-04-13 06:16:57.445; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-13 06:16:58.837; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:58.838; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D2 message=3D{ [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "shard":null, [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:46053_gzx%2Fq", [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "core_node_name":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:46053/gzx/q", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-13 06:16:58.838; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Collection already exists with numShards=3D2 [junit4:junit4] 1> INFO - 2013-04-13 06:16:58.839; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Assigning new node to shard=3Dshard2 [junit4:junit4] 1> INFO - 2013-04-13 06:16:58.843; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-13 06:16:58.843; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-13 06:16:58.843; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-13 06:16:58.843; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-13 06:16:58.843; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.448; org.apache.solr.core.= CoreContainer; registering core: collection1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.448; org.apache.solr.cloud= .ZkController; Register replica - core:collection1 address:http://127.0.0.1= :46053/gzx/q collection:collection1 shard:shard2 [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.465; org.apache.solr.cloud= .ZkController; We are http://127.0.0.1:46053/gzx/q/collection1/ and leader = is http://127.0.0.1:48633/gzx/q/collection1/ [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.465; org.apache.solr.cloud= .ZkController; No LogReplay needed for core=3Dcollection1 baseURL=3Dhttp://= 127.0.0.1:46053/gzx/q [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.465; org.apache.solr.cloud= .ZkController; Core needs to recover:collection1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.466; org.apache.solr.updat= e.DefaultSolrCoreState; Running recovery - first canceling any ongoing reco= very [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.466; org.apache.solr.cloud= .RecoveryStrategy; Starting recovery process. core=3Dcollection1 recoverin= gAfterStartup=3Dtrue [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.467; org.apache.solr.cloud= .RecoveryStrategy; ###### startupVersions=3D[] [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.467; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.467; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Drecovering [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.468; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.476; org.apache.solr.servl= et.SolrDispatchFilter; user.dir=3D/mnt/ssd/jenkins/workspace/Lucene-Solr-4.= x-Linux/solr/build/solr-core/test/J1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.477; org.apache.solr.servl= et.SolrDispatchFilter; SolrDispatchFilter.init() done [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.477; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.484; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.489; org.apache.solr.handl= er.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:46053_= gzx%2Fq_collection1, state: recovering, checkLive: true, onlyIfLeader: true [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.572; org.eclipse.jetty.ser= ver.Server; jetty-8.1.8.v20121106 [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.575; org.eclipse.jetty.ser= ver.AbstractConnector; Started SelectChannelConnector@127.0.0.1:38217 [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.576; org.apache.solr.servl= et.SolrDispatchFilter; SolrDispatchFilter.init() [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.576; org.apache.solr.core.= SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx) [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.577; org.apache.solr.core.= SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/= workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.s= olr.cloud.BasicDistributedZk2Test-jetty4-1365833819481 [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.577; org.apache.solr.core.= CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/w= orkspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.so= lr.cloud.BasicDistributedZk2Test-jetty4-1365833819481/solr.xml [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.577; org.apache.solr.core.= CoreContainer; New CoreContainer 1245414797 [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.578; org.apache.solr.core.= CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/wor= kspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr= .cloud.BasicDistributedZk2Test-jetty4-1365833819481/' [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.578; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-jetty4-1365833819481/' [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.598; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000 [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.599; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting urlScheme to: http:// [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.599; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting connTimeout to: 15000 [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.600; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20 [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.600; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting corePoolSize to: 0 [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.600; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 214748364= 7 [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.600; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5 [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.601; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1 [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.601; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.601; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= sPerHost=3D20&maxConnections=3D10000&socketTimeout=3D120000&connTimeout=3D1= 5000&retry=3Dfalse [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.608; org.apache.solr.core.= CoreContainer; Registering Log Listener [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.616; org.apache.solr.core.= CoreContainer; Zookeeper client=3D127.0.0.1:52571/solr [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.617; org.apache.solr.cloud= .ZkController; zkHost includes chroot [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.617; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.620; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@5a3863d2 name:ZooKeeperConnection Watcher:127.0.0.1:52571 got event = WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.620; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.622; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D500&maxConnectionsPerHost=3D16&socketTimeout=3D120000&connTimeout=3D150= 00 [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.626; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.627; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@354e0f4d name:ZooKeeperConnection Watcher:127.0.0.1:52571/solr got e= vent WatchedEvent state:SyncConnected type:None path:null path:null type:No= ne [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.628; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:16:59.632; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cluster state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.347; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.348; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D2 message=3D{ [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "shard":"shard2", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:46053_gzx%2Fq", [junit4:junit4] 1> "state":"recovering", [junit4:junit4] 1> "core_node_name":"127.0.0.1:46053_gzx%2Fq_collection= 1", [junit4:junit4] 1> "base_url":"http://127.0.0.1:46053/gzx/q", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.383; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.384; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.384; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.384; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.383; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.383; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.489; org.apache.solr.handl= er.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:46053_gzx%2Fq_col= lection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 sec= onds. [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.490; org.apache.solr.servl= et.SolrDispatchFilter; [admin] webapp=3Dnull path=3D/admin/cores params=3D{= coreNodeName=3D127.0.0.1:46053_gzx%252Fq_collection1&version=3D2&nodeName= =3D127.0.0.1:46053_gzx%252Fq&action=3DPREPRECOVERY&wt=3Djavabin&state=3Drec= overing&onlyIfLeader=3Dtrue&checkLive=3Dtrue&core=3Dcollection1} status=3D0= QTime=3D1001=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.635; org.apache.solr.cloud= .ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:382= 17_gzx%2Fq [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.654; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:38217_gzx%2Fq [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.664; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.665; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.665; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.665; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.665; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.666; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.666; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.665; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.665; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.666; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.667; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.667; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.687; org.apache.solr.core.= CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/= jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.= apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365833819481/collection1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.687; org.apache.solr.cloud= .ZkController; Check for collection zkNode:collection1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.688; org.apache.solr.cloud= .ZkController; Collection zkNode exists [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.688; org.apache.solr.cloud= .ZkController; Load collection config from:/collections/collection1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.689; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-jetty4-1365833819481/collection1/' [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.690; org.apache.solr.core.= SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x= -Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZ= k2Test-jetty4-1365833819481/collection1/lib/README' to classloader [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.690; org.apache.solr.core.= SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x= -Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZ= k2Test-jetty4-1365833819481/collection1/lib/classes/' to classloader [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.720; org.apache.solr.core.= SolrConfig; Using Lucene MatchVersion: LUCENE_43 [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.746; org.apache.solr.core.= SolrConfig; Loaded SolrConfig: solrconfig.xml [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.747; org.apache.solr.schem= a.IndexSchema; Reading Solr Schema from schema.xml [junit4:junit4] 1> INFO - 2013-04-13 06:17:00.751; org.apache.solr.schem= a.IndexSchema; Schema name=3Dtest [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.091; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Initialized with rates=3Dopen-exchange-rate= s.json, refreshInterval=3D1440. [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.096; org.apache.solr.schem= a.IndexSchema; default search field in schema is text [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.099; org.apache.solr.schem= a.IndexSchema; unique key field: id [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.111; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.115; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.117; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-13 06:17:01.119; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-13 06:17:01.119; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.120; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-13 06:17:01.121; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-13 06:17:01.121; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.121; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.121; org.apache.solr.core.= SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/= Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.= BasicDistributedZk2Test-jetty4-1365833819481/collection1/, dataDir=3D./org.= apache.solr.cloud.BasicDistributedZk2Test-1365833803388/jetty4/ [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.122; org.apache.solr.core.= JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Serve= r: com.sun.jmx.mbeanserver.JmxMBeanServer@2ed0fd36 [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.122; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.122; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1365833803388/jetty4 [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.123; org.apache.solr.core.= SolrCore; New index directory detected: old=3Dnull new=3D./org.apache.solr.= cloud.BasicDistributedZk2Test-1365833803388/jetty4/index/ [junit4:junit4] 1> WARN - 2013-04-13 06:17:01.123; org.apache.solr.core.= SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.Basic= DistributedZk2Test-1365833803388/jetty4/index' doesn't exist. Creating new = index... [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.123; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1365833803388/jetty4/index [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.125; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=3D1 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(NRTCachingDirectory(org= .apache.lucene.store.RAMDirectory@7f2d7b52 lockFactory=3Dorg.apache.lucene.= store.NativeFSLockFactory@9361c6c; maxCacheMB=3D0.158203125 maxMergeSizeMB= =3D0.8974609375)),segFN=3Dsegments_1,generation=3D1,filenames=3D[segments_1= ] [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.125; org.apache.solr.core.= SolrDeletionPolicy; newest commit =3D 1[segments_1] [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.126; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "dedupe" [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.127; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "stored_sig" [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.127; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit= " [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.128; org.apache.solr.core.= RequestHandlers; created standard: solr.StandardRequestHandler [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.128; org.apache.solr.core.= RequestHandlers; created /get: solr.RealTimeGetHandler [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.128; org.apache.solr.core.= RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.129; org.apache.solr.core.= RequestHandlers; created /replication: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.129; org.apache.solr.core.= RequestHandlers; created /update: solr.UpdateRequestHandler [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.129; org.apache.solr.core.= RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandle= rs [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.132; org.apache.solr.handl= er.loader.XMLLoader; xsltCacheLifetimeSeconds=3D60 [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.134; org.apache.solr.searc= h.SolrIndexSearcher; Opening Searcher@1f359459 main [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.134; org.apache.solr.updat= e.UpdateHandler; Clearing tlog files, tlogDir=3D./org.apache.solr.cloud.Bas= icDistributedZk2Test-1365833803388/jetty4/tlog [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.134; org.apache.solr.updat= e.CommitTracker; Hard AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.135; org.apache.solr.updat= e.CommitTracker; Soft AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.138; org.apache.solr.core.= SolrCore; [collection1] Registered new searcher Searcher@1f359459 main{Stan= dardDirectoryReader(segments_1:1)} [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.140; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Ddown [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.140; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.889; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.890; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D2 message=3D{ [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "shard":null, [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:38217_gzx%2Fq", [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "core_node_name":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:38217/gzx/q", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.890; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Collection already exists with numShards=3D2 [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.890; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Assigning new node to shard=3Dshard1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.923; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.923; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.923; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.923; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.923; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:01.923; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.144; org.apache.solr.core.= CoreContainer; registering core: collection1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.145; org.apache.solr.cloud= .ZkController; Register replica - core:collection1 address:http://127.0.0.1= :38217/gzx/q collection:collection1 shard:shard1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.148; org.apache.solr.cloud= .ZkController; We are http://127.0.0.1:38217/gzx/q/collection1/ and leader = is http://127.0.0.1:39057/gzx/q/collection1/ [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.148; org.apache.solr.cloud= .ZkController; No LogReplay needed for core=3Dcollection1 baseURL=3Dhttp://= 127.0.0.1:38217/gzx/q [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.148; org.apache.solr.cloud= .ZkController; Core needs to recover:collection1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.149; org.apache.solr.updat= e.DefaultSolrCoreState; Running recovery - first canceling any ongoing reco= very [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.149; org.apache.solr.cloud= .RecoveryStrategy; Starting recovery process. core=3Dcollection1 recoverin= gAfterStartup=3Dtrue [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.150; org.apache.solr.cloud= .RecoveryStrategy; ###### startupVersions=3D[] [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.150; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.150; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Drecovering [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.150; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.151; org.apache.solr.servl= et.SolrDispatchFilter; user.dir=3D/mnt/ssd/jenkins/workspace/Lucene-Solr-4.= x-Linux/solr/build/solr-core/test/J1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.152; org.apache.solr.servl= et.SolrDispatchFilter; SolrDispatchFilter.init() done [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.151; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.152; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.156; org.apache.solr.handl= er.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:38217_= gzx%2Fq_collection1, state: recovering, checkLive: true, onlyIfLeader: true [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.156; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.158; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.170; org.apache.solr.core.= CoreContainer; Creating SolrCore 'onenodecollectioncore' using instanceDir:= /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test= /J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365833806798/on= enodecollectioncore [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.170; org.apache.solr.cloud= .ZkController; Check for collection zkNode:onenodecollection [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.171; org.apache.solr.cloud= .ZkController; Creating collection in ZooKeeper:onenodecollection [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.171; org.apache.solr.cloud= .ZkController; Looking for collection configName [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.173; org.apache.solr.cloud= .ZkController; Only one config set found in zk - using it:conf1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.173; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/onenodecollection [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.175; org.apache.solr.cloud= .ZkController; Load collection config from:/collections/onenodecollection [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.177; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-jetty1-1365833806798/onenodecollectionco= re/' [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.211; org.apache.solr.core.= SolrConfig; Using Lucene MatchVersion: LUCENE_43 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.246; org.apache.solr.core.= SolrConfig; Loaded SolrConfig: solrconfig.xml [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.248; org.apache.solr.schem= a.IndexSchema; Reading Solr Schema from schema.xml [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.252; org.apache.solr.schem= a.IndexSchema; Schema name=3Dtest [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.490; org.apache.solr.cloud= .RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:48633/gzx/q= /collection1/ core=3Dcollection1 - recoveringAfterStartup=3Dtrue [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.491; org.apache.solr.updat= e.PeerSync; PeerSync: core=3Dcollection1 url=3Dhttp://127.0.0.1:46053/gzx/q= START replicas=3D[http://127.0.0.1:48633/gzx/q/collection1/] nUpdates=3D10= 0 [junit4:junit4] 1> WARN - 2013-04-13 06:17:02.491; org.apache.solr.updat= e.PeerSync; no frame of reference to tell of we've missed updates [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.492; org.apache.solr.cloud= .RecoveryStrategy; PeerSync Recovery was not successful - trying replicatio= n. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.492; org.apache.solr.cloud= .RecoveryStrategy; Starting Replication Recovery. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.492; org.apache.solr.cloud= .RecoveryStrategy; Begin buffering updates. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.492; org.apache.solr.updat= e.UpdateLog; Starting to buffer updates. FSUpdateLog{state=3DACTIVE, tlog= =3Dnull} [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.492; org.apache.solr.cloud= .RecoveryStrategy; Attempting to replicate from http://127.0.0.1:48633/gzx/= q/collection1/. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.492; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.504; org.apache.solr.core.= SolrCore; [collection1] webapp=3D/gzx/q path=3D/get params=3D{qt=3D/get&ver= sion=3D2&wt=3Djavabin&getVersions=3D100&distrib=3Dfalse} status=3D0 QTime= =3D8=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.507; org.apache.solr.updat= e.DirectUpdateHandler2; start commit{,optimize=3Dfalse,openSearcher=3Dfalse= ,waitSearcher=3Dtrue,expungeDeletes=3Dfalse,softCommit=3Dfalse,prepareCommi= t=3Dfalse} [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.509; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=3D1 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(NRTCachingDirectory(org= .apache.lucene.store.RAMDirectory@15c425b4 lockFactory=3Dorg.apache.lucene.= store.NativeFSLockFactory@3c8d4227; maxCacheMB=3D0.158203125 maxMergeSizeMB= =3D0.8974609375)),segFN=3Dsegments_1,generation=3D1,filenames=3D[segments_1= ] [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.510; org.apache.solr.core.= SolrDeletionPolicy; newest commit =3D 1[segments_1] [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.511; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=3D2 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(NRTCachingDirectory(org= .apache.lucene.store.RAMDirectory@15c425b4 lockFactory=3Dorg.apache.lucene.= store.NativeFSLockFactory@3c8d4227; maxCacheMB=3D0.158203125 maxMergeSizeMB= =3D0.8974609375)),segFN=3Dsegments_1,generation=3D1,filenames=3D[segments_1= ] [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(NRTCachingDirectory(org= .apache.lucene.store.RAMDirectory@15c425b4 lockFactory=3Dorg.apache.lucene.= store.NativeFSLockFactory@3c8d4227; maxCacheMB=3D0.158203125 maxMergeSizeMB= =3D0.8974609375)),segFN=3Dsegments_2,generation=3D2,filenames=3D[segments_2= ] [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.512; org.apache.solr.core.= SolrDeletionPolicy; newest commit =3D 2[segments_2] [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.512; org.apache.solr.searc= h.SolrIndexSearcher; Opening Searcher@b8eae89 realtime [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.512; org.apache.solr.updat= e.DirectUpdateHandler2; end_commit_flush [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.513; org.apache.solr.updat= e.processor.LogUpdateProcessor; [collection1] webapp=3D/gzx/q path=3D/updat= e params=3D{waitSearcher=3Dtrue&version=3D2&commit_end_point=3Dtrue&commit= =3Dtrue&wt=3Djavabin&softCommit=3Dfalse&openSearcher=3Dfalse} {commit=3D} 0= 6 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.515; org.apache.solr.handl= er.ReplicationHandler; Commits will be reserved for 10000 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.515; org.apache.solr.handl= er.SnapPuller; No value set for 'pollInterval'. Timer Task not started. [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.517; org.apache.solr.handl= er.ReplicationHandler; Commits will be reserved for 10000 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.518; org.apache.solr.core.= SolrCore; [collection1] webapp=3D/gzx/q path=3D/replication params=3D{qt=3D= /replication&version=3D2&command=3Dindexversion&wt=3Djavabin} status=3D0 QT= ime=3D2=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.518; org.apache.solr.handl= er.SnapPuller; Master's generation: 2 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.518; org.apache.solr.handl= er.SnapPuller; Slave's generation: 1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.519; org.apache.solr.handl= er.SnapPuller; Starting replication process [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.520; org.apache.solr.core.= SolrCore; [collection1] webapp=3D/gzx/q path=3D/replication params=3D{qt=3D= /replication&generation=3D2&version=3D2&command=3Dfilelist&wt=3Djavabin} st= atus=3D0 QTime=3D0=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.521; org.apache.solr.handl= er.SnapPuller; Number of files in latest index in master: 1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.522; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1365833803388/jetty3/index.20130413021702521 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.522; org.apache.solr.handl= er.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.= RAMDirectory@6779e0e5 lockFactory=3Dorg.apache.lucene.store.NativeFSLockFac= tory@706c7c67) fullCopy=3Dfalse [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.524; org.apache.solr.core.= SolrCore; [collection1] webapp=3D/gzx/q path=3D/replication params=3D{qt=3D= /replication&checksum=3Dtrue&generation=3D2&command=3Dfilecontent&wt=3Dfile= stream&file=3Dsegments_2} status=3D0 QTime=3D0=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.525; org.apache.solr.handl= er.SnapPuller; Total time taken for download : 0 secs [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.526; org.apache.solr.updat= e.DefaultSolrCoreState; Creating new IndexWriter... [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.526; org.apache.solr.updat= e.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=3Dcolle= ction1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.527; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=3D2 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(NRTCachingDirectory(org= .apache.lucene.store.RAMDirectory@1a59831 lockFactory=3Dorg.apache.lucene.s= tore.NativeFSLockFactory@2fde7935; maxCacheMB=3D0.158203125 maxMergeSizeMB= =3D0.8974609375)),segFN=3Dsegments_1,generation=3D1,filenames=3D[segments_1= ] [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(NRTCachingDirectory(org= .apache.lucene.store.RAMDirectory@1a59831 lockFactory=3Dorg.apache.lucene.s= tore.NativeFSLockFactory@2fde7935; maxCacheMB=3D0.158203125 maxMergeSizeMB= =3D0.8974609375)),segFN=3Dsegments_2,generation=3D2,filenames=3D[segments_2= ] [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.528; org.apache.solr.core.= SolrDeletionPolicy; newest commit =3D 2[segments_2] [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.528; org.apache.solr.updat= e.DefaultSolrCoreState; New IndexWriter is ready to be used. [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.528; org.apache.solr.searc= h.SolrIndexSearcher; Opening Searcher@111ed018 main [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.529; org.apache.solr.core.= SolrCore; [collection1] Registered new searcher Searcher@111ed018 main{Stan= dardDirectoryReader(segments_2:1:nrt)} [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.529; org.apache.solr.core.= CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDist= ributedZk2Test-1365833803388/jetty3/index.20130413021702521 [CachedDir<>] [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.530; org.apache.solr.core.= CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDi= stributedZk2Test-1365833803388/jetty3/index.20130413021702521 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.530; org.apache.solr.core.= CachingDirectoryFactory; Removing directory before core close: ./org.apache= .solr.cloud.BasicDistributedZk2Test-1365833803388/jetty3/index.201304130217= 02521 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.530; org.apache.solr.cloud= .RecoveryStrategy; No replay needed. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.530; org.apache.solr.cloud= .RecoveryStrategy; Replication Recovery was successful - registering as Act= ive. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.530; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Dactive [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.530; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.531; org.apache.solr.cloud= .RecoveryStrategy; Finished recovery process. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.567; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Initialized with rates=3Dopen-exchange-rate= s.json, refreshInterval=3D1440. [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.572; org.apache.solr.schem= a.IndexSchema; default search field in schema is text [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.574; org.apache.solr.schem= a.IndexSchema; unique key field: id [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.586; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.589; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.592; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-13 06:17:02.593; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-13 06:17:02.594; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.594; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-13 06:17:02.595; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-13 06:17:02.595; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.596; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.596; org.apache.solr.core.= SolrCore; [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/= workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.s= olr.cloud.BasicDistributedZk2Test-jetty1-1365833806798/onenodecollectioncor= e/, dataDir=3D/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/s= olr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365833803388/onenodeco= llection/ [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.596; org.apache.solr.core.= JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Serve= r: com.sun.jmx.mbeanserver.JmxMBeanServer@2ed0fd36 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.597; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.597; org.apache.solr.core.= CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspac= e/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistri= butedZk2Test-1365833803388/onenodecollection [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.598; org.apache.solr.core.= SolrCore; New index directory detected: old=3Dnull new=3D/mnt/ssd/jenkins/w= orkspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-Basi= cDistributedZk2Test-1365833803388/onenodecollection/index/ [junit4:junit4] 1> WARN - 2013-04-13 06:17:02.598; org.apache.solr.core.= SolrCore; [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/wo= rkspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-Basic= DistributedZk2Test-1365833803388/onenodecollection/index' doesn't exist. Cr= eating new index... [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.598; org.apache.solr.core.= CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspac= e/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistri= butedZk2Test-1365833803388/onenodecollection/index [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.600; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=3D1 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(NRTCachingDirectory(org= .apache.lucene.store.RAMDirectory@7be37697 lockFactory=3Dorg.apache.lucene.= store.NativeFSLockFactory@7aaad6d2; maxCacheMB=3D0.158203125 maxMergeSizeMB= =3D0.8974609375)),segFN=3Dsegments_1,generation=3D1,filenames=3D[segments_1= ] [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.600; org.apache.solr.core.= SolrDeletionPolicy; newest commit =3D 1[segments_1] [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.602; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "dedupe" [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.602; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "stored_sig" [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.603; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit= " [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.603; org.apache.solr.core.= RequestHandlers; created standard: solr.StandardRequestHandler [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.604; org.apache.solr.core.= RequestHandlers; created /get: solr.RealTimeGetHandler [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.604; org.apache.solr.core.= RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.604; org.apache.solr.core.= RequestHandlers; created /replication: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.605; org.apache.solr.core.= RequestHandlers; created /update: solr.UpdateRequestHandler [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.605; org.apache.solr.core.= RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandle= rs [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.607; org.apache.solr.handl= er.loader.XMLLoader; xsltCacheLifetimeSeconds=3D60 [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.610; org.apache.solr.searc= h.SolrIndexSearcher; Opening Searcher@79785c23 main [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.611; org.apache.solr.updat= e.UpdateHandler; Clearing tlog files, tlogDir=3D/mnt/ssd/jenkins/workspace/= Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistribu= tedZk2Test-1365833803388/onenodecollection/tlog [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.612; org.apache.solr.updat= e.CommitTracker; Hard AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.612; org.apache.solr.updat= e.CommitTracker; Soft AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.616; org.apache.solr.core.= SolrCore; [onenodecollectioncore] Registered new searcher Searcher@79785c23= main{StandardDirectoryReader(segments_1:1)} [junit4:junit4] 1> INFO - 2013-04-13 06:17:02.618; org.apache.solr.cloud= .ZkController; publishing core=3Donenodecollectioncore state=3Ddown [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.428; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.429; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D2 message=3D{ [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:38217_gzx%2Fq", [junit4:junit4] 1> "state":"recovering", [junit4:junit4] 1> "core_node_name":"127.0.0.1:38217_gzx%2Fq_collection= 1", [junit4:junit4] 1> "base_url":"http://127.0.0.1:38217/gzx/q", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.433; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D2 message=3D{ [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "shard":"shard2", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:46053_gzx%2Fq", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "core_node_name":"127.0.0.1:46053_gzx%2Fq_collection= 1", [junit4:junit4] 1> "base_url":"http://127.0.0.1:46053/gzx/q", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.435; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D1 message=3D{ [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "shard":null, [junit4:junit4] 1> "roles":"none", [junit4:junit4] 1> "numShards":"1", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "collection":"onenodecollection", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:48633_gzx%2Fq", [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "core_node_name":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:48633/gzx/q", [junit4:junit4] 1> "core":"onenodecollectioncore"} [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.436; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Create collection onenodecollection with num= Shards 1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.436; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Assigning new node to shard=3Dshard1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.439; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.439; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.439; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.439; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.439; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.439; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.620; org.apache.solr.core.= CoreContainer; registering core: onenodecollectioncore [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.620; org.apache.solr.cloud= .ZkController; Register replica - core:onenodecollectioncore address:http:/= /127.0.0.1:48633/gzx/q collection:onenodecollection shard:shard1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.621; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/onenodecollection/leader_elect= /shard1/election [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.627; org.apache.solr.cloud= .ShardLeaderElectionContext; Running the leader process. [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.629; org.apache.solr.cloud= .ShardLeaderElectionContext; Enough replicas found to continue. [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.630; org.apache.solr.cloud= .ShardLeaderElectionContext; I may be the new leader - try and sync [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.630; org.apache.solr.cloud= .SyncStrategy; Sync replicas to http://127.0.0.1:48633/gzx/q/onenodecollect= ioncore/ [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.630; org.apache.solr.cloud= .SyncStrategy; Sync Success - now sync replicas to me [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.630; org.apache.solr.cloud= .SyncStrategy; http://127.0.0.1:48633/gzx/q/onenodecollectioncore/ has no r= eplicas [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.631; org.apache.solr.cloud= .ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:48633/gz= x/q/onenodecollectioncore/ [junit4:junit4] 1> INFO - 2013-04-13 06:17:03.631; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/onenodecollection/leaders/shar= d1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:04.157; org.apache.solr.handl= er.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:38217_gzx%2Fq_col= lection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 sec= onds. [junit4:junit4] 1> INFO - 2013-04-13 06:17:04.157; org.apache.solr.servl= et.SolrDispatchFilter; [admin] webapp=3Dnull path=3D/admin/cores params=3D{= coreNodeName=3D127.0.0.1:38217_gzx%252Fq_collection1&version=3D2&nodeName= =3D127.0.0.1:38217_gzx%252Fq&action=3DPREPRECOVERY&wt=3Djavabin&state=3Drec= overing&onlyIfLeader=3Dtrue&checkLive=3Dtrue&core=3Dcollection1} status=3D0= QTime=3D2001=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:04.947; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:04.959; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:04.959; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:04.959; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:04.959; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:04.959; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:04.959; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:04.990; org.apache.solr.cloud= .ZkController; We are http://127.0.0.1:48633/gzx/q/onenodecollectioncore/ a= nd leader is http://127.0.0.1:48633/gzx/q/onenodecollectioncore/ [junit4:junit4] 1> INFO - 2013-04-13 06:17:04.990; org.apache.solr.cloud= .ZkController; No LogReplay needed for core=3Donenodecollectioncore baseURL= =3Dhttp://127.0.0.1:48633/gzx/q [junit4:junit4] 1> INFO - 2013-04-13 06:17:04.991; org.apache.solr.cloud= .ZkController; I am the leader, no recovery necessary [junit4:junit4] 1> INFO - 2013-04-13 06:17:04.991; org.apache.solr.cloud= .ZkController; publishing core=3Donenodecollectioncore state=3Dactive [junit4:junit4] 1> INFO - 2013-04-13 06:17:04.992; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:04.993; org.apache.solr.servl= et.SolrDispatchFilter; [admin] webapp=3Dnull path=3D/admin/cores params=3D{= version=3D2&roles=3Dnone&dataDir=3D/mnt/ssd/jenkins/workspace/Lucene-Solr-4= .x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-13= 65833803388/onenodecollection&name=3Donenodecollectioncore&numShards=3D1&ac= tion=3DCREATE&wt=3Djavabin&collection=3Donenodecollection} status=3D0 QTime= =3D2824=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:04.994; org.apache.solr.cloud= .AbstractDistribZkTestBase; Wait for recoveries to finish - collection: one= nodecollection failOnTimeout:true timeout (sec):230 [junit4:junit4] 1> INFO - 2013-04-13 06:17:04.995; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:05.996; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.158; org.apache.solr.cloud= .RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:39057/gzx/q= /collection1/ core=3Dcollection1 - recoveringAfterStartup=3Dtrue [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.159; org.apache.solr.updat= e.PeerSync; PeerSync: core=3Dcollection1 url=3Dhttp://127.0.0.1:38217/gzx/q= START replicas=3D[http://127.0.0.1:39057/gzx/q/collection1/] nUpdates=3D10= 0 [junit4:junit4] 1> WARN - 2013-04-13 06:17:06.159; org.apache.solr.updat= e.PeerSync; no frame of reference to tell of we've missed updates [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.159; org.apache.solr.cloud= .RecoveryStrategy; PeerSync Recovery was not successful - trying replicatio= n. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.159; org.apache.solr.cloud= .RecoveryStrategy; Starting Replication Recovery. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.159; org.apache.solr.cloud= .RecoveryStrategy; Begin buffering updates. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.159; org.apache.solr.updat= e.UpdateLog; Starting to buffer updates. FSUpdateLog{state=3DACTIVE, tlog= =3Dnull} [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.160; org.apache.solr.cloud= .RecoveryStrategy; Attempting to replicate from http://127.0.0.1:39057/gzx/= q/collection1/. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.160; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.164; org.apache.solr.core.= SolrCore; [collection1] webapp=3D/gzx/q path=3D/get params=3D{qt=3D/get&ver= sion=3D2&wt=3Djavabin&getVersions=3D100&distrib=3Dfalse} status=3D0 QTime= =3D0=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.166; org.apache.solr.updat= e.DirectUpdateHandler2; start commit{,optimize=3Dfalse,openSearcher=3Dfalse= ,waitSearcher=3Dtrue,expungeDeletes=3Dfalse,softCommit=3Dfalse,prepareCommi= t=3Dfalse} [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.168; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=3D1 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(NRTCachingDirectory(org= .apache.lucene.store.RAMDirectory@6d3ed0be lockFactory=3Dorg.apache.lucene.= store.NativeFSLockFactory@2345365c; maxCacheMB=3D0.158203125 maxMergeSizeMB= =3D0.8974609375)),segFN=3Dsegments_1,generation=3D1,filenames=3D[segments_1= ] [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.168; org.apache.solr.core.= SolrDeletionPolicy; newest commit =3D 1[segments_1] [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.169; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=3D2 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(NRTCachingDirectory(org= .apache.lucene.store.RAMDirectory@6d3ed0be lockFactory=3Dorg.apache.lucene.= store.NativeFSLockFactory@2345365c; maxCacheMB=3D0.158203125 maxMergeSizeMB= =3D0.8974609375)),segFN=3Dsegments_1,generation=3D1,filenames=3D[segments_1= ] [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(NRTCachingDirectory(org= .apache.lucene.store.RAMDirectory@6d3ed0be lockFactory=3Dorg.apache.lucene.= store.NativeFSLockFactory@2345365c; maxCacheMB=3D0.158203125 maxMergeSizeMB= =3D0.8974609375)),segFN=3Dsegments_2,generation=3D2,filenames=3D[segments_2= ] [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.169; org.apache.solr.core.= SolrDeletionPolicy; newest commit =3D 2[segments_2] [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.170; org.apache.solr.searc= h.SolrIndexSearcher; Opening Searcher@2150aae7 realtime [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.170; org.apache.solr.updat= e.DirectUpdateHandler2; end_commit_flush [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.170; org.apache.solr.updat= e.processor.LogUpdateProcessor; [collection1] webapp=3D/gzx/q path=3D/updat= e params=3D{waitSearcher=3Dtrue&version=3D2&commit_end_point=3Dtrue&commit= =3Dtrue&wt=3Djavabin&softCommit=3Dfalse&openSearcher=3Dfalse} {commit=3D} 0= 4 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.171; org.apache.solr.handl= er.ReplicationHandler; Commits will be reserved for 10000 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.171; org.apache.solr.handl= er.SnapPuller; No value set for 'pollInterval'. Timer Task not started. [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.172; org.apache.solr.handl= er.ReplicationHandler; Commits will be reserved for 10000 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.173; org.apache.solr.core.= SolrCore; [collection1] webapp=3D/gzx/q path=3D/replication params=3D{qt=3D= /replication&version=3D2&command=3Dindexversion&wt=3Djavabin} status=3D0 QT= ime=3D1=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.173; org.apache.solr.handl= er.SnapPuller; Master's generation: 2 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.173; org.apache.solr.handl= er.SnapPuller; Slave's generation: 1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.174; org.apache.solr.handl= er.SnapPuller; Starting replication process [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.175; org.apache.solr.core.= SolrCore; [collection1] webapp=3D/gzx/q path=3D/replication params=3D{qt=3D= /replication&generation=3D2&version=3D2&command=3Dfilelist&wt=3Djavabin} st= atus=3D0 QTime=3D0=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.176; org.apache.solr.handl= er.SnapPuller; Number of files in latest index in master: 1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.177; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1365833803388/jetty4/index.20130413021706176 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.177; org.apache.solr.handl= er.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.= RAMDirectory@4ffe2f8f lockFactory=3Dorg.apache.lucene.store.NativeFSLockFac= tory@1e337804) fullCopy=3Dfalse [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.179; org.apache.solr.core.= SolrCore; [collection1] webapp=3D/gzx/q path=3D/replication params=3D{qt=3D= /replication&checksum=3Dtrue&generation=3D2&command=3Dfilecontent&wt=3Dfile= stream&file=3Dsegments_2} status=3D0 QTime=3D0=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.180; org.apache.solr.handl= er.SnapPuller; Total time taken for download : 0 secs [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.181; org.apache.solr.updat= e.DefaultSolrCoreState; Creating new IndexWriter... [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.181; org.apache.solr.updat= e.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=3Dcolle= ction1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.182; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=3D2 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(NRTCachingDirectory(org= .apache.lucene.store.RAMDirectory@7f2d7b52 lockFactory=3Dorg.apache.lucene.= store.NativeFSLockFactory@9361c6c; maxCacheMB=3D0.158203125 maxMergeSizeMB= =3D0.8974609375)),segFN=3Dsegments_1,generation=3D1,filenames=3D[segments_1= ] [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(NRTCachingDirectory(org= .apache.lucene.store.RAMDirectory@7f2d7b52 lockFactory=3Dorg.apache.lucene.= store.NativeFSLockFactory@9361c6c; maxCacheMB=3D0.158203125 maxMergeSizeMB= =3D0.8974609375)),segFN=3Dsegments_2,generation=3D2,filenames=3D[segments_2= ] [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.182; org.apache.solr.core.= SolrDeletionPolicy; newest commit =3D 2[segments_2] [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.182; org.apache.solr.updat= e.DefaultSolrCoreState; New IndexWriter is ready to be used. [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.183; org.apache.solr.searc= h.SolrIndexSearcher; Opening Searcher@54de2b99 main [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.183; org.apache.solr.core.= SolrCore; [collection1] Registered new searcher Searcher@54de2b99 main{Stan= dardDirectoryReader(segments_2:1:nrt)} [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.184; org.apache.solr.core.= CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDist= ributedZk2Test-1365833803388/jetty4/index.20130413021706176 [CachedDir<>] [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.184; org.apache.solr.core.= CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDi= stributedZk2Test-1365833803388/jetty4/index.20130413021706176 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.184; org.apache.solr.core.= CachingDirectoryFactory; Removing directory before core close: ./org.apache= .solr.cloud.BasicDistributedZk2Test-1365833803388/jetty4/index.201304130217= 06176 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.184; org.apache.solr.cloud= .RecoveryStrategy; No replay needed. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.184; org.apache.solr.cloud= .RecoveryStrategy; Replication Recovery was successful - registering as Act= ive. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.185; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Dactive [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.185; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.186; org.apache.solr.cloud= .RecoveryStrategy; Finished recovery process. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.466; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.467; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D1 message=3D{ [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "roles":"none", [junit4:junit4] 1> "numShards":"1", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "collection":"onenodecollection", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:48633_gzx%2Fq", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "core_node_name":"127.0.0.1:48633_gzx%2Fq_onenodecol= lectioncore", [junit4:junit4] 1> "base_url":"http://127.0.0.1:48633/gzx/q", [junit4:junit4] 1> "core":"onenodecollectioncore"} [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.470; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D2 message=3D{ [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:38217_gzx%2Fq", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "core_node_name":"127.0.0.1:38217_gzx%2Fq_collection= 1", [junit4:junit4] 1> "base_url":"http://127.0.0.1:38217/gzx/q", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.474; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.475; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.475; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.475; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.475; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.475; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.998; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.999; org.apache.solr.cloud= .AbstractDistribZkTestBase; Recoveries finished - collection: onenodecollec= tion [junit4:junit4] 1> INFO - 2013-04-13 06:17:06.999; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-13 06:17:07.009; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-13 06:17:07.011; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@7b506988 name:ZooKeeperConnection Watcher:127.0.0.1:52571 got event = WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-04-13 06:17:07.011; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> / (2) [junit4:junit4] 1> DATA: [junit4:junit4] 1> =20 [junit4:junit4] 1> /solr (7) [junit4:junit4] 1> /solr/clusterstate.json (0) [junit4:junit4] 1> DATA: [junit4:junit4] 1> { [junit4:junit4] 1> "control_collection":{ [junit4:junit4] 1> "router":"compositeId", [junit4:junit4] 1> "shards":{"shard1":{ [junit4:junit4] 1> "range":"80000000-7fffffff", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "replicas":{"127.0.0.1:40591_gzx%2Fq_col= lection1":{ [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "collection":"control_collection", [junit4:junit4] 1> "node_name":"127.0.0.1:40591_gzx%2Fq= ", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "base_url":"http://127.0.0.1:40591/g= zx/q", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "leader":"true"}}}}}, [junit4:junit4] 1> "onenodecollection":{ [junit4:junit4] 1> "router":"compositeId", [junit4:junit4] 1> "shards":{"shard1":{ [junit4:junit4] 1> "range":"80000000-7fffffff", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "replicas":{"127.0.0.1:48633_gzx%2Fq_one= nodecollectioncore":{ [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "roles":"none", [junit4:junit4] 1> "collection":"onenodecollection", [junit4:junit4] 1> "node_name":"127.0.0.1:48633_gzx%2Fq= ", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "base_url":"http://127.0.0.1:48633/g= zx/q", [junit4:junit4] 1> "core":"onenodecollectioncore", [junit4:junit4] 1> "leader":"true"}}}}}, [junit4:junit4] 1> "collection1":{ [junit4:junit4] 1> "router":"compositeId", [junit4:junit4] 1> "shards":{ [junit4:junit4] 1> "shard1":{ [junit4:junit4] 1> "range":"80000000-ffffffff", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "replicas":{ [junit4:junit4] 1> "127.0.0.1:39057_gzx%2Fq_collection1":= { [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "node_name":"127.0.0.1:39057_gzx%2Fq= ", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "base_url":"http://127.0.0.1:39057/g= zx/q", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "leader":"true"}, [junit4:junit4] 1> "127.0.0.1:38217_gzx%2Fq_collection1":= { [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "node_name":"127.0.0.1:38217_gzx%2Fq= ", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "base_url":"http://127.0.0.1:38217/g= zx/q", [junit4:junit4] 1> "core":"collection1"}}}, [junit4:junit4] 1> "shard2":{ [junit4:junit4] 1> "range":"0-7fffffff", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "replicas":{ [junit4:junit4] 1> "127.0.0.1:48633_gzx%2Fq_collection1":= { [junit4:junit4] 1> "shard":"shard2", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "node_name":"127.0.0.1:48633_gzx%2Fq= ", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "base_url":"http://127.0.0.1:48633/g= zx/q", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "leader":"true"}, [junit4:junit4] 1> "127.0.0.1:46053_gzx%2Fq_collection1":= { [junit4:junit4] 1> "shard":"shard2", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "node_name":"127.0.0.1:46053_gzx%2Fq= ", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "base_url":"http://127.0.0.1:46053/g= zx/q", [junit4:junit4] 1> "core":"collection1"}}}}}} [junit4:junit4] 1> /solr/overseer (3) [junit4:junit4] 1> DATA: [junit4:junit4] 1> =20 [junit4:junit4] 1> /solr/overseer/queue (0) [junit4:junit4] 1> /solr/overseer/queue-work (0) [junit4:junit4] 1> /solr/overseer/collection-queue-work (0) [junit4:junit4] 1> /solr/overseer_elect (2) [junit4:junit4] 1> /solr/overseer_elect/leader (0) [junit4:junit4] 1> DATA: [junit4:junit4] 1> {"id":"89511284138967043-127.0.0.1:40591_gzx%2F= q-n_0000000000"} [junit4:junit4] 1> /solr/overseer_elect/election (5) [junit4:junit4] 1> /solr/overseer_elect/election/89511284138967043-12= 7.0.0.1:40591_gzx%2Fq-n_0000000000 (0) [junit4:junit4] 1> /solr/overseer_elect/election/89511284138967048-12= 7.0.0.1:39057_gzx%2Fq-n_0000000002 (0) [junit4:junit4] 1> /solr/overseer_elect/election/89511284138967050-12= 7.0.0.1:46053_gzx%2Fq-n_0000000003 (0) [junit4:junit4] 1> /solr/overseer_elect/election/89511284138967046-12= 7.0.0.1:48633_gzx%2Fq-n_0000000001 (0) [junit4:junit4] 1> /solr/overseer_elect/election/89511284138967052-12= 7.0.0.1:38217_gzx%2Fq-n_0000000004 (0) [junit4:junit4] 1> /solr/configs (1) [junit4:junit4] 1> /solr/configs/conf1 (9) [junit4:junit4] 1> /solr/configs/conf1/old_synonyms.txt (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0= ) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/currency.xml (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/synonyms.txt (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/protwords.txt (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/solrconfig.xml (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/stopwords.txt (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/schema.xml (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/open-exchange-rates.json (0) [junit4:junit4] 1> DATA: [junit4:junit4] 1> { [junit4:junit4] 1> "disclaimer": "This data is not real, it was= synthetically created to match currency.xml. It is modeled after the data= format available from openexchangerates.org. See https://openexchangerate= s.org/documentation for details", [junit4:junit4] 1> "license": "http://www.apache.org/licenses/L= ICENSE-2.0", [junit4:junit4] 1> "timestamp": 1332070464, [junit4:junit4] 1> =20 [junit4:junit4] 1> =20 [junit4:junit4] 1> "IMPORTANT NOTE": "In order for tests to wor= k, this data must be kept in sync with ./currency.xml", [junit4:junit4] 1> =20 [junit4:junit4] 1> =20 [junit4:junit4] 1> "base": "USD", [junit4:junit4] 1> "rates": { [junit4:junit4] 1> "USD": 1, [junit4:junit4] 1> "JPY": 81.29, [junit4:junit4] 1> "EUR": 2.5, [junit4:junit4] 1> "GBP": 0.5, [junit4:junit4] 1> "MXN": 2.0 [junit4:junit4] 1> } [junit4:junit4] 1> } [junit4:junit4] 1> =20 [junit4:junit4] 1> /solr/live_nodes (5) [junit4:junit4] 1> /solr/live_nodes/127.0.0.1:39057_gzx%2Fq (0) [junit4:junit4] 1> /solr/live_nodes/127.0.0.1:40591_gzx%2Fq (0) [junit4:junit4] 1> /solr/live_nodes/127.0.0.1:46053_gzx%2Fq (0) [junit4:junit4] 1> /solr/live_nodes/127.0.0.1:38217_gzx%2Fq (0) [junit4:junit4] 1> /solr/live_nodes/127.0.0.1:48633_gzx%2Fq (0) [junit4:junit4] 1> /solr/aliases.json (0) [junit4:junit4] 1> /solr/collections (3) [junit4:junit4] 1> /solr/collections/onenodecollection (2) [junit4:junit4] 1> DATA: [junit4:junit4] 1> { [junit4:junit4] 1> "router":"compositeId", [junit4:junit4] 1> "configName":"conf1"} [junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect (= 1) [junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect/= shard1 (1) [junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect= /shard1/election (1) [junit4:junit4] 1> /solr/collections/onenodecollection/leader_elec= t/shard1/election/89511284138967046-127.0.0.1:48633_gzx%2Fq_onenodecollecti= oncore-n_0000000000 (0) [junit4:junit4] 1> /solr/collections/onenodecollection/leaders (1) [junit4:junit4] 1> /solr/collections/onenodecollection/leaders/shard= 1 (0) [junit4:junit4] 1> DATA: [junit4:junit4] 1> { [junit4:junit4] 1> "node_name":"127.0.0.1:48633_gzx%2Fq", [junit4:junit4] 1> "base_url":"http://127.0.0.1:48633/gzx/q", [junit4:junit4] 1> "core":"onenodecollectioncore"} [junit4:junit4] 1> /solr/collections/collection1 (3) [junit4:junit4] 1> DATA: [junit4:junit4] 1> {"configName":"conf1"} [junit4:junit4] 1> /solr/collections/collection1/shards (0) [junit4:junit4] 1> /solr/collections/collection1/leader_elect (2) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard2= (1) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard= 2/election (2) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shar= d2/election/89511284138967050-127.0.0.1:46053_gzx%2Fq_collection1-n_0000000= 001 (0) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shar= d2/election/89511284138967046-127.0.0.1:48633_gzx%2Fq_collection1-n_0000000= 000 (0) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1= (1) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard= 1/election (2) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shar= d1/election/89511284138967052-127.0.0.1:38217_gzx%2Fq_collection1-n_0000000= 001 (0) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shar= d1/election/89511284138967048-127.0.0.1:39057_gzx%2Fq_collection1-n_0000000= 000 (0) [junit4:junit4] 1> /solr/collections/collection1/leaders (2) [junit4:junit4] 1> /solr/collections/collection1/leaders/shard2 (0) [junit4:junit4] 1> DATA: [junit4:junit4] 1> { [junit4:junit4] 1> "node_name":"127.0.0.1:48633_gzx%2Fq", [junit4:junit4] 1> "base_url":"http://127.0.0.1:48633/gzx/q", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> /solr/collections/collection1/leaders/shard1 (0) [junit4:junit4] 1> DATA: [junit4:junit4] 1> { [junit4:junit4] 1> "node_name":"127.0.0.1:39057_gzx%2Fq", [junit4:junit4] 1> "base_url":"http://127.0.0.1:39057/gzx/q", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> /solr/collections/control_collection (3) [junit4:junit4] 1> DATA: [junit4:junit4] 1> {"configName":"conf1"} [junit4:junit4] 1> /solr/collections/control_collection/shards (0) [junit4:junit4] 1> /solr/collections/control_collection/leader_elect = (1) [junit4:junit4] 1> /solr/collections/control_collection/leader_elect= /shard1 (1) [junit4:junit4] 1> /solr/collections/control_collection/leader_elec= t/shard1/election (1) [junit4:junit4] 1> /solr/collections/control_collection/leader_ele= ct/shard1/election/89511284138967043-127.0.0.1:40591_gzx%2Fq_collection1-n_= 0000000000 (0) [junit4:junit4] 1> /solr/collections/control_collection/leaders (1) [junit4:junit4] 1> /solr/collections/control_collection/leaders/shar= d1 (0) [junit4:junit4] 1> DATA: [junit4:junit4] 1> { [junit4:junit4] 1> "node_name":"127.0.0.1:40591_gzx%2Fq", [junit4:junit4] 1> "base_url":"http://127.0.0.1:40591/gzx/q", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> /zookeeper (1) [junit4:junit4] 1> DATA: [junit4:junit4] 1> =20 [junit4:junit4] 1>=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:07.057; org.apache.solr.cloud= .ChaosMonkey; monkey: stop shard! 40591 [junit4:junit4] 1> INFO - 2013-04-13 06:17:07.057; org.apache.solr.core.= CoreContainer; Shutting down CoreContainer instance=3D1008972035 [junit4:junit4] 1> INFO - 2013-04-13 06:17:07.981; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-13 06:17:07.982; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3Dnull message=3D{ [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "collection":"control_collection", [junit4:junit4] 1> "node_name":"127.0.0.1:40591_gzx%2Fq", [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "core_node_name":"127.0.0.1:40591_gzx%2Fq_collection= 1", [junit4:junit4] 1> "base_url":"http://127.0.0.1:40591/gzx/q", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-13 06:17:07.985; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:07.985; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:07.985; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:07.985; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:07.986; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:09.059; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Ddown [junit4:junit4] 1> INFO - 2013-04-13 06:17:09.060; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-13 06:17:09.064; org.apache.solr.core.= SolrCore; [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@485= 7618e [junit4:junit4] 1> INFO - 2013-04-13 06:17:09.075; org.apache.solr.updat= e.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=3D0,autocommit= s=3D0,soft autocommits=3D0,optimizes=3D0,rollbacks=3D0,expungeDeletes=3D0,d= ocsPending=3D0,adds=3D0,deletesById=3D0,deletesByQuery=3D0,errors=3D0,cumul= ative_adds=3D0,cumulative_deletesById=3D0,cumulative_deletesByQuery=3D0,cum= ulative_errors=3D0} [junit4:junit4] 1> INFO - 2013-04-13 06:17:09.076; org.apache.solr.updat= e.SolrCoreState; Closing SolrCoreState [junit4:junit4] 1> INFO - 2013-04-13 06:17:09.076; org.apache.solr.updat= e.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing Ind= exWriter [junit4:junit4] 1> INFO - 2013-04-13 06:17:09.077; org.apache.solr.updat= e.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser [junit4:junit4] 1> INFO - 2013-04-13 06:17:09.077; org.apache.solr.core.= SolrCore; [collection1] Closing main searcher on request. [junit4:junit4] 1> INFO - 2013-04-13 06:17:09.078; org.apache.solr.core.= CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories curre= ntly being tracked [junit4:junit4] 1> INFO - 2013-04-13 06:17:09.078; org.apache.solr.core.= CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDist= ributedZk2Test-1365833803388/control/data [CachedDir<>] [junit4:junit4] 1> INFO - 2013-04-13 06:17:09.078; org.apache.solr.core.= CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDi= stributedZk2Test-1365833803388/control/data [junit4:junit4] 1> INFO - 2013-04-13 06:17:09.079; org.apache.solr.core.= CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDist= ributedZk2Test-1365833803388/control/data/index [CachedDir<>] [junit4:junit4] 1> INFO - 2013-04-13 06:17:09.079; org.apache.solr.core.= CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDi= stributedZk2Test-1365833803388/control/data/index [junit4:junit4] 1> INFO - 2013-04-13 06:17:09.080; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; According to ZK I (id=3D89511284138967043-12= 7.0.0.1:40591_gzx%2Fq-n_0000000000) am no longer a leader. [junit4:junit4] 1> INFO - 2013-04-13 06:17:09.081; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:09.081; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-13 06:17:09.081; or [...truncated too long message...] ccurred - updating... (live nodes size: 1) [junit4:junit4] 1> INFO - 2013-04-13 06:22:39.484; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 1) [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.016; org.apache.solr.cloud= .ZkController; publishing core=3Dunloadcollection4 state=3Ddown [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.016; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.019; org.apache.solr.core.= SolrCore; [unloadcollection4] CLOSING SolrCore org.apache.solr.core.SolrCo= re@3fe3d1c1 [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.024; org.apache.solr.updat= e.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=3D3,autocommit= s=3D0,soft autocommits=3D0,optimizes=3D0,rollbacks=3D0,expungeDeletes=3D0,d= ocsPending=3D0,adds=3D0,deletesById=3D0,deletesByQuery=3D0,errors=3D0,cumul= ative_adds=3D0,cumulative_deletesById=3D0,cumulative_deletesByQuery=3D0,cum= ulative_errors=3D0} [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.024; org.apache.solr.updat= e.SolrCoreState; Closing SolrCoreState [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.024; org.apache.solr.updat= e.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing Ind= exWriter [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.025; org.apache.solr.updat= e.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.025; org.apache.solr.core.= SolrCore; [unloadcollection4] Closing main searcher on request. [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.026; org.apache.solr.core.= CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories curre= ntly being tracked [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.026; org.apache.solr.core.= CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene= -Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZk= Test-1365834022917/1365834045081unloadcollection_4n [CachedDir<>] [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.026; org.apache.solr.core.= CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Luce= ne-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributed= ZkTest-1365834022917/1365834045081unloadcollection_4n [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.027; org.apache.solr.core.= CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene= -Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZk= Test-1365834022917/1365834045081unloadcollection_4n/index [CachedDir<>] [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.027; org.apache.solr.core.= CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Luce= ne-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributed= ZkTest-1365834022917/1365834045081unloadcollection_4n/index [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.028; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; According to ZK I (id=3D89511298526085132-12= 7.0.0.1:47340_-n_0000000004) am no longer a leader. [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.029; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (0) [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.029; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 0) [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.050; org.eclipse.jetty.ser= ver.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/,null} [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.104; org.apache.solr.SolrT= estCaseJ4; ###Ending testDistribSearch [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.106; org.apache.solr.cloud= .ZkTestServer; connecting to 127.0.0.1:45150 45150 [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.208; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@63bd7257 name:ZooKeeperConnection Watcher:127.0.0.1:45150/solr got e= vent WatchedEvent state:Disconnected type:None path:null path:null type:Non= e [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.208; org.apache.solr.commo= n.cloud.ConnectionManager; Client->ZooKeeper status change trigger but we a= re already closed [junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-So= lr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTes= t-1365834022917 [junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=3DUnloadDis= tributedZkTest -Dtests.method=3DtestDistribSearch -Dtests.seed=3D62541EEC90= F7FD26 -Dtests.multiplier=3D3 -Dtests.slow=3Dtrue -Dtests.locale=3Dsl -Dtes= ts.timezone=3DAmerica/Godthab -Dtests.file.encoding=3DUTF-8 [junit4:junit4] FAILURE 138s J1 | UnloadDistributedZkTest.testDistribSearc= h <<< [junit4:junit4] > Throwable #1: java.lang.AssertionError: Still found sh= ard2 in collection test_unload_shard_and_collection [junit4:junit4] > =09at __randomizedtesting.SeedInfo.seed([62541EEC90F7F= D26:E3B290F4E7A89D1A]:0) [junit4:junit4] > =09at org.apache.solr.cloud.UnloadDistributedZkTest.te= stUnloadShardAndCollection(UnloadDistributedZkTest.java:127) [junit4:junit4] > =09at org.apache.solr.cloud.UnloadDistributedZkTest.do= Test(UnloadDistributedZkTest.java:77) [junit4:junit4] > =09at org.apache.solr.BaseDistributedSearchTestCase.te= stDistribSearch(BaseDistributedSearchTestCase.java:806) [junit4:junit4] > =09at java.lang.Thread.run(Thread.java:722) [junit4:junit4] 1> INFO - 2013-04-13 06:22:41.216; org.apache.solr.SolrT= estCaseJ4; ###deleteCore [junit4:junit4] 2> 138313 T1479 ccr.ThreadLeakControl.checkThreadLeaks WA= RNING Will linger awaiting termination of 3 leaked thread(s). [junit4:junit4] 1> WARN - 2013-04-13 06:22:42.329; org.apache.solr.commo= n.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to= ZK [junit4:junit4] 1> INFO - 2013-04-13 06:22:42.329; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 1) [junit4:junit4] 1> WARN - 2013-04-13 06:22:42.330; org.apache.solr.commo= n.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to= ZK [junit4:junit4] 2> NOTE: test params are: codec=3DAsserting, sim=3DDefaul= tSimilarity, locale=3Dsl, timezone=3DAmerica/Godthab [junit4:junit4] 2> NOTE: Linux 3.2.0-40-generic amd64/Oracle Corporation = 1.8.0-ea (64-bit)/cpus=3D8,threads=3D2,free=3D85044440,total=3D193724416 [junit4:junit4] 2> NOTE: All tests run in this JVM: [TestSerializedLucene= MatchVersion, CurrencyFieldOpenExchangeTest, TestZkChroot, TestQuerySenderN= oQuery, ClusterStateTest, TestRecovery, TestArbitraryIndexDir, OpenCloseCor= eStressTest, TestSolrQueryParserResource, ChaosMonkeyShardSplitTest, PathHi= erarchyTokenizerFactoryTest, SortByFunctionTest, TestSuggestSpellingConvert= er, DirectSolrSpellCheckerTest, IndexBasedSpellCheckerTest, PingRequestHand= lerTest, TestFiltering, SuggesterWFSTTest, SolrIndexConfigTest, RequiredFie= ldsTest, CurrencyFieldXmlFileTest, TestClassNameShortening, StandardRequest= HandlerTest, SpellPossibilityIteratorTest, TestUtils, TestAtomicUpdateError= Cases, MultiTermTest, TestPartialUpdateDeduplication, TestSolrQueryParserDe= faultOperatorResource, SolrPluginUtilsTest, TestSolr4Spatial, TestCSVRespon= seWriter, TestQueryTypes, BasicDistributedZk2Test, SimplePostToolTest, Test= JmxIntegration, TestFieldCollectionResource, SpellCheckComponentTest, NoCac= heHeaderTest, FileUtilsTest, HardAutoCommitTest, TestStressReorder, OutputW= riterTest, TestFoldingMultitermQuery, TestHashPartitioner, NumericFieldsTes= t, FieldAnalysisRequestHandlerTest, NotRequiredUniqueKeyTest, SolrCoreCheck= LockOnStartupTest, TestAnalyzedSuggestions, TestJmxMonitoredMap, XmlUpdateR= equestHandlerTest, TestUniqueKeyFieldResource, TimeZoneUtilsTest, SpellChec= kCollatorTest, SolrCmdDistributorTest, ZkNodePropsTest, HighlighterTest, Hi= ghlighterConfigTest, DOMUtilTest, TestSolrXMLSerializer, TestBinaryResponse= Writer, TestMergePolicyConfig, EchoParamsTest, TestShardHandlerFactory, Sam= pleTest, TestBM25SimilarityFactory, ChaosMonkeySafeLeaderTest, UnloadDistri= butedZkTest] [junit4:junit4] Completed on J1 in 139.60s, 1 test, 1 failure <<< FAILURES! [...truncated 432 lines...] BUILD FAILED /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The followi= ng error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The followi= ng error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The followin= g error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The fo= llowing error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:438:= The following error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:12= 34: The following error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:87= 8: There were test failures: 290 suites, 1203 tests, 1 error, 1 failure, 14= ignored (8 assumptions) Total time: 35 minutes 44 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts Recording test results Description set: Java: 64bit/jdk1.8.0-ea-b84 -XX:+UseSerialGC Email was triggered for: Failure Sending email for trigger: Failure ------=_Part_82_1440731565.1365835130331 Content-Type: text/plain; charset=us-ascii --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org ------=_Part_82_1440731565.1365835130331--