Return-Path: X-Original-To: apmail-lucene-dev-archive@www.apache.org Delivered-To: apmail-lucene-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 00ED8F38E for ; Mon, 29 Apr 2013 03:43:01 +0000 (UTC) Received: (qmail 52680 invoked by uid 500); 29 Apr 2013 03:42:59 -0000 Delivered-To: apmail-lucene-dev-archive@lucene.apache.org Received: (qmail 52162 invoked by uid 500); 29 Apr 2013 03:42:54 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 52112 invoked by uid 99); 29 Apr 2013 03:42:52 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 29 Apr 2013 03:42:52 +0000 X-ASF-Spam-Status: No, hits=0.0 required=5.0 tests=NORMAL_HTTP_TO_IP,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jenkins@thetaphi.de designates 188.138.97.18 as permitted sender) Received: from [188.138.97.18] (HELO mail.sd-datasolutions.de) (188.138.97.18) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 29 Apr 2013 03:42:42 +0000 Received: from serv1 (localhost.localdomain [127.0.0.1]) by mail.sd-datasolutions.de (Postfix) with ESMTP id AE34014AA043 for ; Mon, 29 Apr 2013 03:42:20 +0000 (UTC) Date: Mon, 29 Apr 2013 03:42:05 +0000 (UTC) From: Policeman Jenkins Server To: dev@lucene.apache.org Message-ID: <877097389.11.1367206940696.JavaMail.jenkins@serv1.sd-datasolutions.de> In-Reply-To: <1577610596.7.1367202233944.JavaMail.jenkins@serv1.sd-datasolutions.de> References: <1577610596.7.1367202233944.JavaMail.jenkins@serv1.sd-datasolutions.de> Subject: [JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0-ea-b86) - Build # 5342 - Still Failing! MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_10_1182995741.1367206925792" X-Jenkins-Job: Lucene-Solr-4.x-Linux X-Jenkins-Result: FAILURE X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_10_1182995741.1367206925792 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/5342/ Java: 64bit/jdk1.8.0-ea-b86 -XX:+UseCompressedOops -XX:+UseParallelGC 2 tests failed. FAILED: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch Error Message: Server at http://127.0.0.1:56191/onenodecollectioncore returned non ok stat= us:404, message:Can not find: /onenodecollectioncore/update Stack Trace: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Serve= r at http://127.0.0.1:56191/onenodecollectioncore returned non ok status:40= 4, message:Can not find: /onenodecollectioncore/update =09at __randomizedtesting.SeedInfo.seed([664AAADB85F89FC0:E7AC24C3F2A7FFFC]= :0) =09at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServ= er.java:387) =09at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServ= er.java:180) =09at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(Ab= stractUpdateRequest.java:117) =09at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116) =09at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102) =09at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollecti= onForwarding(BasicDistributedZk2Test.java:197) =09at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributed= Zk2Test.java:89) =09at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseD= istributedSearchTestCase.java:815) =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.= java:57) =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces= sorImpl.java:43) =09at java.lang.reflect.Method.invoke(Method.java:490) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1559) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Random= izedRunner.java:79) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Random= izedRunner.java:737) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:773) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Random= izedRunner.java:787) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:53) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:50) =09at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFi= eldCacheSanity.java:51) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRul= e$1.evaluate(SystemPropertiesInvariantRule.java:55) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:49) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:70) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:358) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:782) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:442) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:746) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Random= izedRunner.java:648) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Random= izedRunner.java:682) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:693) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:53) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:42) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRul= e$1.evaluate(SystemPropertiesInvariantRule.java:55) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:43) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:70) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:55) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:358) =09at java.lang.Thread.run(Thread.java:722) FAILED: org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch Error Message: Still found shard2 in collection test_unload_shard_and_collection Stack Trace: java.lang.AssertionError: Still found shard2 in collection test_unload_shar= d_and_collection =09at __randomizedtesting.SeedInfo.seed([664AAADB85F89FC0:E7AC24C3F2A7FFFC]= :0) =09at org.junit.Assert.fail(Assert.java:93) =09at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndColle= ction(UnloadDistributedZkTest.java:127) =09at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistribute= dZkTest.java:77) =09at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseD= istributedSearchTestCase.java:815) =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.= java:57) =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces= sorImpl.java:43) =09at java.lang.reflect.Method.invoke(Method.java:490) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1559) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Random= izedRunner.java:79) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Random= izedRunner.java:737) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:773) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Random= izedRunner.java:787) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:53) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:50) =09at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFi= eldCacheSanity.java:51) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRul= e$1.evaluate(SystemPropertiesInvariantRule.java:55) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:49) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:70) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:358) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:782) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:442) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:746) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Random= izedRunner.java:648) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Random= izedRunner.java:682) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:693) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:53) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:42) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRul= e$1.evaluate(SystemPropertiesInvariantRule.java:55) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:43) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:70) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:55) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:358) =09at java.lang.Thread.run(Thread.java:722) Build Log: [...truncated 9009 lines...] [junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test [junit4:junit4] 1> INFO - 2013-04-29 03:23:03.129; org.apache.solr.BaseD= istributedSearchTestCase; Setting hostContext system property: / [junit4:junit4] 1> INFO - 2013-04-29 03:23:03.161; org.apache.solr.SolrT= estCaseJ4; ###Starting testDistribSearch [junit4:junit4] 1> INFO - 2013-04-29 03:23:03.165; org.apache.solr.cloud= .ZkTestServer; STARTING ZK TEST SERVER [junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0 [junit4:junit4] 1> INFO - 2013-04-29 03:23:03.168; org.apache.solr.cloud= .ZkTestServer$ZKServerMain; Starting server [junit4:junit4] 1> INFO - 2013-04-29 03:23:03.268; org.apache.solr.cloud= .ZkTestServer; start zk server on port:56356 [junit4:junit4] 1> INFO - 2013-04-29 03:23:03.350; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.027; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@1cd15052 name:ZooKeeperConnection Watcher:127.0.0.1:56356 got event = WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.028; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.031; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /solr [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.062; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.073; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@6eb7f8ce name:ZooKeeperConnection Watcher:127.0.0.1:56356/solr got e= vent WatchedEvent state:SyncConnected type:None path:null path:null type:No= ne [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.074; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.085; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/collection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.092; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/collection1/shards [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.098; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/control_collection [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.111; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/control_collection/shards [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.119; org.apache.solr.cloud= .AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/s= olr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to= /configs/conf1/solrconfig.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.134; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /configs/conf1/solrconfig.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.144; org.apache.solr.cloud= .AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/s= olr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs= /conf1/schema.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.145; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /configs/conf1/schema.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.153; org.apache.solr.cloud= .AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/s= olr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /conf= igs/conf1/stopwords.txt [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.154; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /configs/conf1/stopwords.txt [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.160; org.apache.solr.cloud= .AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/s= olr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /conf= igs/conf1/protwords.txt [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.161; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /configs/conf1/protwords.txt [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.167; org.apache.solr.cloud= .AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/s= olr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /confi= gs/conf1/currency.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.168; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /configs/conf1/currency.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.174; org.apache.solr.cloud= .AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/s= olr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.js= on to /configs/conf1/open-exchange-rates.json [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.175; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /configs/conf1/open-exchange-rates.json [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.180; org.apache.solr.cloud= .AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/s= olr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accen= t.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.181; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /configs/conf1/mapping-ISOLatin1Accent.txt [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.187; org.apache.solr.cloud= .AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/s= olr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /c= onfigs/conf1/old_synonyms.txt [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.188; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /configs/conf1/old_synonyms.txt [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.194; org.apache.solr.cloud= .AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/s= olr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /confi= gs/conf1/synonyms.txt [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.195; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /configs/conf1/synonyms.txt [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.520; org.eclipse.jetty.ser= ver.Server; jetty-8.1.10.v20130312 [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.609; org.eclipse.jetty.ser= ver.AbstractConnector; Started SelectChannelConnector@127.0.0.1:51853 [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.631; org.apache.solr.servl= et.SolrDispatchFilter; SolrDispatchFilter.init() [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.654; org.apache.solr.core.= SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx) [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.655; org.apache.solr.core.= SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/= workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.s= olr.cloud.BasicDistributedZk2Test-controljetty-1367205784202 [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.666; org.apache.solr.core.= CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/w= orkspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.so= lr.cloud.BasicDistributedZk2Test-controljetty-1367205784202/solr.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.673; org.apache.solr.core.= CoreContainer; New CoreContainer 842491366 [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.674; org.apache.solr.core.= CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/wor= kspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr= .cloud.BasicDistributedZk2Test-controljetty-1367205784202/' [junit4:junit4] 1> INFO - 2013-04-29 03:23:04.675; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-controljetty-1367205784202/' [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.042; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000 [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.043; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting urlScheme to: http:// [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.044; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting connTimeout to: 15000 [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.045; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.046; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting corePoolSize to: 0 [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.047; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 214748364= 7 [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.047; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5 [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.048; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.049; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.067; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= sPerHost=3D20&maxConnections=3D10000&socketTimeout=3D120000&connTimeout=3D1= 5000&retry=3Dfalse [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.498; org.apache.solr.core.= CoreContainer; Registering Log Listener [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.501; org.apache.solr.core.= ZkContainer; Zookeeper client=3D127.0.0.1:56356/solr [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.510; org.apache.solr.cloud= .ZkController; zkHost includes chroot [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.511; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.516; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@2160fc38 name:ZooKeeperConnection Watcher:127.0.0.1:56356 got event = WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.516; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.521; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D500&maxConnectionsPerHost=3D16&socketTimeout=3D120000&connTimeout=3D150= 00 [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.533; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.537; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@1afde15e name:ZooKeeperConnection Watcher:127.0.0.1:56356/solr got e= vent WatchedEvent state:SyncConnected type:None path:null path:null type:No= ne [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.538; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.546; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /overseer/queue [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.556; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /overseer/collection-queue-work [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.568; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /live_nodes [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.581; org.apache.solr.cloud= .ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:518= 53_ [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.585; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:51853_ [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.592; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /overseer_elect/election [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.632; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /overseer_elect/leader [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.637; org.apache.solr.cloud= .Overseer; Overseer (id=3D89601198212710403-127.0.0.1:51853_-n_0000000000) = starting [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.653; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /overseer/queue-work [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.667; org.apache.solr.cloud= .OverseerCollectionProcessor; Process current queue of collection creations [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.667; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /clusterstate.json [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.678; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /aliases.json [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.682; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cluster state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.695; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Starting to work on the main queue [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.732; org.apache.solr.core.= CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/= jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.= apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367205784202/collec= tion1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.733; org.apache.solr.cloud= .ZkController; Check for collection zkNode:control_collection [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.735; org.apache.solr.cloud= .ZkController; Collection zkNode exists [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.736; org.apache.solr.cloud= .ZkController; Load collection config from:/collections/control_collection [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.758; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-controljetty-1367205784202/collection1/' [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.764; org.apache.solr.core.= SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x= -Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZ= k2Test-controljetty-1367205784202/collection1/lib/README' to classloader [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.775; org.apache.solr.core.= SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x= -Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZ= k2Test-controljetty-1367205784202/collection1/lib/classes/' to classloader [junit4:junit4] 1> INFO - 2013-04-29 03:23:05.875; org.apache.solr.core.= SolrConfig; Using Lucene MatchVersion: LUCENE_44 [junit4:junit4] 1> INFO - 2013-04-29 03:23:06.086; org.apache.solr.core.= SolrConfig; Loaded SolrConfig: solrconfig.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:06.101; org.apache.solr.schem= a.IndexSchema; Reading Solr Schema from schema.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:06.201; org.apache.solr.schem= a.IndexSchema; Schema name=3Dtest [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.151; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Initialized with rates=3Dopen-exchange-rate= s.json, refreshInterval=3D1440. [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.177; org.apache.solr.schem= a.IndexSchema; default search field in schema is text [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.181; org.apache.solr.schem= a.IndexSchema; unique key field: id [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.394; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.403; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.410; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-29 03:23:07.413; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-29 03:23:07.414; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.414; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-29 03:23:07.417; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-29 03:23:07.417; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.445; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.456; org.apache.solr.core.= SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/= Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.= BasicDistributedZk2Test-controljetty-1367205784202/collection1/, dataDir=3D= ./org.apache.solr.cloud.BasicDistributedZk2Test-1367205783162/control/data/ [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.460; org.apache.solr.core.= JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Serve= r: com.sun.jmx.mbeanserver.JmxMBeanServer@10cfe67b [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.538; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.564; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1367205783162/control/data [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.565; org.apache.solr.core.= SolrCore; New index directory detected: old=3Dnull new=3D./org.apache.solr.= cloud.BasicDistributedZk2Test-1367205783162/control/data/index/ [junit4:junit4] 1> WARN - 2013-04-29 03:23:07.565; org.apache.solr.core.= SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.Basic= DistributedZk2Test-1367205783162/control/data/index' doesn't exist. Creatin= g new index... [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.578; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1367205783162/control/data/index [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.680; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=3D1 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(org.apache.lucene.store= .RAMDirectory@3a86e09 lockFactory=3Dorg.apache.lucene.store.NativeFSLockFac= tory@2ac595bd),segFN=3Dsegments_1,generation=3D1} [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.682; org.apache.solr.core.= SolrDeletionPolicy; newest commit generation =3D 1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.887; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "dedupe" [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.888; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "stored_sig" [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.911; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit= " [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.923; org.apache.solr.core.= RequestHandlers; created standard: solr.StandardRequestHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.929; org.apache.solr.core.= RequestHandlers; created /get: solr.RealTimeGetHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.929; org.apache.solr.core.= RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.931; org.apache.solr.core.= RequestHandlers; created /replication: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.939; org.apache.solr.core.= RequestHandlers; created /update: solr.UpdateRequestHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.941; org.apache.solr.core.= RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandle= rs [junit4:junit4] 1> INFO - 2013-04-29 03:23:07.975; org.apache.solr.handl= er.loader.XMLLoader; xsltCacheLifetimeSeconds=3D60 [junit4:junit4] 1> INFO - 2013-04-29 03:23:08.000; org.apache.solr.searc= h.SolrIndexSearcher; Opening Searcher@26e7ae4c main [junit4:junit4] 1> INFO - 2013-04-29 03:23:08.018; org.apache.solr.updat= e.UpdateHandler; Clearing tlog files, tlogDir=3D./org.apache.solr.cloud.Bas= icDistributedZk2Test-1367205783162/control/data/tlog [junit4:junit4] 1> INFO - 2013-04-29 03:23:08.025; org.apache.solr.updat= e.CommitTracker; Hard AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-29 03:23:08.026; org.apache.solr.updat= e.CommitTracker; Soft AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-29 03:23:08.075; org.apache.solr.core.= SolrCore; [collection1] Registered new searcher Searcher@26e7ae4c main{Stan= dardDirectoryReader(segments_1:1)} [junit4:junit4] 1> INFO - 2013-04-29 03:23:08.082; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Ddown [junit4:junit4] 1> INFO - 2013-04-29 03:23:08.083; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-29 03:23:08.706; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:08.707; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D1 message=3D{ [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "collection":"control_collection", [junit4:junit4] 1> "shard":null, [junit4:junit4] 1> "node_name":"127.0.0.1:51853_", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "core_node_name":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:51853", [junit4:junit4] 1> "numShards":"1", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-29 03:23:08.708; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Create collection control_collection with nu= mShards 1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:08.715; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Assigning new node to shard=3Dshard1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:08.728; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 1) [junit4:junit4] 1> INFO - 2013-04-29 03:23:09.086; org.apache.solr.core.= CoreContainer; registering core: collection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:09.087; org.apache.solr.cloud= .ZkController; Register replica - core:collection1 address:http://127.0.0.1= :51853 collection:control_collection shard:shard1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:09.091; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D10000&maxConnectionsPerHost=3D20&connTimeout=3D30000&socketTimeout=3D30= 000&retry=3Dfalse [junit4:junit4] 1> INFO - 2013-04-29 03:23:09.098; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/control_collection/leader_elec= t/shard1/election [junit4:junit4] 1> INFO - 2013-04-29 03:23:09.111; org.apache.solr.cloud= .ShardLeaderElectionContext; Running the leader process. [junit4:junit4] 1> INFO - 2013-04-29 03:23:09.114; org.apache.solr.cloud= .ShardLeaderElectionContext; Enough replicas found to continue. [junit4:junit4] 1> INFO - 2013-04-29 03:23:09.115; org.apache.solr.cloud= .ShardLeaderElectionContext; I may be the new leader - try and sync [junit4:junit4] 1> INFO - 2013-04-29 03:23:09.117; org.apache.solr.cloud= .SyncStrategy; Sync replicas to http://127.0.0.1:51853/collection1/ [junit4:junit4] 1> INFO - 2013-04-29 03:23:09.117; org.apache.solr.cloud= .SyncStrategy; Sync Success - now sync replicas to me [junit4:junit4] 1> INFO - 2013-04-29 03:23:09.118; org.apache.solr.cloud= .SyncStrategy; http://127.0.0.1:51853/collection1/ has no replicas [junit4:junit4] 1> INFO - 2013-04-29 03:23:09.118; org.apache.solr.cloud= .ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:51853/co= llection1/ [junit4:junit4] 1> INFO - 2013-04-29 03:23:09.119; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/control_collection/leaders/sha= rd1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.235; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.252; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 1) [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.279; org.apache.solr.cloud= .ZkController; We are http://127.0.0.1:51853/collection1/ and leader is htt= p://127.0.0.1:51853/collection1/ [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.282; org.apache.solr.cloud= .ZkController; No LogReplay needed for core=3Dcollection1 baseURL=3Dhttp://= 127.0.0.1:51853 [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.283; org.apache.solr.cloud= .ZkController; I am the leader, no recovery necessary [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.283; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Dactive [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.284; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.287; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.293; org.apache.solr.servl= et.SolrDispatchFilter; user.dir=3D/mnt/ssd/jenkins/workspace/Lucene-Solr-4.= x-Linux/solr/build/solr-core/test/J1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.294; org.apache.solr.servl= et.SolrDispatchFilter; SolrDispatchFilter.init() done [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.316; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.326; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config: [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.330; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.332; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@1ac5aac0 name:ZooKeeperConnection Watcher:127.0.0.1:56356/solr got e= vent WatchedEvent state:SyncConnected type:None path:null path:null type:No= ne [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.332; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.335; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cluster state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.341; org.apache.solr.cloud= .ChaosMonkey; monkey: init - expire sessions:true cause connection loss:tru= e [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.442; org.eclipse.jetty.ser= ver.Server; jetty-8.1.10.v20130312 [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.446; org.eclipse.jetty.ser= ver.AbstractConnector; Started SelectChannelConnector@127.0.0.1:54644 [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.447; org.apache.solr.servl= et.SolrDispatchFilter; SolrDispatchFilter.init() [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.448; org.apache.solr.core.= SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx) [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.448; org.apache.solr.core.= SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/= workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.s= olr.cloud.BasicDistributedZk2Test-jetty1-1367205790342 [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.449; org.apache.solr.core.= CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/w= orkspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.so= lr.cloud.BasicDistributedZk2Test-jetty1-1367205790342/solr.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.450; org.apache.solr.core.= CoreContainer; New CoreContainer 98867691 [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.451; org.apache.solr.core.= CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/wor= kspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr= .cloud.BasicDistributedZk2Test-jetty1-1367205790342/' [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.451; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-jetty1-1367205790342/' [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.569; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000 [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.571; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting urlScheme to: http:// [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.572; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting connTimeout to: 15000 [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.573; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.574; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting corePoolSize to: 0 [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.575; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 214748364= 7 [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.576; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5 [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.577; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.578; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.579; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= sPerHost=3D20&maxConnections=3D10000&socketTimeout=3D120000&connTimeout=3D1= 5000&retry=3Dfalse [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.587; org.apache.solr.core.= CoreContainer; Registering Log Listener [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.588; org.apache.solr.core.= ZkContainer; Zookeeper client=3D127.0.0.1:56356/solr [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.589; org.apache.solr.cloud= .ZkController; zkHost includes chroot [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.593; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.599; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@bcc8734 name:ZooKeeperConnection Watcher:127.0.0.1:56356 got event W= atchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.600; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.604; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D500&maxConnectionsPerHost=3D16&socketTimeout=3D120000&connTimeout=3D150= 00 [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.611; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.614; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@1d260834 name:ZooKeeperConnection Watcher:127.0.0.1:56356/solr got e= vent WatchedEvent state:SyncConnected type:None path:null path:null type:No= ne [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.615; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:10.623; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cluster state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.631; org.apache.solr.cloud= .ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:546= 44_ [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.633; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:54644_ [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.636; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 1) [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.637; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (2) [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.637; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (2) [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.639; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (2) [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.646; org.apache.solr.core.= CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/= jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.= apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367205790342/collection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.647; org.apache.solr.cloud= .ZkController; Check for collection zkNode:collection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.649; org.apache.solr.cloud= .ZkController; Collection zkNode exists [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.649; org.apache.solr.cloud= .ZkController; Load collection config from:/collections/collection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.651; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-jetty1-1367205790342/collection1/' [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.652; org.apache.solr.core.= SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x= -Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZ= k2Test-jetty1-1367205790342/collection1/lib/README' to classloader [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.653; org.apache.solr.core.= SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x= -Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZ= k2Test-jetty1-1367205790342/collection1/lib/classes/' to classloader [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.727; org.apache.solr.core.= SolrConfig; Using Lucene MatchVersion: LUCENE_44 [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.763; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.765; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D1 message=3D{ [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "collection":"control_collection", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "node_name":"127.0.0.1:51853_", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "core_node_name":"127.0.0.1:51853__collection1", [junit4:junit4] 1> "base_url":"http://127.0.0.1:51853", [junit4:junit4] 1> "numShards":"1", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.771; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.772; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.775; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.787; org.apache.solr.core.= SolrConfig; Loaded SolrConfig: solrconfig.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.789; org.apache.solr.schem= a.IndexSchema; Reading Solr Schema from schema.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:11.838; org.apache.solr.schem= a.IndexSchema; Schema name=3Dtest [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.259; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Initialized with rates=3Dopen-exchange-rate= s.json, refreshInterval=3D1440. [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.271; org.apache.solr.schem= a.IndexSchema; default search field in schema is text [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.274; org.apache.solr.schem= a.IndexSchema; unique key field: id [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.306; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.311; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.316; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-29 03:23:12.318; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-29 03:23:12.318; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.319; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-29 03:23:12.320; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-29 03:23:12.321; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.321; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.322; org.apache.solr.core.= SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/= Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.= BasicDistributedZk2Test-jetty1-1367205790342/collection1/, dataDir=3D./org.= apache.solr.cloud.BasicDistributedZk2Test-1367205783162/jetty1/ [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.322; org.apache.solr.core.= JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Serve= r: com.sun.jmx.mbeanserver.JmxMBeanServer@10cfe67b [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.324; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.325; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1367205783162/jetty1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.325; org.apache.solr.core.= SolrCore; New index directory detected: old=3Dnull new=3D./org.apache.solr.= cloud.BasicDistributedZk2Test-1367205783162/jetty1/index/ [junit4:junit4] 1> WARN - 2013-04-29 03:23:12.326; org.apache.solr.core.= SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.Basic= DistributedZk2Test-1367205783162/jetty1/index' doesn't exist. Creating new = index... [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.326; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1367205783162/jetty1/index [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.328; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=3D1 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(org.apache.lucene.store= .RAMDirectory@7a8d1600 lockFactory=3Dorg.apache.lucene.store.NativeFSLockFa= ctory@4140b1a5),segFN=3Dsegments_1,generation=3D1} [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.329; org.apache.solr.core.= SolrDeletionPolicy; newest commit generation =3D 1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.332; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "dedupe" [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.333; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "stored_sig" [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.334; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit= " [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.336; org.apache.solr.core.= RequestHandlers; created standard: solr.StandardRequestHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.338; org.apache.solr.core.= RequestHandlers; created /get: solr.RealTimeGetHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.338; org.apache.solr.core.= RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.339; org.apache.solr.core.= RequestHandlers; created /replication: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.341; org.apache.solr.core.= RequestHandlers; created /update: solr.UpdateRequestHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.342; org.apache.solr.core.= RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandle= rs [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.344; org.apache.solr.handl= er.loader.XMLLoader; xsltCacheLifetimeSeconds=3D60 [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.347; org.apache.solr.searc= h.SolrIndexSearcher; Opening Searcher@12c4f747 main [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.348; org.apache.solr.updat= e.UpdateHandler; Clearing tlog files, tlogDir=3D./org.apache.solr.cloud.Bas= icDistributedZk2Test-1367205783162/jetty1/tlog [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.349; org.apache.solr.updat= e.CommitTracker; Hard AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.349; org.apache.solr.updat= e.CommitTracker; Soft AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.369; org.apache.solr.core.= SolrCore; [collection1] Registered new searcher Searcher@12c4f747 main{Stan= dardDirectoryReader(segments_1:1)} [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.375; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Ddown [junit4:junit4] 1> INFO - 2013-04-29 03:23:12.376; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-29 03:23:13.283; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:13.285; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D2 message=3D{ [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard":null, [junit4:junit4] 1> "node_name":"127.0.0.1:54644_", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "core_node_name":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:54644", [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-29 03:23:13.286; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Create collection collection1 with numShards= 2 [junit4:junit4] 1> INFO - 2013-04-29 03:23:13.287; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Assigning new node to shard=3Dshard1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:13.294; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-29 03:23:13.294; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-29 03:23:13.294; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-29 03:23:13.378; org.apache.solr.core.= CoreContainer; registering core: collection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:13.378; org.apache.solr.cloud= .ZkController; Register replica - core:collection1 address:http://127.0.0.1= :54644 collection:collection1 shard:shard1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:13.380; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard= 1/election [junit4:junit4] 1> INFO - 2013-04-29 03:23:13.390; org.apache.solr.cloud= .ShardLeaderElectionContext; Running the leader process. [junit4:junit4] 1> INFO - 2013-04-29 03:23:13.393; org.apache.solr.cloud= .ShardLeaderElectionContext; Enough replicas found to continue. [junit4:junit4] 1> INFO - 2013-04-29 03:23:13.394; org.apache.solr.cloud= .ShardLeaderElectionContext; I may be the new leader - try and sync [junit4:junit4] 1> INFO - 2013-04-29 03:23:13.394; org.apache.solr.cloud= .SyncStrategy; Sync replicas to http://127.0.0.1:54644/collection1/ [junit4:junit4] 1> INFO - 2013-04-29 03:23:13.395; org.apache.solr.cloud= .SyncStrategy; Sync Success - now sync replicas to me [junit4:junit4] 1> INFO - 2013-04-29 03:23:13.395; org.apache.solr.cloud= .SyncStrategy; http://127.0.0.1:54644/collection1/ has no replicas [junit4:junit4] 1> INFO - 2013-04-29 03:23:13.396; org.apache.solr.cloud= .ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:54644/co= llection1/ [junit4:junit4] 1> INFO - 2013-04-29 03:23:13.396; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.803; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.817; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.817; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.817; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.860; org.apache.solr.cloud= .ZkController; We are http://127.0.0.1:54644/collection1/ and leader is htt= p://127.0.0.1:54644/collection1/ [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.861; org.apache.solr.cloud= .ZkController; No LogReplay needed for core=3Dcollection1 baseURL=3Dhttp://= 127.0.0.1:54644 [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.861; org.apache.solr.cloud= .ZkController; I am the leader, no recovery necessary [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.862; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Dactive [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.862; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.865; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.867; org.apache.solr.servl= et.SolrDispatchFilter; user.dir=3D/mnt/ssd/jenkins/workspace/Lucene-Solr-4.= x-Linux/solr/build/solr-core/test/J1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.868; org.apache.solr.servl= et.SolrDispatchFilter; SolrDispatchFilter.init() done [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.869; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.966; org.eclipse.jetty.ser= ver.Server; jetty-8.1.10.v20130312 [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.969; org.eclipse.jetty.ser= ver.AbstractConnector; Started SelectChannelConnector@127.0.0.1:56191 [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.970; org.apache.solr.servl= et.SolrDispatchFilter; SolrDispatchFilter.init() [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.971; org.apache.solr.core.= SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx) [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.972; org.apache.solr.core.= SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/= workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.s= olr.cloud.BasicDistributedZk2Test-jetty2-1367205794876 [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.972; org.apache.solr.core.= CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/w= orkspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.so= lr.cloud.BasicDistributedZk2Test-jetty2-1367205794876/solr.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.973; org.apache.solr.core.= CoreContainer; New CoreContainer 1602358125 [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.974; org.apache.solr.core.= CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/wor= kspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr= .cloud.BasicDistributedZk2Test-jetty2-1367205794876/' [junit4:junit4] 1> INFO - 2013-04-29 03:23:14.974; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-jetty2-1367205794876/' [junit4:junit4] 1> INFO - 2013-04-29 03:23:15.032; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000 [junit4:junit4] 1> INFO - 2013-04-29 03:23:15.033; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting urlScheme to: http:// [junit4:junit4] 1> INFO - 2013-04-29 03:23:15.033; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting connTimeout to: 15000 [junit4:junit4] 1> INFO - 2013-04-29 03:23:15.034; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:15.034; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting corePoolSize to: 0 [junit4:junit4] 1> INFO - 2013-04-29 03:23:15.035; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 214748364= 7 [junit4:junit4] 1> INFO - 2013-04-29 03:23:15.036; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5 [junit4:junit4] 1> INFO - 2013-04-29 03:23:15.036; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:15.037; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false [junit4:junit4] 1> INFO - 2013-04-29 03:23:15.037; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= sPerHost=3D20&maxConnections=3D10000&socketTimeout=3D120000&connTimeout=3D1= 5000&retry=3Dfalse [junit4:junit4] 1> INFO - 2013-04-29 03:23:15.042; org.apache.solr.core.= CoreContainer; Registering Log Listener [junit4:junit4] 1> INFO - 2013-04-29 03:23:15.043; org.apache.solr.core.= ZkContainer; Zookeeper client=3D127.0.0.1:56356/solr [junit4:junit4] 1> INFO - 2013-04-29 03:23:15.043; org.apache.solr.cloud= .ZkController; zkHost includes chroot [junit4:junit4] 1> INFO - 2013-04-29 03:23:15.044; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:15.047; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@5f1d4adb name:ZooKeeperConnection Watcher:127.0.0.1:56356 got event = WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-04-29 03:23:15.048; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:15.050; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D500&maxConnectionsPerHost=3D16&socketTimeout=3D120000&connTimeout=3D150= 00 [junit4:junit4] 1> INFO - 2013-04-29 03:23:15.055; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:15.057; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@56f47329 name:ZooKeeperConnection Watcher:127.0.0.1:56356/solr got e= vent WatchedEvent state:SyncConnected type:None path:null path:null type:No= ne [junit4:junit4] 1> INFO - 2013-04-29 03:23:15.057; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:15.063; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cluster state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.069; org.apache.solr.cloud= .ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:561= 91_ [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.071; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:56191_ [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.074; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.074; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.075; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (3) [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.076; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (3) [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.076; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.078; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (3) [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.079; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (3) [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.085; org.apache.solr.core.= CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/= jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.= apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367205794876/collection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.086; org.apache.solr.cloud= .ZkController; Check for collection zkNode:collection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.087; org.apache.solr.cloud= .ZkController; Collection zkNode exists [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.087; org.apache.solr.cloud= .ZkController; Load collection config from:/collections/collection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.089; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-jetty2-1367205794876/collection1/' [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.090; org.apache.solr.core.= SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x= -Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZ= k2Test-jetty2-1367205794876/collection1/lib/README' to classloader [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.091; org.apache.solr.core.= SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x= -Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZ= k2Test-jetty2-1367205794876/collection1/lib/classes/' to classloader [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.124; org.apache.solr.core.= SolrConfig; Using Lucene MatchVersion: LUCENE_44 [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.183; org.apache.solr.core.= SolrConfig; Loaded SolrConfig: solrconfig.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.186; org.apache.solr.schem= a.IndexSchema; Reading Solr Schema from schema.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.246; org.apache.solr.schem= a.IndexSchema; Schema name=3Dtest [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.328; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.330; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D2 message=3D{ [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "node_name":"127.0.0.1:54644_", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "core_node_name":"127.0.0.1:54644__collection1", [junit4:junit4] 1> "base_url":"http://127.0.0.1:54644", [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.336; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.336; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.336; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.336; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.636; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Initialized with rates=3Dopen-exchange-rate= s.json, refreshInterval=3D1440. [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.648; org.apache.solr.schem= a.IndexSchema; default search field in schema is text [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.650; org.apache.solr.schem= a.IndexSchema; unique key field: id [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.680; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.686; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.691; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-29 03:23:16.693; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-29 03:23:16.694; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.695; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-29 03:23:16.696; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-29 03:23:16.697; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.697; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.698; org.apache.solr.core.= SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/= Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.= BasicDistributedZk2Test-jetty2-1367205794876/collection1/, dataDir=3D./org.= apache.solr.cloud.BasicDistributedZk2Test-1367205783162/jetty2/ [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.698; org.apache.solr.core.= JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Serve= r: com.sun.jmx.mbeanserver.JmxMBeanServer@10cfe67b [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.699; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.700; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1367205783162/jetty2 [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.700; org.apache.solr.core.= SolrCore; New index directory detected: old=3Dnull new=3D./org.apache.solr.= cloud.BasicDistributedZk2Test-1367205783162/jetty2/index/ [junit4:junit4] 1> WARN - 2013-04-29 03:23:16.701; org.apache.solr.core.= SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.Basic= DistributedZk2Test-1367205783162/jetty2/index' doesn't exist. Creating new = index... [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.701; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1367205783162/jetty2/index [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.703; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=3D1 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(org.apache.lucene.store= .RAMDirectory@10e30ba2 lockFactory=3Dorg.apache.lucene.store.NativeFSLockFa= ctory@29f0ea9),segFN=3Dsegments_1,generation=3D1} [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.704; org.apache.solr.core.= SolrDeletionPolicy; newest commit generation =3D 1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.707; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "dedupe" [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.708; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "stored_sig" [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.709; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit= " [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.711; org.apache.solr.core.= RequestHandlers; created standard: solr.StandardRequestHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.713; org.apache.solr.core.= RequestHandlers; created /get: solr.RealTimeGetHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.713; org.apache.solr.core.= RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.714; org.apache.solr.core.= RequestHandlers; created /replication: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.716; org.apache.solr.core.= RequestHandlers; created /update: solr.UpdateRequestHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.716; org.apache.solr.core.= RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandle= rs [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.719; org.apache.solr.handl= er.loader.XMLLoader; xsltCacheLifetimeSeconds=3D60 [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.722; org.apache.solr.searc= h.SolrIndexSearcher; Opening Searcher@29cdd7c3 main [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.722; org.apache.solr.updat= e.UpdateHandler; Clearing tlog files, tlogDir=3D./org.apache.solr.cloud.Bas= icDistributedZk2Test-1367205783162/jetty2/tlog [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.723; org.apache.solr.updat= e.CommitTracker; Hard AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.724; org.apache.solr.updat= e.CommitTracker; Soft AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.738; org.apache.solr.core.= SolrCore; [collection1] Registered new searcher Searcher@29cdd7c3 main{Stan= dardDirectoryReader(segments_1:1)} [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.745; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Ddown [junit4:junit4] 1> INFO - 2013-04-29 03:23:16.746; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-29 03:23:17.846; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:17.848; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D2 message=3D{ [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard":null, [junit4:junit4] 1> "node_name":"127.0.0.1:56191_", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "core_node_name":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:56191", [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-29 03:23:17.848; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Collection already exists with numShards=3D2 [junit4:junit4] 1> INFO - 2013-04-29 03:23:17.849; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Assigning new node to shard=3Dshard2 [junit4:junit4] 1> INFO - 2013-04-29 03:23:17.856; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-29 03:23:17.856; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-29 03:23:17.856; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-29 03:23:17.856; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-29 03:23:18.748; org.apache.solr.core.= CoreContainer; registering core: collection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:18.749; org.apache.solr.cloud= .ZkController; Register replica - core:collection1 address:http://127.0.0.1= :56191 collection:collection1 shard:shard2 [junit4:junit4] 1> INFO - 2013-04-29 03:23:18.750; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard= 2/election [junit4:junit4] 1> INFO - 2013-04-29 03:23:18.760; org.apache.solr.cloud= .ShardLeaderElectionContext; Running the leader process. [junit4:junit4] 1> INFO - 2013-04-29 03:23:18.765; org.apache.solr.cloud= .ShardLeaderElectionContext; Enough replicas found to continue. [junit4:junit4] 1> INFO - 2013-04-29 03:23:18.765; org.apache.solr.cloud= .ShardLeaderElectionContext; I may be the new leader - try and sync [junit4:junit4] 1> INFO - 2013-04-29 03:23:18.766; org.apache.solr.cloud= .SyncStrategy; Sync replicas to http://127.0.0.1:56191/collection1/ [junit4:junit4] 1> INFO - 2013-04-29 03:23:18.766; org.apache.solr.cloud= .SyncStrategy; Sync Success - now sync replicas to me [junit4:junit4] 1> INFO - 2013-04-29 03:23:18.766; org.apache.solr.cloud= .SyncStrategy; http://127.0.0.1:56191/collection1/ has no replicas [junit4:junit4] 1> INFO - 2013-04-29 03:23:18.767; org.apache.solr.cloud= .ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:56191/co= llection1/ [junit4:junit4] 1> INFO - 2013-04-29 03:23:18.767; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard2 [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.362; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.375; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.375; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.375; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.375; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.427; org.apache.solr.cloud= .ZkController; We are http://127.0.0.1:56191/collection1/ and leader is htt= p://127.0.0.1:56191/collection1/ [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.428; org.apache.solr.cloud= .ZkController; No LogReplay needed for core=3Dcollection1 baseURL=3Dhttp://= 127.0.0.1:56191 [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.428; org.apache.solr.cloud= .ZkController; I am the leader, no recovery necessary [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.429; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Dactive [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.429; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.432; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.434; org.apache.solr.servl= et.SolrDispatchFilter; user.dir=3D/mnt/ssd/jenkins/workspace/Lucene-Solr-4.= x-Linux/solr/build/solr-core/test/J1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.434; org.apache.solr.servl= et.SolrDispatchFilter; SolrDispatchFilter.init() done [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.435; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.503; org.eclipse.jetty.ser= ver.Server; jetty-8.1.10.v20130312 [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.506; org.eclipse.jetty.ser= ver.AbstractConnector; Started SelectChannelConnector@127.0.0.1:44104 [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.507; org.apache.solr.servl= et.SolrDispatchFilter; SolrDispatchFilter.init() [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.508; org.apache.solr.core.= SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx) [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.508; org.apache.solr.core.= SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/= workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.s= olr.cloud.BasicDistributedZk2Test-jetty3-1367205799439 [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.509; org.apache.solr.core.= CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/w= orkspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.so= lr.cloud.BasicDistributedZk2Test-jetty3-1367205799439/solr.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.509; org.apache.solr.core.= CoreContainer; New CoreContainer 1188423229 [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.510; org.apache.solr.core.= CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/wor= kspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr= .cloud.BasicDistributedZk2Test-jetty3-1367205799439/' [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.510; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-jetty3-1367205799439/' [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.566; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000 [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.567; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting urlScheme to: http:// [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.567; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting connTimeout to: 15000 [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.568; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.568; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting corePoolSize to: 0 [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.569; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 214748364= 7 [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.569; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5 [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.570; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.570; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.571; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= sPerHost=3D20&maxConnections=3D10000&socketTimeout=3D120000&connTimeout=3D1= 5000&retry=3Dfalse [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.575; org.apache.solr.core.= CoreContainer; Registering Log Listener [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.575; org.apache.solr.core.= ZkContainer; Zookeeper client=3D127.0.0.1:56356/solr [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.576; org.apache.solr.cloud= .ZkController; zkHost includes chroot [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.577; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.579; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@4faf9cb5 name:ZooKeeperConnection Watcher:127.0.0.1:56356 got event = WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.580; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.582; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D500&maxConnectionsPerHost=3D16&socketTimeout=3D120000&connTimeout=3D150= 00 [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.586; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.588; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@d5614fb name:ZooKeeperConnection Watcher:127.0.0.1:56356/solr got ev= ent WatchedEvent state:SyncConnected type:None path:null path:null type:Non= e [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.589; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:19.594; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cluster state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.598; org.apache.solr.cloud= .ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:441= 04_ [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.600; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:44104_ [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.604; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.605; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.605; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.605; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.605; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.606; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.606; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.608; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.607; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.615; org.apache.solr.core.= CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/= jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.= apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367205799439/collection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.616; org.apache.solr.cloud= .ZkController; Check for collection zkNode:collection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.617; org.apache.solr.cloud= .ZkController; Collection zkNode exists [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.617; org.apache.solr.cloud= .ZkController; Load collection config from:/collections/collection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.619; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-jetty3-1367205799439/collection1/' [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.620; org.apache.solr.core.= SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x= -Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZ= k2Test-jetty3-1367205799439/collection1/lib/README' to classloader [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.621; org.apache.solr.core.= SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x= -Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZ= k2Test-jetty3-1367205799439/collection1/lib/classes/' to classloader [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.653; org.apache.solr.core.= SolrConfig; Using Lucene MatchVersion: LUCENE_44 [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.688; org.apache.solr.core.= SolrConfig; Loaded SolrConfig: solrconfig.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.691; org.apache.solr.schem= a.IndexSchema; Reading Solr Schema from schema.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.731; org.apache.solr.schem= a.IndexSchema; Schema name=3Dtest [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.884; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.886; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D2 message=3D{ [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard":"shard2", [junit4:junit4] 1> "node_name":"127.0.0.1:56191_", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "core_node_name":"127.0.0.1:56191__collection1", [junit4:junit4] 1> "base_url":"http://127.0.0.1:56191", [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.895; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.895; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.895; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.895; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:20.895; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.110; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Initialized with rates=3Dopen-exchange-rate= s.json, refreshInterval=3D1440. [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.122; org.apache.solr.schem= a.IndexSchema; default search field in schema is text [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.125; org.apache.solr.schem= a.IndexSchema; unique key field: id [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.157; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.162; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.168; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-29 03:23:21.170; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-29 03:23:21.170; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.171; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-29 03:23:21.173; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-29 03:23:21.173; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.173; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.174; org.apache.solr.core.= SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/= Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.= BasicDistributedZk2Test-jetty3-1367205799439/collection1/, dataDir=3D./org.= apache.solr.cloud.BasicDistributedZk2Test-1367205783162/jetty3/ [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.174; org.apache.solr.core.= JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Serve= r: com.sun.jmx.mbeanserver.JmxMBeanServer@10cfe67b [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.175; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.176; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1367205783162/jetty3 [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.176; org.apache.solr.core.= SolrCore; New index directory detected: old=3Dnull new=3D./org.apache.solr.= cloud.BasicDistributedZk2Test-1367205783162/jetty3/index/ [junit4:junit4] 1> WARN - 2013-04-29 03:23:21.177; org.apache.solr.core.= SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.Basic= DistributedZk2Test-1367205783162/jetty3/index' doesn't exist. Creating new = index... [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.177; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1367205783162/jetty3/index [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.179; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=3D1 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(org.apache.lucene.store= .RAMDirectory@63921c67 lockFactory=3Dorg.apache.lucene.store.NativeFSLockFa= ctory@4647c361),segFN=3Dsegments_1,generation=3D1} [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.180; org.apache.solr.core.= SolrDeletionPolicy; newest commit generation =3D 1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.183; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "dedupe" [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.184; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "stored_sig" [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.185; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit= " [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.186; org.apache.solr.core.= RequestHandlers; created standard: solr.StandardRequestHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.187; org.apache.solr.core.= RequestHandlers; created /get: solr.RealTimeGetHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.188; org.apache.solr.core.= RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.188; org.apache.solr.core.= RequestHandlers; created /replication: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.189; org.apache.solr.core.= RequestHandlers; created /update: solr.UpdateRequestHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.190; org.apache.solr.core.= RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandle= rs [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.193; org.apache.solr.handl= er.loader.XMLLoader; xsltCacheLifetimeSeconds=3D60 [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.195; org.apache.solr.searc= h.SolrIndexSearcher; Opening Searcher@3fa827ef main [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.196; org.apache.solr.updat= e.UpdateHandler; Clearing tlog files, tlogDir=3D./org.apache.solr.cloud.Bas= icDistributedZk2Test-1367205783162/jetty3/tlog [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.197; org.apache.solr.updat= e.CommitTracker; Hard AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.197; org.apache.solr.updat= e.CommitTracker; Soft AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.207; org.apache.solr.core.= SolrCore; [collection1] Registered new searcher Searcher@3fa827ef main{Stan= dardDirectoryReader(segments_1:1)} [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.211; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Ddown [junit4:junit4] 1> INFO - 2013-04-29 03:23:21.212; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-29 03:23:22.405; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:22.407; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D2 message=3D{ [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard":null, [junit4:junit4] 1> "node_name":"127.0.0.1:44104_", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "core_node_name":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:44104", [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-29 03:23:22.408; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Collection already exists with numShards=3D2 [junit4:junit4] 1> INFO - 2013-04-29 03:23:22.408; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Assigning new node to shard=3Dshard1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:22.414; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:22.415; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:22.415; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:22.414; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:22.414; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.214; org.apache.solr.core.= CoreContainer; registering core: collection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.215; org.apache.solr.cloud= .ZkController; Register replica - core:collection1 address:http://127.0.0.1= :44104 collection:collection1 shard:shard1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.221; org.apache.solr.cloud= .ZkController; We are http://127.0.0.1:44104/collection1/ and leader is htt= p://127.0.0.1:54644/collection1/ [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.221; org.apache.solr.cloud= .ZkController; No LogReplay needed for core=3Dcollection1 baseURL=3Dhttp://= 127.0.0.1:44104 [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.222; org.apache.solr.cloud= .ZkController; Core needs to recover:collection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.223; org.apache.solr.updat= e.DefaultSolrCoreState; Running recovery - first canceling any ongoing reco= very [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.227; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.229; org.apache.solr.servl= et.SolrDispatchFilter; user.dir=3D/mnt/ssd/jenkins/workspace/Lucene-Solr-4.= x-Linux/solr/build/solr-core/test/J1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.230; org.apache.solr.servl= et.SolrDispatchFilter; SolrDispatchFilter.init() done [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.230; org.apache.solr.cloud= .RecoveryStrategy; Starting recovery process. core=3Dcollection1 recoverin= gAfterStartup=3Dtrue [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.231; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.231; org.apache.solr.cloud= .RecoveryStrategy; ###### startupVersions=3D[] [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.232; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Drecovering [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.232; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.234; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.319; org.eclipse.jetty.ser= ver.Server; jetty-8.1.10.v20130312 [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.322; org.eclipse.jetty.ser= ver.AbstractConnector; Started SelectChannelConnector@127.0.0.1:60999 [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.323; org.apache.solr.servl= et.SolrDispatchFilter; SolrDispatchFilter.init() [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.324; org.apache.solr.core.= SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx) [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.324; org.apache.solr.core.= SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/= workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.s= olr.cloud.BasicDistributedZk2Test-jetty4-1367205803237 [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.325; org.apache.solr.core.= CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/w= orkspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.so= lr.cloud.BasicDistributedZk2Test-jetty4-1367205803237/solr.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.325; org.apache.solr.core.= CoreContainer; New CoreContainer 1881484131 [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.326; org.apache.solr.core.= CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/wor= kspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr= .cloud.BasicDistributedZk2Test-jetty4-1367205803237/' [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.326; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-jetty4-1367205803237/' [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.377; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000 [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.378; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting urlScheme to: http:// [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.378; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting connTimeout to: 15000 [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.379; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.380; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting corePoolSize to: 0 [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.381; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 214748364= 7 [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.381; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5 [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.382; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.383; org.apache.solr.handl= er.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.384; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= sPerHost=3D20&maxConnections=3D10000&socketTimeout=3D120000&connTimeout=3D1= 5000&retry=3Dfalse [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.389; org.apache.solr.core.= CoreContainer; Registering Log Listener [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.391; org.apache.solr.core.= ZkContainer; Zookeeper client=3D127.0.0.1:56356/solr [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.391; org.apache.solr.cloud= .ZkController; zkHost includes chroot [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.393; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.395; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@714982ce name:ZooKeeperConnection Watcher:127.0.0.1:56356 got event = WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.396; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.400; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D500&maxConnectionsPerHost=3D16&socketTimeout=3D120000&connTimeout=3D150= 00 [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.408; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.409; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@5622ff71 name:ZooKeeperConnection Watcher:127.0.0.1:56356/solr got e= vent WatchedEvent state:SyncConnected type:None path:null path:null type:No= ne [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.410; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.563; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cluster state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.569; org.apache.solr.handl= er.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:44104_= _collection1, state: recovering, checkLive: true, onlyIfLeader: true [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.922; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.924; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D2 message=3D{ [junit4:junit4] 1> "state":"recovering", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "node_name":"127.0.0.1:44104_", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "core_node_name":"127.0.0.1:44104__collection1", [junit4:junit4] 1> "base_url":"http://127.0.0.1:44104", [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.933; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.934; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.934; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.934; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.933; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:23.933; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.570; org.apache.solr.cloud= .ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:609= 99_ [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.571; org.apache.solr.handl= er.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:44104__collection= 1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds. [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.572; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:60999_ [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.572; org.apache.solr.servl= et.SolrDispatchFilter; [admin] webapp=3Dnull path=3D/admin/cores params=3D{= version=3D2&wt=3Djavabin&state=3Drecovering&coreNodeName=3D127.0.0.1:44104_= _collection1&nodeName=3D127.0.0.1:44104_&checkLive=3Dtrue&onlyIfLeader=3Dtr= ue&core=3Dcollection1&action=3DPREPRECOVERY} status=3D0 QTime=3D1009=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.576; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.576; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.578; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.579; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.581; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.582; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.576; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.583; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.586; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.577; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.595; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.595; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.599; org.apache.solr.core.= CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/= jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.= apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367205803237/collection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.600; org.apache.solr.cloud= .ZkController; Check for collection zkNode:collection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.601; org.apache.solr.cloud= .ZkController; Collection zkNode exists [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.602; org.apache.solr.cloud= .ZkController; Load collection config from:/collections/collection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.604; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-jetty4-1367205803237/collection1/' [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.605; org.apache.solr.core.= SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x= -Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZ= k2Test-jetty4-1367205803237/collection1/lib/README' to classloader [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.606; org.apache.solr.core.= SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x= -Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZ= k2Test-jetty4-1367205803237/collection1/lib/classes/' to classloader [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.667; org.apache.solr.core.= SolrConfig; Using Lucene MatchVersion: LUCENE_44 [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.724; org.apache.solr.core.= SolrConfig; Loaded SolrConfig: solrconfig.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.727; org.apache.solr.schem= a.IndexSchema; Reading Solr Schema from schema.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:24.760; org.apache.solr.schem= a.IndexSchema; Schema name=3Dtest [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.178; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Initialized with rates=3Dopen-exchange-rate= s.json, refreshInterval=3D1440. [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.189; org.apache.solr.schem= a.IndexSchema; default search field in schema is text [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.192; org.apache.solr.schem= a.IndexSchema; unique key field: id [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.224; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.229; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.234; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-29 03:23:25.236; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-29 03:23:25.237; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.237; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-29 03:23:25.239; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-29 03:23:25.239; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.240; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.240; org.apache.solr.core.= SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/= Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.= BasicDistributedZk2Test-jetty4-1367205803237/collection1/, dataDir=3D./org.= apache.solr.cloud.BasicDistributedZk2Test-1367205783162/jetty4/ [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.241; org.apache.solr.core.= JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Serve= r: com.sun.jmx.mbeanserver.JmxMBeanServer@10cfe67b [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.241; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.242; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1367205783162/jetty4 [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.243; org.apache.solr.core.= SolrCore; New index directory detected: old=3Dnull new=3D./org.apache.solr.= cloud.BasicDistributedZk2Test-1367205783162/jetty4/index/ [junit4:junit4] 1> WARN - 2013-04-29 03:23:25.243; org.apache.solr.core.= SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.Basic= DistributedZk2Test-1367205783162/jetty4/index' doesn't exist. Creating new = index... [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.243; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1367205783162/jetty4/index [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.245; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=3D1 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(org.apache.lucene.store= .RAMDirectory@1f3429d2 lockFactory=3Dorg.apache.lucene.store.NativeFSLockFa= ctory@1b6058e1),segFN=3Dsegments_1,generation=3D1} [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.246; org.apache.solr.core.= SolrDeletionPolicy; newest commit generation =3D 1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.249; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "dedupe" [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.249; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "stored_sig" [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.250; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit= " [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.251; org.apache.solr.core.= RequestHandlers; created standard: solr.StandardRequestHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.252; org.apache.solr.core.= RequestHandlers; created /get: solr.RealTimeGetHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.253; org.apache.solr.core.= RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.253; org.apache.solr.core.= RequestHandlers; created /replication: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.254; org.apache.solr.core.= RequestHandlers; created /update: solr.UpdateRequestHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.255; org.apache.solr.core.= RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandle= rs [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.258; org.apache.solr.handl= er.loader.XMLLoader; xsltCacheLifetimeSeconds=3D60 [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.261; org.apache.solr.searc= h.SolrIndexSearcher; Opening Searcher@363f279c main [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.261; org.apache.solr.updat= e.UpdateHandler; Clearing tlog files, tlogDir=3D./org.apache.solr.cloud.Bas= icDistributedZk2Test-1367205783162/jetty4/tlog [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.262; org.apache.solr.updat= e.CommitTracker; Hard AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.262; org.apache.solr.updat= e.CommitTracker; Soft AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.274; org.apache.solr.core.= SolrCore; [collection1] Registered new searcher Searcher@363f279c main{Stan= dardDirectoryReader(segments_1:1)} [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.280; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Ddown [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.280; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.444; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.445; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D2 message=3D{ [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard":null, [junit4:junit4] 1> "node_name":"127.0.0.1:60999_", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "core_node_name":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:60999", [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.446; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Collection already exists with numShards=3D2 [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.446; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Assigning new node to shard=3Dshard2 [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.453; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.453; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.453; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.453; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.453; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:25.453; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.282; org.apache.solr.core.= CoreContainer; registering core: collection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.283; org.apache.solr.cloud= .ZkController; Register replica - core:collection1 address:http://127.0.0.1= :60999 collection:collection1 shard:shard2 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.288; org.apache.solr.cloud= .ZkController; We are http://127.0.0.1:60999/collection1/ and leader is htt= p://127.0.0.1:56191/collection1/ [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.289; org.apache.solr.cloud= .ZkController; No LogReplay needed for core=3Dcollection1 baseURL=3Dhttp://= 127.0.0.1:60999 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.289; org.apache.solr.cloud= .ZkController; Core needs to recover:collection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.290; org.apache.solr.updat= e.DefaultSolrCoreState; Running recovery - first canceling any ongoing reco= very [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.291; org.apache.solr.cloud= .RecoveryStrategy; Starting recovery process. core=3Dcollection1 recoverin= gAfterStartup=3Dtrue [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.292; org.apache.solr.cloud= .RecoveryStrategy; ###### startupVersions=3D[] [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.292; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.292; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Drecovering [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.293; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.294; org.apache.solr.servl= et.SolrDispatchFilter; user.dir=3D/mnt/ssd/jenkins/workspace/Lucene-Solr-4.= x-Linux/solr/build/solr-core/test/J1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.294; org.apache.solr.servl= et.SolrDispatchFilter; SolrDispatchFilter.init() done [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.295; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.295; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.302; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.304; org.apache.solr.handl= er.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:60999_= _collection1, state: recovering, checkLive: true, onlyIfLeader: true [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.305; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.317; org.apache.solr.core.= CoreContainer; Creating SolrCore 'onenodecollectioncore' using instanceDir:= /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test= /J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367205790342/on= enodecollectioncore [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.318; org.apache.solr.cloud= .ZkController; Check for collection zkNode:onenodecollection [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.319; org.apache.solr.cloud= .ZkController; Creating collection in ZooKeeper:onenodecollection [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.319; org.apache.solr.cloud= .ZkController; Looking for collection configName [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.321; org.apache.solr.cloud= .ZkController; Only one config set found in zk - using it:conf1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.322; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/onenodecollection [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.325; org.apache.solr.cloud= .ZkController; Load collection config from:/collections/onenodecollection [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.327; org.apache.solr.core.= SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins= /workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.= solr.cloud.BasicDistributedZk2Test-jetty1-1367205790342/onenodecollectionco= re/' [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.366; org.apache.solr.core.= SolrConfig; Using Lucene MatchVersion: LUCENE_44 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.400; org.apache.solr.core.= SolrConfig; Loaded SolrConfig: solrconfig.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.402; org.apache.solr.schem= a.IndexSchema; Reading Solr Schema from schema.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.426; org.apache.solr.schem= a.IndexSchema; Schema name=3Dtest [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.626; org.apache.solr.cloud= .RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:54644/colle= ction1/ core=3Dcollection1 - recoveringAfterStartup=3Dtrue [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.631; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= sPerHost=3D20&maxConnections=3D10000&connTimeout=3D30000&socketTimeout=3D30= 000&retry=3Dfalse [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.638; org.apache.solr.updat= e.PeerSync; PeerSync: core=3Dcollection1 url=3Dhttp://127.0.0.1:44104 START= replicas=3D[http://127.0.0.1:54644/collection1/] nUpdates=3D100 [junit4:junit4] 1> WARN - 2013-04-29 03:23:26.642; org.apache.solr.updat= e.PeerSync; no frame of reference to tell of we've missed updates [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.642; org.apache.solr.cloud= .RecoveryStrategy; PeerSync Recovery was not successful - trying replicatio= n. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.643; org.apache.solr.cloud= .RecoveryStrategy; Starting Replication Recovery. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.647; org.apache.solr.cloud= .RecoveryStrategy; Begin buffering updates. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.648; org.apache.solr.updat= e.UpdateLog; Starting to buffer updates. FSUpdateLog{state=3DACTIVE, tlog= =3Dnull} [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.649; org.apache.solr.cloud= .RecoveryStrategy; Attempting to replicate from http://127.0.0.1:54644/coll= ection1/. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.651; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.667; org.apache.solr.core.= SolrCore; [collection1] webapp=3D path=3D/get params=3D{version=3D2&wt=3Dja= vabin&getVersions=3D100&distrib=3Dfalse&qt=3D/get} status=3D0 QTime=3D5=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.683; org.apache.solr.updat= e.DirectUpdateHandler2; start commit{,optimize=3Dfalse,openSearcher=3Dfalse= ,waitSearcher=3Dtrue,expungeDeletes=3Dfalse,softCommit=3Dfalse,prepareCommi= t=3Dfalse} [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.687; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=3D1 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(org.apache.lucene.store= .RAMDirectory@7a8d1600 lockFactory=3Dorg.apache.lucene.store.NativeFSLockFa= ctory@4140b1a5),segFN=3Dsegments_1,generation=3D1} [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.688; org.apache.solr.core.= SolrDeletionPolicy; newest commit generation =3D 1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.690; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=3D2 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(org.apache.lucene.store= .RAMDirectory@7a8d1600 lockFactory=3Dorg.apache.lucene.store.NativeFSLockFa= ctory@4140b1a5),segFN=3Dsegments_1,generation=3D1} [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(org.apache.lucene.store= .RAMDirectory@7a8d1600 lockFactory=3Dorg.apache.lucene.store.NativeFSLockFa= ctory@4140b1a5),segFN=3Dsegments_2,generation=3D2} [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.691; org.apache.solr.core.= SolrDeletionPolicy; newest commit generation =3D 2 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.692; org.apache.solr.searc= h.SolrIndexSearcher; Opening Searcher@190be643 realtime [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.693; org.apache.solr.updat= e.DirectUpdateHandler2; end_commit_flush [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.694; org.apache.solr.updat= e.processor.LogUpdateProcessor; [collection1] webapp=3D path=3D/update para= ms=3D{version=3D2&wt=3Djavabin&commit_end_point=3Dtrue&openSearcher=3Dfalse= &waitSearcher=3Dtrue&softCommit=3Dfalse&commit=3Dtrue} {commit=3D} 0 28 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.714; org.apache.solr.handl= er.ReplicationHandler; Commits will be reserved for 10000 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.715; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:connTimeout= =3D5000&socketTimeout=3D20000&allowCompression=3Dfalse&maxConnections=3D100= 00&maxConnectionsPerHost=3D10000 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.720; org.apache.solr.handl= er.SnapPuller; No value set for 'pollInterval'. Timer Task not started. [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.741; org.apache.solr.handl= er.ReplicationHandler; Commits will be reserved for 10000 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.743; org.apache.solr.core.= SolrCore; [collection1] webapp=3D path=3D/replication params=3D{version=3D2= &wt=3Djavabin&command=3Dindexversion&qt=3D/replication} status=3D0 QTime=3D= 20=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.745; org.apache.solr.handl= er.SnapPuller; Master's generation: 2 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.746; org.apache.solr.handl= er.SnapPuller; Slave's generation: 1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.746; org.apache.solr.handl= er.SnapPuller; Starting replication process [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.750; org.apache.solr.core.= SolrCore; [collection1] webapp=3D path=3D/replication params=3D{version=3D2= &wt=3Djavabin&command=3Dfilelist&generation=3D2&qt=3D/replication} status= =3D0 QTime=3D1=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.752; org.apache.solr.handl= er.SnapPuller; Number of files in latest index in master: 1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.753; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1367205783162/jetty3/index.20130429142326753 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.754; org.apache.solr.handl= er.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.= RAMDirectory@7e830011 lockFactory=3Dorg.apache.lucene.store.NativeFSLockFac= tory@4a3c89c6) fullCopy=3Dfalse [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.762; org.apache.solr.core.= SolrCore; [collection1] webapp=3D path=3D/replication params=3D{wt=3Dfilest= ream&command=3Dfilecontent&generation=3D2&file=3Dsegments_2&checksum=3Dtrue= &qt=3D/replication} status=3D0 QTime=3D2=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.768; org.apache.solr.handl= er.SnapPuller; Total time taken for download : 0 secs [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.779; org.apache.solr.updat= e.DefaultSolrCoreState; Creating new IndexWriter... [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.779; org.apache.solr.updat= e.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=3Dcolle= ction1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.782; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=3D2 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(org.apache.lucene.store= .RAMDirectory@63921c67 lockFactory=3Dorg.apache.lucene.store.NativeFSLockFa= ctory@4647c361),segFN=3Dsegments_1,generation=3D1} [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(org.apache.lucene.store= .RAMDirectory@63921c67 lockFactory=3Dorg.apache.lucene.store.NativeFSLockFa= ctory@4647c361),segFN=3Dsegments_2,generation=3D2} [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.782; org.apache.solr.core.= SolrDeletionPolicy; newest commit generation =3D 2 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.783; org.apache.solr.updat= e.DefaultSolrCoreState; New IndexWriter is ready to be used. [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.784; org.apache.solr.searc= h.SolrIndexSearcher; Opening Searcher@2ffcb94a main [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.789; org.apache.solr.core.= SolrCore; [collection1] Registered new searcher Searcher@2ffcb94a main{Stan= dardDirectoryReader(segments_2:1:nrt)} [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.791; org.apache.solr.core.= CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDist= ributedZk2Test-1367205783162/jetty3/index.20130429142326753 [CachedDir<>] [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.792; org.apache.solr.core.= CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDi= stributedZk2Test-1367205783162/jetty3/index.20130429142326753 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.793; org.apache.solr.core.= CachingDirectoryFactory; Removing directory before core close: ./org.apache= .solr.cloud.BasicDistributedZk2Test-1367205783162/jetty3/index.201304291423= 26753 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.794; org.apache.solr.cloud= .RecoveryStrategy; No replay needed. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.794; org.apache.solr.cloud= .RecoveryStrategy; Replication Recovery was successful - registering as Act= ive. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.795; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Dactive [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.796; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.800; org.apache.solr.cloud= .RecoveryStrategy; Finished recovery process. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.831; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Initialized with rates=3Dopen-exchange-rate= s.json, refreshInterval=3D1440. [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.842; org.apache.solr.schem= a.IndexSchema; default search field in schema is text [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.845; org.apache.solr.schem= a.IndexSchema; unique key field: id [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.874; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.881; org.apache.solr.schem= a.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.886; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-29 03:23:26.888; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-29 03:23:26.889; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.890; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange= -rates.json [junit4:junit4] 1> WARN - 2013-04-29 03:23:26.891; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOT= E [junit4:junit4] 1> WARN - 2013-04-29 03:23:26.892; org.apache.solr.schem= a.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.893; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.893; org.apache.solr.core.= SolrCore; [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/= workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.s= olr.cloud.BasicDistributedZk2Test-jetty1-1367205790342/onenodecollectioncor= e/, dataDir=3D/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/s= olr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367205783163/onenodeco= llection/ [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.894; org.apache.solr.core.= JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Serve= r: com.sun.jmx.mbeanserver.JmxMBeanServer@10cfe67b [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.895; org.apache.solr.core.= SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.896; org.apache.solr.core.= CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspac= e/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistri= butedZk2Test-1367205783163/onenodecollection [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.896; org.apache.solr.core.= SolrCore; New index directory detected: old=3Dnull new=3D/mnt/ssd/jenkins/w= orkspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-Basi= cDistributedZk2Test-1367205783163/onenodecollection/index/ [junit4:junit4] 1> WARN - 2013-04-29 03:23:26.897; org.apache.solr.core.= SolrCore; [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/wo= rkspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-Basic= DistributedZk2Test-1367205783163/onenodecollection/index' doesn't exist. Cr= eating new index... [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.898; org.apache.solr.core.= CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspac= e/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistri= butedZk2Test-1367205783163/onenodecollection/index [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.900; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=3D1 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(org.apache.lucene.store= .RAMDirectory@7280e50c lockFactory=3Dorg.apache.lucene.store.NativeFSLockFa= ctory@55e72e35),segFN=3Dsegments_1,generation=3D1} [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.901; org.apache.solr.core.= SolrDeletionPolicy; newest commit generation =3D 1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.904; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "dedupe" [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.905; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "stored_sig" [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.906; org.apache.solr.updat= e.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcess= orFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit= " [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.907; org.apache.solr.core.= RequestHandlers; created standard: solr.StandardRequestHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.908; org.apache.solr.core.= RequestHandlers; created /get: solr.RealTimeGetHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.909; org.apache.solr.core.= RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.909; org.apache.solr.core.= RequestHandlers; created /replication: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.910; org.apache.solr.core.= RequestHandlers; created /update: solr.UpdateRequestHandler [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.911; org.apache.solr.core.= RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandle= rs [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.914; org.apache.solr.handl= er.loader.XMLLoader; xsltCacheLifetimeSeconds=3D60 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.917; org.apache.solr.searc= h.SolrIndexSearcher; Opening Searcher@10d92179 main [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.917; org.apache.solr.updat= e.UpdateHandler; Clearing tlog files, tlogDir=3D/mnt/ssd/jenkins/workspace/= Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistribu= tedZk2Test-1367205783163/onenodecollection/tlog [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.918; org.apache.solr.updat= e.CommitTracker; Hard AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.919; org.apache.solr.updat= e.CommitTracker; Soft AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.925; org.apache.solr.core.= SolrCore; [onenodecollectioncore] Registered new searcher Searcher@10d92179= main{StandardDirectoryReader(segments_1:1)} [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.929; org.apache.solr.cloud= .ZkController; publishing core=3Donenodecollectioncore state=3Ddown [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.962; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.964; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D2 message=3D{ [junit4:junit4] 1> "state":"recovering", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard":"shard2", [junit4:junit4] 1> "node_name":"127.0.0.1:60999_", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "core_node_name":"127.0.0.1:60999__collection1", [junit4:junit4] 1> "base_url":"http://127.0.0.1:60999", [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.969; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D2 message=3D{ [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "node_name":"127.0.0.1:44104_", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "core_node_name":"127.0.0.1:44104__collection1", [junit4:junit4] 1> "base_url":"http://127.0.0.1:44104", [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.974; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D1 message=3D{ [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "roles":"none", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "collection":"onenodecollection", [junit4:junit4] 1> "shard":null, [junit4:junit4] 1> "node_name":"127.0.0.1:54644_", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "core_node_name":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:54644", [junit4:junit4] 1> "numShards":"1", [junit4:junit4] 1> "core":"onenodecollectioncore"} [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.974; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Create collection onenodecollection with num= Shards 1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.974; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Assigning new node to shard=3Dshard1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.980; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.980; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.980; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.980; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.980; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:26.980; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:27.305; org.apache.solr.handl= er.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:60999__collection= 1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds. [junit4:junit4] 1> INFO - 2013-04-29 03:23:27.305; org.apache.solr.servl= et.SolrDispatchFilter; [admin] webapp=3Dnull path=3D/admin/cores params=3D{= version=3D2&wt=3Djavabin&state=3Drecovering&coreNodeName=3D127.0.0.1:60999_= _collection1&nodeName=3D127.0.0.1:60999_&checkLive=3Dtrue&onlyIfLeader=3Dtr= ue&core=3Dcollection1&action=3DPREPRECOVERY} status=3D0 QTime=3D1001=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:27.931; org.apache.solr.core.= CoreContainer; registering core: onenodecollectioncore [junit4:junit4] 1> INFO - 2013-04-29 03:23:27.932; org.apache.solr.cloud= .ZkController; Register replica - core:onenodecollectioncore address:http:/= /127.0.0.1:54644 collection:onenodecollection shard:shard1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:27.933; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/onenodecollection/leader_elect= /shard1/election [junit4:junit4] 1> INFO - 2013-04-29 03:23:27.943; org.apache.solr.cloud= .ShardLeaderElectionContext; Running the leader process. [junit4:junit4] 1> INFO - 2013-04-29 03:23:27.946; org.apache.solr.cloud= .ShardLeaderElectionContext; Enough replicas found to continue. [junit4:junit4] 1> INFO - 2013-04-29 03:23:27.947; org.apache.solr.cloud= .ShardLeaderElectionContext; I may be the new leader - try and sync [junit4:junit4] 1> INFO - 2013-04-29 03:23:27.947; org.apache.solr.cloud= .SyncStrategy; Sync replicas to http://127.0.0.1:54644/onenodecollectioncor= e/ [junit4:junit4] 1> INFO - 2013-04-29 03:23:27.948; org.apache.solr.cloud= .SyncStrategy; Sync Success - now sync replicas to me [junit4:junit4] 1> INFO - 2013-04-29 03:23:27.948; org.apache.solr.cloud= .SyncStrategy; http://127.0.0.1:54644/onenodecollectioncore/ has no replica= s [junit4:junit4] 1> INFO - 2013-04-29 03:23:27.949; org.apache.solr.cloud= .ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:54644/on= enodecollectioncore/ [junit4:junit4] 1> INFO - 2013-04-29 03:23:27.949; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /collections/onenodecollection/leaders/shar= d1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:28.492; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:28.525; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:28.526; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:28.526; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:28.525; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:28.526; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:28.526; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:28.559; org.apache.solr.cloud= .ZkController; We are http://127.0.0.1:54644/onenodecollectioncore/ and lea= der is http://127.0.0.1:54644/onenodecollectioncore/ [junit4:junit4] 1> INFO - 2013-04-29 03:23:28.559; org.apache.solr.cloud= .ZkController; No LogReplay needed for core=3Donenodecollectioncore baseURL= =3Dhttp://127.0.0.1:54644 [junit4:junit4] 1> INFO - 2013-04-29 03:23:28.560; org.apache.solr.cloud= .ZkController; I am the leader, no recovery necessary [junit4:junit4] 1> INFO - 2013-04-29 03:23:28.560; org.apache.solr.cloud= .ZkController; publishing core=3Donenodecollectioncore state=3Dactive [junit4:junit4] 1> INFO - 2013-04-29 03:23:28.567; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:28.569; org.apache.solr.servl= et.SolrDispatchFilter; [admin] webapp=3Dnull path=3D/admin/cores params=3D{= version=3D2&wt=3Djavabin&roles=3Dnone&collection=3Donenodecollection&name= =3Donenodecollectioncore&numShards=3D1&dataDir=3D/mnt/ssd/jenkins/workspace= /Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistrib= utedZk2Test-1367205783163/onenodecollection&action=3DCREATE} status=3D0 QTi= me=3D2258=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:28.570; org.apache.solr.cloud= .AbstractDistribZkTestBase; Wait for recoveries to finish - collection: one= nodecollection failOnTimeout:true timeout (sec):230 [junit4:junit4] 1> INFO - 2013-04-29 03:23:28.571; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.306; org.apache.solr.cloud= .RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:56191/colle= ction1/ core=3Dcollection1 - recoveringAfterStartup=3Dtrue [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.307; org.apache.solr.updat= e.PeerSync; PeerSync: core=3Dcollection1 url=3Dhttp://127.0.0.1:60999 START= replicas=3D[http://127.0.0.1:56191/collection1/] nUpdates=3D100 [junit4:junit4] 1> WARN - 2013-04-29 03:23:29.308; org.apache.solr.updat= e.PeerSync; no frame of reference to tell of we've missed updates [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.308; org.apache.solr.cloud= .RecoveryStrategy; PeerSync Recovery was not successful - trying replicatio= n. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.309; org.apache.solr.cloud= .RecoveryStrategy; Starting Replication Recovery. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.310; org.apache.solr.cloud= .RecoveryStrategy; Begin buffering updates. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.311; org.apache.solr.updat= e.UpdateLog; Starting to buffer updates. FSUpdateLog{state=3DACTIVE, tlog= =3Dnull} [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.312; org.apache.solr.cloud= .RecoveryStrategy; Attempting to replicate from http://127.0.0.1:56191/coll= ection1/. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.312; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.317; org.apache.solr.core.= SolrCore; [collection1] webapp=3D path=3D/get params=3D{version=3D2&wt=3Dja= vabin&getVersions=3D100&distrib=3Dfalse&qt=3D/get} status=3D0 QTime=3D0=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.336; org.apache.solr.updat= e.DirectUpdateHandler2; start commit{,optimize=3Dfalse,openSearcher=3Dfalse= ,waitSearcher=3Dtrue,expungeDeletes=3Dfalse,softCommit=3Dfalse,prepareCommi= t=3Dfalse} [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.339; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=3D1 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(org.apache.lucene.store= .RAMDirectory@10e30ba2 lockFactory=3Dorg.apache.lucene.store.NativeFSLockFa= ctory@29f0ea9),segFN=3Dsegments_1,generation=3D1} [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.340; org.apache.solr.core.= SolrDeletionPolicy; newest commit generation =3D 1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.342; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=3D2 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(org.apache.lucene.store= .RAMDirectory@10e30ba2 lockFactory=3Dorg.apache.lucene.store.NativeFSLockFa= ctory@29f0ea9),segFN=3Dsegments_1,generation=3D1} [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(org.apache.lucene.store= .RAMDirectory@10e30ba2 lockFactory=3Dorg.apache.lucene.store.NativeFSLockFa= ctory@29f0ea9),segFN=3Dsegments_2,generation=3D2} [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.343; org.apache.solr.core.= SolrDeletionPolicy; newest commit generation =3D 2 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.344; org.apache.solr.searc= h.SolrIndexSearcher; Opening Searcher@3f5a018f realtime [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.344; org.apache.solr.updat= e.DirectUpdateHandler2; end_commit_flush [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.345; org.apache.solr.updat= e.processor.LogUpdateProcessor; [collection1] webapp=3D path=3D/update para= ms=3D{version=3D2&wt=3Djavabin&commit_end_point=3Dtrue&openSearcher=3Dfalse= &waitSearcher=3Dtrue&softCommit=3Dfalse&commit=3Dtrue} {commit=3D} 0 9 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.347; org.apache.solr.handl= er.ReplicationHandler; Commits will be reserved for 10000 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.347; org.apache.solr.handl= er.SnapPuller; No value set for 'pollInterval'. Timer Task not started. [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.351; org.apache.solr.handl= er.ReplicationHandler; Commits will be reserved for 10000 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.352; org.apache.solr.core.= SolrCore; [collection1] webapp=3D path=3D/replication params=3D{version=3D2= &wt=3Djavabin&command=3Dindexversion&qt=3D/replication} status=3D0 QTime=3D= 2=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.353; org.apache.solr.handl= er.SnapPuller; Master's generation: 2 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.354; org.apache.solr.handl= er.SnapPuller; Slave's generation: 1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.354; org.apache.solr.handl= er.SnapPuller; Starting replication process [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.358; org.apache.solr.core.= SolrCore; [collection1] webapp=3D path=3D/replication params=3D{version=3D2= &wt=3Djavabin&command=3Dfilelist&generation=3D2&qt=3D/replication} status= =3D0 QTime=3D1=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.360; org.apache.solr.handl= er.SnapPuller; Number of files in latest index in master: 1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.361; org.apache.solr.core.= CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.B= asicDistributedZk2Test-1367205783162/jetty4/index.20130429142329360 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.361; org.apache.solr.handl= er.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.= RAMDirectory@5535de35 lockFactory=3Dorg.apache.lucene.store.NativeFSLockFac= tory@7d01090) fullCopy=3Dfalse [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.365; org.apache.solr.core.= SolrCore; [collection1] webapp=3D path=3D/replication params=3D{wt=3Dfilest= ream&command=3Dfilecontent&generation=3D2&file=3Dsegments_2&checksum=3Dtrue= &qt=3D/replication} status=3D0 QTime=3D0=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.368; org.apache.solr.handl= er.SnapPuller; Total time taken for download : 0 secs [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.369; org.apache.solr.updat= e.DefaultSolrCoreState; Creating new IndexWriter... [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.370; org.apache.solr.updat= e.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=3Dcolle= ction1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.372; org.apache.solr.core.= SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=3D2 [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(org.apache.lucene.store= .RAMDirectory@1f3429d2 lockFactory=3Dorg.apache.lucene.store.NativeFSLockFa= ctory@1b6058e1),segFN=3Dsegments_1,generation=3D1} [junit4:junit4] 1> =09commit{dir=3DMockDirWrapper(org.apache.lucene.store= .RAMDirectory@1f3429d2 lockFactory=3Dorg.apache.lucene.store.NativeFSLockFa= ctory@1b6058e1),segFN=3Dsegments_2,generation=3D2} [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.373; org.apache.solr.core.= SolrDeletionPolicy; newest commit generation =3D 2 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.373; org.apache.solr.updat= e.DefaultSolrCoreState; New IndexWriter is ready to be used. [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.374; org.apache.solr.searc= h.SolrIndexSearcher; Opening Searcher@421afeb main [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.376; org.apache.solr.core.= SolrCore; [collection1] Registered new searcher Searcher@421afeb main{Stand= ardDirectoryReader(segments_2:1:nrt)} [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.377; org.apache.solr.core.= CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDist= ributedZk2Test-1367205783162/jetty4/index.20130429142329360 [CachedDir<>] [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.377; org.apache.solr.core.= CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDi= stributedZk2Test-1367205783162/jetty4/index.20130429142329360 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.378; org.apache.solr.core.= CachingDirectoryFactory; Removing directory before core close: ./org.apache= .solr.cloud.BasicDistributedZk2Test-1367205783162/jetty4/index.201304291423= 29360 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.378; org.apache.solr.cloud= .RecoveryStrategy; No replay needed. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.379; org.apache.solr.cloud= .RecoveryStrategy; Replication Recovery was successful - registering as Act= ive. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.379; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Dactive [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.379; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.578; org.apache.solr.cloud= .RecoveryStrategy; Finished recovery process. core=3Dcollection1 [junit4:junit4] 1> INFO - 2013-04-29 03:23:29.582; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:30.041; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:30.042; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D1 message=3D{ [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "roles":"none", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "collection":"onenodecollection", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "node_name":"127.0.0.1:54644_", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "core_node_name":"127.0.0.1:54644__onenodecollection= core", [junit4:junit4] 1> "base_url":"http://127.0.0.1:54644", [junit4:junit4] 1> "numShards":"1", [junit4:junit4] 1> "core":"onenodecollectioncore"} [junit4:junit4] 1> INFO - 2013-04-29 03:23:30.049; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3D2 message=3D{ [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard":"shard2", [junit4:junit4] 1> "node_name":"127.0.0.1:60999_", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "core_node_name":"127.0.0.1:60999__collection1", [junit4:junit4] 1> "base_url":"http://127.0.0.1:60999", [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-29 03:23:30.054; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:30.055; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:30.054; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:30.054; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:30.054; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:30.054; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:30.585; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:30.587; org.apache.solr.cloud= .AbstractDistribZkTestBase; Recoveries finished - collection: onenodecollec= tion [junit4:junit4] 1> INFO - 2013-04-29 03:23:30.588; org.apache.solr.clien= t.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnection= s=3D128&maxConnectionsPerHost=3D32&followRedirects=3Dfalse [junit4:junit4] 1> INFO - 2013-04-29 03:23:30.651; org.apache.solr.commo= n.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-04-29 03:23:30.654; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@7171186c name:ZooKeeperConnection Watcher:127.0.0.1:56356 got event = WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-04-29 03:23:30.654; org.apache.solr.commo= n.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> / (2) [junit4:junit4] 1> DATA: [junit4:junit4] 1> =20 [junit4:junit4] 1> /zookeeper (1) [junit4:junit4] 1> DATA: [junit4:junit4] 1> =20 [junit4:junit4] 1> /solr (7) [junit4:junit4] 1> /solr/clusterstate.json (0) [junit4:junit4] 1> DATA: [junit4:junit4] 1> { [junit4:junit4] 1> "onenodecollection":{ [junit4:junit4] 1> "router":"compositeId", [junit4:junit4] 1> "shards":{"shard1":{ [junit4:junit4] 1> "range":"80000000-7fffffff", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "replicas":{"127.0.0.1:54644__onenodecol= lectioncore":{ [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "roles":"none", [junit4:junit4] 1> "collection":"onenodecollection", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "node_name":"127.0.0.1:54644_", [junit4:junit4] 1> "base_url":"http://127.0.0.1:54644", [junit4:junit4] 1> "core":"onenodecollectioncore", [junit4:junit4] 1> "leader":"true"}}}}}, [junit4:junit4] 1> "control_collection":{ [junit4:junit4] 1> "router":"compositeId", [junit4:junit4] 1> "shards":{"shard1":{ [junit4:junit4] 1> "range":"80000000-7fffffff", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "replicas":{"127.0.0.1:51853__collection= 1":{ [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "collection":"control_collection", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "node_name":"127.0.0.1:51853_", [junit4:junit4] 1> "base_url":"http://127.0.0.1:51853", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "leader":"true"}}}}}, [junit4:junit4] 1> "collection1":{ [junit4:junit4] 1> "shards":{ [junit4:junit4] 1> "shard1":{ [junit4:junit4] 1> "range":"80000000-ffffffff", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "replicas":{ [junit4:junit4] 1> "127.0.0.1:54644__collection1":{ [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "node_name":"127.0.0.1:54644_", [junit4:junit4] 1> "base_url":"http://127.0.0.1:54644", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "leader":"true"}, [junit4:junit4] 1> "127.0.0.1:44104__collection1":{ [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "node_name":"127.0.0.1:44104_", [junit4:junit4] 1> "base_url":"http://127.0.0.1:44104", [junit4:junit4] 1> "core":"collection1"}}}, [junit4:junit4] 1> "shard2":{ [junit4:junit4] 1> "range":"0-7fffffff", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "replicas":{ [junit4:junit4] 1> "127.0.0.1:56191__collection1":{ [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard":"shard2", [junit4:junit4] 1> "node_name":"127.0.0.1:56191_", [junit4:junit4] 1> "base_url":"http://127.0.0.1:56191", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "leader":"true"}, [junit4:junit4] 1> "127.0.0.1:60999__collection1":{ [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "shard":"shard2", [junit4:junit4] 1> "node_name":"127.0.0.1:60999_", [junit4:junit4] 1> "base_url":"http://127.0.0.1:60999", [junit4:junit4] 1> "core":"collection1"}}}}, [junit4:junit4] 1> "router":"compositeId"}} [junit4:junit4] 1> /solr/live_nodes (5) [junit4:junit4] 1> /solr/live_nodes/127.0.0.1:60999_ (0) [junit4:junit4] 1> /solr/live_nodes/127.0.0.1:44104_ (0) [junit4:junit4] 1> /solr/live_nodes/127.0.0.1:54644_ (0) [junit4:junit4] 1> /solr/live_nodes/127.0.0.1:56191_ (0) [junit4:junit4] 1> /solr/live_nodes/127.0.0.1:51853_ (0) [junit4:junit4] 1> /solr/collections (3) [junit4:junit4] 1> /solr/collections/onenodecollection (2) [junit4:junit4] 1> DATA: [junit4:junit4] 1> { [junit4:junit4] 1> "router":"compositeId", [junit4:junit4] 1> "configName":"conf1"} [junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect (= 1) [junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect/= shard1 (1) [junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect= /shard1/election (1) [junit4:junit4] 1> /solr/collections/onenodecollection/leader_elec= t/shard1/election/89601198212710406-127.0.0.1:54644__onenodecollectioncore-= n_0000000000 (0) [junit4:junit4] 1> /solr/collections/onenodecollection/leaders (1) [junit4:junit4] 1> /solr/collections/onenodecollection/leaders/shard= 1 (0) [junit4:junit4] 1> DATA: [junit4:junit4] 1> { [junit4:junit4] 1> "node_name":"127.0.0.1:54644_", [junit4:junit4] 1> "base_url":"http://127.0.0.1:54644", [junit4:junit4] 1> "core":"onenodecollectioncore"} [junit4:junit4] 1> /solr/collections/control_collection (3) [junit4:junit4] 1> DATA: [junit4:junit4] 1> {"configName":"conf1"} [junit4:junit4] 1> /solr/collections/control_collection/leader_elect = (1) [junit4:junit4] 1> /solr/collections/control_collection/leader_elect= /shard1 (1) [junit4:junit4] 1> /solr/collections/control_collection/leader_elec= t/shard1/election (1) [junit4:junit4] 1> /solr/collections/control_collection/leader_ele= ct/shard1/election/89601198212710403-127.0.0.1:51853__collection1-n_0000000= 000 (0) [junit4:junit4] 1> /solr/collections/control_collection/shards (0) [junit4:junit4] 1> /solr/collections/control_collection/leaders (1) [junit4:junit4] 1> /solr/collections/control_collection/leaders/shar= d1 (0) [junit4:junit4] 1> DATA: [junit4:junit4] 1> { [junit4:junit4] 1> "node_name":"127.0.0.1:51853_", [junit4:junit4] 1> "base_url":"http://127.0.0.1:51853", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> /solr/collections/collection1 (3) [junit4:junit4] 1> DATA: [junit4:junit4] 1> {"configName":"conf1"} [junit4:junit4] 1> /solr/collections/collection1/leader_elect (2) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1= (1) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard= 1/election (2) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shar= d1/election/89601198212710410-127.0.0.1:44104__collection1-n_0000000001 (0) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shar= d1/election/89601198212710406-127.0.0.1:54644__collection1-n_0000000000 (0) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard2= (1) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard= 2/election (2) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shar= d2/election/89601198212710412-127.0.0.1:60999__collection1-n_0000000001 (0) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shar= d2/election/89601198212710408-127.0.0.1:56191__collection1-n_0000000000 (0) [junit4:junit4] 1> /solr/collections/collection1/shards (0) [junit4:junit4] 1> /solr/collections/collection1/leaders (2) [junit4:junit4] 1> /solr/collections/collection1/leaders/shard1 (0) [junit4:junit4] 1> DATA: [junit4:junit4] 1> { [junit4:junit4] 1> "node_name":"127.0.0.1:54644_", [junit4:junit4] 1> "base_url":"http://127.0.0.1:54644", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> /solr/collections/collection1/leaders/shard2 (0) [junit4:junit4] 1> DATA: [junit4:junit4] 1> { [junit4:junit4] 1> "node_name":"127.0.0.1:56191_", [junit4:junit4] 1> "base_url":"http://127.0.0.1:56191", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> /solr/overseer_elect (2) [junit4:junit4] 1> /solr/overseer_elect/leader (0) [junit4:junit4] 1> DATA: [junit4:junit4] 1> {"id":"89601198212710403-127.0.0.1:51853_-n_000= 0000000"} [junit4:junit4] 1> /solr/overseer_elect/election (5) [junit4:junit4] 1> /solr/overseer_elect/election/89601198212710406-12= 7.0.0.1:54644_-n_0000000001 (0) [junit4:junit4] 1> /solr/overseer_elect/election/89601198212710412-12= 7.0.0.1:60999_-n_0000000004 (0) [junit4:junit4] 1> /solr/overseer_elect/election/89601198212710410-12= 7.0.0.1:44104_-n_0000000003 (0) [junit4:junit4] 1> /solr/overseer_elect/election/89601198212710403-12= 7.0.0.1:51853_-n_0000000000 (0) [junit4:junit4] 1> /solr/overseer_elect/election/89601198212710408-12= 7.0.0.1:56191_-n_0000000002 (0) [junit4:junit4] 1> /solr/aliases.json (0) [junit4:junit4] 1> /solr/overseer (3) [junit4:junit4] 1> DATA: [junit4:junit4] 1> =20 [junit4:junit4] 1> /solr/overseer/queue (0) [junit4:junit4] 1> /solr/overseer/queue-work (0) [junit4:junit4] 1> /solr/overseer/collection-queue-work (0) [junit4:junit4] 1> /solr/configs (1) [junit4:junit4] 1> /solr/configs/conf1 (9) [junit4:junit4] 1> /solr/configs/conf1/open-exchange-rates.json (0) [junit4:junit4] 1> DATA: [junit4:junit4] 1> { [junit4:junit4] 1> "disclaimer": "This data is not real, it was= synthetically created to match currency.xml. It is modeled after the data= format available from openexchangerates.org. See https://openexchangerate= s.org/documentation for details", [junit4:junit4] 1> "license": "http://www.apache.org/licenses/L= ICENSE-2.0", [junit4:junit4] 1> "timestamp": 1332070464, [junit4:junit4] 1> =20 [junit4:junit4] 1> =20 [junit4:junit4] 1> "IMPORTANT NOTE": "In order for tests to wor= k, this data must be kept in sync with ./currency.xml", [junit4:junit4] 1> =20 [junit4:junit4] 1> =20 [junit4:junit4] 1> "base": "USD", [junit4:junit4] 1> "rates": { [junit4:junit4] 1> "USD": 1, [junit4:junit4] 1> "JPY": 81.29, [junit4:junit4] 1> "EUR": 2.5, [junit4:junit4] 1> "GBP": 0.5, [junit4:junit4] 1> "MXN": 2.0 [junit4:junit4] 1> } [junit4:junit4] 1> } [junit4:junit4] 1> =20 [junit4:junit4] 1> /solr/configs/conf1/schema.xml (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/old_synonyms.txt (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/solrconfig.xml (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/protwords.txt (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/synonyms.txt (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/currency.xml (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/stopwords.txt (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0= ) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1>=20 [junit4:junit4] 1> WARN - 2013-04-29 03:23:30.745; org.apache.zookeeper.= server.NIOServerCnxn; caught end of stream exception [junit4:junit4] 1> EndOfStreamException: Unable to read additional data f= rom client sessionid 0x13e53d0a6eb0004, likely client has closed socket [junit4:junit4] 1> =09at org.apache.zookeeper.server.NIOServerCnxn.doIO(N= IOServerCnxn.java:220) [junit4:junit4] 1> =09at org.apache.zookeeper.server.NIOServerCnxnFactory= .run(NIOServerCnxnFactory.java:208) [junit4:junit4] 1> =09at java.lang.Thread.run(Thread.java:722) [junit4:junit4] 1> INFO - 2013-04-29 03:23:30.748; org.apache.solr.cloud= .ChaosMonkey; monkey: stop shard! 51853 [junit4:junit4] 1> INFO - 2013-04-29 03:23:30.750; org.apache.solr.core.= CoreContainer; Shutting down CoreContainer instance=3D842491366 [junit4:junit4] 1> INFO - 2013-04-29 03:23:31.566; org.apache.solr.commo= n.cloud.ZkStateReader; Updating cloud state from ZooKeeper...=20 [junit4:junit4] 1> INFO - 2013-04-29 03:23:31.567; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; Update state numShards=3Dnull message=3D{ [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "collection":"control_collection", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "node_name":"127.0.0.1:51853_", [junit4:junit4] 1> "operation":"state", [junit4:junit4] 1> "core_node_name":"127.0.0.1:51853__collection1", [junit4:junit4] 1> "base_url":"http://127.0.0.1:51853", [junit4:junit4] 1> "core":"collection1"} [junit4:junit4] 1> INFO - 2013-04-29 03:23:31.574; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:31.574; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:31.574; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:31.574; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:31.575; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.752; org.apache.solr.cloud= .ZkController; publishing core=3Dcollection1 state=3Ddown [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.753; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.755; org.apache.solr.core.= SolrCore; [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@46a= cbb8d [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.770; org.apache.solr.updat= e.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=3D0,autocommit= s=3D0,soft autocommits=3D0,optimizes=3D0,rollbacks=3D0,expungeDeletes=3D0,d= ocsPending=3D0,adds=3D0,deletesById=3D0,deletesByQuery=3D0,errors=3D0,cumul= ative_adds=3D0,cumulative_deletesById=3D0,cumulative_deletesByQuery=3D0,cum= ulative_errors=3D0} [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.771; org.apache.solr.updat= e.SolrCoreState; Closing SolrCoreState [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.771; org.apache.solr.updat= e.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing Ind= exWriter [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.772; org.apache.solr.updat= e.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.773; org.apache.solr.core.= SolrCore; [collection1] Closing main searcher on request. [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.774; org.apache.solr.core.= CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories curre= ntly being tracked [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.775; org.apache.solr.core.= CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDist= ributedZk2Test-1367205783162/control/data [CachedDir<>] [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.776; org.apache.solr.core.= CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDi= stributedZk2Test-1367205783162/control/data [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.777; org.apache.solr.core.= CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDist= ributedZk2Test-1367205783162/control/data/index [CachedDir<>] [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.777; org.apache.solr.core.= CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDi= stributedZk2Test-1367205783162/control/data/index [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.779; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; According to ZK I (id=3D89601198212710403-12= 7.0.0.1:51853_-n_0000000000) am no longer a leader. [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.782; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.782; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 5) [junit4:junit4] 1> WARN - 2013-04-29 03:23:32.784; org.apache.solr.commo= n.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to= ZK [junit4:junit4] 1> WARN - 2013-04-29 03:23:32.785; org.apache.solr.commo= n.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to= ZK [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.786; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.786; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.787; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.786; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.788; org.apache.solr.commo= n.cloud.SolrZkClient; makePath: /overseer_elect/leader [junit4:junit4] 1> INFO - 2013-04-29 03:23:32.788; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:juni [...truncated too long message...] ccurred - updating... (live nodes size: 1) [junit4:junit4] 1> INFO - 2013-04-29 03:29:49.655; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeDataChanged path:/clusterstate.json, has occurred - updatin= g... (live nodes size: 1) [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.174; org.apache.solr.cloud= .ZkController; publishing core=3Dunloadcollection4 state=3Ddown [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.174; org.apache.solr.cloud= .ZkController; numShards not found on descriptor - reading it from system p= roperty [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.176; org.apache.solr.core.= SolrCore; [unloadcollection4] CLOSING SolrCore org.apache.solr.core.SolrCo= re@4e3319a0 [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.193; org.apache.solr.updat= e.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=3D3,autocommit= s=3D0,soft autocommits=3D0,optimizes=3D0,rollbacks=3D0,expungeDeletes=3D0,d= ocsPending=3D0,adds=3D0,deletesById=3D0,deletesByQuery=3D0,errors=3D0,cumul= ative_adds=3D0,cumulative_deletesById=3D0,cumulative_deletesByQuery=3D0,cum= ulative_errors=3D0} [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.194; org.apache.solr.updat= e.SolrCoreState; Closing SolrCoreState [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.195; org.apache.solr.updat= e.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing Ind= exWriter [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.195; org.apache.solr.updat= e.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.197; org.apache.solr.core.= SolrCore; [unloadcollection4] Closing main searcher on request. [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.199; org.apache.solr.core.= CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories curre= ntly being tracked [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.199; org.apache.solr.core.= CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene= -Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZk= Test-1367206050434/1367206074207unloadcollection_4n/index.20130429062807787= [CachedDir<>] [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.200; org.apache.solr.core.= CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Luce= ne-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributed= ZkTest-1367206050434/1367206074207unloadcollection_4n/index.201304290628077= 87 [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.200; org.apache.solr.core.= CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene= -Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZk= Test-1367206050434/1367206074207unloadcollection_4n [CachedDir<>] [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.200; org.apache.solr.core.= CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Luce= ne-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributed= ZkTest-1367206050434/1367206074207unloadcollection_4n [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.201; org.apache.solr.cloud= .Overseer$ClusterStateUpdater; According to ZK I (id=3D89601215721373708-12= 7.0.0.1:44688_-n_0000000004) am no longer a leader. [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.203; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 1) [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.204; org.apache.solr.commo= n.cloud.ZkStateReader$3; Updating live nodes... (0) [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.223; org.eclipse.jetty.ser= ver.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/,null} [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.276; org.apache.solr.SolrT= estCaseJ4; ###Ending testDistribSearch [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.278; org.apache.solr.cloud= .ZkTestServer; connecting to 127.0.0.1:43752 43752 [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.380; org.apache.solr.commo= n.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionM= anager@55333126 name:ZooKeeperConnection Watcher:127.0.0.1:43752/solr got e= vent WatchedEvent state:Disconnected type:None path:null path:null type:Non= e [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.381; org.apache.solr.commo= n.cloud.ConnectionManager; Client->ZooKeeper status change trigger but we a= re already closed [junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-So= lr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTes= t-1367206050434 [junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=3DUnloadDis= tributedZkTest -Dtests.method=3DtestDistribSearch -Dtests.seed=3D664AAADB85= F89FC0 -Dtests.multiplier=3D3 -Dtests.slow=3Dtrue -Dtests.locale=3Des_EC -D= tests.timezone=3DAsia/Baghdad -Dtests.file.encoding=3DUTF-8 [junit4:junit4] FAILURE 141s J0 | UnloadDistributedZkTest.testDistribSearc= h <<< [junit4:junit4] > Throwable #1: java.lang.AssertionError: Still found sh= ard2 in collection test_unload_shard_and_collection [junit4:junit4] > =09at __randomizedtesting.SeedInfo.seed([664AAADB85F89= FC0:E7AC24C3F2A7FFFC]:0) [junit4:junit4] > =09at org.apache.solr.cloud.UnloadDistributedZkTest.te= stUnloadShardAndCollection(UnloadDistributedZkTest.java:127) [junit4:junit4] > =09at org.apache.solr.cloud.UnloadDistributedZkTest.do= Test(UnloadDistributedZkTest.java:77) [junit4:junit4] > =09at org.apache.solr.BaseDistributedSearchTestCase.te= stDistribSearch(BaseDistributedSearchTestCase.java:815) [junit4:junit4] > =09at java.lang.Thread.run(Thread.java:722) [junit4:junit4] 1> INFO - 2013-04-29 03:29:51.428; org.apache.solr.SolrT= estCaseJ4; ###deleteCore [junit4:junit4] 2> 141011 T1277 ccr.ThreadLeakControl.checkThreadLeaks WA= RNING Will linger awaiting termination of 3 leaked thread(s). [junit4:junit4] 1> WARN - 2013-04-29 03:29:52.503; org.apache.solr.commo= n.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to= ZK [junit4:junit4] 1> INFO - 2013-04-29 03:29:52.503; org.apache.solr.commo= n.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncCon= nected type:NodeChildrenChanged path:/live_nodes, has occurred - updating..= . (live nodes size: 1) [junit4:junit4] 1> WARN - 2013-04-29 03:29:52.503; org.apache.solr.commo= n.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to= ZK [junit4:junit4] 2> NOTE: test params are: codec=3DLucene42: {timestamp=3D= MockFixedIntBlock(blockSize=3D1764), multiDefault=3DPostingsFormat(name=3DM= ockRandom), intDefault=3DMockFixedIntBlock(blockSize=3D1764), _version_=3DM= ockFixedIntBlock(blockSize=3D1764), text=3DMockVariableIntBlock(baseBlockSi= ze=3D41), a_t=3DMockFixedIntBlock(blockSize=3D1764), a_si=3DPostingsFormat(= name=3DMockRandom), other_tl1=3DMockFixedIntBlock(blockSize=3D1764), range_= facet_sl=3DMockVariableIntBlock(baseBlockSize=3D41), range_facet_si=3DPosti= ngsFormat(name=3DMockRandom), range_facet_l=3DMockFixedIntBlock(blockSize= =3D1764), id=3DPulsing41(freqCutoff=3D20 minBlockSize=3D44 maxBlockSize=3D9= 6)}, docValues:{}, sim=3DDefaultSimilarity, locale=3Des_EC, timezone=3DAsia= /Baghdad [junit4:junit4] 2> NOTE: Linux 3.2.0-40-generic amd64/Oracle Corporation = 1.8.0-ea (64-bit)/cpus=3D8,threads=3D2,free=3D191465288,total=3D368967680 [junit4:junit4] 2> NOTE: All tests run in this JVM: [TestCharFilters, Sea= rchHandlerTest, SchemaVersionSpecificBehaviorTest, TestDocumentBuilder, Spe= llingQueryConverterTest, ClusterStateUpdateTest, TestDocSet, TermsComponent= Test, TestSolrQueryParserDefaultOperatorResource, TestFaceting, TestPerFiel= dSimilarity, TestFastLRUCache, StatelessScriptUpdateProcessorFactoryTest, T= estCollationKeyRangeQueries, SliceStateTest, TestPropInjectDefaults, SolrIn= dexSplitterTest, UUIDFieldTest, RAMDirectoryFactoryTest, TestRandomDVFaceti= ng, SolrInfoMBeanTest, TestSolrQueryParser, DistributedSpellCheckComponentT= est, TestReversedWildcardFilterFactory, SuggesterFSTTest, TestSolrDeletionP= olicy1, SolrCoreTest, SyncSliceTest, TestSolrDeletionPolicy2, BinaryUpdateR= equestHandlerTest, TestReplicationHandler, TestSurroundQueryParser, CSVRequ= estHandlerTest, DirectUpdateHandlerOptimizeTest, TestTrie, DocumentBuilderT= est, CircularListTest, DocValuesTest, TestStressRecovery, TestPhraseSuggest= ions, UnloadDistributedZkTest] [junit4:junit4] Completed on J0 in 142.30s, 1 test, 1 failure <<< FAILURES! [...truncated 662 lines...] BUILD FAILED /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:384: The followi= ng error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:364: The followi= ng error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The followin= g error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:181: The fo= llowing error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:437:= The following error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:12= 43: The following error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:88= 7: There were test failures: 294 suites, 1222 tests, 1 error, 1 failure, 14= ignored (8 assumptions) Total time: 37 minutes 15 seconds Build step 'Invoke Ant' marked build as failure Description set: Java: 64bit/jdk1.8.0-ea-b86 -XX:+UseCompressedOops -XX:+Us= eParallelGC Archiving artifacts Recording test results Email was triggered for: Failure Sending email for trigger: Failure ------=_Part_10_1182995741.1367206925792 Content-Type: text/plain; charset=us-ascii --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org ------=_Part_10_1182995741.1367206925792--