Return-Path: X-Original-To: apmail-lucene-dev-archive@www.apache.org Delivered-To: apmail-lucene-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AB8BF9673 for ; Tue, 12 Mar 2013 07:39:44 +0000 (UTC) Received: (qmail 29144 invoked by uid 500); 12 Mar 2013 07:39:40 -0000 Delivered-To: apmail-lucene-dev-archive@lucene.apache.org Received: (qmail 28945 invoked by uid 500); 12 Mar 2013 07:39:39 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 28920 invoked by uid 99); 12 Mar 2013 07:39:38 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 Mar 2013 07:39:38 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,NORMAL_HTTP_TO_IP,WEIRD_PORT X-Spam-Check-By: apache.org Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 Mar 2013 07:39:28 +0000 Received: from aegis.apache.org (localhost [127.0.0.1]) by aegis.apache.org (Postfix) with ESMTP id 66254C00CA for ; Tue, 12 Mar 2013 07:39:08 +0000 (UTC) Date: Tue, 12 Mar 2013 07:38:54 +0000 (UTC) From: Apache Jenkins Server To: dev@lucene.apache.org Message-ID: <575417976.3684.1363073948416.JavaMail.hudson@aegis> Subject: [JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 204 - Failure MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_3683_268369041.1363073934379" X-Jenkins-Job: Lucene-Solr-NightlyTests-trunk X-Jenkins-Result: FAILURE X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_3683_268369041.1363073934379 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/204/ 1 tests failed. FAILED: org.apache.solr.cloud.SyncSliceTest.testDistribSearch Error Message: Test Setup Failure: shard1 should have just been set up to be inconsistent = - but it's still consistent. Leader:http://127.0.0.1:31025/collection1skip = list:[CloudJettyRunner [url=3Dhttp://127.0.0.1:31029/collection1], CloudJet= tyRunner [url=3Dhttp://127.0.0.1:31059/collection1]] Stack Trace: java.lang.AssertionError: Test Setup Failure: shard1 should have just been = set up to be inconsistent - but it's still consistent. Leader:http://127.0.= 0.1:31025/collection1skip list:[CloudJettyRunner [url=3Dhttp://127.0.0.1:31= 029/collection1], CloudJettyRunner [url=3Dhttp://127.0.0.1:31059/collection= 1]] =09at __randomizedtesting.SeedInfo.seed([62A3AA9AF2B5DB88:E345248285EABBB4]= :0) =09at org.junit.Assert.fail(Assert.java:93) =09at org.junit.Assert.assertTrue(Assert.java:43) =09at org.junit.Assert.assertNotNull(Assert.java:526) =09at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:212) =09at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseD= istributedSearchTestCase.java:806) =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.= java:57) =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces= sorImpl.java:43) =09at java.lang.reflect.Method.invoke(Method.java:616) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1559) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Random= izedRunner.java:79) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Random= izedRunner.java:737) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:773) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Random= izedRunner.java:787) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:53) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:50) =09at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFi= eldCacheSanity.java:51) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRul= e$1.evaluate(SystemPropertiesInvariantRule.java:55) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:49) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:70) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:358) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:782) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:442) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:746) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Random= izedRunner.java:648) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Random= izedRunner.java:682) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:693) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:53) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:42) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRul= e$1.evaluate(SystemPropertiesInvariantRule.java:55) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:43) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:70) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:55) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:358) =09at java.lang.Thread.run(Thread.java:679) Build Log: [...truncated 8566 lines...] [junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest [junit4:junit4] 2> 0 T1504 oas.BaseDistributedSearchTestCase.initHostCont= ext Setting hostContext system property: / [junit4:junit4] 2> 3 T1504 oas.SolrTestCaseJ4.setUp ###Starting testDistr= ibSearch [junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/worksp= ace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-= SyncSliceTest-1363072312424 [junit4:junit4] 2> 4 T1504 oasc.ZkTestServer.run STARTING ZK TEST SERVER [junit4:junit4] 2> 4 T1505 oasc.ZkTestServer$ZKServerMain.runFromConfig S= tarting server [junit4:junit4] 2> 6 T1505 oazs.ZooKeeperServer.setTickTime tickTime set = to 1000 [junit4:junit4] 2> 7 T1505 oazs.ZooKeeperServer.setMinSessionTimeout minS= essionTimeout set to -1 [junit4:junit4] 2> 7 T1505 oazs.ZooKeeperServer.setMaxSessionTimeout maxS= essionTimeout set to -1 [junit4:junit4] 2> 7 T1505 oazs.NIOServerCnxnFactory.configure binding to= port 0.0.0.0/0.0.0.0:0 [junit4:junit4] 2> 8 T1505 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to= /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/sol= r/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-13630723124= 23/zookeeper/server1/data/version-2/snapshot.0 [junit4:junit4] 2> 105 T1504 oasc.ZkTestServer.run start zk server on por= t:31008 [junit4:junit4] 2> 105 T1504 oaz.ZooKeeper. Initiating client conne= ction, connectString=3D127.0.0.1:31008 sessionTimeout=3D10000 watcher=3Dorg= .apache.solr.common.cloud.ConnectionManager@2e620d0a [junit4:junit4] 2> 106 T1504 oascc.ConnectionManager.waitForConnected Wai= ting for client to connect to ZooKeeper [junit4:junit4] 2> 106 T1510 oaz.ClientCnxn$SendThread.logStartConnect Op= ening socket connection to server localhost/127.0.0.1:31008. Will not attem= pt to authenticate using SASL (access denied (javax.security.auth.AuthPermi= ssion getLoginConfiguration)) [junit4:junit4] 2> 107 T1510 oaz.ClientCnxn$SendThread.primeConnection So= cket connection established to localhost/127.0.0.1:31008, initiating sessio= n [junit4:junit4] 2> 107 T1506 oazs.NIOServerCnxnFactory.run Accepted socke= t connection from /140.211.11.196:31009 [junit4:junit4] 2> 107 T1506 oazs.ZooKeeperServer.processConnectRequest C= lient attempting to establish new session at /140.211.11.196:31009 [junit4:junit4] 2> 108 T1508 oazsp.FileTxnLog.append Creating new log fil= e: log.1 [junit4:junit4] 2> 136 T1508 oazs.ZooKeeperServer.finishSessionInit Estab= lished session 0x13d5d70e46d0000 with negotiated timeout 10000 for client /= 140.211.11.196:31009 [junit4:junit4] 2> 136 T1510 oaz.ClientCnxn$SendThread.onConnected Sessio= n establishment complete on server localhost/127.0.0.1:31008, sessionid =3D= 0x13d5d70e46d0000, negotiated timeout =3D 10000 [junit4:junit4] 2> 136 T1511 oascc.ConnectionManager.process Watcher org.= apache.solr.common.cloud.ConnectionManager@2e620d0a name:ZooKeeperConnectio= n Watcher:127.0.0.1:31008 got event WatchedEvent state:SyncConnected type:N= one path:null path:null type:None [junit4:junit4] 2> 136 T1504 oascc.ConnectionManager.waitForConnected Cli= ent is connected to ZooKeeper [junit4:junit4] 2> 137 T1504 oascc.SolrZkClient.makePath makePath: /solr [junit4:junit4] 2> 139 T1509 oazs.PrepRequestProcessor.pRequest2Txn Proce= ssed session termination for sessionid: 0x13d5d70e46d0000 [junit4:junit4] 2> 140 T1511 oaz.ClientCnxn$EventThread.run EventThread s= hut down [junit4:junit4] 2> 140 T1504 oaz.ZooKeeper.close Session: 0x13d5d70e46d00= 00 closed [junit4:junit4] 2> 141 T1506 oazs.NIOServerCnxn.closeSock Closed socket c= onnection for client /140.211.11.196:31009 which had sessionid 0x13d5d70e46= d0000 [junit4:junit4] 2> 141 T1504 oaz.ZooKeeper. Initiating client conne= ction, connectString=3D127.0.0.1:31008/solr sessionTimeout=3D10000 watcher= =3Dorg.apache.solr.common.cloud.ConnectionManager@7d8993a4 [junit4:junit4] 2> 141 T1504 oascc.ConnectionManager.waitForConnected Wai= ting for client to connect to ZooKeeper [junit4:junit4] 2> 142 T1512 oaz.ClientCnxn$SendThread.logStartConnect Op= ening socket connection to server localhost/127.0.0.1:31008. Will not attem= pt to authenticate using SASL (access denied (javax.security.auth.AuthPermi= ssion getLoginConfiguration)) [junit4:junit4] 2> 142 T1512 oaz.ClientCnxn$SendThread.primeConnection So= cket connection established to localhost/127.0.0.1:31008, initiating sessio= n [junit4:junit4] 2> 142 T1506 oazs.NIOServerCnxnFactory.run Accepted socke= t connection from /140.211.11.196:31010 [junit4:junit4] 2> 143 T1506 oazs.ZooKeeperServer.processConnectRequest C= lient attempting to establish new session at /140.211.11.196:31010 [junit4:junit4] 2> 153 T1508 oazs.ZooKeeperServer.finishSessionInit Estab= lished session 0x13d5d70e46d0001 with negotiated timeout 10000 for client /= 140.211.11.196:31010 [junit4:junit4] 2> 153 T1512 oaz.ClientCnxn$SendThread.onConnected Sessio= n establishment complete on server localhost/127.0.0.1:31008, sessionid =3D= 0x13d5d70e46d0001, negotiated timeout =3D 10000 [junit4:junit4] 2> 153 T1513 oascc.ConnectionManager.process Watcher org.= apache.solr.common.cloud.ConnectionManager@7d8993a4 name:ZooKeeperConnectio= n Watcher:127.0.0.1:31008/solr got event WatchedEvent state:SyncConnected t= ype:None path:null path:null type:None [junit4:junit4] 2> 153 T1504 oascc.ConnectionManager.waitForConnected Cli= ent is connected to ZooKeeper [junit4:junit4] 2> 154 T1504 oascc.SolrZkClient.makePath makePath: /colle= ctions/collection1 [junit4:junit4] 2> 157 T1504 oascc.SolrZkClient.makePath makePath: /colle= ctions/collection1/shards [junit4:junit4] 2> 159 T1504 oascc.SolrZkClient.makePath makePath: /colle= ctions/control_collection [junit4:junit4] 2> 161 T1504 oascc.SolrZkClient.makePath makePath: /colle= ctions/control_collection/shards [junit4:junit4] 2> 164 T1504 oasc.AbstractZkTestCase.putConfig put /usr/h= ome/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build= /solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs= /conf1/solrconfig.xml [junit4:junit4] 2> 164 T1504 oascc.SolrZkClient.makePath makePath: /confi= gs/conf1/solrconfig.xml [junit4:junit4] 2> 169 T1504 oasc.AbstractZkTestCase.putConfig put /usr/h= ome/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build= /solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/sc= hema.xml [junit4:junit4] 2> 170 T1504 oascc.SolrZkClient.makePath makePath: /confi= gs/conf1/schema.xml [junit4:junit4] 2> 173 T1504 oasc.AbstractZkTestCase.putConfig put /usr/h= ome/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build= /solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1= /stopwords.txt [junit4:junit4] 2> 173 T1504 oascc.SolrZkClient.makePath makePath: /confi= gs/conf1/stopwords.txt [junit4:junit4] 2> 176 T1504 oasc.AbstractZkTestCase.putConfig put /usr/h= ome/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build= /solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1= /protwords.txt [junit4:junit4] 2> 176 T1504 oascc.SolrZkClient.makePath makePath: /confi= gs/conf1/protwords.txt [junit4:junit4] 2> 184 T1504 oasc.AbstractZkTestCase.putConfig put /usr/h= ome/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build= /solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/= currency.xml [junit4:junit4] 2> 185 T1504 oascc.SolrZkClient.makePath makePath: /confi= gs/conf1/currency.xml [junit4:junit4] 2> 187 T1504 oasc.AbstractZkTestCase.putConfig put /usr/h= ome/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build= /solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /co= nfigs/conf1/open-exchange-rates.json [junit4:junit4] 2> 188 T1504 oascc.SolrZkClient.makePath makePath: /confi= gs/conf1/open-exchange-rates.json [junit4:junit4] 2> 191 T1504 oasc.AbstractZkTestCase.putConfig put /usr/h= ome/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build= /solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to = /configs/conf1/mapping-ISOLatin1Accent.txt [junit4:junit4] 2> 191 T1504 oascc.SolrZkClient.makePath makePath: /confi= gs/conf1/mapping-ISOLatin1Accent.txt [junit4:junit4] 2> 194 T1504 oasc.AbstractZkTestCase.putConfig put /usr/h= ome/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build= /solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/co= nf1/old_synonyms.txt [junit4:junit4] 2> 195 T1504 oascc.SolrZkClient.makePath makePath: /confi= gs/conf1/old_synonyms.txt [junit4:junit4] 2> 204 T1504 oasc.AbstractZkTestCase.putConfig put /usr/h= ome/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build= /solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/= synonyms.txt [junit4:junit4] 2> 204 T1504 oascc.SolrZkClient.makePath makePath: /confi= gs/conf1/synonyms.txt [junit4:junit4] 2> 207 T1509 oazs.PrepRequestProcessor.pRequest2Txn Proce= ssed session termination for sessionid: 0x13d5d70e46d0001 [junit4:junit4] 2> 208 T1513 oaz.ClientCnxn$EventThread.run EventThread s= hut down [junit4:junit4] 2> 208 T1504 oaz.ZooKeeper.close Session: 0x13d5d70e46d00= 01 closed [junit4:junit4] 2> 208 T1506 oazs.NIOServerCnxn.closeSock Closed socket c= onnection for client /140.211.11.196:31010 which had sessionid 0x13d5d70e46= d0001 [junit4:junit4] 2> 327 T1504 oejs.Server.doStart jetty-8.1.8.v20121106 [junit4:junit4] 2> 334 T1504 oejs.AbstractConnector.doStart Started Socke= tConnector@127.0.0.1:31011 [junit4:junit4] 2> 334 T1504 oass.SolrDispatchFilter.init SolrDispatchFil= ter.init() [junit4:junit4] 2> 335 T1504 oasc.SolrResourceLoader.locateSolrHome JNDI = not configured for solr (NoInitialContextEx) [junit4:junit4] 2> 335 T1504 oasc.SolrResourceLoader.locateSolrHome using= system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lu= cene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr= .cloud.SyncSliceTest-controljetty-1363072312628 [junit4:junit4] 2> 335 T1504 oasc.CoreContainer$Initializer.initialize lo= oking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-= Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.clou= d.SyncSliceTest-controljetty-1363072312628/solr.xml [junit4:junit4] 2> 335 T1504 oasc.CoreContainer. New CoreContainer = 575463732 [junit4:junit4] 2> 336 T1504 oasc.CoreContainer.load Loading CoreContaine= r using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nig= htlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSl= iceTest-controljetty-1363072312628/' [junit4:junit4] 2> 336 T1504 oasc.SolrResourceLoader. new SolrResou= rceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-So= lr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.= SyncSliceTest-controljetty-1363072312628/' [junit4:junit4] 2> 368 T1504 oashc.HttpShardHandlerFactory.getParameter S= etting socketTimeout to: 120000 [junit4:junit4] 2> 368 T1504 oashc.HttpShardHandlerFactory.getParameter S= etting urlScheme to: http:// [junit4:junit4] 2> 369 T1504 oashc.HttpShardHandlerFactory.getParameter S= etting connTimeout to: 15000 [junit4:junit4] 2> 369 T1504 oashc.HttpShardHandlerFactory.getParameter S= etting maxConnectionsPerHost to: 20 [junit4:junit4] 2> 369 T1504 oashc.HttpShardHandlerFactory.getParameter S= etting corePoolSize to: 0 [junit4:junit4] 2> 370 T1504 oashc.HttpShardHandlerFactory.getParameter S= etting maximumPoolSize to: 2147483647 [junit4:junit4] 2> 370 T1504 oashc.HttpShardHandlerFactory.getParameter S= etting maxThreadIdleTime to: 5 [junit4:junit4] 2> 370 T1504 oashc.HttpShardHandlerFactory.getParameter S= etting sizeOfQueue to: -1 [junit4:junit4] 2> 370 T1504 oashc.HttpShardHandlerFactory.getParameter S= etting fairnessPolicy to: false [junit4:junit4] 2> 371 T1504 oascsi.HttpClientUtil.createClient Creating = new http client, config:maxConnectionsPerHost=3D20&maxConnections=3D10000&s= ocketTimeout=3D120000&connTimeout=3D15000&retry=3Dfalse [junit4:junit4] 2> 385 T1504 oasc.CoreContainer.load Registering Log List= ener [junit4:junit4] 2> 393 T3 oasc.CoreContainer.finalize SEVERE CoreContaine= r was not shutdown prior to finalize(), indicates a bug -- POSSIBLE RESOURC= E LEAK!!! instance=3D1667969614 [junit4:junit4] 2> 402 T1504 oasc.CoreContainer.initZooKeeper Zookeeper c= lient=3D127.0.0.1:31008/solr [junit4:junit4] 2> 403 T1504 oasc.ZkController.checkChrootPath zkHost inc= ludes chroot [junit4:junit4] 2> 403 T1504 oaz.ZooKeeper. Initiating client conne= ction, connectString=3D127.0.0.1:31008 sessionTimeout=3D60000 watcher=3Dorg= .apache.solr.common.cloud.ConnectionManager@7bbcc13e [junit4:junit4] 2> 404 T1504 oascc.ConnectionManager.waitForConnected Wai= ting for client to connect to ZooKeeper [junit4:junit4] 2> 404 T1523 oaz.ClientCnxn$SendThread.logStartConnect Op= ening socket connection to server localhost/127.0.0.1:31008. Will not attem= pt to authenticate using SASL (access denied (javax.security.auth.AuthPermi= ssion getLoginConfiguration)) [junit4:junit4] 2> 405 T1523 oaz.ClientCnxn$SendThread.primeConnection So= cket connection established to localhost/127.0.0.1:31008, initiating sessio= n [junit4:junit4] 2> 405 T1506 oazs.NIOServerCnxnFactory.run Accepted socke= t connection from /140.211.11.196:31012 [junit4:junit4] 2> 405 T1506 oazs.ZooKeeperServer.processConnectRequest C= lient attempting to establish new session at /140.211.11.196:31012 [junit4:junit4] 2> 407 T1508 oazs.ZooKeeperServer.finishSessionInit Estab= lished session 0x13d5d70e46d0002 with negotiated timeout 20000 for client /= 140.211.11.196:31012 [junit4:junit4] 2> 407 T1523 oaz.ClientCnxn$SendThread.onConnected Sessio= n establishment complete on server localhost/127.0.0.1:31008, sessionid =3D= 0x13d5d70e46d0002, negotiated timeout =3D 20000 [junit4:junit4] 2> 408 T1524 oascc.ConnectionManager.process Watcher org.= apache.solr.common.cloud.ConnectionManager@7bbcc13e name:ZooKeeperConnectio= n Watcher:127.0.0.1:31008 got event WatchedEvent state:SyncConnected type:N= one path:null path:null type:None [junit4:junit4] 2> 408 T1504 oascc.ConnectionManager.waitForConnected Cli= ent is connected to ZooKeeper [junit4:junit4] 2> 409 T1509 oazs.PrepRequestProcessor.pRequest2Txn Proce= ssed session termination for sessionid: 0x13d5d70e46d0002 [junit4:junit4] 2> 421 T1524 oaz.ClientCnxn$EventThread.run EventThread s= hut down [junit4:junit4] 2> 421 T1506 oazs.NIOServerCnxn.closeSock Closed socket c= onnection for client /140.211.11.196:31012 which had sessionid 0x13d5d70e46= d0002 [junit4:junit4] 2> 421 T1504 oaz.ZooKeeper.close Session: 0x13d5d70e46d00= 02 closed [junit4:junit4] 2> 421 T1504 oascsi.HttpClientUtil.createClient Creating = new http client, config:maxConnections=3D500&maxConnectionsPerHost=3D16&soc= ketTimeout=3D120000&connTimeout=3D15000 [junit4:junit4] 2> 429 T1504 oaz.ZooKeeper. Initiating client conne= ction, connectString=3D127.0.0.1:31008/solr sessionTimeout=3D30000 watcher= =3Dorg.apache.solr.common.cloud.ConnectionManager@6c8924b4 [junit4:junit4] 2> 430 T1504 oascc.ConnectionManager.waitForConnected Wai= ting for client to connect to ZooKeeper [junit4:junit4] 2> 430 T1525 oaz.ClientCnxn$SendThread.logStartConnect Op= ening socket connection to server localhost/127.0.0.1:31008. Will not attem= pt to authenticate using SASL (access denied (javax.security.auth.AuthPermi= ssion getLoginConfiguration)) [junit4:junit4] 2> 430 T1525 oaz.ClientCnxn$SendThread.primeConnection So= cket connection established to localhost/127.0.0.1:31008, initiating sessio= n [junit4:junit4] 2> 430 T1506 oazs.NIOServerCnxnFactory.run Accepted socke= t connection from /140.211.11.196:31013 [junit4:junit4] 2> 431 T1506 oazs.ZooKeeperServer.processConnectRequest C= lient attempting to establish new session at /140.211.11.196:31013 [junit4:junit4] 2> 432 T1508 oazs.ZooKeeperServer.finishSessionInit Estab= lished session 0x13d5d70e46d0003 with negotiated timeout 20000 for client /= 140.211.11.196:31013 [junit4:junit4] 2> 432 T1525 oaz.ClientCnxn$SendThread.onConnected Sessio= n establishment complete on server localhost/127.0.0.1:31008, sessionid =3D= 0x13d5d70e46d0003, negotiated timeout =3D 20000 [junit4:junit4] 2> 432 T1526 oascc.ConnectionManager.process Watcher org.= apache.solr.common.cloud.ConnectionManager@6c8924b4 name:ZooKeeperConnectio= n Watcher:127.0.0.1:31008/solr got event WatchedEvent state:SyncConnected t= ype:None path:null path:null type:None [junit4:junit4] 2> 432 T1504 oascc.ConnectionManager.waitForConnected Cli= ent is connected to ZooKeeper [junit4:junit4] 2> 439 T1509 oazs.PrepRequestProcessor.pRequest Got user-= level KeeperException when processing sessionid:0x13d5d70e46d0003 type:crea= te cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Erro= r:KeeperErrorCode =3D NodeExists for /solr/overseer [junit4:junit4] 2> 440 T1504 oascc.SolrZkClient.makePath makePath: /live_= nodes [junit4:junit4] 2> 447 T1504 oasc.ZkController.createEphemeralLiveNode Re= gister node as live in ZooKeeper:/live_nodes/127.0.0.1:31011_ [junit4:junit4] 2> 448 T1509 oazs.PrepRequestProcessor.pRequest Got user-= level KeeperException when processing sessionid:0x13d5d70e46d0003 type:dele= te cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/12= 7.0.0.1:31011_ Error:KeeperErrorCode =3D NoNode for /solr/live_nodes/127.0.= 0.1:31011_ [junit4:junit4] 2> 448 T1504 oascc.SolrZkClient.makePath makePath: /live_= nodes/127.0.0.1:31011_ [junit4:junit4] 2> 452 T1504 oascc.SolrZkClient.makePath makePath: /overs= eer_elect/election [junit4:junit4] 2> 467 T1509 oazs.PrepRequestProcessor.pRequest Got user-= level KeeperException when processing sessionid:0x13d5d70e46d0003 type:dele= te cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_ele= ct/leader Error:KeeperErrorCode =3D NoNode for /solr/overseer_elect/leader [junit4:junit4] 2> 468 T1504 oascc.SolrZkClient.makePath makePath: /overs= eer_elect/leader [junit4:junit4] 2> 471 T1504 oasc.Overseer.start Overseer (id=3D893303070= 67346947-127.0.0.1:31011_-n_0000000000) starting [junit4:junit4] 2> 471 T1509 oazs.PrepRequestProcessor.pRequest Got user-= level KeeperException when processing sessionid:0x13d5d70e46d0003 type:crea= te cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Err= or:KeeperErrorCode =3D NodeExists for /solr/overseer [junit4:junit4] 2> 479 T1509 oazs.PrepRequestProcessor.pRequest Got user-= level KeeperException when processing sessionid:0x13d5d70e46d0003 type:crea= te cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Err= or:KeeperErrorCode =3D NodeExists for /solr/overseer [junit4:junit4] 2> 480 T1509 oazs.PrepRequestProcessor.pRequest Got user-= level KeeperException when processing sessionid:0x13d5d70e46d0003 type:crea= te cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Err= or:KeeperErrorCode =3D NodeExists for /solr/overseer [junit4:junit4] 2> 487 T1509 oazs.PrepRequestProcessor.pRequest Got user-= level KeeperException when processing sessionid:0x13d5d70e46d0003 type:crea= te cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Err= or:KeeperErrorCode =3D NodeExists for /solr/overseer [junit4:junit4] 2> 488 T1528 oasc.OverseerCollectionProcessor.run Process= current queue of collection creations [junit4:junit4] 2> 488 T1504 oascc.SolrZkClient.makePath makePath: /clust= erstate.json [junit4:junit4] 2> 501 T1504 oascc.SolrZkClient.makePath makePath: /alias= es.json [junit4:junit4] 2> 503 T1504 oascc.ZkStateReader.createClusterStateWatche= rsAndUpdate Updating cluster state from ZooKeeper...=20 [junit4:junit4] 2> 505 T1527 oasc.Overseer$ClusterStateUpdater.run Starti= ng to work on the main queue [junit4:junit4] 2> 508 T1529 oasc.CoreContainer.create Creating SolrCore = 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lu= cene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr= .cloud.SyncSliceTest-controljetty-1363072312628/collection1 [junit4:junit4] 2> 508 T1529 oasc.ZkController.createCollectionZkNode Che= ck for collection zkNode:control_collection [junit4:junit4] 2> 508 T1529 oasc.ZkController.createCollectionZkNode Col= lection zkNode exists [junit4:junit4] 2> 508 T1529 oasc.ZkController.readConfigName Load collec= tion config from:/collections/control_collection [junit4:junit4] 2> 510 T1529 oasc.SolrResourceLoader. new SolrResou= rceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-So= lr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.= SyncSliceTest-controljetty-1363072312628/collection1/' [junit4:junit4] 2> 511 T1529 oasc.SolrResourceLoader.replaceClassLoader A= dding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTest= s-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-co= ntroljetty-1363072312628/collection1/lib/classes/' to classloader [junit4:junit4] 2> 511 T1529 oasc.SolrResourceLoader.replaceClassLoader A= dding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTest= s-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-co= ntroljetty-1363072312628/collection1/lib/README' to classloader [junit4:junit4] 2> 557 T1529 oasc.SolrConfig. Using Lucene MatchVer= sion: LUCENE_50 [junit4:junit4] 2> 612 T1529 oasc.SolrConfig. Loaded SolrConfig: so= lrconfig.xml [junit4:junit4] 2> 613 T1529 oass.IndexSchema.readSchema Reading Solr Sch= ema [junit4:junit4] 2> 619 T1529 oass.IndexSchema.readSchema Schema name=3Dte= st [junit4:junit4] 2> 1270 T1529 oass.OpenExchangeRatesOrgProvider.init Init= ialized with rates=3Dopen-exchange-rates.json, refreshInterval=3D1440. [junit4:junit4] 2> 1283 T1529 oass.IndexSchema.readSchema default search = field in schema is text [junit4:junit4] 2> 1287 T1529 oass.IndexSchema.readSchema unique key fiel= d: id [junit4:junit4] 2> 1302 T1529 oass.FileExchangeRateProvider.reload Reload= ing exchange rates from file currency.xml [junit4:junit4] 2> 1307 T1529 oass.FileExchangeRateProvider.reload Reload= ing exchange rates from file currency.xml [junit4:junit4] 2> 1312 T1529 oass.OpenExchangeRatesOrgProvider.reload Re= loading exchange rates from open-exchange-rates.json [junit4:junit4] 2> 1313 T1529 oass.OpenExchangeRatesOrgProvider$OpenExcha= ngeRates. WARNING Unknown key IMPORTANT NOTE [junit4:junit4] 2> 1314 T1529 oass.OpenExchangeRatesOrgProvider$OpenExcha= ngeRates. WARNING Expected key, got STRING [junit4:junit4] 2> 1315 T1529 oass.OpenExchangeRatesOrgProvider.reload Re= loading exchange rates from open-exchange-rates.json [junit4:junit4] 2> 1316 T1529 oass.OpenExchangeRatesOrgProvider$OpenExcha= ngeRates. WARNING Unknown key IMPORTANT NOTE [junit4:junit4] 2> 1316 T1529 oass.OpenExchangeRatesOrgProvider$OpenExcha= ngeRates. WARNING Expected key, got STRING [junit4:junit4] 2> 1316 T1529 oasc.SolrCore.initDirectoryFactory org.apac= he.solr.core.MockDirectoryFactory [junit4:junit4] 2> 1316 T1529 oasc.SolrCore. [collection1] Opening = new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nightly= Tests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceT= est-controljetty-1363072312628/collection1/, dataDir=3D./org.apache.solr.cl= oud.SyncSliceTest-1363072312423/control/data/ [junit4:junit4] 2> 1317 T1529 oasc.JmxMonitoredMap. JMX monitoring = is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMB= eanServer@1e81a197 [junit4:junit4] 2> 1317 T1529 oasc.SolrCore.initDirectoryFactory org.apac= he.solr.core.MockDirectoryFactory [junit4:junit4] 2> 1319 T1529 oasc.CachingDirectoryFactory.get return new= directory for ./org.apache.solr.cloud.SyncSliceTest-1363072312423/control/= data forceNew: false [junit4:junit4] 2> 1320 T1529 oasc.SolrCore.getNewIndexDir New index dire= ctory detected: old=3Dnull new=3D./org.apache.solr.cloud.SyncSliceTest-1363= 072312423/control/data/index/ [junit4:junit4] 2> 1320 T1529 oasc.SolrCore.initIndex WARNING [collection= 1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-136307231242= 3/control/data/index' doesn't exist. Creating new index... [junit4:junit4] 2> 1322 T1529 oasc.CachingDirectoryFactory.get return new= directory for ./org.apache.solr.cloud.SyncSliceTest-1363072312423/control/= data/index forceNew: false [junit4:junit4] 2> 1353 T1529 oasc.SolrDeletionPolicy.onCommit SolrDeleti= onPolicy.onCommit: commits:num=3D1 [junit4:junit4] 2> =09=09commit{dir=3DMockDirWrapper(org.apache.lucene.st= ore.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nigh= tlyTests-trunk/solr/build/solr-core/test/J0/index1292012937tmp lockFactory= =3Dorg.apache.lucene.store.NativeFSLockFactory@7a5d134e),segFN=3Dsegments_1= ,generation=3D1,filenames=3D[segments_1] [junit4:junit4] 2> 1354 T1529 oasc.SolrDeletionPolicy.updateCommits newes= t commit =3D 1[segments_1] [junit4:junit4] 2> 1356 T1529 oasup.UpdateRequestProcessorChain.init inse= rting DistributedUpdateProcessorFactory into updateRequestProcessorChain "d= edupe" [junit4:junit4] 2> 1357 T1529 oasup.UpdateRequestProcessorChain.init inse= rting DistributedUpdateProcessorFactory into updateRequestProcessorChain "s= tored_sig" [junit4:junit4] 2> 1357 T1529 oasup.UpdateRequestProcessorChain.init inse= rting DistributedUpdateProcessorFactory into updateRequestProcessorChain "d= istrib-dup-test-chain-implicit" [junit4:junit4] 2> 1358 T1529 oasc.RequestHandlers.initHandlersFromConfig= created standard: solr.StandardRequestHandler [junit4:junit4] 2> 1358 T1529 oasc.RequestHandlers.initHandlersFromConfig= created /get: solr.RealTimeGetHandler [junit4:junit4] 2> 1358 T1529 oasc.RequestHandlers.initHandlersFromConfig= adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 2> 1359 T1529 oasc.RequestHandlers.initHandlersFromConfig= created /replication: solr.ReplicationHandler [junit4:junit4] 2> 1359 T1529 oasc.RequestHandlers.initHandlersFromConfig= created /update: solr.UpdateRequestHandler [junit4:junit4] 2> 1359 T1529 oasc.RequestHandlers.initHandlersFromConfig= created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4:junit4] 2> 1367 T1529 oashl.XMLLoader.init xsltCacheLifetimeSecon= ds=3D60 [junit4:junit4] 2> 1375 T1529 oass.SolrIndexSearcher. Opening Searc= her@6d1be32 main [junit4:junit4] 2> 1376 T1529 oasu.UpdateHandler.clearLog Clearing tlog f= iles, tlogDir=3D./org.apache.solr.cloud.SyncSliceTest-1363072312423/control= /data/tlog [junit4:junit4] 2> 1377 T1529 oasu.CommitTracker. Hard AutoCommit: = disabled [junit4:junit4] 2> 1377 T1529 oasu.CommitTracker. Soft AutoCommit: = disabled [junit4:junit4] 2> 1380 T1530 oasc.SolrCore.registerSearcher [collection1= ] Registered new searcher Searcher@6d1be32 main{StandardDirectoryReader(seg= ments_1:1)} [junit4:junit4] 2> 1382 T1529 oasc.ZkController.publish publishing core= =3Dcollection1 state=3Ddown [junit4:junit4] 2> 1382 T1529 oasc.ZkController.publish numShards not fou= nd on descriptor - reading it from system property [junit4:junit4] 2> 1383 T1509 oazs.PrepRequestProcessor.pRequest Got user= -level KeeperException when processing sessionid:0x13d5d70e46d0003 type:cre= ate cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/qu= eue Error:KeeperErrorCode =3D NoNode for /solr/overseer/queue [junit4:junit4] 2> 2008 T1527 oascc.ZkStateReader.updateClusterState Upda= ting cloud state from ZooKeeper...=20 [junit4:junit4] 2> 2009 T1527 oasc.Overseer$ClusterStateUpdater.updateSta= te Update state numShards=3D1 message=3D{ [junit4:junit4] 2> =09 "operation":"state", [junit4:junit4] 2> =09 "core_node_name":null, [junit4:junit4] 2> =09 "numShards":"1", [junit4:junit4] 2> =09 "shard":null, [junit4:junit4] 2> =09 "roles":null, [junit4:junit4] 2> =09 "state":"down", [junit4:junit4] 2> =09 "core":"collection1", [junit4:junit4] 2> =09 "collection":"control_collection", [junit4:junit4] 2> =09 "node_name":"127.0.0.1:31011_", [junit4:junit4] 2> =09 "base_url":"http://127.0.0.1:31011"} [junit4:junit4] 2> 2014 T1527 oasc.Overseer$ClusterStateUpdater.createCol= lection Create collection control_collection with numShards 1 [junit4:junit4] 2> 2015 T1527 oasc.Overseer$ClusterStateUpdater.updateSta= te Assigning new node to shard shard=3Dshard1 [junit4:junit4] 2> 2015 T1509 oazs.PrepRequestProcessor.pRequest Got user= -level KeeperException when processing sessionid:0x13d5d70e46d0003 type:cre= ate cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/qu= eue-work Error:KeeperErrorCode =3D NoNode for /solr/overseer/queue-work [junit4:junit4] 2> 2042 T1526 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 1) [junit4:junit4] 2> 2395 T1529 oasc.CoreContainer.registerCore registering= core: collection1 [junit4:junit4] 2> 2395 T1529 oasc.ZkController.register Register replica= - core:collection1 address:http://127.0.0.1:31011 collection:control_colle= ction shard:shard1 [junit4:junit4] 2> 2396 T1529 oascc.SolrZkClient.makePath makePath: /coll= ections/control_collection/leader_elect/shard1/election [junit4:junit4] 2> 2412 T1509 oazs.PrepRequestProcessor.pRequest Got user= -level KeeperException when processing sessionid:0x13d5d70e46d0003 type:del= ete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections= /control_collection/leaders Error:KeeperErrorCode =3D NoNode for /solr/coll= ections/control_collection/leaders [junit4:junit4] 2> 2413 T1529 oasc.ShardLeaderElectionContext.runLeaderPr= ocess Running the leader process. [junit4:junit4] 2> 2414 T1509 oazs.PrepRequestProcessor.pRequest Got user= -level KeeperException when processing sessionid:0x13d5d70e46d0003 type:cre= ate cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Er= ror:KeeperErrorCode =3D NodeExists for /solr/overseer [junit4:junit4] 2> 2422 T1529 oasc.ShardLeaderElectionContext.waitForRepl= icasToComeUp Enough replicas found to continue. [junit4:junit4] 2> 2422 T1529 oasc.ShardLeaderElectionContext.runLeaderPr= ocess I may be the new leader - try and sync [junit4:junit4] 2> 2423 T1529 oasc.SyncStrategy.sync Sync replicas to htt= p://127.0.0.1:31011/collection1/ [junit4:junit4] 2> 2423 T1529 oasc.SyncStrategy.syncReplicas Sync Success= - now sync replicas to me [junit4:junit4] 2> 2423 T1529 oasc.SyncStrategy.syncToMe http://127.0.0.1= :31011/collection1/ has no replicas [junit4:junit4] 2> 2423 T1529 oasc.ShardLeaderElectionContext.runLeaderPr= ocess I am the new leader: http://127.0.0.1:31011/collection1/ [junit4:junit4] 2> 2423 T1529 oascc.SolrZkClient.makePath makePath: /coll= ections/control_collection/leaders/shard1 [junit4:junit4] 2> 2431 T1509 oazs.PrepRequestProcessor.pRequest Got user= -level KeeperException when processing sessionid:0x13d5d70e46d0003 type:cre= ate cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Er= ror:KeeperErrorCode =3D NodeExists for /solr/overseer [junit4:junit4] 2> 3554 T1527 oascc.ZkStateReader.updateClusterState Upda= ting cloud state from ZooKeeper...=20 [junit4:junit4] 2> 3576 T1526 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 1) [junit4:junit4] 2> 3615 T1529 oasc.ZkController.register We are http://12= 7.0.0.1:31011/collection1/ and leader is http://127.0.0.1:31011/collection1= / [junit4:junit4] 2> 3615 T1529 oasc.ZkController.register No LogReplay nee= ded for core=3Dcollection1 baseURL=3Dhttp://127.0.0.1:31011 [junit4:junit4] 2> 3615 T1529 oasc.ZkController.checkRecovery I am the le= ader, no recovery necessary [junit4:junit4] 2> 3615 T1529 oasc.ZkController.publish publishing core= =3Dcollection1 state=3Dactive [junit4:junit4] 2> 3616 T1529 oasc.ZkController.publish numShards not fou= nd on descriptor - reading it from system property [junit4:junit4] 2> 3618 T1529 oascc.ZkStateReader.updateClusterState Upda= ting cloud state from ZooKeeper...=20 [junit4:junit4] 2> 3619 T1504 oass.SolrDispatchFilter.init user.dir=3D/us= r/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/bu= ild/solr-core/test/J0 [junit4:junit4] 2> 3619 T1504 oass.SolrDispatchFilter.init SolrDispatchFi= lter.init() done [junit4:junit4] 2> 3620 T1504 oascsi.HttpClientUtil.createClient Creating= new http client, config:maxConnections=3D128&maxConnectionsPerHost=3D32&fo= llowRedirects=3Dfalse [junit4:junit4] 2> 3634 T1504 oascsi.HttpClientUtil.createClient Creating= new http client, config: [junit4:junit4] 2> 3635 T1504 oaz.ZooKeeper. Initiating client conn= ection, connectString=3D127.0.0.1:31008/solr sessionTimeout=3D10000 watcher= =3Dorg.apache.solr.common.cloud.ConnectionManager@645ed3b1 [junit4:junit4] 2> 3636 T1504 oascc.ConnectionManager.waitForConnected Wa= iting for client to connect to ZooKeeper [junit4:junit4] 2> 3637 T1532 oaz.ClientCnxn$SendThread.logStartConnect O= pening socket connection to server localhost/127.0.0.1:31008. Will not atte= mpt to authenticate using SASL (access denied (javax.security.auth.AuthPerm= ission getLoginConfiguration)) [junit4:junit4] 2> 3637 T1532 oaz.ClientCnxn$SendThread.primeConnection S= ocket connection established to localhost/127.0.0.1:31008, initiating sessi= on [junit4:junit4] 2> 3637 T1506 oazs.NIOServerCnxnFactory.run Accepted sock= et connection from /140.211.11.196:31016 [junit4:junit4] 2> 3638 T1506 oazs.ZooKeeperServer.processConnectRequest = Client attempting to establish new session at /140.211.11.196:31016 [junit4:junit4] 2> 3639 T1508 oazs.ZooKeeperServer.finishSessionInit Esta= blished session 0x13d5d70e46d0004 with negotiated timeout 10000 for client = /140.211.11.196:31016 [junit4:junit4] 2> 3639 T1532 oaz.ClientCnxn$SendThread.onConnected Sessi= on establishment complete on server localhost/127.0.0.1:31008, sessionid = =3D 0x13d5d70e46d0004, negotiated timeout =3D 10000 [junit4:junit4] 2> 3639 T1533 oascc.ConnectionManager.process Watcher org= .apache.solr.common.cloud.ConnectionManager@645ed3b1 name:ZooKeeperConnecti= on Watcher:127.0.0.1:31008/solr got event WatchedEvent state:SyncConnected = type:None path:null path:null type:None [junit4:junit4] 2> 3639 T1504 oascc.ConnectionManager.waitForConnected Cl= ient is connected to ZooKeeper [junit4:junit4] 2> 3640 T1504 oascc.ZkStateReader.createClusterStateWatch= ersAndUpdate Updating cluster state from ZooKeeper...=20 [junit4:junit4] 2> 3642 T1504 oasc.ChaosMonkey.monkeyLog monkey: init - e= xpire sessions:true cause connection loss:true [junit4:junit4] 2> 3829 T1504 oejs.Server.doStart jetty-8.1.8.v20121106 [junit4:junit4] 2> 3833 T1504 oejs.AbstractConnector.doStart Started Sock= etConnector@127.0.0.1:31017 [junit4:junit4] 2> 3834 T1504 oass.SolrDispatchFilter.init SolrDispatchFi= lter.init() [junit4:junit4] 2> 3834 T1504 oasc.SolrResourceLoader.locateSolrHome JNDI= not configured for solr (NoInitialContextEx) [junit4:junit4] 2> 3835 T1504 oasc.SolrResourceLoader.locateSolrHome usin= g system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/L= ucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.sol= r.cloud.SyncSliceTest-jetty1-1363072316063 [junit4:junit4] 2> 3835 T1504 oasc.CoreContainer$Initializer.initialize l= ooking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene= -Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.clo= ud.SyncSliceTest-jetty1-1363072316063/solr.xml [junit4:junit4] 2> 3835 T1504 oasc.CoreContainer. New CoreContainer= 600733284 [junit4:junit4] 2> 3836 T1504 oasc.CoreContainer.load Loading CoreContain= er using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Ni= ghtlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncS= liceTest-jetty1-1363072316063/' [junit4:junit4] 2> 3836 T1504 oasc.SolrResourceLoader. new SolrReso= urceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-S= olr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud= .SyncSliceTest-jetty1-1363072316063/' [junit4:junit4] 2> 3890 T1504 oashc.HttpShardHandlerFactory.getParameter = Setting socketTimeout to: 120000 [junit4:junit4] 2> 3891 T1504 oashc.HttpShardHandlerFactory.getParameter = Setting urlScheme to: http:// [junit4:junit4] 2> 3892 T1504 oashc.HttpShardHandlerFactory.getParameter = Setting connTimeout to: 15000 [junit4:junit4] 2> 3892 T1504 oashc.HttpShardHandlerFactory.getParameter = Setting maxConnectionsPerHost to: 20 [junit4:junit4] 2> 3892 T1504 oashc.HttpShardHandlerFactory.getParameter = Setting corePoolSize to: 0 [junit4:junit4] 2> 3893 T1504 oashc.HttpShardHandlerFactory.getParameter = Setting maximumPoolSize to: 2147483647 [junit4:junit4] 2> 3893 T1504 oashc.HttpShardHandlerFactory.getParameter = Setting maxThreadIdleTime to: 5 [junit4:junit4] 2> 3894 T1504 oashc.HttpShardHandlerFactory.getParameter = Setting sizeOfQueue to: -1 [junit4:junit4] 2> 3894 T1504 oashc.HttpShardHandlerFactory.getParameter = Setting fairnessPolicy to: false [junit4:junit4] 2> 3895 T1504 oascsi.HttpClientUtil.createClient Creating= new http client, config:maxConnectionsPerHost=3D20&maxConnections=3D10000&= socketTimeout=3D120000&connTimeout=3D15000&retry=3Dfalse [junit4:junit4] 2> 3915 T1504 oasc.CoreContainer.load Registering Log Lis= tener [junit4:junit4] 2> 3935 T1504 oasc.CoreContainer.initZooKeeper Zookeeper = client=3D127.0.0.1:31008/solr [junit4:junit4] 2> 3936 T1504 oasc.ZkController.checkChrootPath zkHost in= cludes chroot [junit4:junit4] 2> 3936 T1504 oaz.ZooKeeper. Initiating client conn= ection, connectString=3D127.0.0.1:31008 sessionTimeout=3D60000 watcher=3Dor= g.apache.solr.common.cloud.ConnectionManager@387dd89b [junit4:junit4] 2> 3937 T1504 oascc.ConnectionManager.waitForConnected Wa= iting for client to connect to ZooKeeper [junit4:junit4] 2> 3937 T1543 oaz.ClientCnxn$SendThread.logStartConnect O= pening socket connection to server localhost/127.0.0.1:31008. Will not atte= mpt to authenticate using SASL (access denied (javax.security.auth.AuthPerm= ission getLoginConfiguration)) [junit4:junit4] 2> 3938 T1543 oaz.ClientCnxn$SendThread.primeConnection S= ocket connection established to localhost/127.0.0.1:31008, initiating sessi= on [junit4:junit4] 2> 3938 T1506 oazs.NIOServerCnxnFactory.run Accepted sock= et connection from /140.211.11.196:31021 [junit4:junit4] 2> 3939 T1506 oazs.ZooKeeperServer.processConnectRequest = Client attempting to establish new session at /140.211.11.196:31021 [junit4:junit4] 2> 3943 T1508 oazs.ZooKeeperServer.finishSessionInit Esta= blished session 0x13d5d70e46d0005 with negotiated timeout 20000 for client = /140.211.11.196:31021 [junit4:junit4] 2> 3943 T1543 oaz.ClientCnxn$SendThread.onConnected Sessi= on establishment complete on server localhost/127.0.0.1:31008, sessionid = =3D 0x13d5d70e46d0005, negotiated timeout =3D 20000 [junit4:junit4] 2> 3943 T1544 oascc.ConnectionManager.process Watcher org= .apache.solr.common.cloud.ConnectionManager@387dd89b name:ZooKeeperConnecti= on Watcher:127.0.0.1:31008 got event WatchedEvent state:SyncConnected type:= None path:null path:null type:None [junit4:junit4] 2> 3943 T1504 oascc.ConnectionManager.waitForConnected Cl= ient is connected to ZooKeeper [junit4:junit4] 2> 3944 T1509 oazs.PrepRequestProcessor.pRequest2Txn Proc= essed session termination for sessionid: 0x13d5d70e46d0005 [junit4:junit4] 2> 3954 T1544 oaz.ClientCnxn$EventThread.run EventThread = shut down [junit4:junit4] 2> 3954 T1506 oazs.NIOServerCnxn.closeSock Closed socket = connection for client /140.211.11.196:31021 which had sessionid 0x13d5d70e4= 6d0005 [junit4:junit4] 2> 3954 T1504 oaz.ZooKeeper.close Session: 0x13d5d70e46d0= 005 closed [junit4:junit4] 2> 3954 T1504 oascsi.HttpClientUtil.createClient Creating= new http client, config:maxConnections=3D500&maxConnectionsPerHost=3D16&so= cketTimeout=3D120000&connTimeout=3D15000 [junit4:junit4] 2> 3965 T1504 oaz.ZooKeeper. Initiating client conn= ection, connectString=3D127.0.0.1:31008/solr sessionTimeout=3D30000 watcher= =3Dorg.apache.solr.common.cloud.ConnectionManager@373506de [junit4:junit4] 2> 3966 T1504 oascc.ConnectionManager.waitForConnected Wa= iting for client to connect to ZooKeeper [junit4:junit4] 2> 3966 T1545 oaz.ClientCnxn$SendThread.logStartConnect O= pening socket connection to server localhost/127.0.0.1:31008. Will not atte= mpt to authenticate using SASL (access denied (javax.security.auth.AuthPerm= ission getLoginConfiguration)) [junit4:junit4] 2> 3967 T1545 oaz.ClientCnxn$SendThread.primeConnection S= ocket connection established to localhost/127.0.0.1:31008, initiating sessi= on [junit4:junit4] 2> 3967 T1506 oazs.NIOServerCnxnFactory.run Accepted sock= et connection from /140.211.11.196:31024 [junit4:junit4] 2> 3967 T1506 oazs.ZooKeeperServer.processConnectRequest = Client attempting to establish new session at /140.211.11.196:31024 [junit4:junit4] 2> 3969 T1508 oazs.ZooKeeperServer.finishSessionInit Esta= blished session 0x13d5d70e46d0006 with negotiated timeout 20000 for client = /140.211.11.196:31024 [junit4:junit4] 2> 3969 T1545 oaz.ClientCnxn$SendThread.onConnected Sessi= on establishment complete on server localhost/127.0.0.1:31008, sessionid = =3D 0x13d5d70e46d0006, negotiated timeout =3D 20000 [junit4:junit4] 2> 3969 T1546 oascc.ConnectionManager.process Watcher org= .apache.solr.common.cloud.ConnectionManager@373506de name:ZooKeeperConnecti= on Watcher:127.0.0.1:31008/solr got event WatchedEvent state:SyncConnected = type:None path:null path:null type:None [junit4:junit4] 2> 3969 T1504 oascc.ConnectionManager.waitForConnected Cl= ient is connected to ZooKeeper [junit4:junit4] 2> 3970 T1509 oazs.PrepRequestProcessor.pRequest Got user= -level KeeperException when processing sessionid:0x13d5d70e46d0006 type:cre= ate cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Err= or:KeeperErrorCode =3D NodeExists for /solr/overseer [junit4:junit4] 2> 3976 T1509 oazs.PrepRequestProcessor.pRequest Got user= -level KeeperException when processing sessionid:0x13d5d70e46d0006 type:cre= ate cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Err= or:KeeperErrorCode =3D NodeExists for /solr/overseer [junit4:junit4] 2> 3979 T1504 oascc.ZkStateReader.createClusterStateWatch= ersAndUpdate Updating cluster state from ZooKeeper...=20 [junit4:junit4] 2> 4982 T1504 oasc.ZkController.createEphemeralLiveNode R= egister node as live in ZooKeeper:/live_nodes/127.0.0.1:31017_ [junit4:junit4] 2> 4983 T1509 oazs.PrepRequestProcessor.pRequest Got user= -level KeeperException when processing sessionid:0x13d5d70e46d0006 type:del= ete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/1= 27.0.0.1:31017_ Error:KeeperErrorCode =3D NoNode for /solr/live_nodes/127.0= .0.1:31017_ [junit4:junit4] 2> 4995 T1504 oascc.SolrZkClient.makePath makePath: /live= _nodes/127.0.0.1:31017_ [junit4:junit4] 2> 5005 T1533 oascc.ZkStateReader$3.process Updating live= nodes... (2) [junit4:junit4] 2> 5005 T1546 oascc.ZkStateReader$3.process Updating live= nodes... (2) [junit4:junit4] 2> 5005 T1526 oascc.ZkStateReader$3.process Updating live= nodes... (2) [junit4:junit4] 2> 5005 T1526 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/= live_nodes, has occurred - updating... (live nodes size: 2) [junit4:junit4] 2> 5019 T1547 oasc.CoreContainer.create Creating SolrCore= 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/L= ucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.sol= r.cloud.SyncSliceTest-jetty1-1363072316063/collection1 [junit4:junit4] 2> 5019 T1547 oasc.ZkController.createCollectionZkNode Ch= eck for collection zkNode:collection1 [junit4:junit4] 2> 5020 T1547 oasc.ZkController.createCollectionZkNode Co= llection zkNode exists [junit4:junit4] 2> 5020 T1547 oasc.ZkController.readConfigName Load colle= ction config from:/collections/collection1 [junit4:junit4] 2> 5021 T1547 oasc.SolrResourceLoader. new SolrReso= urceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-S= olr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud= .SyncSliceTest-jetty1-1363072316063/collection1/' [junit4:junit4] 2> 5022 T1547 oasc.SolrResourceLoader.replaceClassLoader = Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTes= ts-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-j= etty1-1363072316063/collection1/lib/README' to classloader [junit4:junit4] 2> 5023 T1547 oasc.SolrResourceLoader.replaceClassLoader = Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTes= ts-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-j= etty1-1363072316063/collection1/lib/classes/' to classloader [junit4:junit4] 2> 5082 T1527 oascc.ZkStateReader.updateClusterState Upda= ting cloud state from ZooKeeper...=20 [junit4:junit4] 2> 5083 T1527 oasc.Overseer$ClusterStateUpdater.updateSta= te Update state numShards=3D1 message=3D{ [junit4:junit4] 2> =09 "operation":"state", [junit4:junit4] 2> =09 "core_node_name":null, [junit4:junit4] 2> =09 "numShards":"1", [junit4:junit4] 2> =09 "shard":"shard1", [junit4:junit4] 2> =09 "roles":null, [junit4:junit4] 2> =09 "state":"active", [junit4:junit4] 2> =09 "core":"collection1", [junit4:junit4] 2> =09 "collection":"control_collection", [junit4:junit4] 2> =09 "node_name":"127.0.0.1:31011_", [junit4:junit4] 2> =09 "base_url":"http://127.0.0.1:31011"} [junit4:junit4] 2> 5087 T1547 oasc.SolrConfig. Using Lucene MatchVe= rsion: LUCENE_50 [junit4:junit4] 2> 5097 T1533 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 2) [junit4:junit4] 2> 5097 T1526 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 2) [junit4:junit4] 2> 5097 T1546 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 2) [junit4:junit4] 2> 5156 T1547 oasc.SolrConfig. Loaded SolrConfig: s= olrconfig.xml [junit4:junit4] 2> 5157 T1547 oass.IndexSchema.readSchema Reading Solr Sc= hema [junit4:junit4] 2> 5168 T1547 oass.IndexSchema.readSchema Schema name=3Dt= est [junit4:junit4] 2> 5847 T1547 oass.OpenExchangeRatesOrgProvider.init Init= ialized with rates=3Dopen-exchange-rates.json, refreshInterval=3D1440. [junit4:junit4] 2> 5855 T1547 oass.IndexSchema.readSchema default search = field in schema is text [junit4:junit4] 2> 5858 T1547 oass.IndexSchema.readSchema unique key fiel= d: id [junit4:junit4] 2> 5871 T1547 oass.FileExchangeRateProvider.reload Reload= ing exchange rates from file currency.xml [junit4:junit4] 2> 5875 T1547 oass.FileExchangeRateProvider.reload Reload= ing exchange rates from file currency.xml [junit4:junit4] 2> 5879 T1547 oass.OpenExchangeRatesOrgProvider.reload Re= loading exchange rates from open-exchange-rates.json [junit4:junit4] 2> 5880 T1547 oass.OpenExchangeRatesOrgProvider$OpenExcha= ngeRates. WARNING Unknown key IMPORTANT NOTE [junit4:junit4] 2> 5880 T1547 oass.OpenExchangeRatesOrgProvider$OpenExcha= ngeRates. WARNING Expected key, got STRING [junit4:junit4] 2> 5880 T1547 oass.OpenExchangeRatesOrgProvider.reload Re= loading exchange rates from open-exchange-rates.json [junit4:junit4] 2> 5881 T1547 oass.OpenExchangeRatesOrgProvider$OpenExcha= ngeRates. WARNING Unknown key IMPORTANT NOTE [junit4:junit4] 2> 5881 T1547 oass.OpenExchangeRatesOrgProvider$OpenExcha= ngeRates. WARNING Expected key, got STRING [junit4:junit4] 2> 5881 T1547 oasc.SolrCore.initDirectoryFactory org.apac= he.solr.core.MockDirectoryFactory [junit4:junit4] 2> 5881 T1547 oasc.SolrCore. [collection1] Opening = new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nightly= Tests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceT= est-jetty1-1363072316063/collection1/, dataDir=3D./org.apache.solr.cloud.Sy= ncSliceTest-1363072312423/jetty1/ [junit4:junit4] 2> 5882 T1547 oasc.JmxMonitoredMap. JMX monitoring = is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMB= eanServer@1e81a197 [junit4:junit4] 2> 5882 T1547 oasc.SolrCore.initDirectoryFactory org.apac= he.solr.core.MockDirectoryFactory [junit4:junit4] 2> 5883 T1547 oasc.CachingDirectoryFactory.get return new= directory for ./org.apache.solr.cloud.SyncSliceTest-1363072312423/jetty1 f= orceNew: false [junit4:junit4] 2> 5884 T1547 oasc.SolrCore.getNewIndexDir New index dire= ctory detected: old=3Dnull new=3D./org.apache.solr.cloud.SyncSliceTest-1363= 072312423/jetty1/index/ [junit4:junit4] 2> 5884 T1547 oasc.SolrCore.initIndex WARNING [collection= 1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-136307231242= 3/jetty1/index' doesn't exist. Creating new index... [junit4:junit4] 2> 5885 T1547 oasc.CachingDirectoryFactory.get return new= directory for ./org.apache.solr.cloud.SyncSliceTest-1363072312423/jetty1/i= ndex forceNew: false [junit4:junit4] 2> 5889 T1547 oasc.SolrDeletionPolicy.onCommit SolrDeleti= onPolicy.onCommit: commits:num=3D1 [junit4:junit4] 2> =09=09commit{dir=3DMockDirWrapper(org.apache.lucene.st= ore.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nigh= tlyTests-trunk/solr/build/solr-core/test/J0/index1292012939tmp lockFactory= =3Dorg.apache.lucene.store.NativeFSLockFactory@72fef53c),segFN=3Dsegments_1= ,generation=3D1,filenames=3D[segments_1] [junit4:junit4] 2> 5889 T1547 oasc.SolrDeletionPolicy.updateCommits newes= t commit =3D 1[segments_1] [junit4:junit4] 2> 5891 T1547 oasup.UpdateRequestProcessorChain.init inse= rting DistributedUpdateProcessorFactory into updateRequestProcessorChain "d= edupe" [junit4:junit4] 2> 5891 T1547 oasup.UpdateRequestProcessorChain.init inse= rting DistributedUpdateProcessorFactory into updateRequestProcessorChain "s= tored_sig" [junit4:junit4] 2> 5892 T1547 oasup.UpdateRequestProcessorChain.init inse= rting DistributedUpdateProcessorFactory into updateRequestProcessorChain "d= istrib-dup-test-chain-implicit" [junit4:junit4] 2> 5892 T1547 oasc.RequestHandlers.initHandlersFromConfig= created standard: solr.StandardRequestHandler [junit4:junit4] 2> 5893 T1547 oasc.RequestHandlers.initHandlersFromConfig= created /get: solr.RealTimeGetHandler [junit4:junit4] 2> 5893 T1547 oasc.RequestHandlers.initHandlersFromConfig= adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 2> 5893 T1547 oasc.RequestHandlers.initHandlersFromConfig= created /replication: solr.ReplicationHandler [junit4:junit4] 2> 5893 T1547 oasc.RequestHandlers.initHandlersFromConfig= created /update: solr.UpdateRequestHandler [junit4:junit4] 2> 5894 T1547 oasc.RequestHandlers.initHandlersFromConfig= created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4:junit4] 2> 5899 T1547 oashl.XMLLoader.init xsltCacheLifetimeSecon= ds=3D60 [junit4:junit4] 2> 5905 T1547 oass.SolrIndexSearcher. Opening Searc= her@a28974c main [junit4:junit4] 2> 5905 T1547 oasu.UpdateHandler.clearLog Clearing tlog f= iles, tlogDir=3D./org.apache.solr.cloud.SyncSliceTest-1363072312423/jetty1/= tlog [junit4:junit4] 2> 5906 T1547 oasu.CommitTracker. Hard AutoCommit: = disabled [junit4:junit4] 2> 5906 T1547 oasu.CommitTracker. Soft AutoCommit: = disabled [junit4:junit4] 2> 5909 T1548 oasc.SolrCore.registerSearcher [collection1= ] Registered new searcher Searcher@a28974c main{StandardDirectoryReader(seg= ments_1:1)} [junit4:junit4] 2> 5911 T1547 oasc.ZkController.publish publishing core= =3Dcollection1 state=3Ddown [junit4:junit4] 2> 5911 T1547 oasc.ZkController.publish numShards not fou= nd on descriptor - reading it from system property [junit4:junit4] 2> 6602 T1527 oascc.ZkStateReader.updateClusterState Upda= ting cloud state from ZooKeeper...=20 [junit4:junit4] 2> 6602 T1527 oasc.Overseer$ClusterStateUpdater.updateSta= te Update state numShards=3D1 message=3D{ [junit4:junit4] 2> =09 "operation":"state", [junit4:junit4] 2> =09 "core_node_name":null, [junit4:junit4] 2> =09 "numShards":"1", [junit4:junit4] 2> =09 "shard":null, [junit4:junit4] 2> =09 "roles":null, [junit4:junit4] 2> =09 "state":"down", [junit4:junit4] 2> =09 "core":"collection1", [junit4:junit4] 2> =09 "collection":"collection1", [junit4:junit4] 2> =09 "node_name":"127.0.0.1:31017_", [junit4:junit4] 2> =09 "base_url":"http://127.0.0.1:31017"} [junit4:junit4] 2> 6603 T1527 oasc.Overseer$ClusterStateUpdater.createCol= lection Create collection collection1 with numShards 1 [junit4:junit4] 2> 6603 T1527 oasc.Overseer$ClusterStateUpdater.updateSta= te Assigning new node to shard shard=3Dshard1 [junit4:junit4] 2> 6620 T1533 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 2) [junit4:junit4] 2> 6620 T1526 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 2) [junit4:junit4] 2> 6620 T1546 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 2) [junit4:junit4] 2> 6924 T1547 oasc.CoreContainer.registerCore registering= core: collection1 [junit4:junit4] 2> 6924 T1547 oasc.ZkController.register Register replica= - core:collection1 address:http://127.0.0.1:31017 collection:collection1 s= hard:shard1 [junit4:junit4] 2> 6925 T1547 oascc.SolrZkClient.makePath makePath: /coll= ections/collection1/leader_elect/shard1/election [junit4:junit4] 2> 6956 T1509 oazs.PrepRequestProcessor.pRequest Got user= -level KeeperException when processing sessionid:0x13d5d70e46d0006 type:del= ete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections= /collection1/leaders Error:KeeperErrorCode =3D NoNode for /solr/collections= /collection1/leaders [junit4:junit4] 2> 6957 T1547 oasc.ShardLeaderElectionContext.runLeaderPr= ocess Running the leader process. [junit4:junit4] 2> 6957 T1509 oazs.PrepRequestProcessor.pRequest Got user= -level KeeperException when processing sessionid:0x13d5d70e46d0006 type:cre= ate cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Er= ror:KeeperErrorCode =3D NodeExists for /solr/overseer [junit4:junit4] 2> 6967 T1547 oasc.ShardLeaderElectionContext.waitForRepl= icasToComeUp Enough replicas found to continue. [junit4:junit4] 2> 6967 T1547 oasc.ShardLeaderElectionContext.runLeaderPr= ocess I may be the new leader - try and sync [junit4:junit4] 2> 6967 T1547 oasc.SyncStrategy.sync Sync replicas to htt= p://127.0.0.1:31017/collection1/ [junit4:junit4] 2> 6967 T1547 oasc.SyncStrategy.syncReplicas Sync Success= - now sync replicas to me [junit4:junit4] 2> 6968 T1547 oasc.SyncStrategy.syncToMe http://127.0.0.1= :31017/collection1/ has no replicas [junit4:junit4] 2> 6968 T1547 oasc.ShardLeaderElectionContext.runLeaderPr= ocess I am the new leader: http://127.0.0.1:31017/collection1/ [junit4:junit4] 2> 6968 T1547 oascc.SolrZkClient.makePath makePath: /coll= ections/collection1/leaders/shard1 [junit4:junit4] 2> 6977 T1509 oazs.PrepRequestProcessor.pRequest Got user= -level KeeperException when processing sessionid:0x13d5d70e46d0006 type:cre= ate cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Er= ror:KeeperErrorCode =3D NodeExists for /solr/overseer [junit4:junit4] 2> 8142 T1527 oascc.ZkStateReader.updateClusterState Upda= ting cloud state from ZooKeeper...=20 [junit4:junit4] 2> 8175 T1533 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 2) [junit4:junit4] 2> 8175 T1546 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 2) [junit4:junit4] 2> 8175 T1526 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 2) [junit4:junit4] 2> 8204 T1547 oasc.ZkController.register We are http://12= 7.0.0.1:31017/collection1/ and leader is http://127.0.0.1:31017/collection1= / [junit4:junit4] 2> 8204 T1547 oasc.ZkController.register No LogReplay nee= ded for core=3Dcollection1 baseURL=3Dhttp://127.0.0.1:31017 [junit4:junit4] 2> 8204 T1547 oasc.ZkController.checkRecovery I am the le= ader, no recovery necessary [junit4:junit4] 2> 8204 T1547 oasc.ZkController.publish publishing core= =3Dcollection1 state=3Dactive [junit4:junit4] 2> 8204 T1547 oasc.ZkController.publish numShards not fou= nd on descriptor - reading it from system property [junit4:junit4] 2> 8206 T1547 oascc.ZkStateReader.updateClusterState Upda= ting cloud state from ZooKeeper...=20 [junit4:junit4] 2> 8207 T1504 oass.SolrDispatchFilter.init user.dir=3D/us= r/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/bu= ild/solr-core/test/J0 [junit4:junit4] 2> 8208 T1504 oass.SolrDispatchFilter.init SolrDispatchFi= lter.init() done [junit4:junit4] 2> 8208 T1504 oascsi.HttpClientUtil.createClient Creating= new http client, config:maxConnections=3D128&maxConnectionsPerHost=3D32&fo= llowRedirects=3Dfalse [junit4:junit4] 2> 8420 T1504 oejs.Server.doStart jetty-8.1.8.v20121106 [junit4:junit4] 2> 8423 T1504 oejs.AbstractConnector.doStart Started Sock= etConnector@127.0.0.1:31025 [junit4:junit4] 2> 8424 T1504 oass.SolrDispatchFilter.init SolrDispatchFi= lter.init() [junit4:junit4] 2> 8425 T1504 oasc.SolrResourceLoader.locateSolrHome JNDI= not configured for solr (NoInitialContextEx) [junit4:junit4] 2> 8425 T1504 oasc.SolrResourceLoader.locateSolrHome usin= g system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/L= ucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.sol= r.cloud.SyncSliceTest-jetty2-1363072320643 [junit4:junit4] 2> 8425 T1504 oasc.CoreContainer$Initializer.initialize l= ooking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene= -Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.clo= ud.SyncSliceTest-jetty2-1363072320643/solr.xml [junit4:junit4] 2> 8426 T1504 oasc.CoreContainer. New CoreContainer= 1233446857 [junit4:junit4] 2> 8427 T1504 oasc.CoreContainer.load Loading CoreContain= er using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Ni= ghtlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncS= liceTest-jetty2-1363072320643/' [junit4:junit4] 2> 8427 T1504 oasc.SolrResourceLoader. new SolrReso= urceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-S= olr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud= .SyncSliceTest-jetty2-1363072320643/' [junit4:junit4] 2> 8485 T1504 oashc.HttpShardHandlerFactory.getParameter = Setting socketTimeout to: 120000 [junit4:junit4] 2> 8485 T1504 oashc.HttpShardHandlerFactory.getParameter = Setting urlScheme to: http:// [junit4:junit4] 2> 8486 T1504 oashc.HttpShardHandlerFactory.getParameter = Setting connTimeout to: 15000 [junit4:junit4] 2> 8486 T1504 oashc.HttpShardHandlerFactory.getParameter = Setting maxConnectionsPerHost to: 20 [junit4:junit4] 2> 8486 T1504 oashc.HttpShardHandlerFactory.getParameter = Setting corePoolSize to: 0 [junit4:junit4] 2> 8487 T1504 oashc.HttpShardHandlerFactory.getParameter = Setting maximumPoolSize to: 2147483647 [junit4:junit4] 2> 8487 T1504 oashc.HttpShardHandlerFactory.getParameter = Setting maxThreadIdleTime to: 5 [junit4:junit4] 2> 8488 T1504 oashc.HttpShardHandlerFactory.getParameter = Setting sizeOfQueue to: -1 [junit4:junit4] 2> 8488 T1504 oashc.HttpShardHandlerFactory.getParameter = Setting fairnessPolicy to: false [junit4:junit4] 2> 8489 T1504 oascsi.HttpClientUtil.createClient Creating= new http client, config:maxConnectionsPerHost=3D20&maxConnections=3D10000&= socketTimeout=3D120000&connTimeout=3D15000&retry=3Dfalse [junit4:junit4] 2> 8508 T1504 oasc.CoreContainer.load Registering Log Lis= tener [junit4:junit4] 2> 8527 T1504 oasc.CoreContainer.initZooKeeper Zookeeper = client=3D127.0.0.1:31008/solr [junit4:junit4] 2> 8527 T1504 oasc.ZkController.checkChrootPath zkHost in= cludes chroot [junit4:junit4] 2> 8528 T1504 oaz.ZooKeeper. Initiating client conn= ection, connectString=3D127.0.0.1:31008 sessionTimeout=3D60000 watcher=3Dor= g.apache.solr.common.cloud.ConnectionManager@2e536740 [junit4:junit4] 2> 8529 T1504 oascc.ConnectionManager.waitForConnected Wa= iting for client to connect to ZooKeeper [junit4:junit4] 2> 8529 T1559 oaz.ClientCnxn$SendThread.logStartConnect O= pening socket connection to server localhost/127.0.0.1:31008. Will not atte= mpt to authenticate using SASL (access denied (javax.security.auth.AuthPerm= ission getLoginConfiguration)) [junit4:junit4] 2> 8530 T1559 oaz.ClientCnxn$SendThread.primeConnection S= ocket connection established to localhost/127.0.0.1:31008, initiating sessi= on [junit4:junit4] 2> 8530 T1506 oazs.NIOServerCnxnFactory.run Accepted sock= et connection from /140.211.11.196:31026 [junit4:junit4] 2> 8531 T1506 oazs.ZooKeeperServer.processConnectRequest = Client attempting to establish new session at /140.211.11.196:31026 [junit4:junit4] 2> 8533 T1508 oazs.ZooKeeperServer.finishSessionInit Esta= blished session 0x13d5d70e46d0007 with negotiated timeout 20000 for client = /140.211.11.196:31026 [junit4:junit4] 2> 8533 T1559 oaz.ClientCnxn$SendThread.onConnected Sessi= on establishment complete on server localhost/127.0.0.1:31008, sessionid = =3D 0x13d5d70e46d0007, negotiated timeout =3D 20000 [junit4:junit4] 2> 8533 T1560 oascc.ConnectionManager.process Watcher org= .apache.solr.common.cloud.ConnectionManager@2e536740 name:ZooKeeperConnecti= on Watcher:127.0.0.1:31008 got event WatchedEvent state:SyncConnected type:= None path:null path:null type:None [junit4:junit4] 2> 8533 T1504 oascc.ConnectionManager.waitForConnected Cl= ient is connected to ZooKeeper [junit4:junit4] 2> 8534 T1509 oazs.PrepRequestProcessor.pRequest2Txn Proc= essed session termination for sessionid: 0x13d5d70e46d0007 [junit4:junit4] 2> 8543 T1560 oaz.ClientCnxn$EventThread.run EventThread = shut down [junit4:junit4] 2> 8543 T1506 oazs.NIOServerCnxn.closeSock Closed socket = connection for client /140.211.11.196:31026 which had sessionid 0x13d5d70e4= 6d0007 [junit4:junit4] 2> 8543 T1504 oaz.ZooKeeper.close Session: 0x13d5d70e46d0= 007 closed [junit4:junit4] 2> 8543 T1504 oascsi.HttpClientUtil.createClient Creating= new http client, config:maxConnections=3D500&maxConnectionsPerHost=3D16&so= cketTimeout=3D120000&connTimeout=3D15000 [junit4:junit4] 2> 8554 T1504 oaz.ZooKeeper. Initiating client conn= ection, connectString=3D127.0.0.1:31008/solr sessionTimeout=3D30000 watcher= =3Dorg.apache.solr.common.cloud.ConnectionManager@1100d290 [junit4:junit4] 2> 8555 T1504 oascc.ConnectionManager.waitForConnected Wa= iting for client to connect to ZooKeeper [junit4:junit4] 2> 8555 T1561 oaz.ClientCnxn$SendThread.logStartConnect O= pening socket connection to server localhost/127.0.0.1:31008. Will not atte= mpt to authenticate using SASL (access denied (javax.security.auth.AuthPerm= ission getLoginConfiguration)) [junit4:junit4] 2> 8556 T1561 oaz.ClientCnxn$SendThread.primeConnection S= ocket connection established to localhost/127.0.0.1:31008, initiating sessi= on [junit4:junit4] 2> 8556 T1506 oazs.NIOServerCnxnFactory.run Accepted sock= et connection from /140.211.11.196:31027 [junit4:junit4] 2> 8556 T1506 oazs.ZooKeeperServer.processConnectRequest = Client attempting to establish new session at /140.211.11.196:31027 [junit4:junit4] 2> 8557 T1508 oazs.ZooKeeperServer.finishSessionInit Esta= blished session 0x13d5d70e46d0008 with negotiated timeout 20000 for client = /140.211.11.196:31027 [junit4:junit4] 2> 8557 T1561 oaz.ClientCnxn$SendThread.onConnected Sessi= on establishment complete on server localhost/127.0.0.1:31008, sessionid = =3D 0x13d5d70e46d0008, negotiated timeout =3D 20000 [junit4:junit4] 2> 8558 T1562 oascc.ConnectionManager.process Watcher org= .apache.solr.common.cloud.ConnectionManager@1100d290 name:ZooKeeperConnecti= on Watcher:127.0.0.1:31008/solr got event WatchedEvent state:SyncConnected = type:None path:null path:null type:None [junit4:junit4] 2> 8558 T1504 oascc.ConnectionManager.waitForConnected Cl= ient is connected to ZooKeeper [junit4:junit4] 2> 8558 T1509 oazs.PrepRequestProcessor.pRequest Got user= -level KeeperException when processing sessionid:0x13d5d70e46d0008 type:cre= ate cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Err= or:KeeperErrorCode =3D NodeExists for /solr/overseer [junit4:junit4] 2> 8560 T1509 oazs.PrepRequestProcessor.pRequest Got user= -level KeeperException when processing sessionid:0x13d5d70e46d0008 type:cre= ate cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Err= or:KeeperErrorCode =3D NodeExists for /solr/overseer [junit4:junit4] 2> 8568 T1504 oascc.ZkStateReader.createClusterStateWatch= ersAndUpdate Updating cluster state from ZooKeeper...=20 [junit4:junit4] 2> 9571 T1504 oasc.ZkController.createEphemeralLiveNode R= egister node as live in ZooKeeper:/live_nodes/127.0.0.1:31025_ [junit4:junit4] 2> 9572 T1509 oazs.PrepRequestProcessor.pRequest Got user= -level KeeperException when processing sessionid:0x13d5d70e46d0008 type:del= ete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/1= 27.0.0.1:31025_ Error:KeeperErrorCode =3D NoNode for /solr/live_nodes/127.0= .0.1:31025_ [junit4:junit4] 2> 9573 T1504 oascc.SolrZkClient.makePath makePath: /live= _nodes/127.0.0.1:31025_ [junit4:junit4] 2> 9576 T1533 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/= live_nodes, has occurred - updating... (live nodes size: 2) [junit4:junit4] 2> 9576 T1546 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/= live_nodes, has occurred - updating... (live nodes size: 2) [junit4:junit4] 2> 9577 T1526 oascc.ZkStateReader$3.process Updating live= nodes... (3) [junit4:junit4] 2> 9577 T1562 oascc.ZkStateReader$3.process Updating live= nodes... (3) [junit4:junit4] 2> 9577 T1526 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/= live_nodes, has occurred - updating... (live nodes size: 3) [junit4:junit4] 2> 9578 T1546 oascc.ZkStateReader$3.process Updating live= nodes... (3) [junit4:junit4] 2> 9579 T1533 oascc.ZkStateReader$3.process Updating live= nodes... (3) [junit4:junit4] 2> 9589 T1563 oasc.CoreContainer.create Creating SolrCore= 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/L= ucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.sol= r.cloud.SyncSliceTest-jetty2-1363072320643/collection1 [junit4:junit4] 2> 9589 T1563 oasc.ZkController.createCollectionZkNode Ch= eck for collection zkNode:collection1 [junit4:junit4] 2> 9590 T1563 oasc.ZkController.createCollectionZkNode Co= llection zkNode exists [junit4:junit4] 2> 9590 T1563 oasc.ZkController.readConfigName Load colle= ction config from:/collections/collection1 [junit4:junit4] 2> 9591 T1563 oasc.SolrResourceLoader. new SolrReso= urceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-S= olr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud= .SyncSliceTest-jetty2-1363072320643/collection1/' [junit4:junit4] 2> 9592 T1563 oasc.SolrResourceLoader.replaceClassLoader = Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTes= ts-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-j= etty2-1363072320643/collection1/lib/classes/' to classloader [junit4:junit4] 2> 9593 T1563 oasc.SolrResourceLoader.replaceClassLoader = Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTes= ts-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-j= etty2-1363072320643/collection1/lib/README' to classloader [junit4:junit4] 2> 9641 T1563 oasc.SolrConfig. Using Lucene MatchVe= rsion: LUCENE_50 [junit4:junit4] 2> 9700 T1563 oasc.SolrConfig. Loaded SolrConfig: s= olrconfig.xml [junit4:junit4] 2> 9701 T1563 oass.IndexSchema.readSchema Reading Solr Sc= hema [junit4:junit4] 2> 9702 T1527 oascc.ZkStateReader.updateClusterState Upda= ting cloud state from ZooKeeper...=20 [junit4:junit4] 2> 9703 T1527 oasc.Overseer$ClusterStateUpdater.updateSta= te Update state numShards=3D1 message=3D{ [junit4:junit4] 2> =09 "operation":"state", [junit4:junit4] 2> =09 "core_node_name":null, [junit4:junit4] 2> =09 "numShards":"1", [junit4:junit4] 2> =09 "shard":"shard1", [junit4:junit4] 2> =09 "roles":null, [junit4:junit4] 2> =09 "state":"active", [junit4:junit4] 2> =09 "core":"collection1", [junit4:junit4] 2> =09 "collection":"collection1", [junit4:junit4] 2> =09 "node_name":"127.0.0.1:31017_", [junit4:junit4] 2> =09 "base_url":"http://127.0.0.1:31017"} [junit4:junit4] 2> 9708 T1563 oass.IndexSchema.readSchema Schema name=3Dt= est [junit4:junit4] 2> 9715 T1546 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 2> 9715 T1533 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 2> 9715 T1526 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 2> 9715 T1562 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 2> 10342 T1563 oass.OpenExchangeRatesOrgProvider.init Ini= tialized with rates=3Dopen-exchange-rates.json, refreshInterval=3D1440. [junit4:junit4] 2> 10353 T1563 oass.IndexSchema.readSchema default search= field in schema is text [junit4:junit4] 2> 10358 T1563 oass.IndexSchema.readSchema unique key fie= ld: id [junit4:junit4] 2> 10371 T1563 oass.FileExchangeRateProvider.reload Reloa= ding exchange rates from file currency.xml [junit4:junit4] 2> 10376 T1563 oass.FileExchangeRateProvider.reload Reloa= ding exchange rates from file currency.xml [junit4:junit4] 2> 10381 T1563 oass.OpenExchangeRatesOrgProvider.reload R= eloading exchange rates from open-exchange-rates.json [junit4:junit4] 2> 10382 T1563 oass.OpenExchangeRatesOrgProvider$OpenExch= angeRates. WARNING Unknown key IMPORTANT NOTE [junit4:junit4] 2> 10382 T1563 oass.OpenExchangeRatesOrgProvider$OpenExch= angeRates. WARNING Expected key, got STRING [junit4:junit4] 2> 10382 T1563 oass.OpenExchangeRatesOrgProvider.reload R= eloading exchange rates from open-exchange-rates.json [junit4:junit4] 2> 10384 T1563 oass.OpenExchangeRatesOrgProvider$OpenExch= angeRates. WARNING Unknown key IMPORTANT NOTE [junit4:junit4] 2> 10384 T1563 oass.OpenExchangeRatesOrgProvider$OpenExch= angeRates. WARNING Expected key, got STRING [junit4:junit4] 2> 10385 T1563 oasc.SolrCore.initDirectoryFactory org.apa= che.solr.core.MockDirectoryFactory [junit4:junit4] 2> 10385 T1563 oasc.SolrCore. [collection1] Opening= new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nightl= yTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSlice= Test-jetty2-1363072320643/collection1/, dataDir=3D./org.apache.solr.cloud.S= yncSliceTest-1363072312423/jetty2/ [junit4:junit4] 2> 10385 T1563 oasc.JmxMonitoredMap. JMX monitoring= is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxM= BeanServer@1e81a197 [junit4:junit4] 2> 10386 T1563 oasc.SolrCore.initDirectoryFactory org.apa= che.solr.core.MockDirectoryFactory [junit4:junit4] 2> 10387 T1563 oasc.CachingDirectoryFactory.get return ne= w directory for ./org.apache.solr.cloud.SyncSliceTest-1363072312423/jetty2 = forceNew: false [junit4:junit4] 2> 10388 T1563 oasc.SolrCore.getNewIndexDir New index dir= ectory detected: old=3Dnull new=3D./org.apache.solr.cloud.SyncSliceTest-136= 3072312423/jetty2/index/ [junit4:junit4] 2> 10388 T1563 oasc.SolrCore.initIndex WARNING [collectio= n1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-13630723124= 23/jetty2/index' doesn't exist. Creating new index... [junit4:junit4] 2> 10390 T1563 oasc.CachingDirectoryFactory.get return ne= w directory for ./org.apache.solr.cloud.SyncSliceTest-1363072312423/jetty2/= index forceNew: false [junit4:junit4] 2> 10409 T1563 oasc.SolrDeletionPolicy.onCommit SolrDelet= ionPolicy.onCommit: commits:num=3D1 [junit4:junit4] 2> =09=09commit{dir=3DMockDirWrapper(org.apache.lucene.st= ore.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nigh= tlyTests-trunk/solr/build/solr-core/test/J0/index1292012941tmp lockFactory= =3Dorg.apache.lucene.store.NativeFSLockFactory@788f35da),segFN=3Dsegments_1= ,generation=3D1,filenames=3D[segments_1] [junit4:junit4] 2> 10410 T1563 oasc.SolrDeletionPolicy.updateCommits newe= st commit =3D 1[segments_1] [junit4:junit4] 2> 10412 T1563 oasup.UpdateRequestProcessorChain.init ins= erting DistributedUpdateProcessorFactory into updateRequestProcessorChain "= dedupe" [junit4:junit4] 2> 10412 T1563 oasup.UpdateRequestProcessorChain.init ins= erting DistributedUpdateProcessorFactory into updateRequestProcessorChain "= stored_sig" [junit4:junit4] 2> 10413 T1563 oasup.UpdateRequestProcessorChain.init ins= erting DistributedUpdateProcessorFactory into updateRequestProcessorChain "= distrib-dup-test-chain-implicit" [junit4:junit4] 2> 10414 T1563 oasc.RequestHandlers.initHandlersFromConfi= g created standard: solr.StandardRequestHandler [junit4:junit4] 2> 10414 T1563 oasc.RequestHandlers.initHandlersFromConfi= g created /get: solr.RealTimeGetHandler [junit4:junit4] 2> 10414 T1563 oasc.RequestHandlers.initHandlersFromConfi= g adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 2> 10415 T1563 oasc.RequestHandlers.initHandlersFromConfi= g created /replication: solr.ReplicationHandler [junit4:junit4] 2> 10415 T1563 oasc.RequestHandlers.initHandlersFromConfi= g created /update: solr.UpdateRequestHandler [junit4:junit4] 2> 10416 T1563 oasc.RequestHandlers.initHandlersFromConfi= g created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4:junit4] 2> 10423 T1563 oashl.XMLLoader.init xsltCacheLifetimeSeco= nds=3D60 [junit4:junit4] 2> 10430 T1563 oass.SolrIndexSearcher. Opening Sear= cher@15a20a12 main [junit4:junit4] 2> 10430 T1563 oasu.UpdateHandler.clearLog Clearing tlog = files, tlogDir=3D./org.apache.solr.cloud.SyncSliceTest-1363072312423/jetty2= /tlog [junit4:junit4] 2> 10431 T1563 oasu.CommitTracker. Hard AutoCommit:= disabled [junit4:junit4] 2> 10431 T1563 oasu.CommitTracker. Soft AutoCommit:= disabled [junit4:junit4] 2> 10436 T1564 oasc.SolrCore.registerSearcher [collection= 1] Registered new searcher Searcher@15a20a12 main{StandardDirectoryReader(s= egments_1:1)} [junit4:junit4] 2> 10438 T1563 oasc.ZkController.publish publishing core= =3Dcollection1 state=3Ddown [junit4:junit4] 2> 10438 T1563 oasc.ZkController.publish numShards not fo= und on descriptor - reading it from system property [junit4:junit4] 2> 11225 T1527 oascc.ZkStateReader.updateClusterState Upd= ating cloud state from ZooKeeper...=20 [junit4:junit4] 2> 11225 T1527 oasc.Overseer$ClusterStateUpdater.updateSt= ate Update state numShards=3D1 message=3D{ [junit4:junit4] 2> =09 "operation":"state", [junit4:junit4] 2> =09 "core_node_name":null, [junit4:junit4] 2> =09 "numShards":"1", [junit4:junit4] 2> =09 "shard":null, [junit4:junit4] 2> =09 "roles":null, [junit4:junit4] 2> =09 "state":"down", [junit4:junit4] 2> =09 "core":"collection1", [junit4:junit4] 2> =09 "collection":"collection1", [junit4:junit4] 2> =09 "node_name":"127.0.0.1:31025_", [junit4:junit4] 2> =09 "base_url":"http://127.0.0.1:31025"} [junit4:junit4] 2> 11226 T1527 oasc.Overseer$ClusterStateUpdater.updateSt= ate Collection already exists with numShards=3D1 [junit4:junit4] 2> 11226 T1527 oasc.Overseer$ClusterStateUpdater.updateSt= ate Assigning new node to shard shard=3Dshard1 [junit4:junit4] 2> 11236 T1533 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 2> 11236 T1526 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 2> 11236 T1562 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 2> 11236 T1546 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 2> 11440 T1563 oasc.CoreContainer.registerCore registerin= g core: collection1 [junit4:junit4] 2> 11440 T1563 oasc.ZkController.register Register replic= a - core:collection1 address:http://127.0.0.1:31025 collection:collection1 = shard:shard1 [junit4:junit4] 2> 11444 T1563 oasc.ZkController.register We are http://1= 27.0.0.1:31025/collection1/ and leader is http://127.0.0.1:31017/collection= 1/ [junit4:junit4] 2> 11444 T1563 oasc.ZkController.register No LogReplay ne= eded for core=3Dcollection1 baseURL=3Dhttp://127.0.0.1:31025 [junit4:junit4] 2> 11444 T1563 oasc.ZkController.checkRecovery Core needs= to recover:collection1 [junit4:junit4] 2> 11445 T1563 oasu.DefaultSolrCoreState.doRecovery Runni= ng recovery - first canceling any ongoing recovery [junit4:junit4] 2> ASYNC NEW_CORE C63 name=3Dcollection1 org.apache.solr= .core.SolrCore@4727cfaa url=3Dhttp://127.0.0.1:31025/collection1 node=3D127= .0.0.1:31025_ C63_STATE=3Dcoll:collection1 core:collection1 props:{state=3D= down, core=3Dcollection1, collection=3Dcollection1, node_name=3D127.0.0.1:3= 1025_, base_url=3Dhttp://127.0.0.1:31025} [junit4:junit4] 2> 11445 T1565 C63 P31025 oasc.RecoveryStrategy.run Start= ing recovery process. core=3Dcollection1 recoveringAfterStartup=3Dtrue [junit4:junit4] 2> 11445 T1563 oascc.ZkStateReader.updateClusterState Upd= ating cloud state from ZooKeeper...=20 [junit4:junit4] 2> 11447 T1565 C63 P31025 oasc.RecoveryStrategy.doRecover= y ###### startupVersions=3D[] [junit4:junit4] 2> 11447 T1565 C63 P31025 oasc.ZkController.publish publi= shing core=3Dcollection1 state=3Drecovering [junit4:junit4] 2> 11447 T1565 C63 P31025 oasc.ZkController.publish numSh= ards not found on descriptor - reading it from system property [junit4:junit4] 2> 11448 T1504 oass.SolrDispatchFilter.init user.dir=3D/u= sr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/b= uild/solr-core/test/J0 [junit4:junit4] 2> 11448 T1504 oass.SolrDispatchFilter.init SolrDispatchF= ilter.init() done [junit4:junit4] 2> 11449 T1504 oascsi.HttpClientUtil.createClient Creatin= g new http client, config:maxConnections=3D128&maxConnectionsPerHost=3D32&f= ollowRedirects=3Dfalse [junit4:junit4] 2> 11456 T1565 C63 P31025 oascsi.HttpClientUtil.createCli= ent Creating new http client, config:maxConnections=3D128&maxConnectionsPer= Host=3D32&followRedirects=3Dfalse [junit4:junit4] 2> 11706 T1504 oejs.Server.doStart jetty-8.1.8.v20121106 [junit4:junit4] 2> 11709 T1504 oejs.AbstractConnector.doStart Started Soc= ketConnector@127.0.0.1:31029 [junit4:junit4] 2> 11710 T1504 oass.SolrDispatchFilter.init SolrDispatchF= ilter.init() [junit4:junit4] 2> 11710 T1504 oasc.SolrResourceLoader.locateSolrHome JND= I not configured for solr (NoInitialContextEx) [junit4:junit4] 2> 11711 T1504 oasc.SolrResourceLoader.locateSolrHome usi= ng system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/= Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.so= lr.cloud.SyncSliceTest-jetty3-1363072323896 [junit4:junit4] 2> 11711 T1504 oasc.CoreContainer$Initializer.initialize = looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucen= e-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cl= oud.SyncSliceTest-jetty3-1363072323896/solr.xml [junit4:junit4] 2> 11712 T1504 oasc.CoreContainer. New CoreContaine= r 819097921 [junit4:junit4] 2> 11712 T1504 oasc.CoreContainer.load Loading CoreContai= ner using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-N= ightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.Sync= SliceTest-jetty3-1363072323896/' [junit4:junit4] 2> 11713 T1504 oasc.SolrResourceLoader. new SolrRes= ourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-= Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.clou= d.SyncSliceTest-jetty3-1363072323896/' [junit4:junit4] 2> 11765 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting socketTimeout to: 120000 [junit4:junit4] 2> 11766 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting urlScheme to: http:// [junit4:junit4] 2> 11766 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting connTimeout to: 15000 [junit4:junit4] 2> 11767 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting maxConnectionsPerHost to: 20 [junit4:junit4] 2> 11767 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting corePoolSize to: 0 [junit4:junit4] 2> 11768 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting maximumPoolSize to: 2147483647 [junit4:junit4] 2> 11768 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting maxThreadIdleTime to: 5 [junit4:junit4] 2> 11769 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting sizeOfQueue to: -1 [junit4:junit4] 2> 11769 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting fairnessPolicy to: false [junit4:junit4] 2> 11769 T1504 oascsi.HttpClientUtil.createClient Creatin= g new http client, config:maxConnectionsPerHost=3D20&maxConnections=3D10000= &socketTimeout=3D120000&connTimeout=3D15000&retry=3Dfalse [junit4:junit4] 2> 11792 T1504 oasc.CoreContainer.load Registering Log Li= stener [junit4:junit4] 2> 11812 T1504 oasc.CoreContainer.initZooKeeper Zookeeper= client=3D127.0.0.1:31008/solr [junit4:junit4] 2> 11812 T1504 oasc.ZkController.checkChrootPath zkHost i= ncludes chroot [junit4:junit4] 2> 11813 T1504 oaz.ZooKeeper. Initiating client con= nection, connectString=3D127.0.0.1:31008 sessionTimeout=3D60000 watcher=3Do= rg.apache.solr.common.cloud.ConnectionManager@66875ca9 [junit4:junit4] 2> 11814 T1504 oascc.ConnectionManager.waitForConnected W= aiting for client to connect to ZooKeeper [junit4:junit4] 2> 11814 T1576 oaz.ClientCnxn$SendThread.logStartConnect = Opening socket connection to server localhost/127.0.0.1:31008. Will not att= empt to authenticate using SASL (access denied (javax.security.auth.AuthPer= mission getLoginConfiguration)) [junit4:junit4] 2> 11815 T1576 oaz.ClientCnxn$SendThread.primeConnection = Socket connection established to localhost/127.0.0.1:31008, initiating sess= ion [junit4:junit4] 2> 11815 T1506 oazs.NIOServerCnxnFactory.run Accepted soc= ket connection from /140.211.11.196:31030 [junit4:junit4] 2> 11816 T1506 oazs.ZooKeeperServer.processConnectRequest= Client attempting to establish new session at /140.211.11.196:31030 [junit4:junit4] 2> 11817 T1508 oazs.ZooKeeperServer.finishSessionInit Est= ablished session 0x13d5d70e46d0009 with negotiated timeout 20000 for client= /140.211.11.196:31030 [junit4:junit4] 2> 11817 T1576 oaz.ClientCnxn$SendThread.onConnected Sess= ion establishment complete on server localhost/127.0.0.1:31008, sessionid = =3D 0x13d5d70e46d0009, negotiated timeout =3D 20000 [junit4:junit4] 2> 11817 T1577 oascc.ConnectionManager.process Watcher or= g.apache.solr.common.cloud.ConnectionManager@66875ca9 name:ZooKeeperConnect= ion Watcher:127.0.0.1:31008 got event WatchedEvent state:SyncConnected type= :None path:null path:null type:None [junit4:junit4] 2> 11818 T1504 oascc.ConnectionManager.waitForConnected C= lient is connected to ZooKeeper [junit4:junit4] 2> 11819 T1509 oazs.PrepRequestProcessor.pRequest2Txn Pro= cessed session termination for sessionid: 0x13d5d70e46d0009 [junit4:junit4] 2> 11820 T1577 oaz.ClientCnxn$EventThread.run EventThread= shut down [junit4:junit4] 2> 11820 T1506 oazs.NIOServerCnxn.closeSock Closed socket= connection for client /140.211.11.196:31030 which had sessionid 0x13d5d70e= 46d0009 [junit4:junit4] 2> 11820 T1504 oaz.ZooKeeper.close Session: 0x13d5d70e46d= 0009 closed [junit4:junit4] 2> 11820 T1504 oascsi.HttpClientUtil.createClient Creatin= g new http client, config:maxConnections=3D500&maxConnectionsPerHost=3D16&s= ocketTimeout=3D120000&connTimeout=3D15000 [junit4:junit4] 2> 11833 T1504 oaz.ZooKeeper. Initiating client con= nection, connectString=3D127.0.0.1:31008/solr sessionTimeout=3D30000 watche= r=3Dorg.apache.solr.common.cloud.ConnectionManager@2f810452 [junit4:junit4] 2> 11834 T1504 oascc.ConnectionManager.waitForConnected W= aiting for client to connect to ZooKeeper [junit4:junit4] 2> 11834 T1578 oaz.ClientCnxn$SendThread.logStartConnect = Opening socket connection to server localhost/127.0.0.1:31008. Will not att= empt to authenticate using SASL (access denied (javax.security.auth.AuthPer= mission getLoginConfiguration)) [junit4:junit4] 2> 11834 T1578 oaz.ClientCnxn$SendThread.primeConnection = Socket connection established to localhost/127.0.0.1:31008, initiating sess= ion [junit4:junit4] 2> 11835 T1506 oazs.NIOServerCnxnFactory.run Accepted soc= ket connection from /140.211.11.196:31031 [junit4:junit4] 2> 11835 T1506 oazs.ZooKeeperServer.processConnectRequest= Client attempting to establish new session at /140.211.11.196:31031 [junit4:junit4] 2> 11839 T1508 oazs.ZooKeeperServer.finishSessionInit Est= ablished session 0x13d5d70e46d000a with negotiated timeout 20000 for client= /140.211.11.196:31031 [junit4:junit4] 2> 11839 T1578 oaz.ClientCnxn$SendThread.onConnected Sess= ion establishment complete on server localhost/127.0.0.1:31008, sessionid = =3D 0x13d5d70e46d000a, negotiated timeout =3D 20000 [junit4:junit4] 2> 11840 T1579 oascc.ConnectionManager.process Watcher or= g.apache.solr.common.cloud.ConnectionManager@2f810452 name:ZooKeeperConnect= ion Watcher:127.0.0.1:31008/solr got event WatchedEvent state:SyncConnected= type:None path:null path:null type:None [junit4:junit4] 2> 11840 T1504 oascc.ConnectionManager.waitForConnected C= lient is connected to ZooKeeper [junit4:junit4] 2> 11841 T1509 oazs.PrepRequestProcessor.pRequest Got use= r-level KeeperException when processing sessionid:0x13d5d70e46d000a type:cr= eate cxid:0x1 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Er= ror:KeeperErrorCode =3D NodeExists for /solr/overseer [junit4:junit4] 2> 11847 T1509 oazs.PrepRequestProcessor.pRequest Got use= r-level KeeperException when processing sessionid:0x13d5d70e46d000a type:cr= eate cxid:0x2 zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Er= ror:KeeperErrorCode =3D NodeExists for /solr/overseer [junit4:junit4] 2> 11859 T1504 oascc.ZkStateReader.createClusterStateWatc= hersAndUpdate Updating cluster state from ZooKeeper...=20 [junit4:junit4] 2> 12746 T1527 oascc.ZkStateReader.updateClusterState Upd= ating cloud state from ZooKeeper...=20 [junit4:junit4] 2> 12747 T1527 oasc.Overseer$ClusterStateUpdater.updateSt= ate Update state numShards=3D1 message=3D{ [junit4:junit4] 2> =09 "operation":"state", [junit4:junit4] 2> =09 "core_node_name":null, [junit4:junit4] 2> =09 "numShards":"1", [junit4:junit4] 2> =09 "shard":"shard1", [junit4:junit4] 2> =09 "roles":null, [junit4:junit4] 2> =09 "state":"recovering", [junit4:junit4] 2> =09 "core":"collection1", [junit4:junit4] 2> =09 "collection":"collection1", [junit4:junit4] 2> =09 "node_name":"127.0.0.1:31025_", [junit4:junit4] 2> =09 "base_url":"http://127.0.0.1:31025"} [junit4:junit4] 2> 12762 T1579 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 2> 12762 T1562 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 2> 12762 T1533 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 2> 12762 T1526 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 2> 12762 T1546 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 2> 12862 T1504 oasc.ZkController.createEphemeralLiveNode = Register node as live in ZooKeeper:/live_nodes/127.0.0.1:31029_ [junit4:junit4] 2> 12863 T1509 oazs.PrepRequestProcessor.pRequest Got use= r-level KeeperException when processing sessionid:0x13d5d70e46d000a type:de= lete cxid:0xd zxid:0x87 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/= 127.0.0.1:31029_ Error:KeeperErrorCode =3D NoNode for /solr/live_nodes/127.= 0.0.1:31029_ [junit4:junit4] 2> 12864 T1504 oascc.SolrZkClient.makePath makePath: /liv= e_nodes/127.0.0.1:31029_ [junit4:junit4] 2> 12867 T1533 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:= /live_nodes, has occurred - updating... (live nodes size: 3) [junit4:junit4] 2> 12867 T1546 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:= /live_nodes, has occurred - updating... (live nodes size: 3) [junit4:junit4] 2> 12867 T1526 oascc.ZkStateReader$3.process Updating liv= e nodes... (4) [junit4:junit4] 2> 12867 T1562 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:= /live_nodes, has occurred - updating... (live nodes size: 3) [junit4:junit4] 2> 12867 T1579 oascc.ZkStateReader$3.process Updating liv= e nodes... (4) [junit4:junit4] 2> 12867 T1526 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:= /live_nodes, has occurred - updating... (live nodes size: 4) [junit4:junit4] 2> 12868 T1579 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:= /live_nodes, has occurred - updating... (live nodes size: 4) [junit4:junit4] 2> 12869 T1533 oascc.ZkStateReader$3.process Updating liv= e nodes... (4) [junit4:junit4] 2> 12869 T1546 oascc.ZkStateReader$3.process Updating liv= e nodes... (4) [junit4:junit4] 2> 12875 T1562 oascc.ZkStateReader$3.process Updating liv= e nodes... (4) [junit4:junit4] 2> 12881 T1580 oasc.CoreContainer.create Creating SolrCor= e 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/= Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.so= lr.cloud.SyncSliceTest-jetty3-1363072323896/collection1 [junit4:junit4] 2> 12881 T1580 oasc.ZkController.createCollectionZkNode C= heck for collection zkNode:collection1 [junit4:junit4] 2> 12882 T1580 oasc.ZkController.createCollectionZkNode C= ollection zkNode exists [junit4:junit4] 2> 12882 T1580 oasc.ZkController.readConfigName Load coll= ection config from:/collections/collection1 [junit4:junit4] 2> 12883 T1580 oasc.SolrResourceLoader. new SolrRes= ourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-= Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.clou= d.SyncSliceTest-jetty3-1363072323896/collection1/' [junit4:junit4] 2> 12884 T1580 oasc.SolrResourceLoader.replaceClassLoader= Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTe= sts-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-= jetty3-1363072323896/collection1/lib/README' to classloader [junit4:junit4] 2> 12885 T1580 oasc.SolrResourceLoader.replaceClassLoader= Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTe= sts-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-= jetty3-1363072323896/collection1/lib/classes/' to classloader [junit4:junit4] 2> 12937 T1580 oasc.SolrConfig. Using Lucene MatchV= ersion: LUCENE_50 [junit4:junit4] 2> 12998 T1580 oasc.SolrConfig. Loaded SolrConfig: = solrconfig.xml [junit4:junit4] 2> 13000 T1580 oass.IndexSchema.readSchema Reading Solr S= chema [junit4:junit4] 2> 13006 T1580 oass.IndexSchema.readSchema Schema name=3D= test [junit4:junit4] 2> 13479 T1536 oass.SolrDispatchFilter.handleAdminRequest= /admin/cores {coreNodeName=3D127.0.0.1:31025__collection1&state=3Drecoveri= ng&nodeName=3D127.0.0.1:31025_&action=3DPREPRECOVERY&checkLive=3Dtrue&core= =3Dcollection1&wt=3Djavabin&onlyIfLeader=3Dtrue&version=3D2} status=3D0 QTi= me=3D2002=20 [junit4:junit4] 2> 13598 T1580 oass.OpenExchangeRatesOrgProvider.init Ini= tialized with rates=3Dopen-exchange-rates.json, refreshInterval=3D1440. [junit4:junit4] 2> 13606 T1580 oass.IndexSchema.readSchema default search= field in schema is text [junit4:junit4] 2> 13609 T1580 oass.IndexSchema.readSchema unique key fie= ld: id [junit4:junit4] 2> 13620 T1580 oass.FileExchangeRateProvider.reload Reloa= ding exchange rates from file currency.xml [junit4:junit4] 2> 13624 T1580 oass.FileExchangeRateProvider.reload Reloa= ding exchange rates from file currency.xml [junit4:junit4] 2> 13627 T1580 oass.OpenExchangeRatesOrgProvider.reload R= eloading exchange rates from open-exchange-rates.json [junit4:junit4] 2> 13627 T1580 oass.OpenExchangeRatesOrgProvider$OpenExch= angeRates. WARNING Unknown key IMPORTANT NOTE [junit4:junit4] 2> 13628 T1580 oass.OpenExchangeRatesOrgProvider$OpenExch= angeRates. WARNING Expected key, got STRING [junit4:junit4] 2> 13628 T1580 oass.OpenExchangeRatesOrgProvider.reload R= eloading exchange rates from open-exchange-rates.json [junit4:junit4] 2> 13630 T1580 oass.OpenExchangeRatesOrgProvider$OpenExch= angeRates. WARNING Unknown key IMPORTANT NOTE [junit4:junit4] 2> 13630 T1580 oass.OpenExchangeRatesOrgProvider$OpenExch= angeRates. WARNING Expected key, got STRING [junit4:junit4] 2> 13630 T1580 oasc.SolrCore.initDirectoryFactory org.apa= che.solr.core.MockDirectoryFactory [junit4:junit4] 2> 13631 T1580 oasc.SolrCore. [collection1] Opening= new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nightl= yTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSlice= Test-jetty3-1363072323896/collection1/, dataDir=3D./org.apache.solr.cloud.S= yncSliceTest-1363072312423/jetty3/ [junit4:junit4] 2> 13631 T1580 oasc.JmxMonitoredMap. JMX monitoring= is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxM= BeanServer@1e81a197 [junit4:junit4] 2> 13631 T1580 oasc.SolrCore.initDirectoryFactory org.apa= che.solr.core.MockDirectoryFactory [junit4:junit4] 2> 13632 T1580 oasc.CachingDirectoryFactory.get return ne= w directory for ./org.apache.solr.cloud.SyncSliceTest-1363072312423/jetty3 = forceNew: false [junit4:junit4] 2> 13633 T1580 oasc.SolrCore.getNewIndexDir New index dir= ectory detected: old=3Dnull new=3D./org.apache.solr.cloud.SyncSliceTest-136= 3072312423/jetty3/index/ [junit4:junit4] 2> 13633 T1580 oasc.SolrCore.initIndex WARNING [collectio= n1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-13630723124= 23/jetty3/index' doesn't exist. Creating new index... [junit4:junit4] 2> 13634 T1580 oasc.CachingDirectoryFactory.get return ne= w directory for ./org.apache.solr.cloud.SyncSliceTest-1363072312423/jetty3/= index forceNew: false [junit4:junit4] 2> 13652 T1580 oasc.SolrDeletionPolicy.onCommit SolrDelet= ionPolicy.onCommit: commits:num=3D1 [junit4:junit4] 2> =09=09commit{dir=3DMockDirWrapper(org.apache.lucene.st= ore.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nigh= tlyTests-trunk/solr/build/solr-core/test/J0/index1292012943tmp lockFactory= =3Dorg.apache.lucene.store.NativeFSLockFactory@480d93a1),segFN=3Dsegments_1= ,generation=3D1,filenames=3D[segments_1] [junit4:junit4] 2> 13652 T1580 oasc.SolrDeletionPolicy.updateCommits newe= st commit =3D 1[segments_1] [junit4:junit4] 2> 13654 T1580 oasup.UpdateRequestProcessorChain.init ins= erting DistributedUpdateProcessorFactory into updateRequestProcessorChain "= dedupe" [junit4:junit4] 2> 13654 T1580 oasup.UpdateRequestProcessorChain.init ins= erting DistributedUpdateProcessorFactory into updateRequestProcessorChain "= stored_sig" [junit4:junit4] 2> 13654 T1580 oasup.UpdateRequestProcessorChain.init ins= erting DistributedUpdateProcessorFactory into updateRequestProcessorChain "= distrib-dup-test-chain-implicit" [junit4:junit4] 2> 13655 T1580 oasc.RequestHandlers.initHandlersFromConfi= g created standard: solr.StandardRequestHandler [junit4:junit4] 2> 13655 T1580 oasc.RequestHandlers.initHandlersFromConfi= g created /get: solr.RealTimeGetHandler [junit4:junit4] 2> 13655 T1580 oasc.RequestHandlers.initHandlersFromConfi= g adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 2> 13656 T1580 oasc.RequestHandlers.initHandlersFromConfi= g created /replication: solr.ReplicationHandler [junit4:junit4] 2> 13656 T1580 oasc.RequestHandlers.initHandlersFromConfi= g created /update: solr.UpdateRequestHandler [junit4:junit4] 2> 13656 T1580 oasc.RequestHandlers.initHandlersFromConfi= g created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4:junit4] 2> 13663 T1580 oashl.XMLLoader.init xsltCacheLifetimeSeco= nds=3D60 [junit4:junit4] 2> 13671 T1580 oass.SolrIndexSearcher. Opening Sear= cher@7b0c2fa main [junit4:junit4] 2> 13671 T1580 oasu.UpdateHandler.clearLog Clearing tlog = files, tlogDir=3D./org.apache.solr.cloud.SyncSliceTest-1363072312423/jetty3= /tlog [junit4:junit4] 2> 13672 T1580 oasu.CommitTracker. Hard AutoCommit:= disabled [junit4:junit4] 2> 13672 T1580 oasu.CommitTracker. Soft AutoCommit:= disabled [junit4:junit4] 2> 13675 T1581 oasc.SolrCore.registerSearcher [collection= 1] Registered new searcher Searcher@7b0c2fa main{StandardDirectoryReader(se= gments_1:1)} [junit4:junit4] 2> 13676 T1580 oasc.ZkController.publish publishing core= =3Dcollection1 state=3Ddown [junit4:junit4] 2> 13676 T1580 oasc.ZkController.publish numShards not fo= und on descriptor - reading it from system property [junit4:junit4] 2> 14267 T1527 oascc.ZkStateReader.updateClusterState Upd= ating cloud state from ZooKeeper...=20 [junit4:junit4] 2> 14268 T1527 oasc.Overseer$ClusterStateUpdater.updateSt= ate Update state numShards=3D1 message=3D{ [junit4:junit4] 2> =09 "operation":"state", [junit4:junit4] 2> =09 "core_node_name":null, [junit4:junit4] 2> =09 "numShards":"1", [junit4:junit4] 2> =09 "shard":null, [junit4:junit4] 2> =09 "roles":null, [junit4:junit4] 2> =09 "state":"down", [junit4:junit4] 2> =09 "core":"collection1", [junit4:junit4] 2> =09 "collection":"collection1", [junit4:junit4] 2> =09 "node_name":"127.0.0.1:31029_", [junit4:junit4] 2> =09 "base_url":"http://127.0.0.1:31029"} [junit4:junit4] 2> 14268 T1527 oasc.Overseer$ClusterStateUpdater.updateSt= ate Collection already exists with numShards=3D1 [junit4:junit4] 2> 14268 T1527 oasc.Overseer$ClusterStateUpdater.updateSt= ate Assigning new node to shard shard=3Dshard1 [junit4:junit4] 2> 14295 T1526 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 2> 14295 T1533 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 2> 14295 T1579 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 2> 14295 T1546 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 2> 14295 T1562 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 2> 14679 T1580 oasc.CoreContainer.registerCore registerin= g core: collection1 [junit4:junit4] 2> 14679 T1580 oasc.ZkController.register Register replic= a - core:collection1 address:http://127.0.0.1:31029 collection:collection1 = shard:shard1 [junit4:junit4] 2> 14686 T1580 oasc.ZkController.register We are http://1= 27.0.0.1:31029/collection1/ and leader is http://127.0.0.1:31017/collection= 1/ [junit4:junit4] 2> 14686 T1580 oasc.ZkController.register No LogReplay ne= eded for core=3Dcollection1 baseURL=3Dhttp://127.0.0.1:31029 [junit4:junit4] 2> 14686 T1580 oasc.ZkController.checkRecovery Core needs= to recover:collection1 [junit4:junit4] 2> 14687 T1580 oasu.DefaultSolrCoreState.doRecovery Runni= ng recovery - first canceling any ongoing recovery [junit4:junit4] 2> ASYNC NEW_CORE C64 name=3Dcollection1 org.apache.solr= .core.SolrCore@1750a5f7 url=3Dhttp://127.0.0.1:31029/collection1 node=3D127= .0.0.1:31029_ C64_STATE=3Dcoll:collection1 core:collection1 props:{state=3D= down, core=3Dcollection1, collection=3Dcollection1, node_name=3D127.0.0.1:3= 1029_, base_url=3Dhttp://127.0.0.1:31029} [junit4:junit4] 2> 14687 T1582 C64 P31029 oasc.RecoveryStrategy.run Start= ing recovery process. core=3Dcollection1 recoveringAfterStartup=3Dtrue [junit4:junit4] 2> 14688 T1582 C64 P31029 oasc.RecoveryStrategy.doRecover= y ###### startupVersions=3D[] [junit4:junit4] 2> 14688 T1582 C64 P31029 oasc.ZkController.publish publi= shing core=3Dcollection1 state=3Drecovering [junit4:junit4] 2> 14688 T1580 oascc.ZkStateReader.updateClusterState Upd= ating cloud state from ZooKeeper...=20 [junit4:junit4] 2> 14689 T1582 C64 P31029 oasc.ZkController.publish numSh= ards not found on descriptor - reading it from system property [junit4:junit4] 2> 14690 T1504 oass.SolrDispatchFilter.init user.dir=3D/u= sr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/b= uild/solr-core/test/J0 [junit4:junit4] 2> 14690 T1582 C64 P31029 oascsi.HttpClientUtil.createCli= ent Creating new http client, config:maxConnections=3D128&maxConnectionsPer= Host=3D32&followRedirects=3Dfalse [junit4:junit4] 2> 14690 T1504 oass.SolrDispatchFilter.init SolrDispatchF= ilter.init() done [junit4:junit4] 2> 14691 T1504 oascsi.HttpClientUtil.createClient Creatin= g new http client, config:maxConnections=3D128&maxConnectionsPerHost=3D32&f= ollowRedirects=3Dfalse [junit4:junit4] 2> 14920 T1504 oejs.Server.doStart jetty-8.1.8.v20121106 [junit4:junit4] 2> 14923 T1504 oejs.AbstractConnector.doStart Started Soc= ketConnector@127.0.0.1:31033 [junit4:junit4] 2> 14923 T1504 oass.SolrDispatchFilter.init SolrDispatchF= ilter.init() [junit4:junit4] 2> 14924 T1504 oasc.SolrResourceLoader.locateSolrHome JND= I not configured for solr (NoInitialContextEx) [junit4:junit4] 2> 14924 T1504 oasc.SolrResourceLoader.locateSolrHome usi= ng system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/= Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.so= lr.cloud.SyncSliceTest-jetty4-1363072327131 [junit4:junit4] 2> 14925 T1504 oasc.CoreContainer$Initializer.initialize = looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucen= e-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cl= oud.SyncSliceTest-jetty4-1363072327131/solr.xml [junit4:junit4] 2> 14925 T1504 oasc.CoreContainer. New CoreContaine= r 1213014267 [junit4:junit4] 2> 14926 T1504 oasc.CoreContainer.load Loading CoreContai= ner using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-N= ightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.Sync= SliceTest-jetty4-1363072327131/' [junit4:junit4] 2> 14926 T1504 oasc.SolrResourceLoader. new SolrRes= ourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-= Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.clou= d.SyncSliceTest-jetty4-1363072327131/' [junit4:junit4] 2> 14982 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting socketTimeout to: 120000 [junit4:junit4] 2> 14983 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting urlScheme to: http:// [junit4:junit4] 2> 14983 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting connTimeout to: 15000 [junit4:junit4] 2> 14983 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting maxConnectionsPerHost to: 20 [junit4:junit4] 2> 14984 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting corePoolSize to: 0 [junit4:junit4] 2> 14984 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting maximumPoolSize to: 2147483647 [junit4:junit4] 2> 14985 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting maxThreadIdleTime to: 5 [junit4:junit4] 2> 14985 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting sizeOfQueue to: -1 [junit4:junit4] 2> 14986 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting fairnessPolicy to: false [junit4:junit4] 2> 14986 T1504 oascsi.HttpClientUtil.createClient Creatin= g new http client, config:maxConnectionsPerHost=3D20&maxConnections=3D10000= &socketTimeout=3D120000&connTimeout=3D15000&retry=3Dfalse [junit4:junit4] 2> 15007 T1504 oasc.CoreContainer.load Registering Log Li= stener [junit4:junit4] 2> 15033 T1504 oasc.CoreContainer.initZooKeeper Zookeeper= client=3D127.0.0.1:31008/solr [junit4:junit4] 2> 15034 T1504 oasc.ZkController.checkChrootPath zkHost i= ncludes chroot [junit4:junit4] 2> 15034 T1504 oaz.ZooKeeper. Initiating client con= nection, connectString=3D127.0.0.1:31008 sessionTimeout=3D60000 watcher=3Do= rg.apache.solr.common.cloud.ConnectionManager@5b884fed [junit4:junit4] 2> 15035 T1504 oascc.ConnectionManager.waitForConnected W= aiting for client to connect to ZooKeeper [junit4:junit4] 2> 15036 T1593 oaz.ClientCnxn$SendThread.logStartConnect = Opening socket connection to server localhost/127.0.0.1:31008. Will not att= empt to authenticate using SASL (access denied (javax.security.auth.AuthPer= mission getLoginConfiguration)) [junit4:junit4] 2> 15036 T1593 oaz.ClientCnxn$SendThread.primeConnection = Socket connection established to localhost/127.0.0.1:31008, initiating sess= ion [junit4:junit4] 2> 15037 T1506 oazs.NIOServerCnxnFactory.run Accepted soc= ket connection from /140.211.11.196:31034 [junit4:junit4] 2> 15037 T1506 oazs.ZooKeeperServer.processConnectRequest= Client attempting to establish new session at /140.211.11.196:31034 [junit4:junit4] 2> 15041 T1508 oazs.ZooKeeperServer.finishSessionInit Est= ablished session 0x13d5d70e46d000b with negotiated timeout 20000 for client= /140.211.11.196:31034 [junit4:junit4] 2> 15041 T1593 oaz.ClientCnxn$SendThread.onConnected Sess= ion establishment complete on server localhost/127.0.0.1:31008, sessionid = =3D 0x13d5d70e46d000b, negotiated timeout =3D 20000 [junit4:junit4] 2> 15042 T1594 oascc.ConnectionManager.process Watcher or= g.apache.solr.common.cloud.ConnectionManager@5b884fed name:ZooKeeperConnect= ion Watcher:127.0.0.1:31008 got event WatchedEvent state:SyncConnected type= :None path:null path:null type:None [junit4:junit4] 2> 15042 T1504 oascc.ConnectionManager.waitForConnected C= lient is connected to ZooKeeper [junit4:junit4] 2> 15043 T1509 oazs.PrepRequestProcessor.pRequest2Txn Pro= cessed session termination for sessionid: 0x13d5d70e46d000b [junit4:junit4] 2> 15044 T1594 oaz.ClientCnxn$EventThread.run EventThread= shut down [junit4:junit4] 2> 15044 T1506 oazs.NIOServerCnxn.closeSock Closed socket= connection for client /140.211.11.196:31034 which had sessionid 0x13d5d70e= 46d000b [junit4:junit4] 2> 15044 T1504 oaz.ZooKeeper.close Session: 0x13d5d70e46d= 000b closed [junit4:junit4] 2> 15045 T1504 oascsi.HttpClientUtil.createClient Creatin= g new http client, config:maxConnections=3D500&maxConnectionsPerHost=3D16&s= ocketTimeout=3D120000&connTimeout=3D15000 [junit4:junit4] 2> 15055 T1504 oaz.ZooKeeper. Initiating client con= nection, connectString=3D127.0.0.1:31008/solr sessionTimeout=3D30000 watche= r=3Dorg.apache.solr.common.cloud.ConnectionManager@357dea4e [junit4:junit4] 2> 15056 T1504 oascc.ConnectionManager.waitForConnected W= aiting for client to connect to ZooKeeper [junit4:junit4] 2> 15056 T1595 oaz.ClientCnxn$SendThread.logStartConnect = Opening socket connection to server localhost/127.0.0.1:31008. Will not att= empt to authenticate using SASL (access denied (javax.security.auth.AuthPer= mission getLoginConfiguration)) [junit4:junit4] 2> 15057 T1595 oaz.ClientCnxn$SendThread.primeConnection = Socket connection established to localhost/127.0.0.1:31008, initiating sess= ion [junit4:junit4] 2> 15057 T1506 oazs.NIOServerCnxnFactory.run Accepted soc= ket connection from /140.211.11.196:31035 [junit4:junit4] 2> 15057 T1506 oazs.ZooKeeperServer.processConnectRequest= Client attempting to establish new session at /140.211.11.196:31035 [junit4:junit4] 2> 15059 T1508 oazs.ZooKeeperServer.finishSessionInit Est= ablished session 0x13d5d70e46d000c with negotiated timeout 20000 for client= /140.211.11.196:31035 [junit4:junit4] 2> 15059 T1595 oaz.ClientCnxn$SendThread.onConnected Sess= ion establishment complete on server localhost/127.0.0.1:31008, sessionid = =3D 0x13d5d70e46d000c, negotiated timeout =3D 20000 [junit4:junit4] 2> 15059 T1596 oascc.ConnectionManager.process Watcher or= g.apache.solr.common.cloud.ConnectionManager@357dea4e name:ZooKeeperConnect= ion Watcher:127.0.0.1:31008/solr got event WatchedEvent state:SyncConnected= type:None path:null path:null type:None [junit4:junit4] 2> 15059 T1504 oascc.ConnectionManager.waitForConnected C= lient is connected to ZooKeeper [junit4:junit4] 2> 15060 T1509 oazs.PrepRequestProcessor.pRequest Got use= r-level KeeperException when processing sessionid:0x13d5d70e46d000c type:cr= eate cxid:0x1 zxid:0x94 txntype:-1 reqpath:n/a Error Path:/solr/overseer Er= ror:KeeperErrorCode =3D NodeExists for /solr/overseer [junit4:junit4] 2> 15061 T1509 oazs.PrepRequestProcessor.pRequest Got use= r-level KeeperException when processing sessionid:0x13d5d70e46d000c type:cr= eate cxid:0x2 zxid:0x95 txntype:-1 reqpath:n/a Error Path:/solr/overseer Er= ror:KeeperErrorCode =3D NodeExists for /solr/overseer [junit4:junit4] 2> 15070 T1504 oascc.ZkStateReader.createClusterStateWatc= hersAndUpdate Updating cluster state from ZooKeeper...=20 [junit4:junit4] 2> C63_STATE=3Dcoll:collection1 core:collection1 props:{= shard=3Dshard1, state=3Drecovering, core=3Dcollection1, collection=3Dcollec= tion1, node_name=3D127.0.0.1:31025_, base_url=3Dhttp://127.0.0.1:31025} [junit4:junit4] 2> 15481 T1565 C63 P31025 oasc.RecoveryStrategy.doRecover= y Attempting to PeerSync from http://127.0.0.1:31017/collection1/ core=3Dco= llection1 - recoveringAfterStartup=3Dtrue [junit4:junit4] 2> 15481 T1565 C63 P31025 oasu.PeerSync.sync PeerSync: co= re=3Dcollection1 url=3Dhttp://127.0.0.1:31025 START replicas=3D[http://127.= 0.0.1:31017/collection1/] nUpdates=3D100 [junit4:junit4] 2> 15481 T1565 C63 P31025 oasu.PeerSync.sync WARNING no f= rame of reference to tell of we've missed updates [junit4:junit4] 2> 15483 T1565 C63 P31025 oasc.RecoveryStrategy.doRecover= y PeerSync Recovery was not successful - trying replication. core=3Dcollect= ion1 [junit4:junit4] 2> 15483 T1565 C63 P31025 oasc.RecoveryStrategy.doRecover= y Starting Replication Recovery. core=3Dcollection1 [junit4:junit4] 2> 15483 T1565 C63 P31025 oasc.RecoveryStrategy.doRecover= y Begin buffering updates. core=3Dcollection1 [junit4:junit4] 2> 15483 T1565 C63 P31025 oasu.UpdateLog.bufferUpdates St= arting to buffer updates. FSUpdateLog{state=3DACTIVE, tlog=3Dnull} [junit4:junit4] 2> 15483 T1565 C63 P31025 oasc.RecoveryStrategy.replicate= Attempting to replicate from http://127.0.0.1:31017/collection1/. core=3Dc= ollection1 [junit4:junit4] 2> 15483 T1565 C63 P31025 oascsi.HttpClientUtil.createCli= ent Creating new http client, config:maxConnections=3D128&maxConnectionsPer= Host=3D32&followRedirects=3Dfalse [junit4:junit4] 2> ASYNC NEW_CORE C65 name=3Dcollection1 org.apache.solr= .core.SolrCore@30185461 url=3Dhttp://127.0.0.1:31017/collection1 node=3D127= .0.0.1:31017_ C65_STATE=3Dcoll:collection1 core:collection1 props:{shard=3D= shard1, state=3Dactive, core=3Dcollection1, collection=3Dcollection1, node_= name=3D127.0.0.1:31017_, base_url=3Dhttp://127.0.0.1:31017, leader=3Dtrue} [junit4:junit4] 2> 15489 T1538 C65 P31017 REQ /get {getVersions=3D100&dis= trib=3Dfalse&wt=3Djavabin&qt=3D/get&version=3D2} status=3D0 QTime=3D0=20 [junit4:junit4] 2> 15495 T1539 C65 P31017 oasu.DirectUpdateHandler2.commi= t start commit{,optimize=3Dfalse,openSearcher=3Dfalse,waitSearcher=3Dtrue,e= xpungeDeletes=3Dfalse,softCommit=3Dfalse,prepareCommit=3Dfalse} [junit4:junit4] 2> 15499 T1539 C65 P31017 oasc.SolrDeletionPolicy.onInit = SolrDeletionPolicy.onInit: commits:num=3D1 [junit4:junit4] 2> =09=09commit{dir=3DMockDirWrapper(org.apache.lucene.st= ore.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nigh= tlyTests-trunk/solr/build/solr-core/test/J0/index1292012939tmp lockFactory= =3Dorg.apache.lucene.store.NativeFSLockFactory@72fef53c),segFN=3Dsegments_1= ,generation=3D1,filenames=3D[segments_1] [junit4:junit4] 2> 15500 T1539 C65 P31017 oasc.SolrDeletionPolicy.updateC= ommits newest commit =3D 1[segments_1] [junit4:junit4] 2> 15503 T1539 C65 P31017 oasc.SolrDeletionPolicy.onCommi= t SolrDeletionPolicy.onCommit: commits:num=3D2 [junit4:junit4] 2> =09=09commit{dir=3DMockDirWrapper(org.apache.lucene.st= ore.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nigh= tlyTests-trunk/solr/build/solr-core/test/J0/index1292012939tmp lockFactory= =3Dorg.apache.lucene.store.NativeFSLockFactory@72fef53c),segFN=3Dsegments_1= ,generation=3D1,filenames=3D[segments_1] [junit4:junit4] 2> =09=09commit{dir=3DMockDirWrapper(org.apache.lucene.st= ore.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nigh= tlyTests-trunk/solr/build/solr-core/test/J0/index1292012939tmp lockFactory= =3Dorg.apache.lucene.store.NativeFSLockFactory@72fef53c),segFN=3Dsegments_2= ,generation=3D2,filenames=3D[segments_2] [junit4:junit4] 2> 15503 T1539 C65 P31017 oasc.SolrDeletionPolicy.updateC= ommits newest commit =3D 2[segments_2] [junit4:junit4] 2> 15504 T1539 C65 P31017 oass.SolrIndexSearcher. O= pening Searcher@22e5f22d realtime [junit4:junit4] 2> 15505 T1539 C65 P31017 oasu.DirectUpdateHandler2.commi= t end_commit_flush [junit4:junit4] 2> 15505 T1539 C65 P31017 /update {waitSearcher=3Dtrue&op= enSearcher=3Dfalse&commit=3Dtrue&wt=3Djavabin&commit_end_point=3Dtrue&versi= on=3D2&softCommit=3Dfalse} {commit=3D} 0 10 [junit4:junit4] 2> 15506 T1565 C63 P31025 oash.ReplicationHandler.inform = Commits will be reserved for 10000 [junit4:junit4] 2> 15506 T1565 C63 P31025 oash.SnapPuller. No valu= e set for 'pollInterval'. Timer Task not started. [junit4:junit4] 2> 15508 T1540 C65 P31017 oash.ReplicationHandler.inform = Commits will be reserved for 10000 [junit4:junit4] 2> 15509 T1540 C65 P31017 REQ /replication {command=3Dind= exversion&qt=3D/replication&wt=3Djavabin&version=3D2} status=3D0 QTime=3D2= =20 [junit4:junit4] 2> 15509 T1565 C63 P31025 oash.SnapPuller.fetchLatestInde= x Master's generation: 2 [junit4:junit4] 2> 15510 T1565 C63 P31025 oash.SnapPuller.fetchLatestInde= x Slave's generation: 1 [junit4:junit4] 2> 15510 T1565 C63 P31025 oash.SnapPuller.fetchLatestInde= x Starting replication process [junit4:junit4] 2> 15513 T1540 C65 P31017 REQ /replication {command=3Dfil= elist&qt=3D/replication&wt=3Djavabin&generation=3D2&version=3D2} status=3D0= QTime=3D1=20 [junit4:junit4] 2> 15514 T1565 C63 P31025 oash.SnapPuller.fetchLatestInde= x Number of files in latest index in master: 1 [junit4:junit4] 2> 15516 T1565 C63 P31025 oasc.CachingDirectoryFactory.ge= t return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363072312= 423/jetty2/index.20130312071207934 forceNew: false [junit4:junit4] 2> 15517 T1565 C63 P31025 oash.SnapPuller.fetchLatestInde= x Starting download to MockDirWrapper(org.apache.lucene.store.SimpleFSDirec= tory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk= /solr/build/solr-core/test/J0/index1292012944tmp lockFactory=3Dorg.apache.l= ucene.store.NativeFSLockFactory@d9bce79) fullCopy=3Dfalse [junit4:junit4] 2> 15520 T1540 C65 P31017 REQ /replication {file=3Dsegmen= ts_2&command=3Dfilecontent&checksum=3Dtrue&wt=3Dfilestream&qt=3D/replicatio= n&generation=3D2} status=3D0 QTime=3D0=20 [junit4:junit4] 2> 15522 T1565 C63 P31025 oash.SnapPuller.fetchLatestInde= x Total time taken for download : 0 secs [junit4:junit4] 2> 15525 T1565 C63 P31025 oasu.DefaultSolrCoreState.newIn= dexWriter Creating new IndexWriter... [junit4:junit4] 2> 15525 T1565 C63 P31025 oasu.DefaultSolrCoreState.newIn= dexWriter Waiting until IndexWriter is unused... core=3Dcollection1 [junit4:junit4] 2> 15529 T1565 C63 P31025 oasc.SolrDeletionPolicy.onInit = SolrDeletionPolicy.onInit: commits:num=3D2 [junit4:junit4] 2> =09=09commit{dir=3DMockDirWrapper(org.apache.lucene.st= ore.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nigh= tlyTests-trunk/solr/build/solr-core/test/J0/index1292012941tmp lockFactory= =3Dorg.apache.lucene.store.NativeFSLockFactory@788f35da),segFN=3Dsegments_1= ,generation=3D1,filenames=3D[segments_1] [junit4:junit4] 2> =09=09commit{dir=3DMockDirWrapper(org.apache.lucene.st= ore.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nigh= tlyTests-trunk/solr/build/solr-core/test/J0/index1292012941tmp lockFactory= =3Dorg.apache.lucene.store.NativeFSLockFactory@788f35da),segFN=3Dsegments_2= ,generation=3D2,filenames=3D[segments_2] [junit4:junit4] 2> 15529 T1565 C63 P31025 oasc.SolrDeletionPolicy.updateC= ommits newest commit =3D 2[segments_2] [junit4:junit4] 2> 15530 T1565 C63 P31025 oasu.DefaultSolrCoreState.newIn= dexWriter New IndexWriter is ready to be used. [junit4:junit4] 2> 15530 T1565 C63 P31025 oass.SolrIndexSearcher. O= pening Searcher@4cb23b1c main [junit4:junit4] 2> 15532 T1564 oasc.SolrCore.registerSearcher [collection= 1] Registered new searcher Searcher@4cb23b1c main{StandardDirectoryReader(s= egments_2:1:nrt)} [junit4:junit4] 2> 15532 T1565 C63 P31025 oash.SnapPuller.fetchLatestInde= x removing temporary index download directory files MockDirWrapper(org.apac= he.lucene.store.SimpleFSDirectory@/usr/home/hudson/hudson-slave/workspace/L= ucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/index1292012944t= mp lockFactory=3Dorg.apache.lucene.store.NativeFSLockFactory@d9bce79) [junit4:junit4] 2> 15533 T1565 C63 P31025 oasc.RecoveryStrategy.replay No= replay needed. core=3Dcollection1 [junit4:junit4] 2> 15533 T1565 C63 P31025 oasc.RecoveryStrategy.doRecover= y Replication Recovery was successful - registering as Active. core=3Dcolle= ction1 [junit4:junit4] 2> 15533 T1565 C63 P31025 oasc.ZkController.publish publi= shing core=3Dcollection1 state=3Dactive [junit4:junit4] 2> 15533 T1565 C63 P31025 oasc.ZkController.publish numSh= ards not found on descriptor - reading it from system property [junit4:junit4] 2> 15535 T1565 C63 P31025 oasc.RecoveryStrategy.doRecover= y Finished recovery process. core=3Dcollection1 [junit4:junit4] 2> 15840 T1527 oascc.ZkStateReader.updateClusterState Upd= ating cloud state from ZooKeeper...=20 [junit4:junit4] 2> 15841 T1527 oasc.Overseer$ClusterStateUpdater.updateSt= ate Update state numShards=3D1 message=3D{ [junit4:junit4] 2> =09 "operation":"state", [junit4:junit4] 2> =09 "core_node_name":null, [junit4:junit4] 2> =09 "numShards":"1", [junit4:junit4] 2> =09 "shard":"shard1", [junit4:junit4] 2> =09 "roles":null, [junit4:junit4] 2> =09 "state":"recovering", [junit4:junit4] 2> =09 "core":"collection1", [junit4:junit4] 2> =09 "collection":"collection1", [junit4:junit4] 2> =09 "node_name":"127.0.0.1:31029_", [junit4:junit4] 2> =09 "base_url":"http://127.0.0.1:31029"} [junit4:junit4] 2> 15860 T1527 oasc.Overseer$ClusterStateUpdater.updateSt= ate Update state numShards=3D1 message=3D{ [junit4:junit4] 2> =09 "operation":"state", [junit4:junit4] 2> =09 "core_node_name":null, [junit4:junit4] 2> =09 "numShards":"1", [junit4:junit4] 2> =09 "shard":"shard1", [junit4:junit4] 2> =09 "roles":null, [junit4:junit4] 2> =09 "state":"active", [junit4:junit4] 2> =09 "core":"collection1", [junit4:junit4] 2> =09 "collection":"collection1", [junit4:junit4] 2> =09 "node_name":"127.0.0.1:31025_", [junit4:junit4] 2> =09 "base_url":"http://127.0.0.1:31025"} [junit4:junit4] 2> 15869 T1526 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 2> 15869 T1596 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 2> 15869 T1562 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 2> 15869 T1546 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 2> 15869 T1533 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 2> 15869 T1579 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 2> 16073 T1504 oasc.ZkController.createEphemeralLiveNode = Register node as live in ZooKeeper:/live_nodes/127.0.0.1:31033_ [junit4:junit4] 2> 16074 T1509 oazs.PrepRequestProcessor.pRequest Got use= r-level KeeperException when processing sessionid:0x13d5d70e46d000c type:de= lete cxid:0xd zxid:0x9e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/= 127.0.0.1:31033_ Error:KeeperErrorCode =3D NoNode for /solr/live_nodes/127.= 0.0.1:31033_ [junit4:junit4] 2> 16075 T1504 oascc.SolrZkClient.makePath makePath: /liv= e_nodes/127.0.0.1:31033_ [junit4:junit4] 2> 16077 T1533 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:= /live_nodes, has occurred - updating... (live nodes size: 4) [junit4:junit4] 2> 16077 T1562 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:= /live_nodes, has occurred - updating... (live nodes size: 4) [junit4:junit4] 2> 16077 T1546 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:= /live_nodes, has occurred - updating... (live nodes size: 4) [junit4:junit4] 2> 16078 T1596 oascc.ZkStateReader$3.process Updating liv= e nodes... (5) [junit4:junit4] 2> 16078 T1579 oascc.ZkStateReader$3.process Updating liv= e nodes... (5) [junit4:junit4] 2> 16078 T1596 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:= /live_nodes, has occurred - updating... (live nodes size: 5) [junit4:junit4] 2> 16078 T1526 oascc.ZkStateReader$3.process Updating liv= e nodes... (5) [junit4:junit4] 2> 16078 T1579 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:= /live_nodes, has occurred - updating... (live nodes size: 5) [junit4:junit4] 2> 16079 T1526 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:= /live_nodes, has occurred - updating... (live nodes size: 5) [junit4:junit4] 2> 16080 T1562 oascc.ZkStateReader$3.process Updating liv= e nodes... (5) [junit4:junit4] 2> 16080 T1546 oascc.ZkStateReader$3.process Updating liv= e nodes... (5) [junit4:junit4] 2> 16086 T1533 oascc.ZkStateReader$3.process Updating liv= e nodes... (5) [junit4:junit4] 2> 16094 T1599 oasc.CoreContainer.create Creating SolrCor= e 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/= Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.so= lr.cloud.SyncSliceTest-jetty4-1363072327131/collection1 [junit4:junit4] 2> 16094 T1599 oasc.ZkController.createCollectionZkNode C= heck for collection zkNode:collection1 [junit4:junit4] 2> 16095 T1599 oasc.ZkController.createCollectionZkNode C= ollection zkNode exists [junit4:junit4] 2> 16095 T1599 oasc.ZkController.readConfigName Load coll= ection config from:/collections/collection1 [junit4:junit4] 2> 16096 T1599 oasc.SolrResourceLoader. new SolrRes= ourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-= Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.clou= d.SyncSliceTest-jetty4-1363072327131/collection1/' [junit4:junit4] 2> 16097 T1599 oasc.SolrResourceLoader.replaceClassLoader= Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTe= sts-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-= jetty4-1363072327131/collection1/lib/README' to classloader [junit4:junit4] 2> 16098 T1599 oasc.SolrResourceLoader.replaceClassLoader= Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTe= sts-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-= jetty4-1363072327131/collection1/lib/classes/' to classloader [junit4:junit4] 2> 16172 T1599 oasc.SolrConfig. Using Lucene MatchV= ersion: LUCENE_50 [junit4:junit4] 2> 16231 T1599 oasc.SolrConfig. Loaded SolrConfig: = solrconfig.xml [junit4:junit4] 2> 16233 T1599 oass.IndexSchema.readSchema Reading Solr S= chema [junit4:junit4] 2> 16239 T1599 oass.IndexSchema.readSchema Schema name=3D= test [junit4:junit4] 2> 16714 T1537 oass.SolrDispatchFilter.handleAdminRequest= /admin/cores {coreNodeName=3D127.0.0.1:31029__collection1&state=3Drecoveri= ng&nodeName=3D127.0.0.1:31029_&action=3DPREPRECOVERY&checkLive=3Dtrue&core= =3Dcollection1&wt=3Djavabin&onlyIfLeader=3Dtrue&version=3D2} status=3D0 QTi= me=3D2002=20 [junit4:junit4] 2> 16892 T1599 oass.OpenExchangeRatesOrgProvider.init Ini= tialized with rates=3Dopen-exchange-rates.json, refreshInterval=3D1440. [junit4:junit4] 2> 16904 T1599 oass.IndexSchema.readSchema default search= field in schema is text [junit4:junit4] 2> 16909 T1599 oass.IndexSchema.readSchema unique key fie= ld: id [junit4:junit4] 2> 16921 T1599 oass.FileExchangeRateProvider.reload Reloa= ding exchange rates from file currency.xml [junit4:junit4] 2> 16926 T1599 oass.FileExchangeRateProvider.reload Reloa= ding exchange rates from file currency.xml [junit4:junit4] 2> 16930 T1599 oass.OpenExchangeRatesOrgProvider.reload R= eloading exchange rates from open-exchange-rates.json [junit4:junit4] 2> 16931 T1599 oass.OpenExchangeRatesOrgProvider$OpenExch= angeRates. WARNING Unknown key IMPORTANT NOTE [junit4:junit4] 2> 16932 T1599 oass.OpenExchangeRatesOrgProvider$OpenExch= angeRates. WARNING Expected key, got STRING [junit4:junit4] 2> 16932 T1599 oass.OpenExchangeRatesOrgProvider.reload R= eloading exchange rates from open-exchange-rates.json [junit4:junit4] 2> 16933 T1599 oass.OpenExchangeRatesOrgProvider$OpenExch= angeRates. WARNING Unknown key IMPORTANT NOTE [junit4:junit4] 2> 16933 T1599 oass.OpenExchangeRatesOrgProvider$OpenExch= angeRates. WARNING Expected key, got STRING [junit4:junit4] 2> 16933 T1599 oasc.SolrCore.initDirectoryFactory org.apa= che.solr.core.MockDirectoryFactory [junit4:junit4] 2> 16934 T1599 oasc.SolrCore. [collection1] Opening= new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nightl= yTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSlice= Test-jetty4-1363072327131/collection1/, dataDir=3D./org.apache.solr.cloud.S= yncSliceTest-1363072312423/jetty4/ [junit4:junit4] 2> 16934 T1599 oasc.JmxMonitoredMap. JMX monitoring= is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxM= BeanServer@1e81a197 [junit4:junit4] 2> 16934 T1599 oasc.SolrCore.initDirectoryFactory org.apa= che.solr.core.MockDirectoryFactory [junit4:junit4] 2> 16936 T1599 oasc.CachingDirectoryFactory.get return ne= w directory for ./org.apache.solr.cloud.SyncSliceTest-1363072312423/jetty4 = forceNew: false [junit4:junit4] 2> 16937 T1599 oasc.SolrCore.getNewIndexDir New index dir= ectory detected: old=3Dnull new=3D./org.apache.solr.cloud.SyncSliceTest-136= 3072312423/jetty4/index/ [junit4:junit4] 2> 16937 T1599 oasc.SolrCore.initIndex WARNING [collectio= n1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-13630723124= 23/jetty4/index' doesn't exist. Creating new index... [junit4:junit4] 2> 16939 T1599 oasc.CachingDirectoryFactory.get return ne= w directory for ./org.apache.solr.cloud.SyncSliceTest-1363072312423/jetty4/= index forceNew: false [junit4:junit4] 2> 16970 T1599 oasc.SolrDeletionPolicy.onCommit SolrDelet= ionPolicy.onCommit: commits:num=3D1 [junit4:junit4] 2> =09=09commit{dir=3DMockDirWrapper(org.apache.lucene.st= ore.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nigh= tlyTests-trunk/solr/build/solr-core/test/J0/index1292012946tmp lockFactory= =3Dorg.apache.lucene.store.NativeFSLockFactory@794579f3),segFN=3Dsegments_1= ,generation=3D1,filenames=3D[segments_1] [junit4:junit4] 2> 16970 T1599 oasc.SolrDeletionPolicy.updateCommits newe= st commit =3D 1[segments_1] [junit4:junit4] 2> 16972 T1599 oasup.UpdateRequestProcessorChain.init ins= erting DistributedUpdateProcessorFactory into updateRequestProcessorChain "= dedupe" [junit4:junit4] 2> 16972 T1599 oasup.UpdateRequestProcessorChain.init ins= erting DistributedUpdateProcessorFactory into updateRequestProcessorChain "= stored_sig" [junit4:junit4] 2> 16972 T1599 oasup.UpdateRequestProcessorChain.init ins= erting DistributedUpdateProcessorFactory into updateRequestProcessorChain "= distrib-dup-test-chain-implicit" [junit4:junit4] 2> 16973 T1599 oasc.RequestHandlers.initHandlersFromConfi= g created standard: solr.StandardRequestHandler [junit4:junit4] 2> 16973 T1599 oasc.RequestHandlers.initHandlersFromConfi= g created /get: solr.RealTimeGetHandler [junit4:junit4] 2> 16973 T1599 oasc.RequestHandlers.initHandlersFromConfi= g adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 2> 16974 T1599 oasc.RequestHandlers.initHandlersFromConfi= g created /replication: solr.ReplicationHandler [junit4:junit4] 2> 16974 T1599 oasc.RequestHandlers.initHandlersFromConfi= g created /update: solr.UpdateRequestHandler [junit4:junit4] 2> 16974 T1599 oasc.RequestHandlers.initHandlersFromConfi= g created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4:junit4] 2> 16980 T1599 oashl.XMLLoader.init xsltCacheLifetimeSeco= nds=3D60 [junit4:junit4] 2> 16986 T1599 oass.SolrIndexSearcher. Opening Sear= cher@415dd847 main [junit4:junit4] 2> 16986 T1599 oasu.UpdateHandler.clearLog Clearing tlog = files, tlogDir=3D./org.apache.solr.cloud.SyncSliceTest-1363072312423/jetty4= /tlog [junit4:junit4] 2> 16987 T1599 oasu.CommitTracker. Hard AutoCommit:= disabled [junit4:junit4] 2> 16987 T1599 oasu.CommitTracker. Soft AutoCommit:= disabled [junit4:junit4] 2> 16991 T1600 oasc.SolrCore.registerSearcher [collection= 1] Registered new searcher Searcher@415dd847 main{StandardDirectoryReader(s= egments_1:1)} [junit4:junit4] 2> 16992 T1599 oasc.ZkController.publish publishing core= =3Dcollection1 state=3Ddown [junit4:junit4] 2> 16992 T1599 oasc.ZkController.publish numShards not fo= und on descriptor - reading it from system property [junit4:junit4] 2> 17380 T1527 oascc.ZkStateReader.updateClusterState Upd= ating cloud state from ZooKeeper...=20 [junit4:junit4] 2> 17381 T1527 oasc.Overseer$ClusterStateUpdater.updateSt= ate Update state numShards=3D1 message=3D{ [junit4:junit4] 2> =09 "operation":"state", [junit4:junit4] 2> =09 "core_node_name":null, [junit4:junit4] 2> =09 "numShards":"1", [junit4:junit4] 2> =09 "shard":null, [junit4:junit4] 2> =09 "roles":null, [junit4:junit4] 2> =09 "state":"down", [junit4:junit4] 2> =09 "core":"collection1", [junit4:junit4] 2> =09 "collection":"collection1", [junit4:junit4] 2> =09 "node_name":"127.0.0.1:31033_", [junit4:junit4] 2> =09 "base_url":"http://127.0.0.1:31033"} [junit4:junit4] 2> 17381 T1527 oasc.Overseer$ClusterStateUpdater.updateSt= ate Collection already exists with numShards=3D1 [junit4:junit4] 2> 17381 T1527 oasc.Overseer$ClusterStateUpdater.updateSt= ate Assigning new node to shard shard=3Dshard1 [junit4:junit4] 2> 17396 T1596 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 2> 17396 T1579 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 2> 17396 T1546 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 2> 17396 T1533 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 2> 17396 T1562 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 2> 17396 T1526 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 2> 17995 T1599 oasc.CoreContainer.registerCore registerin= g core: collection1 [junit4:junit4] 2> 17995 T1599 oasc.ZkController.register Register replic= a - core:collection1 address:http://127.0.0.1:31033 collection:collection1 = shard:shard1 [junit4:junit4] 2> 18000 T1599 oasc.ZkController.register We are http://1= 27.0.0.1:31033/collection1/ and leader is http://127.0.0.1:31017/collection= 1/ [junit4:junit4] 2> 18000 T1599 oasc.ZkController.register No LogReplay ne= eded for core=3Dcollection1 baseURL=3Dhttp://127.0.0.1:31033 [junit4:junit4] 2> 18000 T1599 oasc.ZkController.checkRecovery Core needs= to recover:collection1 [junit4:junit4] 2> 18000 T1599 oasu.DefaultSolrCoreState.doRecovery Runni= ng recovery - first canceling any ongoing recovery [junit4:junit4] 2> ASYNC NEW_CORE C66 name=3Dcollection1 org.apache.solr= .core.SolrCore@1ff19bf0 url=3Dhttp://127.0.0.1:31033/collection1 node=3D127= .0.0.1:31033_ C66_STATE=3Dcoll:collection1 core:collection1 props:{state=3D= down, core=3Dcollection1, collection=3Dcollection1, node_name=3D127.0.0.1:3= 1033_, base_url=3Dhttp://127.0.0.1:31033} [junit4:junit4] 2> 18000 T1601 C66 P31033 oasc.RecoveryStrategy.run Start= ing recovery process. core=3Dcollection1 recoveringAfterStartup=3Dtrue [junit4:junit4] 2> 18002 T1601 C66 P31033 oasc.RecoveryStrategy.doRecover= y ###### startupVersions=3D[] [junit4:junit4] 2> 18002 T1601 C66 P31033 oasc.ZkController.publish publi= shing core=3Dcollection1 state=3Drecovering [junit4:junit4] 2> 18002 T1599 oascc.ZkStateReader.updateClusterState Upd= ating cloud state from ZooKeeper...=20 [junit4:junit4] 2> 18002 T1601 C66 P31033 oasc.ZkController.publish numSh= ards not found on descriptor - reading it from system property [junit4:junit4] 2> 18003 T1504 oass.SolrDispatchFilter.init user.dir=3D/u= sr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/b= uild/solr-core/test/J0 [junit4:junit4] 2> 18003 T1504 oass.SolrDispatchFilter.init SolrDispatchF= ilter.init() done [junit4:junit4] 2> 18004 T1504 oascsi.HttpClientUtil.createClient Creatin= g new http client, config:maxConnections=3D128&maxConnectionsPerHost=3D32&f= ollowRedirects=3Dfalse [junit4:junit4] 2> 18010 T1601 C66 P31033 oascsi.HttpClientUtil.createCli= ent Creating new http client, config:maxConnections=3D128&maxConnectionsPer= Host=3D32&followRedirects=3Dfalse [junit4:junit4] 2> 18166 T1504 oejs.Server.doStart jetty-8.1.8.v20121106 [junit4:junit4] 2> 18169 T1504 oejs.AbstractConnector.doStart Started Soc= ketConnector@127.0.0.1:31041 [junit4:junit4] 2> 18169 T1504 oass.SolrDispatchFilter.init SolrDispatchF= ilter.init() [junit4:junit4] 2> 18170 T1504 oasc.SolrResourceLoader.locateSolrHome JND= I not configured for solr (NoInitialContextEx) [junit4:junit4] 2> 18170 T1504 oasc.SolrResourceLoader.locateSolrHome usi= ng system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/= Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.so= lr.cloud.SyncSliceTest-jetty5-1363072330435 [junit4:junit4] 2> 18170 T1504 oasc.CoreContainer$Initializer.initialize = looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucen= e-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cl= oud.SyncSliceTest-jetty5-1363072330435/solr.xml [junit4:junit4] 2> 18171 T1504 oasc.CoreContainer. New CoreContaine= r 1766462023 [junit4:junit4] 2> 18171 T1504 oasc.CoreContainer.load Loading CoreContai= ner using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-N= ightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.Sync= SliceTest-jetty5-1363072330435/' [junit4:junit4] 2> 18171 T1504 oasc.SolrResourceLoader. new SolrRes= ourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-= Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.clou= d.SyncSliceTest-jetty5-1363072330435/' [junit4:junit4] 2> 18212 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting socketTimeout to: 120000 [junit4:junit4] 2> 18212 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting urlScheme to: http:// [junit4:junit4] 2> 18213 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting connTimeout to: 15000 [junit4:junit4] 2> 18213 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting maxConnectionsPerHost to: 20 [junit4:junit4] 2> 18213 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting corePoolSize to: 0 [junit4:junit4] 2> 18214 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting maximumPoolSize to: 2147483647 [junit4:junit4] 2> 18214 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting maxThreadIdleTime to: 5 [junit4:junit4] 2> 18214 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting sizeOfQueue to: -1 [junit4:junit4] 2> 18214 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting fairnessPolicy to: false [junit4:junit4] 2> 18215 T1504 oascsi.HttpClientUtil.createClient Creatin= g new http client, config:maxConnectionsPerHost=3D20&maxConnections=3D10000= &socketTimeout=3D120000&connTimeout=3D15000&retry=3Dfalse [junit4:junit4] 2> 18230 T1504 oasc.CoreContainer.load Registering Log Li= stener [junit4:junit4] 2> 18245 T1504 oasc.CoreContainer.initZooKeeper Zookeeper= client=3D127.0.0.1:31008/solr [junit4:junit4] 2> 18245 T1504 oasc.ZkController.checkChrootPath zkHost i= ncludes chroot [junit4:junit4] 2> 18245 T1504 oaz.ZooKeeper. Initiating client con= nection, connectString=3D127.0.0.1:31008 sessionTimeout=3D60000 watcher=3Do= rg.apache.solr.common.cloud.ConnectionManager@2c12c572 [junit4:junit4] 2> 18246 T1504 oascc.ConnectionManager.waitForConnected W= aiting for client to connect to ZooKeeper [junit4:junit4] 2> 18247 T1612 oaz.ClientCnxn$SendThread.logStartConnect = Opening socket connection to server localhost/127.0.0.1:31008. Will not att= empt to authenticate using SASL (access denied (javax.security.auth.AuthPer= mission getLoginConfiguration)) [junit4:junit4] 2> 18247 T1612 oaz.ClientCnxn$SendThread.primeConnection = Socket connection established to localhost/127.0.0.1:31008, initiating sess= ion [junit4:junit4] 2> 18248 T1506 oazs.NIOServerCnxnFactory.run Accepted soc= ket connection from /140.211.11.196:31042 [junit4:junit4] 2> 18248 T1506 oazs.ZooKeeperServer.processConnectRequest= Client attempting to establish new session at /140.211.11.196:31042 [junit4:junit4] 2> 18250 T1508 oazs.ZooKeeperServer.finishSessionInit Est= ablished session 0x13d5d70e46d000d with negotiated timeout 20000 for client= /140.211.11.196:31042 [junit4:junit4] 2> 18250 T1612 oaz.ClientCnxn$SendThread.onConnected Sess= ion establishment complete on server localhost/127.0.0.1:31008, sessionid = =3D 0x13d5d70e46d000d, negotiated timeout =3D 20000 [junit4:junit4] 2> 18250 T1613 oascc.ConnectionManager.process Watcher or= g.apache.solr.common.cloud.ConnectionManager@2c12c572 name:ZooKeeperConnect= ion Watcher:127.0.0.1:31008 got event WatchedEvent state:SyncConnected type= :None path:null path:null type:None [junit4:junit4] 2> 18251 T1504 oascc.ConnectionManager.waitForConnected C= lient is connected to ZooKeeper [junit4:junit4] 2> 18252 T1509 oazs.PrepRequestProcessor.pRequest2Txn Pro= cessed session termination for sessionid: 0x13d5d70e46d000d [junit4:junit4] 2> 18253 T1613 oaz.ClientCnxn$EventThread.run EventThread= shut down [junit4:junit4] 2> 18253 T1506 oazs.NIOServerCnxn.closeSock Closed socket= connection for client /140.211.11.196:31042 which had sessionid 0x13d5d70e= 46d000d [junit4:junit4] 2> 18253 T1504 oaz.ZooKeeper.close Session: 0x13d5d70e46d= 000d closed [junit4:junit4] 2> 18253 T1504 oascsi.HttpClientUtil.createClient Creatin= g new http client, config:maxConnections=3D500&maxConnectionsPerHost=3D16&s= ocketTimeout=3D120000&connTimeout=3D15000 [junit4:junit4] 2> 18261 T1504 oaz.ZooKeeper. Initiating client con= nection, connectString=3D127.0.0.1:31008/solr sessionTimeout=3D30000 watche= r=3Dorg.apache.solr.common.cloud.ConnectionManager@504ff367 [junit4:junit4] 2> 18261 T1504 oascc.ConnectionManager.waitForConnected W= aiting for client to connect to ZooKeeper [junit4:junit4] 2> 18262 T1614 oaz.ClientCnxn$SendThread.logStartConnect = Opening socket connection to server localhost/127.0.0.1:31008. Will not att= empt to authenticate using SASL (access denied (javax.security.auth.AuthPer= mission getLoginConfiguration)) [junit4:junit4] 2> 18262 T1614 oaz.ClientCnxn$SendThread.primeConnection = Socket connection established to localhost/127.0.0.1:31008, initiating sess= ion [junit4:junit4] 2> 18262 T1506 oazs.NIOServerCnxnFactory.run Accepted soc= ket connection from /140.211.11.196:31043 [junit4:junit4] 2> 18262 T1506 oazs.ZooKeeperServer.processConnectRequest= Client attempting to establish new session at /140.211.11.196:31043 [junit4:junit4] 2> 18264 T1508 oazs.ZooKeeperServer.finishSessionInit Est= ablished session 0x13d5d70e46d000e with negotiated timeout 20000 for client= /140.211.11.196:31043 [junit4:junit4] 2> 18264 T1614 oaz.ClientCnxn$SendThread.onConnected Sess= ion establishment complete on server localhost/127.0.0.1:31008, sessionid = =3D 0x13d5d70e46d000e, negotiated timeout =3D 20000 [junit4:junit4] 2> 18264 T1615 oascc.ConnectionManager.process Watcher or= g.apache.solr.common.cloud.ConnectionManager@504ff367 name:ZooKeeperConnect= ion Watcher:127.0.0.1:31008/solr got event WatchedEvent state:SyncConnected= type:None path:null path:null type:None [junit4:junit4] 2> 18264 T1504 oascc.ConnectionManager.waitForConnected C= lient is connected to ZooKeeper [junit4:junit4] 2> 18265 T1509 oazs.PrepRequestProcessor.pRequest Got use= r-level KeeperException when processing sessionid:0x13d5d70e46d000e type:cr= eate cxid:0x1 zxid:0xab txntype:-1 reqpath:n/a Error Path:/solr/overseer Er= ror:KeeperErrorCode =3D NodeExists for /solr/overseer [junit4:junit4] 2> 18266 T1509 oazs.PrepRequestProcessor.pRequest Got use= r-level KeeperException when processing sessionid:0x13d5d70e46d000e type:cr= eate cxid:0x2 zxid:0xac txntype:-1 reqpath:n/a Error Path:/solr/overseer Er= ror:KeeperErrorCode =3D NodeExists for /solr/overseer [junit4:junit4] 2> 18275 T1504 oascc.ZkStateReader.createClusterStateWatc= hersAndUpdate Updating cluster state from ZooKeeper...=20 [junit4:junit4] 2> C64_STATE=3Dcoll:collection1 core:collection1 props:{= shard=3Dshard1, state=3Drecovering, core=3Dcollection1, collection=3Dcollec= tion1, node_name=3D127.0.0.1:31029_, base_url=3Dhttp://127.0.0.1:31029} [junit4:junit4] 2> 18716 T1582 C64 P31029 oasc.RecoveryStrategy.doRecover= y Attempting to PeerSync from http://127.0.0.1:31017/collection1/ core=3Dco= llection1 - recoveringAfterStartup=3Dtrue [junit4:junit4] 2> 18716 T1582 C64 P31029 oasu.PeerSync.sync PeerSync: co= re=3Dcollection1 url=3Dhttp://127.0.0.1:31029 START replicas=3D[http://127.= 0.0.1:31017/collection1/] nUpdates=3D100 [junit4:junit4] 2> 18716 T1582 C64 P31029 oasu.PeerSync.sync WARNING no f= rame of reference to tell of we've missed updates [junit4:junit4] 2> 18717 T1582 C64 P31029 oasc.RecoveryStrategy.doRecover= y PeerSync Recovery was not successful - trying replication. core=3Dcollect= ion1 [junit4:junit4] 2> 18717 T1582 C64 P31029 oasc.RecoveryStrategy.doRecover= y Starting Replication Recovery. core=3Dcollection1 [junit4:junit4] 2> 18717 T1582 C64 P31029 oasc.RecoveryStrategy.doRecover= y Begin buffering updates. core=3Dcollection1 [junit4:junit4] 2> 18717 T1582 C64 P31029 oasu.UpdateLog.bufferUpdates St= arting to buffer updates. FSUpdateLog{state=3DACTIVE, tlog=3Dnull} [junit4:junit4] 2> 18717 T1582 C64 P31029 oasc.RecoveryStrategy.replicate= Attempting to replicate from http://127.0.0.1:31017/collection1/. core=3Dc= ollection1 [junit4:junit4] 2> 18717 T1582 C64 P31029 oascsi.HttpClientUtil.createCli= ent Creating new http client, config:maxConnections=3D128&maxConnectionsPer= Host=3D32&followRedirects=3Dfalse [junit4:junit4] 2> 18719 T1538 C65 P31017 REQ /get {getVersions=3D100&dis= trib=3Dfalse&wt=3Djavabin&qt=3D/get&version=3D2} status=3D0 QTime=3D0=20 [junit4:junit4] 2> 18729 T1542 C65 P31017 oasu.DirectUpdateHandler2.commi= t start commit{,optimize=3Dfalse,openSearcher=3Dfalse,waitSearcher=3Dtrue,e= xpungeDeletes=3Dfalse,softCommit=3Dfalse,prepareCommit=3Dfalse} [junit4:junit4] 2> 18734 T1542 C65 P31017 oasc.SolrDeletionPolicy.onCommi= t SolrDeletionPolicy.onCommit: commits:num=3D2 [junit4:junit4] 2> =09=09commit{dir=3DMockDirWrapper(org.apache.lucene.st= ore.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nigh= tlyTests-trunk/solr/build/solr-core/test/J0/index1292012939tmp lockFactory= =3Dorg.apache.lucene.store.NativeFSLockFactory@72fef53c),segFN=3Dsegments_2= ,generation=3D2,filenames=3D[segments_2] [junit4:junit4] 2> =09=09commit{dir=3DMockDirWrapper(org.apache.lucene.st= ore.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nigh= tlyTests-trunk/solr/build/solr-core/test/J0/index1292012939tmp lockFactory= =3Dorg.apache.lucene.store.NativeFSLockFactory@72fef53c),segFN=3Dsegments_3= ,generation=3D3,filenames=3D[segments_3] [junit4:junit4] 2> 18734 T1542 C65 P31017 oasc.SolrDeletionPolicy.updateC= ommits newest commit =3D 3[segments_3] [junit4:junit4] 2> 18735 T1542 C65 P31017 oasu.DirectUpdateHandler2.commi= t end_commit_flush [junit4:junit4] 2> 18735 T1542 C65 P31017 /update {waitSearcher=3Dtrue&op= enSearcher=3Dfalse&commit=3Dtrue&wt=3Djavabin&commit_end_point=3Dtrue&versi= on=3D2&softCommit=3Dfalse} {commit=3D} 0 6 [junit4:junit4] 2> 18736 T1582 C64 P31029 oash.ReplicationHandler.inform = Commits will be reserved for 10000 [junit4:junit4] 2> 18736 T1582 C64 P31029 oash.SnapPuller. No valu= e set for 'pollInterval'. Timer Task not started. [junit4:junit4] 2> 18739 T1540 C65 P31017 REQ /replication {command=3Dind= exversion&qt=3D/replication&wt=3Djavabin&version=3D2} status=3D0 QTime=3D0= =20 [junit4:junit4] 2> 18740 T1582 C64 P31029 oash.SnapPuller.fetchLatestInde= x Master's generation: 3 [junit4:junit4] 2> 18740 T1582 C64 P31029 oash.SnapPuller.fetchLatestInde= x Slave's generation: 1 [junit4:junit4] 2> 18741 T1582 C64 P31029 oash.SnapPuller.fetchLatestInde= x Starting replication process [junit4:junit4] 2> 18744 T1540 C65 P31017 REQ /replication {command=3Dfil= elist&qt=3D/replication&wt=3Djavabin&generation=3D3&version=3D2} status=3D0= QTime=3D1=20 [junit4:junit4] 2> 18744 T1582 C64 P31029 oash.SnapPuller.fetchLatestInde= x Number of files in latest index in master: 1 [junit4:junit4] 2> 18747 T1582 C64 P31029 oasc.CachingDirectoryFactory.ge= t return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363072312= 423/jetty3/index.20130312071211165 forceNew: false [junit4:junit4] 2> 18747 T1582 C64 P31029 oash.SnapPuller.fetchLatestInde= x Starting download to MockDirWrapper(org.apache.lucene.store.SimpleFSDirec= tory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk= /solr/build/solr-core/test/J0/index1292012947tmp lockFactory=3Dorg.apache.l= ucene.store.NativeFSLockFactory@dc3efb6) fullCopy=3Dfalse [junit4:junit4] 2> 18751 T1540 C65 P31017 REQ /replication {file=3Dsegmen= ts_3&command=3Dfilecontent&checksum=3Dtrue&wt=3Dfilestream&qt=3D/replicatio= n&generation=3D3} status=3D0 QTime=3D0=20 [junit4:junit4] 2> 18753 T1582 C64 P31029 oash.SnapPuller.fetchLatestInde= x Total time taken for download : 0 secs [junit4:junit4] 2> 18756 T1582 C64 P31029 oasu.DefaultSolrCoreState.newIn= dexWriter Creating new IndexWriter... [junit4:junit4] 2> 18756 T1582 C64 P31029 oasu.DefaultSolrCoreState.newIn= dexWriter Waiting until IndexWriter is unused... core=3Dcollection1 [junit4:junit4] 2> 18760 T1582 C64 P31029 oasc.SolrDeletionPolicy.onInit = SolrDeletionPolicy.onInit: commits:num=3D2 [junit4:junit4] 2> =09=09commit{dir=3DMockDirWrapper(org.apache.lucene.st= ore.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nigh= tlyTests-trunk/solr/build/solr-core/test/J0/index1292012943tmp lockFactory= =3Dorg.apache.lucene.store.NativeFSLockFactory@480d93a1),segFN=3Dsegments_1= ,generation=3D1,filenames=3D[segments_1] [junit4:junit4] 2> =09=09commit{dir=3DMockDirWrapper(org.apache.lucene.st= ore.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nigh= tlyTests-trunk/solr/build/solr-core/test/J0/index1292012943tmp lockFactory= =3Dorg.apache.lucene.store.NativeFSLockFactory@480d93a1),segFN=3Dsegments_3= ,generation=3D3,filenames=3D[segments_3] [junit4:junit4] 2> 18760 T1582 C64 P31029 oasc.SolrDeletionPolicy.updateC= ommits newest commit =3D 3[segments_3] [junit4:junit4] 2> 18761 T1582 C64 P31029 oasu.DefaultSolrCoreState.newIn= dexWriter New IndexWriter is ready to be used. [junit4:junit4] 2> 18762 T1582 C64 P31029 oass.SolrIndexSearcher. O= pening Searcher@3e4c2521 main [junit4:junit4] 2> 18763 T1581 oasc.SolrCore.registerSearcher [collection= 1] Registered new searcher Searcher@3e4c2521 main{StandardDirectoryReader(s= egments_3:1:nrt)} [junit4:junit4] 2> 18763 T1582 C64 P31029 oash.SnapPuller.fetchLatestInde= x removing temporary index download directory files MockDirWrapper(org.apac= he.lucene.store.SimpleFSDirectory@/usr/home/hudson/hudson-slave/workspace/L= ucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/index1292012947t= mp lockFactory=3Dorg.apache.lucene.store.NativeFSLockFactory@dc3efb6) [junit4:junit4] 2> 18764 T1582 C64 P31029 oasc.RecoveryStrategy.replay No= replay needed. core=3Dcollection1 [junit4:junit4] 2> 18764 T1582 C64 P31029 oasc.RecoveryStrategy.doRecover= y Replication Recovery was successful - registering as Active. core=3Dcolle= ction1 [junit4:junit4] 2> 18764 T1582 C64 P31029 oasc.ZkController.publish publi= shing core=3Dcollection1 state=3Dactive [junit4:junit4] 2> 18764 T1582 C64 P31029 oasc.ZkController.publish numSh= ards not found on descriptor - reading it from system property [junit4:junit4] 2> 18766 T1582 C64 P31029 oasc.RecoveryStrategy.doRecover= y Finished recovery process. core=3Dcollection1 [junit4:junit4] 2> 18900 T1527 oascc.ZkStateReader.updateClusterState Upd= ating cloud state from ZooKeeper...=20 [junit4:junit4] 2> 18901 T1527 oasc.Overseer$ClusterStateUpdater.updateSt= ate Update state numShards=3D1 message=3D{ [junit4:junit4] 2> =09 "operation":"state", [junit4:junit4] 2> =09 "core_node_name":null, [junit4:junit4] 2> =09 "numShards":"1", [junit4:junit4] 2> =09 "shard":"shard1", [junit4:junit4] 2> =09 "roles":null, [junit4:junit4] 2> =09 "state":"recovering", [junit4:junit4] 2> =09 "core":"collection1", [junit4:junit4] 2> =09 "collection":"collection1", [junit4:junit4] 2> =09 "node_name":"127.0.0.1:31033_", [junit4:junit4] 2> =09 "base_url":"http://127.0.0.1:31033"} [junit4:junit4] 2> 18904 T1527 oasc.Overseer$ClusterStateUpdater.updateSt= ate Update state numShards=3D1 message=3D{ [junit4:junit4] 2> =09 "operation":"state", [junit4:junit4] 2> =09 "core_node_name":null, [junit4:junit4] 2> =09 "numShards":"1", [junit4:junit4] 2> =09 "shard":"shard1", [junit4:junit4] 2> =09 "roles":null, [junit4:junit4] 2> =09 "state":"active", [junit4:junit4] 2> =09 "core":"collection1", [junit4:junit4] 2> =09 "collection":"collection1", [junit4:junit4] 2> =09 "node_name":"127.0.0.1:31029_", [junit4:junit4] 2> =09 "base_url":"http://127.0.0.1:31029"} [junit4:junit4] 2> 18916 T1562 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 2> 18916 T1533 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 2> 18916 T1615 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 2> 18916 T1596 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 2> 18916 T1546 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 2> 18916 T1526 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 2> 18916 T1579 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 2> 19019 T1541 oass.SolrDispatchFilter.handleAdminRequest= /admin/cores {coreNodeName=3D127.0.0.1:31033__collection1&state=3Drecoveri= ng&nodeName=3D127.0.0.1:31033_&action=3DPREPRECOVERY&checkLive=3Dtrue&core= =3Dcollection1&wt=3Djavabin&onlyIfLeader=3Dtrue&version=3D2} status=3D0 QTi= me=3D1001=20 [junit4:junit4] 2> 19278 T1504 oasc.ZkController.createEphemeralLiveNode = Register node as live in ZooKeeper:/live_nodes/127.0.0.1:31041_ [junit4:junit4] 2> 19279 T1509 oazs.PrepRequestProcessor.pRequest Got use= r-level KeeperException when processing sessionid:0x13d5d70e46d000e type:de= lete cxid:0xd zxid:0xb5 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/= 127.0.0.1:31041_ Error:KeeperErrorCode =3D NoNode for /solr/live_nodes/127.= 0.0.1:31041_ [junit4:junit4] 2> 19281 T1504 oascc.SolrZkClient.makePath makePath: /liv= e_nodes/127.0.0.1:31041_ [junit4:junit4] 2> 19284 T1533 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:= /live_nodes, has occurred - updating... (live nodes size: 5) [junit4:junit4] 2> 19284 T1546 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:= /live_nodes, has occurred - updating... (live nodes size: 5) [junit4:junit4] 2> 19284 T1615 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:= /live_nodes, has occurred - updating... (live nodes size: 5) [junit4:junit4] 2> 19285 T1596 oascc.ZkStateReader$3.process Updating liv= e nodes... (6) [junit4:junit4] 2> 19284 T1562 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:= /live_nodes, has occurred - updating... (live nodes size: 5) [junit4:junit4] 2> 19285 T1526 oascc.ZkStateReader$3.process Updating liv= e nodes... (6) [junit4:junit4] 2> 19285 T1596 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:= /live_nodes, has occurred - updating... (live nodes size: 6) [junit4:junit4] 2> 19285 T1579 oascc.ZkStateReader$3.process Updating liv= e nodes... (6) [junit4:junit4] 2> 19285 T1526 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:= /live_nodes, has occurred - updating... (live nodes size: 6) [junit4:junit4] 2> 19285 T1579 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:= /live_nodes, has occurred - updating... (live nodes size: 6) [junit4:junit4] 2> 19287 T1533 oascc.ZkStateReader$3.process Updating liv= e nodes... (6) [junit4:junit4] 2> 19318 T1546 oascc.ZkStateReader$3.process Updating liv= e nodes... (6) [junit4:junit4] 2> 19319 T1562 oascc.ZkStateReader$3.process Updating liv= e nodes... (6) [junit4:junit4] 2> 19318 T1615 oascc.ZkStateReader$3.process Updating liv= e nodes... (6) [junit4:junit4] 2> 19328 T1618 oasc.CoreContainer.create Creating SolrCor= e 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/= Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.so= lr.cloud.SyncSliceTest-jetty5-1363072330435/collection1 [junit4:junit4] 2> 19328 T1618 oasc.ZkController.createCollectionZkNode C= heck for collection zkNode:collection1 [junit4:junit4] 2> 19329 T1618 oasc.ZkController.createCollectionZkNode C= ollection zkNode exists [junit4:junit4] 2> 19329 T1618 oasc.ZkController.readConfigName Load coll= ection config from:/collections/collection1 [junit4:junit4] 2> 19330 T1618 oasc.SolrResourceLoader. new SolrRes= ourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-= Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.clou= d.SyncSliceTest-jetty5-1363072330435/collection1/' [junit4:junit4] 2> 19332 T1618 oasc.SolrResourceLoader.replaceClassLoader= Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTe= sts-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-= jetty5-1363072330435/collection1/lib/README' to classloader [junit4:junit4] 2> 19333 T1618 oasc.SolrResourceLoader.replaceClassLoader= Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTe= sts-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-= jetty5-1363072330435/collection1/lib/classes/' to classloader [junit4:junit4] 2> 19401 T1618 oasc.SolrConfig. Using Lucene MatchV= ersion: LUCENE_50 [junit4:junit4] 2> 19466 T1618 oasc.SolrConfig. Loaded SolrConfig: = solrconfig.xml [junit4:junit4] 2> 19468 T1618 oass.IndexSchema.readSchema Reading Solr S= chema [junit4:junit4] 2> 19474 T1618 oass.IndexSchema.readSchema Schema name=3D= test [junit4:junit4] 2> 20053 T1618 oass.OpenExchangeRatesOrgProvider.init Ini= tialized with rates=3Dopen-exchange-rates.json, refreshInterval=3D1440. [junit4:junit4] 2> 20061 T1618 oass.IndexSchema.readSchema default search= field in schema is text [junit4:junit4] 2> 20064 T1618 oass.IndexSchema.readSchema unique key fie= ld: id [junit4:junit4] 2> 20077 T1618 oass.FileExchangeRateProvider.reload Reloa= ding exchange rates from file currency.xml [junit4:junit4] 2> 20081 T1618 oass.FileExchangeRateProvider.reload Reloa= ding exchange rates from file currency.xml [junit4:junit4] 2> 20085 T1618 oass.OpenExchangeRatesOrgProvider.reload R= eloading exchange rates from open-exchange-rates.json [junit4:junit4] 2> 20086 T1618 oass.OpenExchangeRatesOrgProvider$OpenExch= angeRates. WARNING Unknown key IMPORTANT NOTE [junit4:junit4] 2> 20086 T1618 oass.OpenExchangeRatesOrgProvider$OpenExch= angeRates. WARNING Expected key, got STRING [junit4:junit4] 2> 20087 T1618 oass.OpenExchangeRatesOrgProvider.reload R= eloading exchange rates from open-exchange-rates.json [junit4:junit4] 2> 20088 T1618 oass.OpenExchangeRatesOrgProvider$OpenExch= angeRates. WARNING Unknown key IMPORTANT NOTE [junit4:junit4] 2> 20088 T1618 oass.OpenExchangeRatesOrgProvider$OpenExch= angeRates. WARNING Expected key, got STRING [junit4:junit4] 2> 20088 T1618 oasc.SolrCore.initDirectoryFactory org.apa= che.solr.core.MockDirectoryFactory [junit4:junit4] 2> 20088 T1618 oasc.SolrCore. [collection1] Opening= new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nightl= yTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSlice= Test-jetty5-1363072330435/collection1/, dataDir=3D./org.apache.solr.cloud.S= yncSliceTest-1363072312423/jetty5/ [junit4:junit4] 2> 20088 T1618 oasc.JmxMonitoredMap. JMX monitoring= is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxM= BeanServer@1e81a197 [junit4:junit4] 2> 20089 T1618 oasc.SolrCore.initDirectoryFactory org.apa= che.solr.core.MockDirectoryFactory [junit4:junit4] 2> 20090 T1618 oasc.CachingDirectoryFactory.get return ne= w directory for ./org.apache.solr.cloud.SyncSliceTest-1363072312423/jetty5 = forceNew: false [junit4:junit4] 2> 20090 T1618 oasc.SolrCore.getNewIndexDir New index dir= ectory detected: old=3Dnull new=3D./org.apache.solr.cloud.SyncSliceTest-136= 3072312423/jetty5/index/ [junit4:junit4] 2> 20091 T1618 oasc.SolrCore.initIndex WARNING [collectio= n1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-13630723124= 23/jetty5/index' doesn't exist. Creating new index... [junit4:junit4] 2> 20092 T1618 oasc.CachingDirectoryFactory.get return ne= w directory for ./org.apache.solr.cloud.SyncSliceTest-1363072312423/jetty5/= index forceNew: false [junit4:junit4] 2> 20103 T1618 oasc.SolrDeletionPolicy.onCommit SolrDelet= ionPolicy.onCommit: commits:num=3D1 [junit4:junit4] 2> =09=09commit{dir=3DMockDirWrapper(org.apache.lucene.st= ore.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nigh= tlyTests-trunk/solr/build/solr-core/test/J0/index1292012949tmp lockFactory= =3Dorg.apache.lucene.store.NativeFSLockFactory@3a501d3f),segFN=3Dsegments_1= ,generation=3D1,filenames=3D[segments_1] [junit4:junit4] 2> 20103 T1618 oasc.SolrDeletionPolicy.updateCommits newe= st commit =3D 1[segments_1] [junit4:junit4] 2> 20105 T1618 oasup.UpdateRequestProcessorChain.init ins= erting DistributedUpdateProcessorFactory into updateRequestProcessorChain "= dedupe" [junit4:junit4] 2> 20105 T1618 oasup.UpdateRequestProcessorChain.init ins= erting DistributedUpdateProcessorFactory into updateRequestProcessorChain "= stored_sig" [junit4:junit4] 2> 20106 T1618 oasup.UpdateRequestProcessorChain.init ins= erting DistributedUpdateProcessorFactory into updateRequestProcessorChain "= distrib-dup-test-chain-implicit" [junit4:junit4] 2> 20106 T1618 oasc.RequestHandlers.initHandlersFromConfi= g created standard: solr.StandardRequestHandler [junit4:junit4] 2> 20107 T1618 oasc.RequestHandlers.initHandlersFromConfi= g created /get: solr.RealTimeGetHandler [junit4:junit4] 2> 20107 T1618 oasc.RequestHandlers.initHandlersFromConfi= g adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 2> 20107 T1618 oasc.RequestHandlers.initHandlersFromConfi= g created /replication: solr.ReplicationHandler [junit4:junit4] 2> 20107 T1618 oasc.RequestHandlers.initHandlersFromConfi= g created /update: solr.UpdateRequestHandler [junit4:junit4] 2> 20108 T1618 oasc.RequestHandlers.initHandlersFromConfi= g created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4:junit4] 2> 20113 T1618 oashl.XMLLoader.init xsltCacheLifetimeSeco= nds=3D60 [junit4:junit4] 2> 20119 T1618 oass.SolrIndexSearcher. Opening Sear= cher@5856cf4c main [junit4:junit4] 2> 20119 T1618 oasu.UpdateHandler.clearLog Clearing tlog = files, tlogDir=3D./org.apache.solr.cloud.SyncSliceTest-1363072312423/jetty5= /tlog [junit4:junit4] 2> 20120 T1618 oasu.CommitTracker. Hard AutoCommit:= disabled [junit4:junit4] 2> 20120 T1618 oasu.CommitTracker. Soft AutoCommit:= disabled [junit4:junit4] 2> 20123 T1619 oasc.SolrCore.registerSearcher [collection= 1] Registered new searcher Searcher@5856cf4c main{StandardDirectoryReader(s= egments_1:1)} [junit4:junit4] 2> 20124 T1618 oasc.ZkController.publish publishing core= =3Dcollection1 state=3Ddown [junit4:junit4] 2> 20124 T1618 oasc.ZkController.publish numShards not fo= und on descriptor - reading it from system property [junit4:junit4] 2> 20428 T1527 oascc.ZkStateReader.updateClusterState Upd= ating cloud state from ZooKeeper...=20 [junit4:junit4] 2> 20429 T1527 oasc.Overseer$ClusterStateUpdater.updateSt= ate Update state numShards=3D1 message=3D{ [junit4:junit4] 2> =09 "operation":"state", [junit4:junit4] 2> =09 "core_node_name":null, [junit4:junit4] 2> =09 "numShards":"1", [junit4:junit4] 2> =09 "shard":null, [junit4:junit4] 2> =09 "roles":null, [junit4:junit4] 2> =09 "state":"down", [junit4:junit4] 2> =09 "core":"collection1", [junit4:junit4] 2> =09 "collection":"collection1", [junit4:junit4] 2> =09 "node_name":"127.0.0.1:31041_", [junit4:junit4] 2> =09 "base_url":"http://127.0.0.1:31041"} [junit4:junit4] 2> 20429 T1527 oasc.Overseer$ClusterStateUpdater.updateSt= ate Collection already exists with numShards=3D1 [junit4:junit4] 2> 20429 T1527 oasc.Overseer$ClusterStateUpdater.updateSt= ate Assigning new node to shard shard=3Dshard1 [junit4:junit4] 2> 20441 T1596 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 6) [junit4:junit4] 2> 20441 T1546 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 6) [junit4:junit4] 2> 20441 T1579 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 6) [junit4:junit4] 2> 20441 T1615 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 6) [junit4:junit4] 2> 20441 T1526 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 6) [junit4:junit4] 2> 20441 T1562 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 6) [junit4:junit4] 2> 20441 T1533 oascc.ZkStateReader$2.process A cluster st= ate change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clu= sterstate.json, has occurred - updating... (live nodes size: 6) [junit4:junit4] 2> C66_STATE=3Dcoll:collection1 core:collection1 props:{= shard=3Dshard1, state=3Drecovering, core=3Dcollection1, collection=3Dcollec= tion1, node_name=3D127.0.0.1:31033_, base_url=3Dhttp://127.0.0.1:31033} [junit4:junit4] 2> 21024 T1601 C66 P31033 oasc.RecoveryStrategy.doRecover= y Attempting to PeerSync from http://127.0.0.1:31017/collection1/ core=3Dco= llection1 - recoveringAfterStartup=3Dtrue [junit4:junit4] 2> 21025 T1601 C66 P31033 oasu.PeerSync.sync PeerSync: co= re=3Dcollection1 url=3Dhttp://127.0.0.1:31033 START replicas=3D[http://127.= 0.0.1:31017/collection1/] nUpdates=3D100 [junit4:junit4] 2> 21025 T1601 C66 P31033 oasu.PeerSync.sync WARNING no f= rame of reference to tell of we've missed updates [junit4:junit4] 2> 21025 T1601 C66 P31033 oasc.RecoveryStrategy.doRecover= y PeerSync Recovery was not successful - trying replication. core=3Dcollect= ion1 [junit4:junit4] 2> 21026 T1601 C66 P31033 oasc.RecoveryStrategy.doRecover= y Starting Replication Recovery. core=3Dcollection1 [junit4:junit4] 2> 21026 T1601 C66 P31033 oasc.RecoveryStrategy.doRecover= y Begin buffering updates. core=3Dcollection1 [junit4:junit4] 2> 21026 T1601 C66 P31033 oasu.UpdateLog.bufferUpdates St= arting to buffer updates. FSUpdateLog{state=3DACTIVE, tlog=3Dnull} [junit4:junit4] 2> 21026 T1601 C66 P31033 oasc.RecoveryStrategy.replicate= Attempting to replicate from http://127.0.0.1:31017/collection1/. core=3Dc= ollection1 [junit4:junit4] 2> 21026 T1601 C66 P31033 oascsi.HttpClientUtil.createCli= ent Creating new http client, config:maxConnections=3D128&maxConnectionsPer= Host=3D32&followRedirects=3Dfalse [junit4:junit4] 2> 21028 T1538 C65 P31017 REQ /get {getVersions=3D100&dis= trib=3Dfalse&wt=3Djavabin&qt=3D/get&version=3D2} status=3D0 QTime=3D0=20 [junit4:junit4] 2> 21036 T1536 C65 P31017 oasu.DirectUpdateHandler2.commi= t start commit{,optimize=3Dfalse,openSearcher=3Dfalse,waitSearcher=3Dtrue,e= xpungeDeletes=3Dfalse,softCommit=3Dfalse,prepareCommit=3Dfalse} [junit4:junit4] 2> 21054 T1536 C65 P31017 oasc.SolrDeletionPolicy.onCommi= t SolrDeletionPolicy.onCommit: commits:num=3D3 [junit4:junit4] 2> =09=09commit{dir=3DMockDirWrapper(org.apache.lucene.st= ore.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nigh= tlyTests-trunk/solr/build/solr-core/test/J0/index1292012939tmp lockFactory= =3Dorg.apache.lucene.store.NativeFSLockFactory@72fef53c),segFN=3Dsegments_2= ,generation=3D2,filenames=3D[segments_2] [junit4:junit4] 2> =09=09commit{dir=3DMockDirWrapper(org.apache.lucene.st= ore.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nigh= tlyTests-trunk/solr/build/solr-core/test/J0/index1292012939tmp lockFactory= =3Dorg.apache.lucene.store.NativeFSLockFactory@72fef53c),segFN=3Dsegments_3= ,generation=3D3,filenames=3D[segments_3] [junit4:junit4] 2> =09=09commit{dir=3DMockDirWrapper(org.apache.lucene.st= ore.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nigh= tlyTests-trunk/solr/build/solr-core/test/J0/index1292012939tmp lockFactory= =3Dorg.apache.lucene.store.NativeFSLockFactory@72fef53c),segFN=3Dsegments_4= ,generation=3D4,filenames=3D[segments_4] [junit4:junit4] 2> 21055 T1536 C65 P31017 oasc.SolrDeletionPolicy.updateC= ommits newest commit =3D 4[segments_4] [junit4:junit4] 2> 21055 T1536 C65 P31017 oasu.DirectUpdateHandler2.commi= t end_commit_flush [junit4:junit4] 2> 21055 T1536 C65 P31017 /update {waitSearcher=3Dtrue&op= enSearcher=3Dfalse&commit=3Dtrue&wt=3Djavabin&commit_end_point=3Dtrue&versi= on=3D2&softCommit=3Dfalse} {commit=3D} 0 19 [junit4:junit4] 2> 21057 T1601 C66 P31033 oash.ReplicationHandler.inform = Commits will be reserved for 10000 [junit4:junit4] 2> 21057 T1601 C66 P31033 oash.SnapPuller. No valu= e set for 'pollInterval'. Timer Task not started. [junit4:junit4] 2> 21059 T1540 C65 P31017 REQ /replication {command=3Dind= exversion&qt=3D/replication&wt=3Djavabin&version=3D2} status=3D0 QTime=3D0= =20 [junit4:junit4] 2> 21060 T1601 C66 P31033 oash.SnapPuller.fetchLatestInde= x Master's generation: 4 [junit4:junit4] 2> 21060 T1601 C66 P31033 oash.SnapPuller.fetchLatestInde= x Slave's generation: 1 [junit4:junit4] 2> 21060 T1601 C66 P31033 oash.SnapPuller.fetchLatestInde= x Starting replication process [junit4:junit4] 2> 21063 T1540 C65 P31017 REQ /replication {command=3Dfil= elist&qt=3D/replication&wt=3Djavabin&generation=3D4&version=3D2} status=3D0= QTime=3D0=20 [junit4:junit4] 2> 21064 T1601 C66 P31033 oash.SnapPuller.fetchLatestInde= x Number of files in latest index in master: 1 [junit4:junit4] 2> 21066 T1601 C66 P31033 oasc.CachingDirectoryFactory.ge= t return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363072312= 423/jetty4/index.20130312071213484 forceNew: false [junit4:junit4] 2> 21067 T1601 C66 P31033 oash.SnapPuller.fetchLatestInde= x Starting download to MockDirWrapper(org.apache.lucene.store.SimpleFSDirec= tory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk= /solr/build/solr-core/test/J0/index1292012950tmp lockFactory=3Dorg.apache.l= ucene.store.NativeFSLockFactory@6351149e) fullCopy=3Dfalse [junit4:junit4] 2> 21070 T1540 C65 P31017 REQ /replication {file=3Dsegmen= ts_4&command=3Dfilecontent&checksum=3Dtrue&wt=3Dfilestream&qt=3D/replicatio= n&generation=3D4} status=3D0 QTime=3D0=20 [junit4:junit4] 2> 21072 T1601 C66 P31033 oash.SnapPuller.fetchLatestInde= x Total time taken for download : 0 secs [junit4:junit4] 2> 21075 T1601 C66 P31033 oasu.DefaultSolrCoreState.newIn= dexWriter Creating new IndexWriter... [junit4:junit4] 2> 21075 T1601 C66 P31033 oasu.DefaultSolrCoreState.newIn= dexWriter Waiting until IndexWriter is unused... core=3Dcollection1 [junit4:junit4] 2> 21077 T1601 C66 P31033 oasc.SolrDeletionPolicy.onInit = SolrDeletionPolicy.onInit: commits:num=3D2 [junit4:junit4] 2> =09=09commit{dir=3DMockDirWrapper(org.apache.lucene.st= ore.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nigh= tlyTests-trunk/solr/build/solr-core/test/J0/index1292012946tmp lockFactory= =3Dorg.apache.lucene.store.NativeFSLockFactory@794579f3),segFN=3Dsegments_1= ,generation=3D1,filenames=3D[segments_1] [junit4:junit4] 2> =09=09commit{dir=3DMockDirWrapper(org.apache.lucene.st= ore.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Nigh= tlyTests-trunk/solr/build/solr-core/test/J0/index1292012946tmp lockFactory= =3Dorg.apache.lucene.store.NativeFSLockFactory@794579f3),segFN=3Dsegments_4= ,generation=3D4,filenames=3D[segments_4] [junit4:junit4] 2> 21078 T1601 C66 P31033 oasc.SolrDeletionPolicy.updateC= ommits newest commit =3D 4[segments_4] [junit4:junit4] 2> 21078 T1601 C66 P31033 oasu.DefaultSolrCoreState.newIn= dexWriter New IndexWriter is ready to be used. [junit4:junit4] 2> 21078 T1601 C66 P31033 oass.SolrIndexSearcher. O= pening Searcher@384e5d26 main [junit4:junit4] 2> 21079 T1600 oasc.SolrCore.registerSearcher [collection= 1] Registered new searcher Searcher@384e5d26 main{StandardDirectoryReader(s= egments_4:1:nrt)} [junit4:junit4] 2> 21080 T1601 C66 P31033 oash.SnapPuller.fetchLatestInde= x removing temporary index download directory files MockDirWrapper(org.apac= he.lucene.store.SimpleFSDirectory@/usr/home/hudson/hudson-slave/workspace/L= ucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/index1292012950t= mp lockFactory=3Dorg.apache.lucene.store.NativeFSLockFactory@6351149e) [junit4:junit4] 2> 21080 T1601 C66 P31033 oasc.RecoveryStrategy.replay No= replay needed. core=3Dcollection1 [junit4:junit4] 2> 21080 T1601 C66 P31033 oasc.RecoveryStrategy.doRecover= y Replication Recovery was successful - registering as Active. core=3Dcolle= ction1 [junit4:junit4] 2> 21080 T1601 C66 P31033 oasc.ZkController.publish publi= shing core=3Dcollection1 state=3Dactive [junit4:junit4] 2> 21080 T1601 C66 P31033 oasc.ZkController.publish numSh= ards not found on descriptor - reading it from system property [junit4:junit4] 2> 21082 T1601 C66 P31033 oasc.RecoveryStrategy.doRecover= y Finished recovery process. core=3Dcollection1 [junit4:junit4] 2> 21127 T1618 oasc.CoreContainer.registerCore registerin= g core: collection1 [junit4:junit4] 2> 21127 T1618 oasc.ZkController.register Register replic= a - core:collection1 address:http://127.0.0.1:31041 collection:collection1 = shard:shard1 [junit4:junit4] 2> 21131 T1618 oasc.ZkController.register We are http://1= 27.0.0.1:31041/collection1/ and leader is http://127.0.0.1:31017/collection= 1/ [junit4:junit4] 2> 21131 T1618 oasc.ZkController.register No LogReplay ne= eded for core=3Dcollection1 baseURL=3Dhttp://127.0.0.1:31041 [junit4:junit4] 2> 21131 T1618 oasc.ZkController.checkRecovery Core needs= to recover:collection1 [junit4:junit4] 2> 21131 T1618 oasu.DefaultSolrCoreState.doRecovery Runni= ng recovery - first canceling any ongoing recovery [junit4:junit4] 2> ASYNC NEW_CORE C67 name=3Dcollection1 org.apache.solr= .core.SolrCore@3f2a1ab3 url=3Dhttp://127.0.0.1:31041/collection1 node=3D127= .0.0.1:31041_ C67_STATE=3Dcoll:collection1 core:collection1 props:{state=3D= down, core=3Dcollection1, collection=3Dcollection1, node_name=3D127.0.0.1:3= 1041_, base_url=3Dhttp://127.0.0.1:31041} [junit4:junit4] 2> 21132 T1622 C67 P31041 oasc.RecoveryStrategy.run Start= ing recovery process. core=3Dcollection1 recoveringAfterStartup=3Dtrue [junit4:junit4] 2> 21132 T1622 C67 P31041 oasc.RecoveryStrategy.doRecover= y ###### startupVersions=3D[] [junit4:junit4] 2> 21132 T1618 oascc.ZkStateReader.updateClusterState Upd= ating cloud state from ZooKeeper...=20 [junit4:junit4] 2> 21132 T1622 C67 P31041 oasc.ZkController.publish publi= shing core=3Dcollection1 state=3Drecovering [junit4:junit4] 2> 21133 T1622 C67 P31041 oasc.ZkController.publish numSh= ards not found on descriptor - reading it from system property [junit4:junit4] 2> 21133 T1504 oass.SolrDispatchFilter.init user.dir=3D/u= sr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/b= uild/solr-core/test/J0 [junit4:junit4] 2> 21134 T1504 oass.SolrDispatchFilter.init SolrDispatchF= ilter.init() done [junit4:junit4] 2> 21134 T1622 C67 P31041 oascsi.HttpClientUtil.createCli= ent Creating new http client, config:maxConnections=3D128&maxConnectionsPer= Host=3D32&followRedirects=3Dfalse [junit4:junit4] 2> 21134 T1504 oascsi.HttpClientUtil.createClient Creatin= g new http client, config:maxConnections=3D128&maxConnectionsPerHost=3D32&f= ollowRedirects=3Dfalse [junit4:junit4] 2> 21277 T1504 oejs.Server.doStart jetty-8.1.8.v20121106 [junit4:junit4] 2> 21279 T1504 oejs.AbstractConnector.doStart Started Soc= ketConnector@127.0.0.1:31055 [junit4:junit4] 2> 21280 T1504 oass.SolrDispatchFilter.init SolrDispatchF= ilter.init() [junit4:junit4] 2> 21280 T1504 oasc.SolrResourceLoader.locateSolrHome JND= I not configured for solr (NoInitialContextEx) [junit4:junit4] 2> 21280 T1504 oasc.SolrResourceLoader.locateSolrHome usi= ng system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/= Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.so= lr.cloud.SyncSliceTest-jetty6-1363072333569 [junit4:junit4] 2> 21281 T1504 oasc.CoreContainer$Initializer.initialize = looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucen= e-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cl= oud.SyncSliceTest-jetty6-1363072333569/solr.xml [junit4:junit4] 2> 21281 T1504 oasc.CoreContainer. New CoreContaine= r 1074731568 [junit4:junit4] 2> 21282 T1504 oasc.CoreContainer.load Loading CoreContai= ner using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-N= ightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.Sync= SliceTest-jetty6-1363072333569/' [junit4:junit4] 2> 21282 T1504 oasc.SolrResourceLoader. new SolrRes= ourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-= Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.clou= d.SyncSliceTest-jetty6-1363072333569/' [junit4:junit4] 2> 21316 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting socketTimeout to: 120000 [junit4:junit4] 2> 21317 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting urlScheme to: http:// [junit4:junit4] 2> 21317 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting connTimeout to: 15000 [junit4:junit4] 2> 21317 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting maxConnectionsPerHost to: 20 [junit4:junit4] 2> 21318 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting corePoolSize to: 0 [junit4:junit4] 2> 21318 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting maximumPoolSize to: 2147483647 [junit4:junit4] 2> 21318 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting maxThreadIdleTime to: 5 [junit4:junit4] 2> 21319 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting sizeOfQueue to: -1 [junit4:junit4] 2> 21319 T1504 oashc.HttpShardHandlerFactory.getParameter= Setting fairnessPolicy to: false [junit4:junit4] 2> 21319 T1504 oascsi.HttpClientUtil.createClient Creatin= g new http client, config:maxConnectionsPerHost=3D20&maxConnections=3D10000= &socketTimeout=3D120000&connTimeout=3D15000&retry=3Dfalse [junit4:junit4] 2> 21334 T1504 oasc.CoreContainer.load Registering Log Li= stener [junit4:junit4] 2> 21348 T1504 oasc.CoreContainer.initZooKeeper Zookeeper= client=3D127.0.0.1:31008/solr [junit4:junit4] 2> 21349 T1504 oasc.ZkController.checkChrootPath zkHost i= ncludes chroot [junit4:junit4] 2> 21349 T1504 oaz.ZooKeeper. Initiating client con= nection, connectString=3D127.0.0.1:31008 sessionTimeout=3D60000 watcher=3Do= rg.apache.solr.common.cloud.ConnectionManager@5393c049 [junit4:junit4] 2> 21350 T1504 oascc.ConnectionManager.waitForConnected W= aiting for client to connect to ZooKeeper [junit4:junit4] 2> 21350 T1633 oaz.ClientCnxn$SendThread.logStartConnect = Opening socket connection to server localhost/127.0.0.1:31008. Will not att= empt to authenticate using SASL (access denied (javax.security.auth.AuthPer= mission getLoginConfiguration)) [junit4:junit4] 2> 21351 T1633 oaz.ClientCnxn$SendThread.primeConnection = Socket connection established to localhost/127.0.0.1:31008, initiating sess= ion [junit4:junit4] 2> 21351 T1506 oazs.NIOServerCnxnFactory.run Accepted soc= ket connection from /140.211.11.196:31056 [junit4:junit4] 2> 21351 T1506 oazs.ZooKeeperServer.processConnectRequest= Client attempting to establish new session at /140.211.11.196:31056 [junit4:junit4] 2> 21353 T1508 oazs.ZooKeeperServer.finishSessionInit Est= ablished session 0x13d5d70e46d000f with negotiated timeout 20000 for client= /140.211.11.196:31056 [junit4:junit4] 2> 21353 T1633 oaz.ClientCnxn$SendThread.onConnected Sess= ion establishment complete on server localhost/127.0.0.1:31008, sessionid = =3D 0x13d5d70e46d000f, negotiated timeout =3D 20000 [junit4:junit4] 2> 21353 T1634 oascc.ConnectionManager.process Watcher or= g.apache.solr.common.cloud.ConnectionManager@5393c049 name:ZooKeeperConnect= ion Watcher:127.0.0.1:31008 got event WatchedEvent state:SyncConnected type= :None path:null path:null type:None [junit4:junit4] 2> 21353 T1504 oascc.ConnectionManager.waitForConnected C= lient is connected to ZooKeeper [junit4:junit4] 2> 21354 T1509 oazs.PrepRequestProcessor.pRequest2Txn Pro= cessed session termination for sessionid: 0x13d5d70e46d000f [junit4:junit4] 2> 21355 T1634 oaz.ClientCnxn$EventThread.run EventThread= shut down [junit4:junit4] 2> 21355 T1506 oazs.NIOServerCnxn.closeSock Closed socket= connection for client /140.211.11.196:31056 which had sessionid 0x13d5d70e= 46d000f [junit4:junit4] 2> 21355 T1504 oaz.ZooKeeper.close Session: 0x13d5d70e46d= 000f closed [junit4:junit4] 2> 21356 T1504 oascsi.HttpClientUtil.createClient Creatin= g new http client, config:maxConnections=3D500&maxConnectionsPerHost=3D16&s= ocketTimeout=3D120000&connTimeout=3D15000 [junit4:junit4] 2> 21364 T1504 oaz.ZooKeeper. Initiating client con= nection, connectString=3D127.0.0.1:31008/solr sessionTimeout=3D30000 watche= r=3Dorg.apache.solr.common.cloud.ConnectionManager@5e546ed6 [junit4:junit4] 2> 21365 T1504 oascc.ConnectionManager.waitForConnected W= aiting for client to connect to ZooKeeper [junit4:junit4] 2> 21365 T1635 oaz.ClientCnxn$SendThread.logStartConnect = Opening socket connection to server localhost/127.0.0.1:31008. Will not att= empt to authenticate using SASL (access denied (javax.security.auth.AuthPer= mission getLoginConfiguration)) [junit4:junit4] 2> 21366 T1635 oaz.ClientCnxn$SendThread.primeConnection = Socket connection established to localhost/127.0.0.1:31008, initiating sess= ion [junit4:junit4] 2> 21366 T1506 oazs.NIOServerCnxnFactory.run Accepted soc= ket connection from /140.211.11.196:31057 [junit4:junit4] 2> 21366 T1506 oazs.ZooKeeperServer.processConnectRequest= Client attempting to establish new session at /140.211.11.196:31057 [junit4:junit4] 2> 21367 T1508 oazs.ZooKeeperServer.finishSessionInit Est= ablished session 0x13d5d70e46d0010 with negotiated timeout 20000 for client= /140.211.11.196:31057 [junit4:junit4] 2> 21367 T1635 oaz.ClientCnxn$SendThread.onConnected Sess= ion establishment complete on server localhost/127.0.0.1:31008, sessionid = =3D 0x13d5d70e46d0010, negotiated timeout =3D 20000 [junit4:junit4] 2> 21368 T1636 oascc.ConnectionManager.process Watcher or= g.apache.solr.common.cloud.ConnectionManager@5e546ed6 name:ZooKeeperConnect= ion Watcher:127.0.0.1:31008/solr got event WatchedEvent state:SyncConnected= type:None path:null path:null type:None [junit4:junit4] 2> 21368 T1504 oascc.ConnectionManager.waitForConnected C= lient is connected to ZooKeeper [junit4:junit4] 2> 21369 T1509 oazs.PrepRequestProcessor.pRequest Got use= r-level KeeperException when processing sessionid:0x13d5d70e46d0010 type:cr= eate cxid:0x1 zxid:0xc3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Er= ror:KeeperErrorCode =3D NodeExists for /solr/overseer [junit4:junit4] 2> 21370 T1509 oazs.PrepRequestProcessor.pRequest Got use= r-level KeeperException when processing sessionid:0x13d5d70e46d0010 type:cr= eate cxid:0x2 zxid:0xc4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Er= ror:KeeperErrorCode =3D NodeExists for /solr/overseer [junit4:junit4] 2> 21379 T1504 oascc.ZkStateReader.createClusterStateWatc= hersAndUpdate Updating cluster state from ZooKeeper...=20 [junit4:junit4] 2> 21945 T1527 oascc.ZkStateReader.updateClusterState Upd= ating cloud state from ZooKeeper...=20 [junit4:junit4] 2> 21946 T1527 oasc.Overseer$ClusterStateUpdater.updateSt= ate Update state numShards=3D1 message=3D{ [junit4:junit4] 2 [...truncated too long message...] ateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk= to ZK [junit4:junit4] 2> 179748 T1636 oaz.ClientCnxn$EventThread.run EventThrea= d shut down [junit4:junit4] 2> 180789 T1655 oasu.PeerSync.handleResponse WARNING Peer= Sync: core=3Dcollection1 url=3Dhttp://127.0.0.1:31059 couldn't connect to = http://127.0.0.1:31055/collection1/, counting as success [junit4:junit4] 2> 180789 T1655 oasu.PeerSync.sync PeerSync: core=3Dcolle= ction1 url=3Dhttp://127.0.0.1:31059 DONE. sync succeeded [junit4:junit4] 2> 180789 T1655 oasc.SyncStrategy.syncReplicas We have be= en closed, won't attempt to sync replicas back to leader [junit4:junit4] 2> 180790 T1655 oasc.ShardLeaderElectionContext.runLeader= Process Sync was not a success but no one else is active! I am the leader [junit4:junit4] 2> 180790 T1655 oasc.ShardLeaderElectionContext.runLeader= Process I am the new leader: http://127.0.0.1:31059/collection1/ [junit4:junit4] 2> 180790 T1655 oasc.SolrCore.close [collection1] CLOSIN= G SolrCore org.apache.solr.core.SolrCore@254d2fba [junit4:junit4] 2> 180791 T1655 oasu.DirectUpdateHandler2.close closing D= irectUpdateHandler2{commits=3D10,autocommits=3D0,soft autocommits=3D0,optim= izes=3D0,rollbacks=3D0,expungeDeletes=3D0,docsPending=3D0,adds=3D0,deletesB= yId=3D0,deletesByQuery=3D0,errors=3D0,cumulative_adds=3D305,cumulative_dele= tesById=3D0,cumulative_deletesByQuery=3D1,cumulative_errors=3D0} [junit4:junit4] 2> 180803 T1655 oasu.SolrCoreState.decrefSolrCoreState Cl= osing SolrCoreState [junit4:junit4] 2> 180803 T1655 oasu.DefaultSolrCoreState.closeIndexWrite= r SolrCoreState ref count has reached 0 - closing IndexWriter [junit4:junit4] 2> 180804 T1655 oasu.DefaultSolrCoreState.closeIndexWrite= r closing IndexWriter with IndexWriterCloser [junit4:junit4] 2> 180804 T1655 C69 P31059 oasu.TransactionLog.forceClose= SEVERE Error: Forcing close of tlog{file=3D./org.apache.solr.cloud.SyncSli= ceTest-1363072312423/jetty7/tlog/tlog.0000000000000000005 refcount=3D1} [junit4:junit4] 2> 180806 T1655 oasc.SolrCore.closeSearcher [collection1]= Closing main searcher on request. [junit4:junit4] 2> 180807 T1655 oasc.CachingDirectoryFactory.close Closin= g directory when closing factory: ./org.apache.solr.cloud.SyncSliceTest-136= 3072312423/jetty7/index [junit4:junit4] 2> 180807 T1655 oasc.CachingDirectoryFactory.closeDirecto= ry Closing directory: ./org.apache.solr.cloud.SyncSliceTest-1363072312423/j= etty7/index [junit4:junit4] 2> 180808 T1655 oasc.CachingDirectoryFactory.close Closin= g directory when closing factory: ./org.apache.solr.cloud.SyncSliceTest-136= 3072312423/jetty7/index.20130312071222678 [junit4:junit4] 2> 180808 T1655 oasc.CachingDirectoryFactory.closeDirecto= ry Closing directory: ./org.apache.solr.cloud.SyncSliceTest-1363072312423/j= etty7/index.20130312071222678 [junit4:junit4] 2> 180808 T1655 oasc.CachingDirectoryFactory.close Closin= g directory when closing factory: ./org.apache.solr.cloud.SyncSliceTest-136= 3072312423/jetty7 [junit4:junit4] 2> 180808 T1655 oasc.CachingDirectoryFactory.closeDirecto= ry Closing directory: ./org.apache.solr.cloud.SyncSliceTest-1363072312423/j= etty7 [junit4:junit4] 2> 180808 T1655 oascc.SolrZkClient.makePath makePath: /co= llections/collection1/leaders/shard1 [junit4:junit4] 2> 180809 T1655 oasc.LeaderElector$1.process WARNING org= .apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = =3D Session expired for /collections/collection1/leader_elect/shard1/electi= on/89330307067346962-127.0.0.1:31059__collection1-n_0000000006 [junit4:junit4] 2> =09at org.apache.zookeeper.KeeperException.create(Keep= erException.java:127) [junit4:junit4] 2> =09at org.apache.zookeeper.KeeperException.create(Keep= erException.java:51) [junit4:junit4] 2> =09at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.= java:873) [junit4:junit4] 2> =09at org.apache.solr.common.cloud.SolrZkClient$2.exec= ute(SolrZkClient.java:153) [junit4:junit4] 2> =09at org.apache.solr.common.cloud.SolrZkClient$2.exec= ute(SolrZkClient.java:150) [junit4:junit4] 2> =09at org.apache.solr.common.cloud.ZkCmdExecutor.retry= Operation(ZkCmdExecutor.java:65) [junit4:junit4] 2> =09at org.apache.solr.common.cloud.SolrZkClient.delete= (SolrZkClient.java:150) [junit4:junit4] 2> =09at org.apache.solr.cloud.ElectionContext.cancelElec= tion(ElectionContext.java:63) [junit4:junit4] 2> =09at org.apache.solr.cloud.ShardLeaderElectionContext= .runLeaderProcess(ElectionContext.java:243) [junit4:junit4] 2> =09at org.apache.solr.cloud.LeaderElector.runIamLeader= Process(LeaderElector.java:156) [junit4:junit4] 2> =09at org.apache.solr.cloud.LeaderElector.checkIfIamLe= ader(LeaderElector.java:100) [junit4:junit4] 2> =09at org.apache.solr.cloud.LeaderElector.access$000(L= eaderElector.java:55) [junit4:junit4] 2> =09at org.apache.solr.cloud.LeaderElector$1.process(Le= aderElector.java:129) [junit4:junit4] 2> =09at org.apache.zookeeper.ClientCnxn$EventThread.proc= essEvent(ClientCnxn.java:519) [junit4:junit4] 2> =09at org.apache.zookeeper.ClientCnxn$EventThread.run(= ClientCnxn.java:495) [junit4:junit4] 2>=20 [junit4:junit4] 2> 180809 T1655 oascc.ZkStateReader$2.process A cluster s= tate change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path= :/live_nodes, has occurred - updating... (live nodes size: 2) [junit4:junit4] 2> 180810 T1655 oascc.ZkStateReader$2.process WARNING Zoo= Keeper watch triggered, but Solr cannot talk to ZK [junit4:junit4] 2> 180810 T1655 oascc.ZkStateReader$3.process WARNING Zoo= Keeper watch triggered, but Solr cannot talk to ZK [junit4:junit4] 2> 180810 T1655 oasc.LeaderElector$1.process WARNING org= .apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = =3D Session expired for /overseer_elect/election [junit4:junit4] 2> =09at org.apache.zookeeper.KeeperException.create(Keep= erException.java:127) [junit4:junit4] 2> =09at org.apache.zookeeper.KeeperException.create(Keep= erException.java:51) [junit4:junit4] 2> =09at org.apache.zookeeper.ZooKeeper.getChildren(ZooKe= eper.java:1468) [junit4:junit4] 2> =09at org.apache.solr.common.cloud.SolrZkClient$6.exec= ute(SolrZkClient.java:236) [junit4:junit4] 2> =09at org.apache.solr.common.cloud.SolrZkClient$6.exec= ute(SolrZkClient.java:233) [junit4:junit4] 2> =09at org.apache.solr.common.cloud.ZkCmdExecutor.retry= Operation(ZkCmdExecutor.java:65) [junit4:junit4] 2> =09at org.apache.solr.common.cloud.SolrZkClient.getChi= ldren(SolrZkClient.java:233) [junit4:junit4] 2> =09at org.apache.solr.cloud.LeaderElector.checkIfIamLe= ader(LeaderElector.java:84) [junit4:junit4] 2> =09at org.apache.solr.cloud.LeaderElector.access$000(L= eaderElector.java:55) [junit4:junit4] 2> =09at org.apache.solr.cloud.LeaderElector$1.process(Le= aderElector.java:129) [junit4:junit4] 2> =09at org.apache.zookeeper.ClientCnxn$EventThread.proc= essEvent(ClientCnxn.java:519) [junit4:junit4] 2> =09at org.apache.zookeeper.ClientCnxn$EventThread.run(= ClientCnxn.java:495) [junit4:junit4] 2>=20 [junit4:junit4] 2> 180810 T1655 oaz.ClientCnxn$EventThread.run EventThrea= d shut down [junit4:junit4] 2> NOTE: test params are: codec=3DAsserting, sim=3DRandom= SimilarityProvider(queryNorm=3Dfalse,coord=3Dyes): {}, locale=3Dzh_HK, time= zone=3DEtc/Universal [junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. = 1.6.0_32 (64-bit)/cpus=3D16,threads=3D4,free=3D134342848,total=3D437256192 [junit4:junit4] 2> NOTE: All tests run in this JVM: [LegacyHTMLStripCharF= ilterTest, CSVRequestHandlerTest, ResourceLoaderTest, TestBadConfig, DocVal= uesTest, TestWriterPerf, TestSearchPerf, PrimitiveFieldTypeTest, PeerSyncTe= st, TestLMDirichletSimilarityFactory, RecoveryZkTest, PrimUtilsTest, Analys= isAfterCoreReloadTest, ZkCLITest, TestFunctionQuery, SynonymTokenizerTest, = TestFieldResource, FieldMutatingUpdateProcessorTest, ScriptEngineTest, Circ= ularListTest, UpdateRequestProcessorFactoryTest, TestPseudoReturnFields, Bi= naryUpdateRequestHandlerTest, TestFastLRUCache, BasicFunctionalityTest, Pre= AnalyzedFieldTest, ClusterStateUpdateTest, WordBreakSolrSpellCheckerTest, L= ukeRequestHandlerTest, TestExtendedDismaxParser, TestReversedWildcardFilter= Factory, CoreAdminHandlerTest, ShardRoutingTest, QueryElevationComponentTes= t, TestSolrQueryParser, SolrIndexSplitterTest, SystemInfoHandlerTest, Searc= hHandlerTest, TestQueryUtils, TestSolrIndexConfig, TestRealTimeGet, TermVec= torComponentTest, LeaderElectionTest, FileBasedSpellCheckerTest, TestTrie, = TestStressVersions, DistributedQueryElevationComponentTest, TestXIncludeCon= fig, FastVectorHighlighterTest, TestGroupingSearch, SOLR749Test, ZkControll= erTest, SimpleFacetsTest, SliceStateTest, MinimalSchemaTest, TestSolrCorePr= operties, DistributedSpellCheckComponentTest, SolrCoreTest, BadComponentTes= t, SyncSliceTest] [junit4:junit4] Completed on J0 in 181.05s, 1 test, 1 failure <<< FAILURES! [...truncated 542 lines...] BUILD FAILED /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/buil= d.xml:388: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/buil= d.xml:361: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/buil= d.xml:39: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr= /build.xml:183: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr= /common-build.xml:449: The following error occurred while executing this li= ne: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/luce= ne/common-build.xml:1213: The following error occurred while executing this= line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/luce= ne/common-build.xml:877: There were test failures: 271 suites, 1140 tests, = 1 failure, 25 ignored (6 assumptions) Total time: 115 minutes 43 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts Recording test results Email was triggered for: Failure Sending email for trigger: Failure ------=_Part_3683_268369041.1363073934379 Content-Type: text/plain; charset=us-ascii --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org ------=_Part_3683_268369041.1363073934379--