Return-Path: X-Original-To: apmail-lucene-dev-archive@www.apache.org Delivered-To: apmail-lucene-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AC9A8F68B for ; Wed, 1 May 2013 13:58:35 +0000 (UTC) Received: (qmail 73524 invoked by uid 500); 1 May 2013 13:58:34 -0000 Delivered-To: apmail-lucene-dev-archive@lucene.apache.org Received: (qmail 72928 invoked by uid 500); 1 May 2013 13:58:29 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 72904 invoked by uid 99); 1 May 2013 13:58:28 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 May 2013 13:58:28 +0000 X-ASF-Spam-Status: No, hits=0.0 required=5.0 tests=NORMAL_HTTP_TO_IP,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jenkins@thetaphi.de designates 188.138.97.18 as permitted sender) Received: from [188.138.97.18] (HELO mail.sd-datasolutions.de) (188.138.97.18) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 May 2013 13:58:18 +0000 Received: from serv1 (localhost.localdomain [127.0.0.1]) by mail.sd-datasolutions.de (Postfix) with ESMTP id 2122814AA043 for ; Wed, 1 May 2013 13:57:56 +0000 (UTC) Date: Wed, 1 May 2013 13:57:42 +0000 (UTC) From: Policeman Jenkins Server To: dev@lucene.apache.org Message-ID: <844485225.79.1367416676117.JavaMail.jenkins@serv1.sd-datasolutions.de> In-Reply-To: <206162288.77.1367411852793.JavaMail.jenkins@serv1.sd-datasolutions.de> References: <206162288.77.1367411852793.JavaMail.jenkins@serv1.sd-datasolutions.de> Subject: [JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b86) - Build # 5381 - Still Failing! MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_78_1435171227.1367416662475" X-Jenkins-Job: Lucene-Solr-4.x-Linux X-Jenkins-Result: FAILURE X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_78_1435171227.1367416662475 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/5381/ Java: 32bit/jdk1.8.0-ea-b86 -server -XX:+UseSerialGC 1 tests failed. FAILED: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch Error Message: Server at http://127.0.0.1:38834/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update Stack Trace: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:38834/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update at __randomizedtesting.SeedInfo.seed([747A9C495D95415E:F59C12512ACA2162]:0) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:387) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180) at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102) at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197) at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89) at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:490) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559) at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746) at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648) at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358) at java.lang.Thread.run(Thread.java:722) Build Log: [...truncated 9006 lines...] [junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test [junit4:junit4] 1> INFO - 2013-05-01 13:36:58.472; org.apache.solr.BaseDistributedSearchTestCase; Setting hostContext system property: / [junit4:junit4] 1> INFO - 2013-05-01 13:36:58.482; org.apache.solr.SolrTestCaseJ4; ###Starting testDistribSearch [junit4:junit4] 1> INFO - 2013-05-01 13:36:58.487; org.apache.solr.cloud.ZkTestServer; STARTING ZK TEST SERVER [junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0 [junit4:junit4] 1> INFO - 2013-05-01 13:36:58.490; org.apache.solr.cloud.ZkTestServer$ZKServerMain; Starting server [junit4:junit4] 1> INFO - 2013-05-01 13:36:58.590; org.apache.solr.cloud.ZkTestServer; start zk server on port:37089 [junit4:junit4] 1> INFO - 2013-05-01 13:36:58.643; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.257; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@18d2d74 name:ZooKeeperConnection Watcher:127.0.0.1:37089 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.258; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.260; org.apache.solr.common.cloud.SolrZkClient; makePath: /solr [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.286; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.289; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@9a4bfa name:ZooKeeperConnection Watcher:127.0.0.1:37089/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.289; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.290; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.297; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/shards [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.305; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.309; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/shards [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.314; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.323; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/solrconfig.xml [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.332; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.333; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/schema.xml [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.338; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.339; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/stopwords.txt [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.345; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.346; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/protwords.txt [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.352; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.353; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/currency.xml [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.358; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.359; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/open-exchange-rates.json [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.364; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.364; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/mapping-ISOLatin1Accent.txt [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.370; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.370; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/old_synonyms.txt [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.375; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.376; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/synonyms.txt [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.587; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312 [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.698; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:46285 [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.713; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.714; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx) [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.714; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367415419382 [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.715; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367415419382/solr.xml [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.716; org.apache.solr.core.CoreContainer; New CoreContainer 8625691 [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.717; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367415419382/' [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.717; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367415419382/' [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.815; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000 [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.816; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http:// [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.817; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000 [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.817; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20 [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.818; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0 [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.819; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647 [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.819; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5 [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.820; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1 [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.821; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false [junit4:junit4] 1> INFO - 2013-05-01 13:36:59.835; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.073; org.apache.solr.core.CoreContainer; Registering Log Listener [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.074; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:37089/solr [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.083; org.apache.solr.cloud.ZkController; zkHost includes chroot [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.085; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.089; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@58ab97 name:ZooKeeperConnection Watcher:127.0.0.1:37089 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.090; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.094; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000 [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.103; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.105; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@2cbe0b name:ZooKeeperConnection Watcher:127.0.0.1:37089/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.106; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.111; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.120; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/collection-queue-work [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.128; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.131; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46285_ [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.134; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:46285_ [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.139; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/election [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.152; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.156; org.apache.solr.cloud.Overseer; Overseer (id=89614936870486019-127.0.0.1:46285_-n_0000000000) starting [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.166; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue-work [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.177; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.178; org.apache.solr.common.cloud.SolrZkClient; makePath: /clusterstate.json [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.182; org.apache.solr.common.cloud.SolrZkClient; makePath: /aliases.json [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.186; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.196; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.215; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367415419382/collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.216; org.apache.solr.cloud.ZkController; Check for collection zkNode:control_collection [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.217; org.apache.solr.cloud.ZkController; Collection zkNode exists [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.218; org.apache.solr.cloud.ZkController; Load collection config from:/collections/control_collection [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.221; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367415419382/collection1/' [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.222; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367415419382/collection1/lib/README' to classloader [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.223; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367415419382/collection1/lib/classes/' to classloader [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.283; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44 [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.332; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.335; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.374; org.apache.solr.schema.IndexSchema; Schema name=test [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.876; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.888; org.apache.solr.schema.IndexSchema; default search field in schema is text [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.891; org.apache.solr.schema.IndexSchema; unique key field: id [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.926; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.934; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.939; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json [junit4:junit4] 1> WARN - 2013-05-01 13:37:00.943; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE [junit4:junit4] 1> WARN - 2013-05-01 13:37:00.944; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.945; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json [junit4:junit4] 1> WARN - 2013-05-01 13:37:00.947; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE [junit4:junit4] 1> WARN - 2013-05-01 13:37:00.948; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.948; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.949; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367415419382/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/control/data/ [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.952; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@efb2cc [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.953; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.954; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/control/data [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.955; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/control/data/index/ [junit4:junit4] 1> WARN - 2013-05-01 13:37:00.955; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/control/data/index' doesn't exist. Creating new index... [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.956; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/control/data/index [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.959; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1 [junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@c88958 lockFactory=org.apache.lucene.store.NativeFSLockFactory@86888c),segFN=segments_1,generation=1} [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.960; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.975; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.976; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.977; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.978; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.979; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.979; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.980; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.980; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.981; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.984; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60 [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.987; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@f91ae1 main [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.990; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/control/data/tlog [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.997; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-05-01 13:37:00.997; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-05-01 13:37:01.003; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@f91ae1 main{StandardDirectoryReader(segments_1:1)} [junit4:junit4] 1> INFO - 2013-05-01 13:37:01.006; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down [junit4:junit4] 1> INFO - 2013-05-01 13:37:01.006; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property [junit4:junit4] 1> INFO - 2013-05-01 13:37:01.706; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:01.708; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={ [junit4:junit4] 1> "numShards":"1", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "collection":"control_collection", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:46285_", [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "shard":null, [junit4:junit4] 1> "core_node_name":"1", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:46285", [junit4:junit4] 1> "operation":"state"} [junit4:junit4] 1> INFO - 2013-05-01 13:37:01.708; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection control_collection with numShards 1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:01.716; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:01.729; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4:junit4] 1> INFO - 2013-05-01 13:37:02.009; org.apache.solr.core.CoreContainer; registering core: collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:02.010; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:46285 collection:control_collection shard:shard1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:02.016; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false [junit4:junit4] 1> INFO - 2013-05-01 13:37:02.029; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leader_elect/shard1/election [junit4:junit4] 1> INFO - 2013-05-01 13:37:02.040; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process. [junit4:junit4] 1> INFO - 2013-05-01 13:37:02.044; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue. [junit4:junit4] 1> INFO - 2013-05-01 13:37:02.044; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync [junit4:junit4] 1> INFO - 2013-05-01 13:37:02.046; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:46285/collection1/ [junit4:junit4] 1> INFO - 2013-05-01 13:37:02.046; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me [junit4:junit4] 1> INFO - 2013-05-01 13:37:02.047; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:46285/collection1/ has no replicas [junit4:junit4] 1> INFO - 2013-05-01 13:37:02.047; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:46285/collection1/ [junit4:junit4] 1> INFO - 2013-05-01 13:37:02.047; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leaders/shard1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.239; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.254; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.312; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:46285/collection1/ and leader is http://127.0.0.1:46285/collection1/ [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.316; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46285 [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.317; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.318; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.319; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.324; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.326; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.327; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.348; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.354; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config: [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.356; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.358; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@97c87b name:ZooKeeperConnection Watcher:127.0.0.1:37089/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.359; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.361; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.367; org.apache.solr.cloud.ChaosMonkey; monkey: init - expire sessions:true cause connection loss:true [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.440; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312 [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.444; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:43043 [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.445; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.446; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx) [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.446; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367415423367 [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.447; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367415423367/solr.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.448; org.apache.solr.core.CoreContainer; New CoreContainer 21373082 [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.448; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367415423367/' [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.449; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367415423367/' [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.529; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000 [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.530; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http:// [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.530; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000 [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.531; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20 [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.531; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0 [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.532; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647 [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.532; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5 [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.533; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.533; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.534; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.538; org.apache.solr.core.CoreContainer; Registering Log Listener [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.538; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:37089/solr [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.539; org.apache.solr.cloud.ZkController; zkHost includes chroot [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.540; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.542; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@200d31 name:ZooKeeperConnection Watcher:127.0.0.1:37089 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.543; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.545; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000 [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.549; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.551; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@383248 name:ZooKeeperConnection Watcher:127.0.0.1:37089/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.551; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:03.558; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.564; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43043_ [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.566; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:43043_ [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.570; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2) [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.571; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2) [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.571; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2) [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.571; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.581; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367415423367/collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.582; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.584; org.apache.solr.cloud.ZkController; Collection zkNode exists [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.585; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.589; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367415423367/collection1/' [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.591; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367415423367/collection1/lib/README' to classloader [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.593; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367415423367/collection1/lib/classes/' to classloader [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.644; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44 [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.689; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.692; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.729; org.apache.solr.schema.IndexSchema; Schema name=test [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.763; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.765; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={ [junit4:junit4] 1> "numShards":"1", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "collection":"control_collection", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:46285_", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "core_node_name":"1", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:46285", [junit4:junit4] 1> "operation":"state"} [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.782; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.782; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-05-01 13:37:04.782; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.217; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.228; org.apache.solr.schema.IndexSchema; default search field in schema is text [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.231; org.apache.solr.schema.IndexSchema; unique key field: id [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.273; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.282; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.291; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json [junit4:junit4] 1> WARN - 2013-05-01 13:37:05.295; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE [junit4:junit4] 1> WARN - 2013-05-01 13:37:05.296; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.297; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json [junit4:junit4] 1> WARN - 2013-05-01 13:37:05.300; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE [junit4:junit4] 1> WARN - 2013-05-01 13:37:05.301; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.302; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.302; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367415423367/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty1/ [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.303; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@efb2cc [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.307; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.308; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.309; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty1/index/ [junit4:junit4] 1> WARN - 2013-05-01 13:37:05.310; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty1/index' doesn't exist. Creating new index... [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.311; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty1/index [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.314; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1 [junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ba0fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@14816b8),segFN=segments_1,generation=1} [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.315; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.321; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.322; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.324; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.326; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.328; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.328; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.329; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.330; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.330; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.333; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60 [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.336; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@fae881 main [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.336; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty1/tlog [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.337; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.337; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.348; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@fae881 main{StandardDirectoryReader(segments_1:1)} [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.351; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down [junit4:junit4] 1> INFO - 2013-05-01 13:37:05.351; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property [junit4:junit4] 1> INFO - 2013-05-01 13:37:06.290; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:06.292; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={ [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:43043_", [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "shard":null, [junit4:junit4] 1> "core_node_name":"2", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:43043", [junit4:junit4] 1> "operation":"state"} [junit4:junit4] 1> INFO - 2013-05-01 13:37:06.292; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection collection1 with numShards 2 [junit4:junit4] 1> INFO - 2013-05-01 13:37:06.293; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:06.342; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-05-01 13:37:06.342; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-05-01 13:37:06.342; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-05-01 13:37:06.353; org.apache.solr.core.CoreContainer; registering core: collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:06.354; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:43043 collection:collection1 shard:shard1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:06.356; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard1/election [junit4:junit4] 1> INFO - 2013-05-01 13:37:06.368; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process. [junit4:junit4] 1> INFO - 2013-05-01 13:37:06.372; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue. [junit4:junit4] 1> INFO - 2013-05-01 13:37:06.373; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync [junit4:junit4] 1> INFO - 2013-05-01 13:37:06.373; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:43043/collection1/ [junit4:junit4] 1> INFO - 2013-05-01 13:37:06.374; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me [junit4:junit4] 1> INFO - 2013-05-01 13:37:06.374; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:43043/collection1/ has no replicas [junit4:junit4] 1> INFO - 2013-05-01 13:37:06.374; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:43043/collection1/ [junit4:junit4] 1> INFO - 2013-05-01 13:37:06.375; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.850; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.864; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.864; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.864; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.888; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:43043/collection1/ and leader is http://127.0.0.1:43043/collection1/ [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.889; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:43043 [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.889; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.889; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.890; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.892; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.894; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.895; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.895; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.969; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312 [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.972; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:38834 [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.973; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.973; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx) [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.974; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367415427899 [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.974; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367415427899/solr.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.975; org.apache.solr.core.CoreContainer; New CoreContainer 8414521 [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.975; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367415427899/' [junit4:junit4] 1> INFO - 2013-05-01 13:37:07.976; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367415427899/' [junit4:junit4] 1> INFO - 2013-05-01 13:37:08.034; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000 [junit4:junit4] 1> INFO - 2013-05-01 13:37:08.035; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http:// [junit4:junit4] 1> INFO - 2013-05-01 13:37:08.035; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000 [junit4:junit4] 1> INFO - 2013-05-01 13:37:08.036; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20 [junit4:junit4] 1> INFO - 2013-05-01 13:37:08.036; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0 [junit4:junit4] 1> INFO - 2013-05-01 13:37:08.037; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647 [junit4:junit4] 1> INFO - 2013-05-01 13:37:08.037; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5 [junit4:junit4] 1> INFO - 2013-05-01 13:37:08.038; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:08.038; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false [junit4:junit4] 1> INFO - 2013-05-01 13:37:08.039; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false [junit4:junit4] 1> INFO - 2013-05-01 13:37:08.043; org.apache.solr.core.CoreContainer; Registering Log Listener [junit4:junit4] 1> INFO - 2013-05-01 13:37:08.044; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:37089/solr [junit4:junit4] 1> INFO - 2013-05-01 13:37:08.044; org.apache.solr.cloud.ZkController; zkHost includes chroot [junit4:junit4] 1> INFO - 2013-05-01 13:37:08.045; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:08.048; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@19c70b2 name:ZooKeeperConnection Watcher:127.0.0.1:37089 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-05-01 13:37:08.048; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:08.051; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000 [junit4:junit4] 1> INFO - 2013-05-01 13:37:08.055; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:08.057; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1f74385 name:ZooKeeperConnection Watcher:127.0.0.1:37089/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-05-01 13:37:08.057; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:08.065; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.070; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38834_ [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.072; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:38834_ [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.076; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.076; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.077; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3) [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.076; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2) [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.078; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3) [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.079; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3) [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.081; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3) [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.084; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367415427899/collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.084; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.085; org.apache.solr.cloud.ZkController; Collection zkNode exists [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.086; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.088; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367415427899/collection1/' [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.088; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367415427899/collection1/lib/README' to classloader [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.089; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367415427899/collection1/lib/classes/' to classloader [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.128; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44 [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.169; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.171; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.204; org.apache.solr.schema.IndexSchema; Schema name=test [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.373; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.375; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={ [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:43043_", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "core_node_name":"2", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:43043", [junit4:junit4] 1> "operation":"state"} [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.381; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.381; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.381; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.382; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.643; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.653; org.apache.solr.schema.IndexSchema; default search field in schema is text [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.656; org.apache.solr.schema.IndexSchema; unique key field: id [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.685; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.690; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.696; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json [junit4:junit4] 1> WARN - 2013-05-01 13:37:09.698; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE [junit4:junit4] 1> WARN - 2013-05-01 13:37:09.698; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.699; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json [junit4:junit4] 1> WARN - 2013-05-01 13:37:09.700; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE [junit4:junit4] 1> WARN - 2013-05-01 13:37:09.701; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.701; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.701; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367415427899/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty2/ [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.702; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@efb2cc [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.702; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.703; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty2 [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.703; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty2/index/ [junit4:junit4] 1> WARN - 2013-05-01 13:37:09.704; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty2/index' doesn't exist. Creating new index... [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.704; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty2/index [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.706; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1 [junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@8edbdf lockFactory=org.apache.lucene.store.NativeFSLockFactory@fbfa7b),segFN=segments_1,generation=1} [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.706; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.709; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.709; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.710; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.711; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.712; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.712; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.713; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.714; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.715; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.717; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60 [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.720; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@297459 main [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.720; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty2/tlog [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.721; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.721; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.728; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@297459 main{StandardDirectoryReader(segments_1:1)} [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.731; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down [junit4:junit4] 1> INFO - 2013-05-01 13:37:09.732; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property [junit4:junit4] 1> INFO - 2013-05-01 13:37:10.889; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:10.891; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={ [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:38834_", [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "shard":null, [junit4:junit4] 1> "core_node_name":"3", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:38834", [junit4:junit4] 1> "operation":"state"} [junit4:junit4] 1> INFO - 2013-05-01 13:37:10.891; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2 [junit4:junit4] 1> INFO - 2013-05-01 13:37:10.892; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2 [junit4:junit4] 1> INFO - 2013-05-01 13:37:10.901; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-05-01 13:37:10.902; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-05-01 13:37:10.901; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-05-01 13:37:10.901; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-05-01 13:37:11.734; org.apache.solr.core.CoreContainer; registering core: collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:11.735; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:38834 collection:collection1 shard:shard2 [junit4:junit4] 1> INFO - 2013-05-01 13:37:11.736; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard2/election [junit4:junit4] 1> INFO - 2013-05-01 13:37:11.749; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process. [junit4:junit4] 1> INFO - 2013-05-01 13:37:11.754; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue. [junit4:junit4] 1> INFO - 2013-05-01 13:37:11.754; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync [junit4:junit4] 1> INFO - 2013-05-01 13:37:11.755; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:38834/collection1/ [junit4:junit4] 1> INFO - 2013-05-01 13:37:11.755; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me [junit4:junit4] 1> INFO - 2013-05-01 13:37:11.756; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:38834/collection1/ has no replicas [junit4:junit4] 1> INFO - 2013-05-01 13:37:11.756; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:38834/collection1/ [junit4:junit4] 1> INFO - 2013-05-01 13:37:11.757; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard2 [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.409; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.424; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.424; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.424; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.424; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.468; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:38834/collection1/ and leader is http://127.0.0.1:38834/collection1/ [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.469; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38834 [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.470; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.471; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.471; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.476; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.478; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.479; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.479; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.554; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312 [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.557; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:51014 [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.558; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.559; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx) [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.559; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367415432483 [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.560; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367415432483/solr.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.560; org.apache.solr.core.CoreContainer; New CoreContainer 27446282 [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.561; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367415432483/' [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.561; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367415432483/' [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.619; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000 [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.619; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http:// [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.620; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000 [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.620; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20 [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.620; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0 [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.621; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647 [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.621; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5 [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.622; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.622; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.623; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.627; org.apache.solr.core.CoreContainer; Registering Log Listener [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.628; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:37089/solr [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.628; org.apache.solr.cloud.ZkController; zkHost includes chroot [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.629; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.631; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@638f01 name:ZooKeeperConnection Watcher:127.0.0.1:37089 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.632; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.634; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000 [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.638; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.640; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@872431 name:ZooKeeperConnection Watcher:127.0.0.1:37089/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.641; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:12.646; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.651; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51014_ [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.654; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:51014_ [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.659; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.660; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.660; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3) [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.661; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.661; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.663; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.667; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.667; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.669; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.675; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367415432483/collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.676; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.678; org.apache.solr.cloud.ZkController; Collection zkNode exists [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.679; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.682; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367415432483/collection1/' [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.684; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367415432483/collection1/lib/README' to classloader [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.685; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367415432483/collection1/lib/classes/' to classloader [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.736; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44 [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.785; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.789; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.815; org.apache.solr.schema.IndexSchema; Schema name=test [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.933; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.934; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={ [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:38834_", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "shard":"shard2", [junit4:junit4] 1> "core_node_name":"3", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:38834", [junit4:junit4] 1> "operation":"state"} [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.948; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.948; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.948; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.948; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:13.948; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.259; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.277; org.apache.solr.schema.IndexSchema; default search field in schema is text [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.280; org.apache.solr.schema.IndexSchema; unique key field: id [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.319; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.328; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.336; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json [junit4:junit4] 1> WARN - 2013-05-01 13:37:14.339; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE [junit4:junit4] 1> WARN - 2013-05-01 13:37:14.340; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.341; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json [junit4:junit4] 1> WARN - 2013-05-01 13:37:14.344; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE [junit4:junit4] 1> WARN - 2013-05-01 13:37:14.345; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.346; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.347; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367415432483/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty3/ [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.348; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@efb2cc [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.349; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.350; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty3 [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.351; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty3/index/ [junit4:junit4] 1> WARN - 2013-05-01 13:37:14.352; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty3/index' doesn't exist. Creating new index... [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.352; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty3/index [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.356; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1 [junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ae6ded lockFactory=org.apache.lucene.store.NativeFSLockFactory@1644e1e),segFN=segments_1,generation=1} [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.357; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.362; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.363; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.364; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.365; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.365; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.366; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.366; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.367; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.367; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.370; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60 [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.372; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@15bbf4c main [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.373; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty3/tlog [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.373; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.374; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.385; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@15bbf4c main{StandardDirectoryReader(segments_1:1)} [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.388; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down [junit4:junit4] 1> INFO - 2013-05-01 13:37:14.388; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property [junit4:junit4] 1> INFO - 2013-05-01 13:37:15.456; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:15.457; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={ [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:51014_", [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "shard":null, [junit4:junit4] 1> "core_node_name":"4", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:51014", [junit4:junit4] 1> "operation":"state"} [junit4:junit4] 1> INFO - 2013-05-01 13:37:15.458; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2 [junit4:junit4] 1> INFO - 2013-05-01 13:37:15.458; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:15.466; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:15.466; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:15.466; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:15.466; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:15.466; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.390; org.apache.solr.core.CoreContainer; registering core: collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.391; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:51014 collection:collection1 shard:shard1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.400; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:51014/collection1/ and leader is http://127.0.0.1:43043/collection1/ [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.401; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51014 [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.402; org.apache.solr.cloud.ZkController; Core needs to recover:collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.403; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.408; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process. core=collection1 recoveringAfterStartup=true [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.409; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[] [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.409; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.410; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.411; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.413; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.413; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.414; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.414; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.544; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312 [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.547; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:35888 [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.548; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.549; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx) [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.549; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367415436419 [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.549; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367415436419/solr.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.550; org.apache.solr.core.CoreContainer; New CoreContainer 11911636 [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.550; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367415436419/' [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.551; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367415436419/' [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.605; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000 [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.606; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http:// [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.606; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000 [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.607; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20 [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.607; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0 [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.609; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647 [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.609; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5 [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.610; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.610; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.611; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.615; org.apache.solr.core.CoreContainer; Registering Log Listener [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.616; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:37089/solr [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.617; org.apache.solr.cloud.ZkController; zkHost includes chroot [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.619; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.621; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@41950f name:ZooKeeperConnection Watcher:127.0.0.1:37089 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.622; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.625; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000 [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.630; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.632; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@195c935 name:ZooKeeperConnection Watcher:127.0.0.1:37089/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.633; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.641; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.725; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.973; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.975; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={ [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:51014_", [junit4:junit4] 1> "state":"recovering", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "core_node_name":"4", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:51014", [junit4:junit4] 1> "operation":"state"} [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.985; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.985; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.985; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.985; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.985; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:16.985; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.650; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35888_ [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.653; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:35888_ [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.658; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.658; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.658; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.660; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.660; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.659; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.662; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.661; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.664; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.664; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.663; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.665; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.671; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367415436419/collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.672; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.673; org.apache.solr.cloud.ZkController; Collection zkNode exists [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.673; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.676; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367415436419/collection1/' [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.677; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367415436419/collection1/lib/README' to classloader [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.677; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367415436419/collection1/lib/classes/' to classloader [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.728; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds. [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.728; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44 [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.729; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={coreNodeName=4&core=collection1&version=2&onlyIfLeader=true&action=PREPRECOVERY&state=recovering&wt=javabin&nodeName=127.0.0.1:51014_&checkLive=true} status=0 QTime=1006 [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.780; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.782; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:17.803; org.apache.solr.schema.IndexSchema; Schema name=test [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.252; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.262; org.apache.solr.schema.IndexSchema; default search field in schema is text [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.265; org.apache.solr.schema.IndexSchema; unique key field: id [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.295; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.301; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.312; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json [junit4:junit4] 1> WARN - 2013-05-01 13:37:18.315; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE [junit4:junit4] 1> WARN - 2013-05-01 13:37:18.315; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.315; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json [junit4:junit4] 1> WARN - 2013-05-01 13:37:18.318; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE [junit4:junit4] 1> WARN - 2013-05-01 13:37:18.318; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.319; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.320; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367415436419/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty4/ [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.320; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@efb2cc [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.321; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.322; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty4 [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.323; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty4/index/ [junit4:junit4] 1> WARN - 2013-05-01 13:37:18.323; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty4/index' doesn't exist. Creating new index... [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.324; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty4/index [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.325; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1 [junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@69c913 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d2615f),segFN=segments_1,generation=1} [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.326; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.328; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.329; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.330; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.332; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.333; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.334; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.335; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.336; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.336; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.341; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60 [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.345; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@12f5f54 main [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.345; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty4/tlog [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.346; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.346; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.352; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@12f5f54 main{StandardDirectoryReader(segments_1:1)} [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.356; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.356; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.495; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.497; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={ [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:35888_", [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "shard":null, [junit4:junit4] 1> "core_node_name":"5", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:35888", [junit4:junit4] 1> "operation":"state"} [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.498; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2 [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.499; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2 [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.508; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.509; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.508; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.509; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.508; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:18.510; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.358; org.apache.solr.core.CoreContainer; registering core: collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.359; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:35888 collection:collection1 shard:shard2 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.366; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:35888/collection1/ and leader is http://127.0.0.1:38834/collection1/ [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.367; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35888 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.368; org.apache.solr.cloud.ZkController; Core needs to recover:collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.368; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.369; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process. core=collection1 recoveringAfterStartup=true [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.370; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[] [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.370; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.370; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.372; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.373; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.374; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.375; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.376; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.386; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.389; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.390; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.409; org.apache.solr.core.CoreContainer; Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367415423367/onenodecollectioncore [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.410; org.apache.solr.cloud.ZkController; Check for collection zkNode:onenodecollection [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.411; org.apache.solr.cloud.ZkController; Creating collection in ZooKeeper:onenodecollection [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.412; org.apache.solr.cloud.ZkController; Looking for collection configName [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.414; org.apache.solr.cloud.ZkController; Only one config set found in zk - using it:conf1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.414; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.418; org.apache.solr.cloud.ZkController; Load collection config from:/collections/onenodecollection [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.421; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367415423367/onenodecollectioncore/' [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.477; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.529; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.532; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.551; org.apache.solr.schema.IndexSchema; Schema name=test [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.773; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:43043/collection1/ core=collection1 - recoveringAfterStartup=true [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.777; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.789; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:51014 START replicas=[http://127.0.0.1:43043/collection1/] nUpdates=100 [junit4:junit4] 1> WARN - 2013-05-01 13:37:19.792; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.793; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.793; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.793; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.794; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null} [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.794; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:43043/collection1/. core=collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.794; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.808; org.apache.solr.core.SolrCore; [collection1] webapp= path=/get params={distrib=false&getVersions=100&version=2&qt=/get&wt=javabin} status=0 QTime=2 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.814; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.824; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=1 [junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ba0fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@14816b8),segFN=segments_1,generation=1} [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.824; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.826; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2 [junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ba0fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@14816b8),segFN=segments_1,generation=1} [junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ba0fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@14816b8),segFN=segments_2,generation=2} [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.826; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.827; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@12ad8a2 realtime [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.828; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.829; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={commit=true&version=2&commit_end_point=true&waitSearcher=true&softCommit=false&openSearcher=false&wt=javabin} {commit=} 0 21 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.851; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for 10000 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.852; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.857; org.apache.solr.handler.SnapPuller; No value set for 'pollInterval'. Timer Task not started. [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.878; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for 10000 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.879; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={version=2&command=indexversion&qt=/replication&wt=javabin} status=0 QTime=14 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.881; org.apache.solr.handler.SnapPuller; Master's generation: 2 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.881; org.apache.solr.handler.SnapPuller; Slave's generation: 1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.881; org.apache.solr.handler.SnapPuller; Starting replication process [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.884; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={version=2&command=filelist&generation=2&qt=/replication&wt=javabin} status=0 QTime=0 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.886; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.887; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty3/index.20130501213719886 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.887; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@1c43f6c lockFactory=org.apache.lucene.store.NativeFSLockFactory@11ef286) fullCopy=false [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.893; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={command=filecontent&generation=2&qt=/replication&wt=filestream&file=segments_2&checksum=true} status=0 QTime=1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.905; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.915; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter... [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.915; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.917; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=2 [junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ae6ded lockFactory=org.apache.lucene.store.NativeFSLockFactory@1644e1e),segFN=segments_1,generation=1} [junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ae6ded lockFactory=org.apache.lucene.store.NativeFSLockFactory@1644e1e),segFN=segments_2,generation=2} [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.917; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.918; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used. [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.918; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1f84104 main [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.920; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1f84104 main{StandardDirectoryReader(segments_2:1:nrt)} [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.921; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty3/index.20130501213719886 [CachedDir<>] [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.922; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty3/index.20130501213719886 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.923; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty3/index.20130501213719886 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.923; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.924; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.924; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.924; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.926; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:19.999; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.008; org.apache.solr.schema.IndexSchema; default search field in schema is text [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.010; org.apache.solr.schema.IndexSchema; unique key field: id [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.020; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.021; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={ [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:35888_", [junit4:junit4] 1> "state":"recovering", [junit4:junit4] 1> "shard":"shard2", [junit4:junit4] 1> "core_node_name":"5", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:35888", [junit4:junit4] 1> "operation":"state"} [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.026; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={ [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:51014_", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "core_node_name":"4", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:51014", [junit4:junit4] 1> "operation":"state"} [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.030; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.031; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.031; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.031; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.031; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.031; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.044; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.054; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.059; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json [junit4:junit4] 1> WARN - 2013-05-01 13:37:20.061; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE [junit4:junit4] 1> WARN - 2013-05-01 13:37:20.062; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.062; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json [junit4:junit4] 1> WARN - 2013-05-01 13:37:20.064; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE [junit4:junit4] 1> WARN - 2013-05-01 13:37:20.064; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.064; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.065; org.apache.solr.core.SolrCore; [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367415423367/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367415418484/onenodecollection/ [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.065; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@efb2cc [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.066; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.067; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367415418484/onenodecollection [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.068; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367415418484/onenodecollection/index/ [junit4:junit4] 1> WARN - 2013-05-01 13:37:20.068; org.apache.solr.core.SolrCore; [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367415418484/onenodecollection/index' doesn't exist. Creating new index... [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.069; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367415418484/onenodecollection/index [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.071; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1 [junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@14beb7a lockFactory=org.apache.lucene.store.NativeFSLockFactory@a19170),segFN=segments_1,generation=1} [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.072; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.075; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.076; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.077; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.078; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.079; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.079; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.080; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.081; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.082; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.085; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60 [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.089; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@581096 main [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.089; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367415418484/onenodecollection/tlog [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.090; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.091; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.097; org.apache.solr.core.SolrCore; [onenodecollectioncore] Registered new searcher Searcher@581096 main{StandardDirectoryReader(segments_1:1)} [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.100; org.apache.solr.cloud.ZkController; publishing core=onenodecollectioncore state=down [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.390; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds. [junit4:junit4] 1> INFO - 2013-05-01 13:37:20.390; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={coreNodeName=5&core=collection1&version=2&onlyIfLeader=true&action=PREPRECOVERY&state=recovering&wt=javabin&nodeName=127.0.0.1:35888_&checkLive=true} status=0 QTime=1001 [junit4:junit4] 1> INFO - 2013-05-01 13:37:21.541; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:21.542; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={ [junit4:junit4] 1> "numShards":"1", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "collection":"onenodecollection", [junit4:junit4] 1> "core":"onenodecollectioncore", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:43043_", [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "shard":null, [junit4:junit4] 1> "core_node_name":null, [junit4:junit4] 1> "roles":"none", [junit4:junit4] 1> "base_url":"http://127.0.0.1:43043", [junit4:junit4] 1> "operation":"state"} [junit4:junit4] 1> INFO - 2013-05-01 13:37:21.543; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection onenodecollection with numShards 1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:21.543; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:21.548; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:21.548; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:21.548; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:21.548; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:21.548; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:21.548; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.103; org.apache.solr.core.CoreContainer; registering core: onenodecollectioncore [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.104; org.apache.solr.cloud.ZkController; Register replica - core:onenodecollectioncore address:http://127.0.0.1:43043 collection:onenodecollection shard:shard1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.106; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection/leader_elect/shard1/election [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.124; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process. [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.132; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue. [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.133; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.134; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:43043/onenodecollectioncore/ [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.135; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.135; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:43043/onenodecollectioncore/ has no replicas [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.136; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:43043/onenodecollectioncore/ [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.137; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection/leaders/shard1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.392; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:38834/collection1/ core=collection1 - recoveringAfterStartup=true [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.393; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:35888 START replicas=[http://127.0.0.1:38834/collection1/] nUpdates=100 [junit4:junit4] 1> WARN - 2013-05-01 13:37:22.394; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.395; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.396; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.397; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.398; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null} [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.398; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:38834/collection1/. core=collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.399; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.405; org.apache.solr.core.SolrCore; [collection1] webapp= path=/get params={distrib=false&getVersions=100&version=2&qt=/get&wt=javabin} status=0 QTime=0 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.406; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.409; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=1 [junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@8edbdf lockFactory=org.apache.lucene.store.NativeFSLockFactory@fbfa7b),segFN=segments_1,generation=1} [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.410; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.412; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2 [junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@8edbdf lockFactory=org.apache.lucene.store.NativeFSLockFactory@fbfa7b),segFN=segments_1,generation=1} [junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@8edbdf lockFactory=org.apache.lucene.store.NativeFSLockFactory@fbfa7b),segFN=segments_2,generation=2} [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.413; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.414; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@15890a4 realtime [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.415; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.415; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={commit=true&version=2&commit_end_point=true&waitSearcher=true&softCommit=false&openSearcher=false&wt=javabin} {commit=} 0 9 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.418; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for 10000 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.418; org.apache.solr.handler.SnapPuller; No value set for 'pollInterval'. Timer Task not started. [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.423; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for 10000 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.423; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={version=2&command=indexversion&qt=/replication&wt=javabin} status=0 QTime=1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.424; org.apache.solr.handler.SnapPuller; Master's generation: 2 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.425; org.apache.solr.handler.SnapPuller; Slave's generation: 1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.425; org.apache.solr.handler.SnapPuller; Starting replication process [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.429; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={version=2&command=filelist&generation=2&qt=/replication&wt=javabin} status=0 QTime=0 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.432; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.434; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty4/index.20130501213722433 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.434; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@899bd6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1612422) fullCopy=false [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.439; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={command=filecontent&generation=2&qt=/replication&wt=filestream&file=segments_2&checksum=true} status=0 QTime=1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.442; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.444; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter... [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.445; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.449; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=2 [junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@69c913 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d2615f),segFN=segments_1,generation=1} [junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@69c913 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d2615f),segFN=segments_2,generation=2} [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.450; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.451; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used. [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.452; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1d1a392 main [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.455; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1d1a392 main{StandardDirectoryReader(segments_2:1:nrt)} [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.457; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty4/index.20130501213722433 [CachedDir<>] [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.458; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty4/index.20130501213722433 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.460; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty4/index.20130501213722433 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.461; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.461; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.462; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.463; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property [junit4:junit4] 1> INFO - 2013-05-01 13:37:22.466; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1 [junit4:junit4] 1> INFO - 2013-05-01 13:37:23.058; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:23.078; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={ [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:35888_", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "shard":"shard2", [junit4:junit4] 1> "core_node_name":"5", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:35888", [junit4:junit4] 1> "operation":"state"} [junit4:junit4] 1> INFO - 2013-05-01 13:37:23.089; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:23.089; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:23.089; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:23.089; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:23.089; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:23.089; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:23.107; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:43043/onenodecollectioncore/ and leader is http://127.0.0.1:43043/onenodecollectioncore/ [junit4:junit4] 1> INFO - 2013-05-01 13:37:23.108; org.apache.solr.cloud.ZkController; No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:43043 [junit4:junit4] 1> INFO - 2013-05-01 13:37:23.109; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary [junit4:junit4] 1> INFO - 2013-05-01 13:37:23.110; org.apache.solr.cloud.ZkController; publishing core=onenodecollectioncore state=active [junit4:junit4] 1> INFO - 2013-05-01 13:37:23.114; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:23.117; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={numShards=1&collection=onenodecollection&version=2&action=CREATE&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367415418484/onenodecollection&name=onenodecollectioncore&roles=none&wt=javabin} status=0 QTime=3718 [junit4:junit4] 1> INFO - 2013-05-01 13:37:23.119; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230 [junit4:junit4] 1> INFO - 2013-05-01 13:37:23.122; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:24.127; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:24.607; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:24.609; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={ [junit4:junit4] 1> "numShards":"1", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "collection":"onenodecollection", [junit4:junit4] 1> "core":"onenodecollectioncore", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:43043_", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "core_node_name":"127.0.0.1:43043__onenodecollectioncore", [junit4:junit4] 1> "roles":"none", [junit4:junit4] 1> "base_url":"http://127.0.0.1:43043", [junit4:junit4] 1> "operation":"state"} [junit4:junit4] 1> INFO - 2013-05-01 13:37:24.616; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:24.616; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:24.616; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:24.616; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:24.616; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:24.616; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:25.131; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:25.135; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished - collection: onenodecollection [junit4:junit4] 1> INFO - 2013-05-01 13:37:25.136; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false [junit4:junit4] 1> INFO - 2013-05-01 13:37:25.184; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper [junit4:junit4] 1> INFO - 2013-05-01 13:37:25.186; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1692ecd name:ZooKeeperConnection Watcher:127.0.0.1:37089 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4:junit4] 1> INFO - 2013-05-01 13:37:25.187; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper [junit4:junit4] 1> / (2) [junit4:junit4] 1> DATA: [junit4:junit4] 1> [junit4:junit4] 1> /zookeeper (1) [junit4:junit4] 1> DATA: [junit4:junit4] 1> [junit4:junit4] 1> /solr (7) [junit4:junit4] 1> /solr/aliases.json (0) [junit4:junit4] 1> /solr/live_nodes (5) [junit4:junit4] 1> /solr/live_nodes/127.0.0.1:51014_ (0) [junit4:junit4] 1> /solr/live_nodes/127.0.0.1:38834_ (0) [junit4:junit4] 1> /solr/live_nodes/127.0.0.1:43043_ (0) [junit4:junit4] 1> /solr/live_nodes/127.0.0.1:46285_ (0) [junit4:junit4] 1> /solr/live_nodes/127.0.0.1:35888_ (0) [junit4:junit4] 1> /solr/collections (3) [junit4:junit4] 1> /solr/collections/onenodecollection (2) [junit4:junit4] 1> DATA: [junit4:junit4] 1> { [junit4:junit4] 1> "router":"compositeId", [junit4:junit4] 1> "configName":"conf1"} [junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect (1) [junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect/shard1 (1) [junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect/shard1/election (1) [junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect/shard1/election/89614936870486022-127.0.0.1:43043__onenodecollectioncore-n_0000000000 (0) [junit4:junit4] 1> /solr/collections/onenodecollection/leaders (1) [junit4:junit4] 1> /solr/collections/onenodecollection/leaders/shard1 (0) [junit4:junit4] 1> DATA: [junit4:junit4] 1> { [junit4:junit4] 1> "core":"onenodecollectioncore", [junit4:junit4] 1> "node_name":"127.0.0.1:43043_", [junit4:junit4] 1> "base_url":"http://127.0.0.1:43043"} [junit4:junit4] 1> /solr/collections/control_collection (3) [junit4:junit4] 1> DATA: [junit4:junit4] 1> {"configName":"conf1"} [junit4:junit4] 1> /solr/collections/control_collection/leader_elect (1) [junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1 (1) [junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election (1) [junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election/89614936870486019-1-n_0000000000 (0) [junit4:junit4] 1> /solr/collections/control_collection/shards (0) [junit4:junit4] 1> /solr/collections/control_collection/leaders (1) [junit4:junit4] 1> /solr/collections/control_collection/leaders/shard1 (0) [junit4:junit4] 1> DATA: [junit4:junit4] 1> { [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "node_name":"127.0.0.1:46285_", [junit4:junit4] 1> "base_url":"http://127.0.0.1:46285"} [junit4:junit4] 1> /solr/collections/collection1 (3) [junit4:junit4] 1> DATA: [junit4:junit4] 1> {"configName":"conf1"} [junit4:junit4] 1> /solr/collections/collection1/leader_elect (2) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1 (1) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election (2) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89614936870486026-4-n_0000000001 (0) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89614936870486022-2-n_0000000000 (0) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard2 (1) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard2/election (2) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard2/election/89614936870486024-3-n_0000000000 (0) [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard2/election/89614936870486028-5-n_0000000001 (0) [junit4:junit4] 1> /solr/collections/collection1/shards (0) [junit4:junit4] 1> /solr/collections/collection1/leaders (2) [junit4:junit4] 1> /solr/collections/collection1/leaders/shard1 (0) [junit4:junit4] 1> DATA: [junit4:junit4] 1> { [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "node_name":"127.0.0.1:43043_", [junit4:junit4] 1> "base_url":"http://127.0.0.1:43043"} [junit4:junit4] 1> /solr/collections/collection1/leaders/shard2 (0) [junit4:junit4] 1> DATA: [junit4:junit4] 1> { [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "node_name":"127.0.0.1:38834_", [junit4:junit4] 1> "base_url":"http://127.0.0.1:38834"} [junit4:junit4] 1> /solr/overseer (3) [junit4:junit4] 1> DATA: [junit4:junit4] 1> [junit4:junit4] 1> /solr/overseer/queue-work (0) [junit4:junit4] 1> /solr/overseer/queue (0) [junit4:junit4] 1> /solr/overseer/collection-queue-work (0) [junit4:junit4] 1> /solr/clusterstate.json (0) [junit4:junit4] 1> DATA: [junit4:junit4] 1> { [junit4:junit4] 1> "control_collection":{ [junit4:junit4] 1> "router":"compositeId", [junit4:junit4] 1> "shards":{"shard1":{ [junit4:junit4] 1> "range":"80000000-7fffffff", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "replicas":{"1":{ [junit4:junit4] 1> "collection":"control_collection", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "node_name":"127.0.0.1:46285_", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "base_url":"http://127.0.0.1:46285", [junit4:junit4] 1> "leader":"true"}}}}}, [junit4:junit4] 1> "collection1":{ [junit4:junit4] 1> "router":"compositeId", [junit4:junit4] 1> "shards":{ [junit4:junit4] 1> "shard1":{ [junit4:junit4] 1> "range":"80000000-ffffffff", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "replicas":{ [junit4:junit4] 1> "2":{ [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "node_name":"127.0.0.1:43043_", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "base_url":"http://127.0.0.1:43043", [junit4:junit4] 1> "leader":"true"}, [junit4:junit4] 1> "4":{ [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "node_name":"127.0.0.1:51014_", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "base_url":"http://127.0.0.1:51014"}}}, [junit4:junit4] 1> "shard2":{ [junit4:junit4] 1> "range":"0-7fffffff", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "replicas":{ [junit4:junit4] 1> "3":{ [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "node_name":"127.0.0.1:38834_", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "shard":"shard2", [junit4:junit4] 1> "base_url":"http://127.0.0.1:38834", [junit4:junit4] 1> "leader":"true"}, [junit4:junit4] 1> "5":{ [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "node_name":"127.0.0.1:35888_", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "shard":"shard2", [junit4:junit4] 1> "base_url":"http://127.0.0.1:35888"}}}}}, [junit4:junit4] 1> "onenodecollection":{ [junit4:junit4] 1> "router":"compositeId", [junit4:junit4] 1> "shards":{"shard1":{ [junit4:junit4] 1> "range":"80000000-7fffffff", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "replicas":{"127.0.0.1:43043__onenodecollectioncore":{ [junit4:junit4] 1> "collection":"onenodecollection", [junit4:junit4] 1> "core":"onenodecollectioncore", [junit4:junit4] 1> "node_name":"127.0.0.1:43043_", [junit4:junit4] 1> "state":"active", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "roles":"none", [junit4:junit4] 1> "base_url":"http://127.0.0.1:43043", [junit4:junit4] 1> "leader":"true"}}}}}} [junit4:junit4] 1> /solr/configs (1) [junit4:junit4] 1> /solr/configs/conf1 (9) [junit4:junit4] 1> /solr/configs/conf1/currency.xml (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/open-exchange-rates.json (0) [junit4:junit4] 1> DATA: [junit4:junit4] 1> { [junit4:junit4] 1> "disclaimer": "This data is not real, it was synthetically created to match currency.xml. It is modeled after the data format available from openexchangerates.org. See https://openexchangerates.org/documentation for details", [junit4:junit4] 1> "license": "http://www.apache.org/licenses/LICENSE-2.0", [junit4:junit4] 1> "timestamp": 1332070464, [junit4:junit4] 1> [junit4:junit4] 1> [junit4:junit4] 1> "IMPORTANT NOTE": "In order for tests to work, this data must be kept in sync with ./currency.xml", [junit4:junit4] 1> [junit4:junit4] 1> [junit4:junit4] 1> "base": "USD", [junit4:junit4] 1> "rates": { [junit4:junit4] 1> "USD": 1, [junit4:junit4] 1> "JPY": 81.29, [junit4:junit4] 1> "EUR": 2.5, [junit4:junit4] 1> "GBP": 0.5, [junit4:junit4] 1> "MXN": 2.0 [junit4:junit4] 1> } [junit4:junit4] 1> } [junit4:junit4] 1> [junit4:junit4] 1> /solr/configs/conf1/schema.xml (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/synonyms.txt (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/stopwords.txt (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/old_synonyms.txt (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/protwords.txt (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/solrconfig.xml (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0) [junit4:junit4] 1> DATA: ...supressed... [junit4:junit4] 1> /solr/overseer_elect (2) [junit4:junit4] 1> /solr/overseer_elect/leader (0) [junit4:junit4] 1> DATA: [junit4:junit4] 1> {"id":"89614936870486019-127.0.0.1:46285_-n_0000000000"} [junit4:junit4] 1> /solr/overseer_elect/election (5) [junit4:junit4] 1> /solr/overseer_elect/election/89614936870486026-127.0.0.1:51014_-n_0000000003 (0) [junit4:junit4] 1> /solr/overseer_elect/election/89614936870486024-127.0.0.1:38834_-n_0000000002 (0) [junit4:junit4] 1> /solr/overseer_elect/election/89614936870486022-127.0.0.1:43043_-n_0000000001 (0) [junit4:junit4] 1> /solr/overseer_elect/election/89614936870486028-127.0.0.1:35888_-n_0000000004 (0) [junit4:junit4] 1> /solr/overseer_elect/election/89614936870486019-127.0.0.1:46285_-n_0000000000 (0) [junit4:junit4] 1> [junit4:junit4] 1> INFO - 2013-05-01 13:37:25.327; org.apache.solr.cloud.ChaosMonkey; monkey: stop shard! 46285 [junit4:junit4] 1> INFO - 2013-05-01 13:37:25.330; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=8625691 [junit4:junit4] 1> INFO - 2013-05-01 13:37:26.124; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:26.125; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=null message={ [junit4:junit4] 1> "collection":"control_collection", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "node_name":"127.0.0.1:46285_", [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "core_node_name":"1", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:46285", [junit4:junit4] 1> "operation":"state"} [junit4:junit4] 1> INFO - 2013-05-01 13:37:26.131; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:26.131; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:26.131; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:26.131; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:26.131; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.333; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.334; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.338; org.apache.solr.core.SolrCore; [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@49f355 [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.357; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0} [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.358; org.apache.solr.update.SolrCoreState; Closing SolrCoreState [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.359; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.360; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.361; org.apache.solr.core.SolrCore; [collection1] Closing main searcher on request. [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.362; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.363; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/control/data/index [CachedDir<>] [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.364; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/control/data/index [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.364; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/control/data [CachedDir<>] [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.364; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/control/data [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.367; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89614936870486019-127.0.0.1:46285_-n_0000000000) am no longer a leader. [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.368; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.369; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.369; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.369; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.370; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.370; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.371; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.375; org.apache.solr.cloud.Overseer; Overseer (id=89614936870486022-127.0.0.1:43043_-n_0000000001) starting [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.383; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.383; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.387; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.388; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.393; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/,null} [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.394; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.396; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={ [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "collection":"control_collection", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:46285_", [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "core_node_name":"1", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:46285", [junit4:junit4] 1> "operation":"state"} [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.405; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.405; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.405; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.405; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.449; org.apache.solr.cloud.ChaosMonkey; monkey: stop shard! 43043 [junit4:junit4] 1> INFO - 2013-05-01 13:37:27.449; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=21373082 [junit4:junit4] 1> WARN - 2013-05-01 13:37:28.669; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK [junit4:junit4] 1> INFO - 2013-05-01 13:37:28.670; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5) [junit4:junit4] 1> WARN - 2013-05-01 13:37:28.670; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK [junit4:junit4] 1> INFO - 2013-05-01 13:37:28.917; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:28.920; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=null message={ [junit4:junit4] 1> "collection":"onenodecollection", [junit4:junit4] 1> "core":"onenodecollectioncore", [junit4:junit4] 1> "node_name":"127.0.0.1:43043_", [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "core_node_name":"127.0.0.1:43043__onenodecollectioncore", [junit4:junit4] 1> "roles":"none", [junit4:junit4] 1> "base_url":"http://127.0.0.1:43043", [junit4:junit4] 1> "operation":"state"} [junit4:junit4] 1> INFO - 2013-05-01 13:37:28.931; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=null message={ [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "node_name":"127.0.0.1:43043_", [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "core_node_name":"2", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "base_ur [...truncated too long message...] ations [junit4:junit4] 1> INFO - 2013-05-01 13:37:32.733; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (1) [junit4:junit4] 1> INFO - 2013-05-01 13:37:32.734; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1) [junit4:junit4] 1> INFO - 2013-05-01 13:37:32.734; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue [junit4:junit4] 1> INFO - 2013-05-01 13:37:32.737; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... [junit4:junit4] 1> INFO - 2013-05-01 13:37:32.738; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=null message={ [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "node_name":"127.0.0.1:51014_", [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "core_node_name":"4", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:51014", [junit4:junit4] 1> "operation":"state"} [junit4:junit4] 1> INFO - 2013-05-01 13:37:32.741; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/,null} [junit4:junit4] 1> INFO - 2013-05-01 13:37:32.743; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={ [junit4:junit4] 1> "numShards":"2", [junit4:junit4] 1> "shard_range":null, [junit4:junit4] 1> "collection":"collection1", [junit4:junit4] 1> "core":"collection1", [junit4:junit4] 1> "shard_state":"active", [junit4:junit4] 1> "node_name":"127.0.0.1:51014_", [junit4:junit4] 1> "state":"down", [junit4:junit4] 1> "shard":"shard1", [junit4:junit4] 1> "core_node_name":"4", [junit4:junit4] 1> "roles":null, [junit4:junit4] 1> "base_url":"http://127.0.0.1:51014", [junit4:junit4] 1> "operation":"state"} [junit4:junit4] 1> INFO - 2013-05-01 13:37:32.750; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4:junit4] 1> INFO - 2013-05-01 13:37:32.792; org.apache.solr.cloud.ChaosMonkey; monkey: stop shard! 35888 [junit4:junit4] 1> INFO - 2013-05-01 13:37:32.793; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=11911636 [junit4:junit4] 1> INFO - 2013-05-01 13:37:33.795; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down [junit4:junit4] 1> INFO - 2013-05-01 13:37:33.796; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property [junit4:junit4] 1> INFO - 2013-05-01 13:37:33.799; org.apache.solr.core.SolrCore; [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1c3c36e [junit4:junit4] 1> INFO - 2013-05-01 13:37:33.819; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0} [junit4:junit4] 1> INFO - 2013-05-01 13:37:33.820; org.apache.solr.update.SolrCoreState; Closing SolrCoreState [junit4:junit4] 1> INFO - 2013-05-01 13:37:33.821; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter [junit4:junit4] 1> INFO - 2013-05-01 13:37:33.822; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser [junit4:junit4] 1> INFO - 2013-05-01 13:37:33.825; org.apache.solr.core.SolrCore; [collection1] Closing main searcher on request. [junit4:junit4] 1> INFO - 2013-05-01 13:37:33.826; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked [junit4:junit4] 1> INFO - 2013-05-01 13:37:33.826; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty4/index [CachedDir<>] [junit4:junit4] 1> INFO - 2013-05-01 13:37:33.826; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty4/index [junit4:junit4] 1> INFO - 2013-05-01 13:37:33.827; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty4 [CachedDir<>] [junit4:junit4] 1> INFO - 2013-05-01 13:37:33.827; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367415418483/jetty4 [junit4:junit4] 1> INFO - 2013-05-01 13:37:33.829; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89614936870486028-127.0.0.1:35888_-n_0000000004) am no longer a leader. [junit4:junit4] 1> INFO - 2013-05-01 13:37:33.830; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1) [junit4:junit4] 1> WARN - 2013-05-01 13:37:33.830; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK [junit4:junit4] 1> WARN - 2013-05-01 13:37:33.830; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK [junit4:junit4] 1> INFO - 2013-05-01 13:37:33.853; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/,null} [junit4:junit4] 1> INFO - 2013-05-01 13:37:33.913; org.apache.solr.SolrTestCaseJ4; ###Ending testDistribSearch [junit4:junit4] 1> INFO - 2013-05-01 13:37:33.917; org.apache.solr.cloud.ZkTestServer; connecting to 127.0.0.1:37089 37089 [junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367415418484 [junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=747A9C495D95415E -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=cs -Dtests.timezone=Australia/West -Dtests.file.encoding=UTF-8 [junit4:junit4] ERROR 35.5s J1 | BasicDistributedZk2Test.testDistribSearch <<< [junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:38834/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update [junit4:junit4] > at __randomizedtesting.SeedInfo.seed([747A9C495D95415E:F59C12512ACA2162]:0) [junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:387) [junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180) [junit4:junit4] > at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117) [junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116) [junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102) [junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197) [junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89) [junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815) [junit4:junit4] > at java.lang.Thread.run(Thread.java:722) [junit4:junit4] 1> INFO - 2013-05-01 13:37:33.972; org.apache.solr.SolrTestCaseJ4; ###deleteCore [junit4:junit4] 2> 35505 T19 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s). [junit4:junit4] 2> NOTE: test params are: codec=Lucene40, sim=DefaultSimilarity, locale=cs, timezone=Australia/West [junit4:junit4] 2> NOTE: Linux 3.2.0-40-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=3,free=25963256,total=65142784 [junit4:junit4] 2> NOTE: All tests run in this JVM: [TestDFRSimilarityFactory, UniqFieldsUpdateProcessorFactoryTest, TestFastOutputStream, ZkNodePropsTest, BasicDistributedZk2Test] [junit4:junit4] Completed on J1 in 35.80s, 1 test, 1 error <<< FAILURES! [...truncated 895 lines...] BUILD FAILED /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:384: The following error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:364: The following error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:181: The following error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:437: The following error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1243: The following error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:887: There were test failures: 294 suites, 1222 tests, 1 error, 13 ignored (7 assumptions) Total time: 38 minutes 0 seconds Build step 'Invoke Ant' marked build as failure Description set: Java: 32bit/jdk1.8.0-ea-b86 -server -XX:+UseSerialGC Archiving artifacts Recording test results Email was triggered for: Failure Sending email for trigger: Failure ------=_Part_78_1435171227.1367416662475 Content-Type: text/plain; charset=us-ascii --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org ------=_Part_78_1435171227.1367416662475--