Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id E7F52200D2C for ; Sun, 29 Oct 2017 18:55:00 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id E68C2160BE3; Sun, 29 Oct 2017 17:55:00 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 3E6731609E9 for ; Sun, 29 Oct 2017 18:54:58 +0100 (CET) Received: (qmail 60636 invoked by uid 500); 29 Oct 2017 17:54:52 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 60626 invoked by uid 99); 29 Oct 2017 17:54:52 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 29 Oct 2017 17:54:51 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 02F471A1F76 for ; Sun, 29 Oct 2017 17:54:51 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.3 X-Spam-Level: X-Spam-Status: No, score=-0.3 tagged_above=-999 required=6.31 tests=[KAM_BADIPHTTP=2, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, WEIRD_PORT=0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id NHSd-JxJKTuL for ; Sun, 29 Oct 2017 17:54:35 +0000 (UTC) Received: from serv1.sd-datasolutions.de (serv1.sd-datasolutions.de [88.99.242.108]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 1E1625FCE9 for ; Sun, 29 Oct 2017 17:54:35 +0000 (UTC) Received: from serv1 (ip6-localhost [IPv6:::1]) by serv1.sd-datasolutions.de (Postfix) with ESMTP id A00211080684 for ; Sun, 29 Oct 2017 17:54:32 +0000 (UTC) Date: Sun, 29 Oct 2017 17:52:55 +0000 (UTC) From: Policeman Jenkins Server To: dev@lucene.apache.org Message-ID: <189053839.11.1509299672658.JavaMail.jenkins@serv1.sd-datasolutions.de> In-Reply-To: <1822478301.253.1509244051011.JavaMail.jenkins@serv1.sd-datasolutions.de> References: <1822478301.253.1509244051011.JavaMail.jenkins@serv1.sd-datasolutions.de> Subject: [JENKINS] Lucene-Solr-7.x-MacOSX (64bit/jdk1.8.0) - Build # 269 - Still Unstable! MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_10_787477228.1509299672612" X-Jenkins-Job: Lucene-Solr-7.x-MacOSX X-Jenkins-Result: UNSTABLE archived-at: Sun, 29 Oct 2017 17:55:01 -0000 ------=_Part_10_787477228.1509299672612 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/269/ Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC 3 tests failed. FAILED: org.apache.solr.cloud.CdcrBootstrapTest.testBootstrapWithContinous= IndexingOnSourceCluster Error Message: Document mismatch on target after sync expected:<2000> but was:<1901> Stack Trace: java.lang.AssertionError: Document mismatch on target after sync expected:<= 2000> but was:<1901> =09at __randomizedtesting.SeedInfo.seed([1960521F5633FD5:D5D34E7812358C2E]:= 0) =09at org.junit.Assert.fail(Assert.java:93) =09at org.junit.Assert.failNotEquals(Assert.java:647) =09at org.junit.Assert.assertEquals(Assert.java:128) =09at org.junit.Assert.assertEquals(Assert.java:472) =09at org.apache.solr.cloud.CdcrBootstrapTest.testBootstrapWithContinousInd= exingOnSourceCluster(CdcrBootstrapTest.java:294) =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.= java:62) =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces= sorImpl.java:43) =09at java.lang.reflect.Method.invoke(Method.java:498) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1737) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Random= izedRunner.java:934) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(Random= izedRunner.java:970) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(Rando= mizedRunner.java:984) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:49) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:368) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:817) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:468) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:943) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:829) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Random= izedRunner.java:879) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:890) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:41) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:53) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:54) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:368) =09at java.lang.Thread.run(Thread.java:748) FAILED: org.apache.solr.cloud.CustomCollectionTest.testRouteFieldForImplic= itRouter Error Message: Collection not found: withShardField Stack Trace: org.apache.solr.common.SolrException: Collection not found: withShardField =09at __randomizedtesting.SeedInfo.seed([1960521F5633FD5:54C6EDB3599AF025]:= 0) =09at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnS= taleState(CloudSolrClient.java:842) =09at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrCl= ient.java:808) =09at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178= ) =09at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateReque= st.java:233) =09at org.apache.solr.cloud.CustomCollectionTest.testRouteFieldForImplicitR= outer(CustomCollectionTest.java:141) =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.= java:62) =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces= sorImpl.java:43) =09at java.lang.reflect.Method.invoke(Method.java:498) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1737) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Random= izedRunner.java:934) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(Random= izedRunner.java:970) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(Rando= mizedRunner.java:984) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:49) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:368) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:817) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:468) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:943) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:829) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Random= izedRunner.java:879) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:890) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:41) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:53) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:54) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:368) =09at java.lang.Thread.run(Thread.java:748) FAILED: org.apache.solr.cloud.autoscaling.ExecutePlanActionTest.testIntegr= ation Error Message: Timed out waiting for replicas of collection to be 2 again null Live Nodes:= [127.0.0.1:50374_solr] Last available state: DocCollection(testIntegration= //collections/testIntegration/state.json/6)=3D{ "pullReplicas":"0", "re= plicationFactor":"2", "shards":{"shard1":{ "range":"80000000-7fffff= ff", "state":"active", "replicas":{ "core_node3":{ = "core":"testIntegration_shard1_replica_n1", "base_url":"htt= p://127.0.0.1:50374/solr", "node_name":"127.0.0.1:50374_solr", = "state":"active", "type":"NRT", "leader":"true"= }, "core_node4":{ "core":"testIntegration_shard1_replica_= n2", "base_url":"http://127.0.0.1:50375/solr", "node_na= me":"127.0.0.1:50375_solr", "state":"down", "type":"NRT= "}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "auto= AddReplicas":"false", "nrtReplicas":"2", "tlogReplicas":"0"} Stack Trace: java.lang.AssertionError: Timed out waiting for replicas of collection to b= e 2 again null Live Nodes: [127.0.0.1:50374_solr] Last available state: DocCollection(testIntegration//collections/testIntegr= ation/state.json/6)=3D{ "pullReplicas":"0", "replicationFactor":"2", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node3":{ "core":"testIntegration_shard1_replica_n1", "base_url":"http://127.0.0.1:50374/solr", "node_name":"127.0.0.1:50374_solr", "state":"active", "type":"NRT", "leader":"true"}, "core_node4":{ "core":"testIntegration_shard1_replica_n2", "base_url":"http://127.0.0.1:50375/solr", "node_name":"127.0.0.1:50375_solr", "state":"down", "type":"NRT"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"2", "tlogReplicas":"0"} =09at __randomizedtesting.SeedInfo.seed([1960521F5633FD5:B1F70B0DD05C9EF0]:= 0) =09at org.junit.Assert.fail(Assert.java:93) =09at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCas= e.java:269) =09at org.apache.solr.cloud.autoscaling.ExecutePlanActionTest.testIntegrati= on(ExecutePlanActionTest.java:209) =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.= java:62) =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces= sorImpl.java:43) =09at java.lang.reflect.Method.invoke(Method.java:498) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1737) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Random= izedRunner.java:934) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(Random= izedRunner.java:970) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(Rando= mizedRunner.java:984) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:49) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:368) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:817) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:468) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:943) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:829) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Random= izedRunner.java:879) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:890) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:41) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:53) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:54) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:368) =09at java.lang.Thread.run(Thread.java:748) Build Log: [...truncated 13140 lines...] [junit4] Suite: org.apache.solr.cloud.CdcrBootstrapTest [junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-7.x= -MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrBootstrapTest_1960= 521F5633FD5-001/init-core-data-001 [junit4] 2> 2273758 WARN (SUITE-CdcrBootstrapTest-seed#[1960521F5633F= D5]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=3D= 2 numCloses=3D2 [junit4] 2> 2273758 INFO (SUITE-CdcrBootstrapTest-seed#[1960521F5633F= D5]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SY= SPROP=3Dfalse) w/NUMERIC_DOCVALUES_SYSPROP=3Dtrue [junit4] 2> 2273764 INFO (SUITE-CdcrBootstrapTest-seed#[1960521F5633F= D5]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAu= th (false) via: @org.apache.solr.util.RandomizeSSL(reason=3D, value=3DNaN, = ssl=3DNaN, clientAuth=3DNaN) w/ MAC_OS_X supressed clientAuth [junit4] 2> 2273764 INFO (SUITE-CdcrBootstrapTest-seed#[1960521F5633F= D5]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.so= lr.allowed.securerandom=3Dnull & java.security.egd=3Dfile:/dev/./urandom [junit4] 2> 2273772 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.SolrTestCaseJ4 ###Sta= rting testConvertClusterToCdcrAndBootstrap [junit4] 2> 2273772 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.c.MiniSolrCloudCluste= r Starting cluster of 1 servers in /Users/jenkins/workspace/Lucene-Solr-7.x= -MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrBootstrapTest_1960= 521F5633FD5-001/cdcr-target-001 [junit4] 2> 2273772 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.c.ZkTestServer STARTI= NG ZK TEST SERVER [junit4] 2> 2273773 INFO (Thread-4136) [ ] o.a.s.c.ZkTestServer cl= ient port:0.0.0.0/0.0.0.0:0 [junit4] 2> 2273773 INFO (Thread-4136) [ ] o.a.s.c.ZkTestServer St= arting server [junit4] 2> 2273781 ERROR (Thread-4136) [ ] o.a.z.s.ZooKeeperServer= ZKShutdownHandler is not registered, so ZooKeeper server won't take any ac= tion on ERROR or SHUTDOWN server state changes [junit4] 2> 2273883 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.c.ZkTestServer start = zk server on port:50193 [junit4] 2> 2273923 INFO (jetty-launcher-3628-thread-1) [ ] o.e.j.= s.Server jetty-9.3.20.v20170531 [junit4] 2> 2273925 INFO (jetty-launcher-3628-thread-1) [ ] o.e.j.= s.h.ContextHandler Started o.e.j.s.ServletContextHandler@a79677e{/solr,null= ,AVAILABLE} [junit4] 2> 2273925 INFO (jetty-launcher-3628-thread-1) [ ] o.e.j.= s.AbstractConnector Started ServerConnector@2b902a79{HTTP/1.1,[http/1.1]}{1= 27.0.0.1:50195} [junit4] 2> 2273925 INFO (jetty-launcher-3628-thread-1) [ ] o.e.j.= s.Server Started @2277677ms [junit4] 2> 2273927 INFO (jetty-launcher-3628-thread-1) [ ] o.a.s.= c.s.e.JettySolrRunner Jetty properties: {hostContext=3D/solr, hostPort=3D50= 195} [junit4] 2> 2273928 ERROR (jetty-launcher-3628-thread-1) [ ] o.a.s.= u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be miss= ing or incomplete. [junit4] 2> 2273928 INFO (jetty-launcher-3628-thread-1) [ ] o.a.s.= s.SolrDispatchFilter ___ _ Welcome to Apache Solr=E2=84=A2 vers= ion 7.2.0 [junit4] 2> 2273928 INFO (jetty-launcher-3628-thread-1) [ ] o.a.s.= s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 2273928 INFO (jetty-launcher-3628-thread-1) [ ] o.a.s.= s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 2273928 INFO (jetty-launcher-3628-thread-1) [ ] o.a.s.= s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-29T17:03:01.665Z [junit4] 2> 2273930 INFO (jetty-launcher-3628-thread-1) [ ] o.a.s.= s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 2273958 INFO (jetty-launcher-3628-thread-1) [ ] o.a.s.= c.ZkContainer Zookeeper client=3D127.0.0.1:50193/solr [junit4] 2> 2274098 INFO (jetty-launcher-3628-thread-1) [n:127.0.0.1:= 50195_solr ] o.a.s.c.Overseer Overseer (id=3Dnull) closing [junit4] 2> 2274099 INFO (jetty-launcher-3628-thread-1) [n:127.0.0.1:= 50195_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader= 127.0.0.1:50195_solr [junit4] 2> 2274100 INFO (jetty-launcher-3628-thread-1) [n:127.0.0.1:= 50195_solr ] o.a.s.c.Overseer Overseer (id=3D98913260766101507-127.0.0.1= :50195_solr-n_0000000000) starting [junit4] 2> 2274110 INFO (jetty-launcher-3628-thread-1) [n:127.0.0.1:= 50195_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/li= ve_nodes/127.0.0.1:50195_solr [junit4] 2> 2274117 INFO (OverseerStateUpdate-98913260766101507-127.0= .0.1:50195_solr-n_0000000000) [n:127.0.0.1:50195_solr ] o.a.s.c.c.ZkStat= eReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 2274191 INFO (jetty-launcher-3628-thread-1) [n:127.0.0.1:= 50195_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50195.so= lr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.= JmxMBeanServer@5dabd4f6 [junit4] 2> 2274194 INFO (jetty-launcher-3628-thread-1) [n:127.0.0.1:= 50195_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50195.so= lr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.Jm= xMBeanServer@5dabd4f6 [junit4] 2> 2274194 INFO (jetty-launcher-3628-thread-1) [n:127.0.0.1:= 50195_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50195.so= lr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserve= r.JmxMBeanServer@5dabd4f6 [junit4] 2> 2274194 INFO (jetty-launcher-3628-thread-1) [n:127.0.0.1:= 50195_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions unde= rneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core= /test/J1/temp/solr.cloud.CdcrBootstrapTest_1960521F5633FD5-001/cdcr-target-= 001/node1/. [junit4] 2> 2274219 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.c.CdcrBootstrapTest T= arget zkHost =3D 127.0.0.1:50193/solr [junit4] 2> 2274220 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.c.MiniSolrCloudCluste= r Starting cluster of 1 servers in /Users/jenkins/workspace/Lucene-Solr-7.x= -MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrBootstrapTest_1960= 521F5633FD5-001/cdcr-source-001 [junit4] 2> 2274220 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.c.ZkTestServer STARTI= NG ZK TEST SERVER [junit4] 2> 2274220 INFO (Thread-4146) [ ] o.a.s.c.ZkTestServer cl= ient port:0.0.0.0/0.0.0.0:0 [junit4] 2> 2274220 INFO (Thread-4146) [ ] o.a.s.c.ZkTestServer St= arting server [junit4] 2> 2274224 ERROR (Thread-4146) [ ] o.a.z.s.ZooKeeperServer= ZKShutdownHandler is not registered, so ZooKeeper server won't take any ac= tion on ERROR or SHUTDOWN server state changes [junit4] 2> 2274321 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.c.ZkTestServer start = zk server on port:50201 [junit4] 2> 2274363 INFO (jetty-launcher-3641-thread-1) [ ] o.e.j.= s.Server jetty-9.3.20.v20170531 [junit4] 2> 2274366 INFO (jetty-launcher-3641-thread-1) [ ] o.e.j.= s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5f8e2113{/solr,nul= l,AVAILABLE} [junit4] 2> 2274366 INFO (jetty-launcher-3641-thread-1) [ ] o.e.j.= s.AbstractConnector Started ServerConnector@1b736ac3{HTTP/1.1,[http/1.1]}{1= 27.0.0.1:50203} [junit4] 2> 2274366 INFO (jetty-launcher-3641-thread-1) [ ] o.e.j.= s.Server Started @2278118ms [junit4] 2> 2274370 INFO (jetty-launcher-3641-thread-1) [ ] o.a.s.= c.s.e.JettySolrRunner Jetty properties: {hostContext=3D/solr, hostPort=3D50= 203} [junit4] 2> 2274370 ERROR (jetty-launcher-3641-thread-1) [ ] o.a.s.= u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be miss= ing or incomplete. [junit4] 2> 2274370 INFO (jetty-launcher-3641-thread-1) [ ] o.a.s.= s.SolrDispatchFilter ___ _ Welcome to Apache Solr=E2=84=A2 vers= ion 7.2.0 [junit4] 2> 2274371 INFO (jetty-launcher-3641-thread-1) [ ] o.a.s.= s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 2274371 INFO (jetty-launcher-3641-thread-1) [ ] o.a.s.= s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 2274371 INFO (jetty-launcher-3641-thread-1) [ ] o.a.s.= s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-29T17:03:02.108Z [junit4] 2> 2274376 INFO (jetty-launcher-3641-thread-1) [ ] o.a.s.= s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 2274388 INFO (jetty-launcher-3641-thread-1) [ ] o.a.s.= c.ZkContainer Zookeeper client=3D127.0.0.1:50201/solr [junit4] 2> 2274523 INFO (jetty-launcher-3641-thread-1) [n:127.0.0.1:= 50203_solr ] o.a.s.c.Overseer Overseer (id=3Dnull) closing [junit4] 2> 2274524 INFO (jetty-launcher-3641-thread-1) [n:127.0.0.1:= 50203_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader= 127.0.0.1:50203_solr [junit4] 2> 2274525 INFO (jetty-launcher-3641-thread-1) [n:127.0.0.1:= 50203_solr ] o.a.s.c.Overseer Overseer (id=3D98913260795199491-127.0.0.1= :50203_solr-n_0000000000) starting [junit4] 2> 2274534 INFO (jetty-launcher-3641-thread-1) [n:127.0.0.1:= 50203_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/li= ve_nodes/127.0.0.1:50203_solr [junit4] 2> 2274536 INFO (OverseerStateUpdate-98913260795199491-127.0= .0.1:50203_solr-n_0000000000) [n:127.0.0.1:50203_solr ] o.a.s.c.c.ZkStat= eReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 2274627 INFO (jetty-launcher-3641-thread-1) [n:127.0.0.1:= 50203_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50203.so= lr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.= JmxMBeanServer@5dabd4f6 [junit4] 2> 2274632 INFO (jetty-launcher-3641-thread-1) [n:127.0.0.1:= 50203_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50203.so= lr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.Jm= xMBeanServer@5dabd4f6 [junit4] 2> 2274632 INFO (jetty-launcher-3641-thread-1) [n:127.0.0.1:= 50203_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50203.so= lr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserve= r.JmxMBeanServer@5dabd4f6 [junit4] 2> 2274633 INFO (jetty-launcher-3641-thread-1) [n:127.0.0.1:= 50203_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions unde= rneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core= /test/J1/temp/solr.cloud.CdcrBootstrapTest_1960521F5633FD5-001/cdcr-source-= 001/node1/. [junit4] 2> 2274668 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.c.c.ZkStateReader Upd= ated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 2274670 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.c.s.i.ZkClientCluster= StateProvider Cluster at 127.0.0.1:50201/solr ready [junit4] 2> 2274671 INFO (qtp132987633-21941) [n:127.0.0.1:50203_solr= ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with p= arams replicationFactor=3D1&collection.configName=3Dcdcr-source&name=3Dcdcr= -source&nrtReplicas=3D1&action=3DCREATE&numShards=3D1&property.solr.directo= ryFactory=3Dsolr.StandardDirectoryFactory&wt=3Djavabin&version=3D2 and send= ToOCPQueue=3Dtrue [junit4] 2> 2274673 INFO (OverseerThreadFactory-10285-thread-1-proces= sing-n:127.0.0.1:50203_solr) [n:127.0.0.1:50203_solr ] o.a.s.c.CreateCol= lectionCmd Create collection cdcr-source [junit4] 2> 2274799 INFO (OverseerStateUpdate-98913260795199491-127.0= .0.1:50203_solr-n_0000000000) [n:127.0.0.1:50203_solr ] o.a.s.c.o.SliceM= utator createReplica() { [junit4] 2> "operation":"ADDREPLICA", [junit4] 2> "collection":"cdcr-source", [junit4] 2> "shard":"shard1", [junit4] 2> "core":"cdcr-source_shard1_replica_n1", [junit4] 2> "state":"down", [junit4] 2> "base_url":"http://127.0.0.1:50203/solr", [junit4] 2> "type":"NRT", [junit4] 2> "waitForFinalState":"false"}=20 [junit4] 2> 2275022 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= ] o.a.s.h.a.CoreAdminOperation core create command qt=3D/admin/cores&co= llection.configName=3Dcdcr-source&newCollection=3Dtrue&collection=3Dcdcr-so= urce&version=3D2&replicaType=3DNRT&coreNodeName=3Dcore_node2&name=3Dcdcr-so= urce_shard1_replica_n1&action=3DCREATE&numShards=3D1&shard=3Dshard1&propert= y.solr.directoryFactory=3Dsolr.StandardDirectoryFactory&wt=3Djavabin [junit4] 2> 2275023 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for = 2147483647 transient cores [junit4] 2> 2275134 INFO (zkCallback-3648-thread-1-processing-n:127.0= .0.1:50203_solr) [n:127.0.0.1:50203_solr ] o.a.s.c.c.ZkStateReader A clu= ster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged p= ath:/collections/cdcr-source/state.json] for collection [cdcr-source] has o= ccurred - updating... (live nodes size: [1]) [junit4] 2> 2275134 INFO (zkCallback-3648-thread-2-processing-n:127.0= .0.1:50203_solr) [n:127.0.0.1:50203_solr ] o.a.s.c.c.ZkStateReader A clu= ster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged p= ath:/collections/cdcr-source/state.json] for collection [cdcr-source] has o= ccurred - updating... (live nodes size: [1]) [junit4] 2> 2276043 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .c.SolrConfig Using Lucene MatchVersion: 7.2.0 [junit4] 2> 2276047 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .s.IndexSchema [cdcr-source_shard1_replica_n1] Schema name=3Dminimal [junit4] 2> 2276050 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id [junit4] 2> 2276050 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .c.CoreContainer Creating SolrCore 'cdcr-source_shard1_replica_n1' using co= nfiguration from collection cdcr-source, trusted=3Dtrue [junit4] 2> 2276051 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .m.r.SolrJmxReporter JMX monitoring for 'solr_50203.solr.core.cdcr-source.s= hard1.replica_n1' (registry 'solr.core.cdcr-source.shard1.replica_n1') enab= led at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5dabd4f6 [junit4] 2> 2276051 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .c.SolrCore solr.RecoveryStrategy.Builder [junit4] 2> 2276051 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .c.SolrCore [[cdcr-source_shard1_replica_n1] ] Opening new SolrCore at [/Us= ers/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/t= emp/solr.cloud.CdcrBootstrapTest_1960521F5633FD5-001/cdcr-source-001/node1/= cdcr-source_shard1_replica_n1], dataDir=3D[/Users/jenkins/workspace/Lucene-= Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrBootstrapT= est_1960521F5633FD5-001/cdcr-source-001/node1/./cdcr-source_shard1_replica_= n1/data/] [junit4] 2> 2276116 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.Upd= ateLog [junit4] 2> 2276116 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.UpdateLog Initializing UpdateLog: dataDir=3D defaultSyncLevel=3DFLUSH nu= mRecordsToKeep=3D100 maxNumLogsToKeep=3D10 numVersionBuckets=3D65536 [junit4] 2> 2276117 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 2276117 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 2276119 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .s.SolrIndexSearcher Opening [Searcher@1ac4ee8[cdcr-source_shard1_replica_n= 1] main] [junit4] 2> 2276120 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /co= nfigs/cdcr-source [junit4] 2> 2276121 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooK= eeperStorageIO:path=3D/configs/cdcr-source [junit4] 2> 2276121 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .h.ReplicationHandler Commits will be reserved for 10000ms. [junit4] 2> 2276121 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.UpdateLog Could not find max version in index or recent updates, using n= ew clock 1582612174715486208 [junit4] 2> 2276122 INFO (searcherExecutor-10288-thread-1-processing-= n:127.0.0.1:50203_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-sour= ce r:core_node2) [n:127.0.0.1:50203_solr c:cdcr-source s:shard1 r:core_node= 2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_rep= lica_n1] Registered new searcher Searcher@1ac4ee8[cdcr-source_shard1_replic= a_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 2276127 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 2276127 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 2276127 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .c.SyncStrategy Sync replicas to http://127.0.0.1:50203/solr/cdcr-source_sh= ard1_replica_n1/ [junit4] 2> 2276127 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 2276127 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .c.SyncStrategy http://127.0.0.1:50203/solr/cdcr-source_shard1_replica_n1/ = has no replicas [junit4] 2> 2276128 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .c.ShardLeaderElectionContext Found all replicas participating in election,= clear LIR [junit4] 2> 2276132 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:50203/s= olr/cdcr-source_shard1_replica_n1/ shard1 [junit4] 2> 2276247 INFO (zkCallback-3648-thread-2-processing-n:127.0= .0.1:50203_solr) [n:127.0.0.1:50203_solr ] o.a.s.c.c.ZkStateReader A clu= ster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged p= ath:/collections/cdcr-source/state.json] for collection [cdcr-source] has o= ccurred - updating... (live nodes size: [1]) [junit4] 2> 2276247 INFO (zkCallback-3648-thread-3-processing-n:127.0= .0.1:50203_solr) [n:127.0.0.1:50203_solr ] o.a.s.c.c.ZkStateReader A clu= ster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged p= ath:/collections/cdcr-source/state.json] for collection [cdcr-source] has o= ccurred - updating... (live nodes size: [1]) [junit4] 2> 2276297 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .c.ZkController I am the leader, no recovery necessary [junit4] 2> 2276298 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .s.HttpSolrCall [admin] webapp=3Dnull path=3D/admin/cores params=3D{qt=3D/a= dmin/cores&collection.configName=3Dcdcr-source&newCollection=3Dtrue&collect= ion=3Dcdcr-source&version=3D2&replicaType=3DNRT&coreNodeName=3Dcore_node2&n= ame=3Dcdcr-source_shard1_replica_n1&action=3DCREATE&numShards=3D1&shard=3Ds= hard1&property.solr.directoryFactory=3Dsolr.StandardDirectoryFactory&wt=3Dj= avabin} status=3D0 QTime=3D1276 [junit4] 2> 2276303 INFO (qtp132987633-21941) [n:127.0.0.1:50203_solr= ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for= at most 30 seconds. Check all shard replicas [junit4] 2> 2276410 INFO (zkCallback-3648-thread-3-processing-n:127.0= .0.1:50203_solr) [n:127.0.0.1:50203_solr ] o.a.s.c.c.ZkStateReader A clu= ster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged p= ath:/collections/cdcr-source/state.json] for collection [cdcr-source] has o= ccurred - updating... (live nodes size: [1]) [junit4] 2> 2276410 INFO (zkCallback-3648-thread-2-processing-n:127.0= .0.1:50203_solr) [n:127.0.0.1:50203_solr ] o.a.s.c.c.ZkStateReader A clu= ster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged p= ath:/collections/cdcr-source/state.json] for collection [cdcr-source] has o= ccurred - updating... (live nodes size: [1]) [junit4] 2> 2276683 INFO (OverseerCollectionConfigSetProcessor-989132= 60795199491-127.0.0.1:50203_solr-n_0000000000) [n:127.0.0.1:50203_solr ]= o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-wor= k/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKe= eper [junit4] 2> 2277310 INFO (qtp132987633-21941) [n:127.0.0.1:50203_solr= ] o.a.s.s.HttpSolrCall [admin] webapp=3Dnull path=3D/admin/collections = params=3D{replicationFactor=3D1&collection.configName=3Dcdcr-source&name=3D= cdcr-source&nrtReplicas=3D1&action=3DCREATE&numShards=3D1&property.solr.dir= ectoryFactory=3Dsolr.StandardDirectoryFactory&wt=3Djavabin&version=3D2} sta= tus=3D0 QTime=3D2638 [junit4] 2> 2277321 INFO (qtp132987633-21944) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.p.LogUpdateProcessorFactory [cdcr-source_shard1_replica_n1] webapp=3D/s= olr path=3D/update params=3D{_stateVer_=3Dcdcr-source:4&wt=3Djavabin&versio= n=3D2}{add=3D[source_0 (1582612175966437376), source_1 (1582612175969583104= ), source_2 (1582612175969583105), source_3 (1582612175969583106), source_4= (1582612175970631680), source_5 (1582612175970631681), source_6 (158261217= 5970631682), source_7 (1582612175970631683), source_8 (1582612175970631684)= , source_9 (1582612175970631685), ... (100 adds)]} 0 7 [junit4] 2> 2277323 INFO (qtp132987633-21945) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.DirectUpdateHandler2 start commit{_version_=3D1582612175975874560,optimi= ze=3Dfalse,openSearcher=3Dtrue,waitSearcher=3Dtrue,expungeDeletes=3Dfalse,s= oftCommit=3Dfalse,prepareCommit=3Dfalse} [junit4] 2> 2277323 INFO (qtp132987633-21945) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.Sol= rIndexWriter@5ae8b61b commitCommandVersion:1582612175975874560 [junit4] 2> 2277349 INFO (qtp132987633-21945) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .s.SolrIndexSearcher Opening [Searcher@69648b1e[cdcr-source_shard1_replica_= n1] main] [junit4] 2> 2277350 INFO (qtp132987633-21945) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.DirectUpdateHandler2 end_commit_flush [junit4] 2> 2277351 INFO (searcherExecutor-10288-thread-1-processing-= n:127.0.0.1:50203_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-sour= ce r:core_node2) [n:127.0.0.1:50203_solr c:cdcr-source s:shard1 r:core_node= 2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_rep= lica_n1] Registered new searcher Searcher@69648b1e[cdcr-source_shard1_repli= ca_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(= _0(7.2.0):C100)))} [junit4] 2> 2277351 INFO (qtp132987633-21945) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.p.LogUpdateProcessorFactory [cdcr-source_shard1_replica_n1] webapp=3D/s= olr path=3D/update params=3D{_stateVer_=3Dcdcr-source:4&waitSearcher=3Dtrue= &commit=3Dtrue&softCommit=3Dfalse&wt=3Djavabin&version=3D2}{commit=3D} 0 28 [junit4] 2> 2277357 INFO (qtp132987633-21946) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.p.LogUpdateProcessorFactory [cdcr-source_shard1_replica_n1] webapp=3D/s= olr path=3D/update params=3D{_stateVer_=3Dcdcr-source:4&wt=3Djavabin&versio= n=3D2}{add=3D[source_100 (1582612176006283264), source_101 (158261217601047= 7568), source_102 (1582612176010477569), source_103 (1582612176010477570), = source_104 (1582612176010477571), source_105 (1582612176010477572), source_= 106 (1582612176010477573), source_107 (1582612176010477574), source_108 (15= 82612176010477575), source_109 (1582612176010477576), ... (100 adds)]} 0 5 [junit4] 2> 2277358 INFO (qtp132987633-21939) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.DirectUpdateHandler2 start commit{_version_=3D1582612176012574720,optimi= ze=3Dfalse,openSearcher=3Dtrue,waitSearcher=3Dtrue,expungeDeletes=3Dfalse,s= oftCommit=3Dfalse,prepareCommit=3Dfalse} [junit4] 2> 2277358 INFO (qtp132987633-21939) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.Sol= rIndexWriter@5ae8b61b commitCommandVersion:1582612176012574720 [junit4] 2> 2277368 INFO (qtp132987633-21939) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .s.SolrIndexSearcher Opening [Searcher@2815f0f0[cdcr-source_shard1_replica_= n1] main] [junit4] 2> 2277369 INFO (qtp132987633-21939) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.DirectUpdateHandler2 end_commit_flush [junit4] 2> 2277370 INFO (searcherExecutor-10288-thread-1-processing-= n:127.0.0.1:50203_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-sour= ce r:core_node2) [n:127.0.0.1:50203_solr c:cdcr-source s:shard1 r:core_node= 2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_rep= lica_n1] Registered new searcher Searcher@2815f0f0[cdcr-source_shard1_repli= ca_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(= _0(7.2.0):C100) Uninverting(_1(7.2.0):C100)))} [junit4] 2> 2277370 INFO (qtp132987633-21939) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.p.LogUpdateProcessorFactory [cdcr-source_shard1_replica_n1] webapp=3D/s= olr path=3D/update params=3D{_stateVer_=3Dcdcr-source:4&waitSearcher=3Dtrue= &commit=3Dtrue&softCommit=3Dfalse&wt=3Djavabin&version=3D2}{commit=3D} 0 11 [junit4] 2> 2277373 INFO (qtp132987633-21942) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.p.LogUpdateProcessorFactory [cdcr-source_shard1_replica_n1] webapp=3D/s= olr path=3D/update params=3D{_stateVer_=3Dcdcr-source:4&wt=3Djavabin&versio= n=3D2}{add=3D[source_200 (1582612176026206208), source_201 (158261217602725= 4784), source_202 (1582612176027254785), source_203 (1582612176027254786), = source_204 (1582612176027254787), source_205 (1582612176027254788), source_= 206 (1582612176027254789), source_207 (1582612176027254790), source_208 (15= 82612176027254791), source_209 (1582612176027254792), ... (100 adds)]} 0 2 [junit4] 2> 2277374 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.DirectUpdateHandler2 start commit{_version_=3D1582612176029351936,optimi= ze=3Dfalse,openSearcher=3Dtrue,waitSearcher=3Dtrue,expungeDeletes=3Dfalse,s= oftCommit=3Dfalse,prepareCommit=3Dfalse} [junit4] 2> 2277374 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.Sol= rIndexWriter@5ae8b61b commitCommandVersion:1582612176029351936 [junit4] 2> 2277384 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .s.SolrIndexSearcher Opening [Searcher@27014172[cdcr-source_shard1_replica_= n1] main] [junit4] 2> 2277385 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.DirectUpdateHandler2 end_commit_flush [junit4] 2> 2277385 INFO (searcherExecutor-10288-thread-1-processing-= n:127.0.0.1:50203_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-sour= ce r:core_node2) [n:127.0.0.1:50203_solr c:cdcr-source s:shard1 r:core_node= 2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_rep= lica_n1] Registered new searcher Searcher@27014172[cdcr-source_shard1_repli= ca_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(= _0(7.2.0):C100) Uninverting(_1(7.2.0):C100) Uninverting(_2(7.2.0):C100)))} [junit4] 2> 2277385 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.p.LogUpdateProcessorFactory [cdcr-source_shard1_replica_n1] webapp=3D/s= olr path=3D/update params=3D{_stateVer_=3Dcdcr-source:4&waitSearcher=3Dtrue= &commit=3Dtrue&softCommit=3Dfalse&wt=3Djavabin&version=3D2}{commit=3D} 0 11 [junit4] 2> 2277402 INFO (qtp132987633-21941) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.p.LogUpdateProcessorFactory [cdcr-source_shard1_replica_n1] webapp=3D/s= olr path=3D/update params=3D{_stateVer_=3Dcdcr-source:4&wt=3Djavabin&versio= n=3D2}{add=3D[source_300 (1582612176055566336), source_301 (158261217605661= 4912), source_302 (1582612176057663488), source_303 (1582612176057663489), = source_304 (1582612176057663490), source_305 (1582612176057663491), source_= 306 (1582612176057663492), source_307 (1582612176057663493), source_308 (15= 82612176057663494), source_309 (1582612176057663495), ... (100 adds)]} 0 16 [junit4] 2> 2277403 INFO (qtp132987633-21944) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.DirectUpdateHandler2 start commit{_version_=3D1582612176059760640,optimi= ze=3Dfalse,openSearcher=3Dtrue,waitSearcher=3Dtrue,expungeDeletes=3Dfalse,s= oftCommit=3Dfalse,prepareCommit=3Dfalse} [junit4] 2> 2277403 INFO (qtp132987633-21944) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.Sol= rIndexWriter@5ae8b61b commitCommandVersion:1582612176059760640 [junit4] 2> 2277413 INFO (qtp132987633-21944) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .s.SolrIndexSearcher Opening [Searcher@7bc658ac[cdcr-source_shard1_replica_= n1] main] [junit4] 2> 2277413 INFO (qtp132987633-21944) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.DirectUpdateHandler2 end_commit_flush [junit4] 2> 2277414 INFO (searcherExecutor-10288-thread-1-processing-= n:127.0.0.1:50203_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-sour= ce r:core_node2) [n:127.0.0.1:50203_solr c:cdcr-source s:shard1 r:core_node= 2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_rep= lica_n1] Registered new searcher Searcher@7bc658ac[cdcr-source_shard1_repli= ca_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(= _0(7.2.0):C100) Uninverting(_1(7.2.0):C100) Uninverting(_2(7.2.0):C100) Uni= nverting(_3(7.2.0):C100)))} [junit4] 2> 2277414 INFO (qtp132987633-21944) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.p.LogUpdateProcessorFactory [cdcr-source_shard1_replica_n1] webapp=3D/s= olr path=3D/update params=3D{_stateVer_=3Dcdcr-source:4&waitSearcher=3Dtrue= &commit=3Dtrue&softCommit=3Dfalse&wt=3Djavabin&version=3D2}{commit=3D} 0 11 [junit4] 2> 2277418 INFO (qtp132987633-21945) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.p.LogUpdateProcessorFactory [cdcr-source_shard1_replica_n1] webapp=3D/s= olr path=3D/update params=3D{_stateVer_=3Dcdcr-source:4&wt=3Djavabin&versio= n=3D2}{add=3D[source_400 (1582612176072343552), source_401 (158261217607444= 0704), source_402 (1582612176074440705), source_403 (1582612176074440706), = source_404 (1582612176074440707), source_405 (1582612176074440708), source_= 406 (1582612176074440709), source_407 (1582612176074440710), source_408 (15= 82612176074440711), source_409 (1582612176074440712), ... (100 adds)]} 0 3 [junit4] 2> 2277419 INFO (qtp132987633-21946) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.DirectUpdateHandler2 start commit{_version_=3D1582612176076537856,optimi= ze=3Dfalse,openSearcher=3Dtrue,waitSearcher=3Dtrue,expungeDeletes=3Dfalse,s= oftCommit=3Dfalse,prepareCommit=3Dfalse} [junit4] 2> 2277419 INFO (qtp132987633-21946) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.Sol= rIndexWriter@5ae8b61b commitCommandVersion:1582612176076537856 [junit4] 2> 2277428 INFO (qtp132987633-21946) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .s.SolrIndexSearcher Opening [Searcher@215ba566[cdcr-source_shard1_replica_= n1] main] [junit4] 2> 2277429 INFO (qtp132987633-21946) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.DirectUpdateHandler2 end_commit_flush [junit4] 2> 2277430 INFO (searcherExecutor-10288-thread-1-processing-= n:127.0.0.1:50203_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-sour= ce r:core_node2) [n:127.0.0.1:50203_solr c:cdcr-source s:shard1 r:core_node= 2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_rep= lica_n1] Registered new searcher Searcher@215ba566[cdcr-source_shard1_repli= ca_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(= _0(7.2.0):C100) Uninverting(_1(7.2.0):C100) Uninverting(_2(7.2.0):C100) Uni= nverting(_3(7.2.0):C100) Uninverting(_4(7.2.0):C100)))} [junit4] 2> 2277430 INFO (qtp132987633-21946) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.p.LogUpdateProcessorFactory [cdcr-source_shard1_replica_n1] webapp=3D/s= olr path=3D/update params=3D{_stateVer_=3Dcdcr-source:4&waitSearcher=3Dtrue= &commit=3Dtrue&softCommit=3Dfalse&wt=3Djavabin&version=3D2}{commit=3D} 0 10 [junit4] 2> 2277433 INFO (qtp132987633-21939) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.p.LogUpdateProcessorFactory [cdcr-source_shard1_replica_n1] webapp=3D/s= olr path=3D/update params=3D{_stateVer_=3Dcdcr-source:4&wt=3Djavabin&versio= n=3D2}{add=3D[source_500 (1582612176089120768), source_501 (158261217609016= 9344), source_502 (1582612176090169345), source_503 (1582612176090169346), = source_504 (1582612176090169347), source_505 (1582612176090169348), source_= 506 (1582612176090169349), source_507 (1582612176090169350), source_508 (15= 82612176090169351), source_509 (1582612176090169352), ... (100 adds)]} 0 2 [junit4] 2> 2277434 INFO (qtp132987633-21942) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.DirectUpdateHandler2 start commit{_version_=3D1582612176092266496,optimi= ze=3Dfalse,openSearcher=3Dtrue,waitSearcher=3Dtrue,expungeDeletes=3Dfalse,s= oftCommit=3Dfalse,prepareCommit=3Dfalse} [junit4] 2> 2277434 INFO (qtp132987633-21942) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.Sol= rIndexWriter@5ae8b61b commitCommandVersion:1582612176092266496 [junit4] 2> 2277445 INFO (qtp132987633-21942) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .s.SolrIndexSearcher Opening [Searcher@44d8681d[cdcr-source_shard1_replica_= n1] main] [junit4] 2> 2277445 INFO (qtp132987633-21942) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.DirectUpdateHandler2 end_commit_flush [junit4] 2> 2277446 INFO (searcherExecutor-10288-thread-1-processing-= n:127.0.0.1:50203_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-sour= ce r:core_node2) [n:127.0.0.1:50203_solr c:cdcr-source s:shard1 r:core_node= 2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_rep= lica_n1] Registered new searcher Searcher@44d8681d[cdcr-source_shard1_repli= ca_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(= _0(7.2.0):C100) Uninverting(_1(7.2.0):C100) Uninverting(_2(7.2.0):C100) Uni= nverting(_3(7.2.0):C100) Uninverting(_4(7.2.0):C100) Uninverting(_5(7.2.0):= C100)))} [junit4] 2> 2277446 INFO (qtp132987633-21942) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.p.LogUpdateProcessorFactory [cdcr-source_shard1_replica_n1] webapp=3D/s= olr path=3D/update params=3D{_stateVer_=3Dcdcr-source:4&waitSearcher=3Dtrue= &commit=3Dtrue&softCommit=3Dfalse&wt=3Djavabin&version=3D2}{commit=3D} 0 12 [junit4] 2> 2277451 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.p.LogUpdateProcessorFactory [cdcr-source_shard1_replica_n1] webapp=3D/s= olr path=3D/update params=3D{_stateVer_=3Dcdcr-source:4&wt=3Djavabin&versio= n=3D2}{add=3D[source_600 (1582612176105897984), source_601 (158261217610904= 3712), source_602 (1582612176109043713), source_603 (1582612176109043714), = source_604 (1582612176109043715), source_605 (1582612176109043716), source_= 606 (1582612176109043717), source_607 (1582612176109043718), source_608 (15= 82612176109043719), source_609 (1582612176109043720), ... (100 adds)]} 0 3 [junit4] 2> 2277452 INFO (qtp132987633-21941) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.DirectUpdateHandler2 start commit{_version_=3D1582612176111140864,optimi= ze=3Dfalse,openSearcher=3Dtrue,waitSearcher=3Dtrue,expungeDeletes=3Dfalse,s= oftCommit=3Dfalse,prepareCommit=3Dfalse} [junit4] 2> 2277452 INFO (qtp132987633-21941) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.Sol= rIndexWriter@5ae8b61b commitCommandVersion:1582612176111140864 [junit4] 2> 2277463 INFO (qtp132987633-21941) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .s.SolrIndexSearcher Opening [Searcher@60738ce8[cdcr-source_shard1_replica_= n1] main] [junit4] 2> 2277464 INFO (qtp132987633-21941) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.DirectUpdateHandler2 end_commit_flush [junit4] 2> 2277464 INFO (searcherExecutor-10288-thread-1-processing-= n:127.0.0.1:50203_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-sour= ce r:core_node2) [n:127.0.0.1:50203_solr c:cdcr-source s:shard1 r:core_node= 2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_rep= lica_n1] Registered new searcher Searcher@60738ce8[cdcr-source_shard1_repli= ca_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(= _0(7.2.0):C100) Uninverting(_1(7.2.0):C100) Uninverting(_2(7.2.0):C100) Uni= nverting(_3(7.2.0):C100) Uninverting(_4(7.2.0):C100) Uninverting(_5(7.2.0):= C100) Uninverting(_6(7.2.0):C100)))} [junit4] 2> 2277465 INFO (qtp132987633-21941) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.p.LogUpdateProcessorFactory [cdcr-source_shard1_replica_n1] webapp=3D/s= olr path=3D/update params=3D{_stateVer_=3Dcdcr-source:4&waitSearcher=3Dtrue= &commit=3Dtrue&softCommit=3Dfalse&wt=3Djavabin&version=3D2}{commit=3D} 0 13 [junit4] 2> 2277468 INFO (qtp132987633-21944) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.p.LogUpdateProcessorFactory [cdcr-source_shard1_replica_n1] webapp=3D/s= olr path=3D/update params=3D{_stateVer_=3Dcdcr-source:4&wt=3Djavabin&versio= n=3D2}{add=3D[source_700 (1582612176124772352), source_701 (158261217612582= 0928), source_702 (1582612176125820929), source_703 (1582612176125820930), = source_704 (1582612176125820931), source_705 (1582612176125820932), source_= 706 (1582612176125820933), source_707 (1582612176125820934), source_708 (15= 82612176125820935), source_709 (1582612176125820936), ... (100 adds)]} 0 2 [junit4] 2> 2277468 INFO (qtp132987633-21945) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.DirectUpdateHandler2 start commit{_version_=3D1582612176127918089,optimi= ze=3Dfalse,openSearcher=3Dtrue,waitSearcher=3Dtrue,expungeDeletes=3Dfalse,s= oftCommit=3Dfalse,prepareCommit=3Dfalse} [junit4] 2> 2277468 INFO (qtp132987633-21945) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.Sol= rIndexWriter@5ae8b61b commitCommandVersion:1582612176127918089 [junit4] 2> 2277478 INFO (qtp132987633-21945) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .s.SolrIndexSearcher Opening [Searcher@3bc8dd7d[cdcr-source_shard1_replica_= n1] main] [junit4] 2> 2277478 INFO (qtp132987633-21945) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.DirectUpdateHandler2 end_commit_flush [junit4] 2> 2277479 INFO (searcherExecutor-10288-thread-1-processing-= n:127.0.0.1:50203_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-sour= ce r:core_node2) [n:127.0.0.1:50203_solr c:cdcr-source s:shard1 r:core_node= 2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_rep= lica_n1] Registered new searcher Searcher@3bc8dd7d[cdcr-source_shard1_repli= ca_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(= _0(7.2.0):C100) Uninverting(_1(7.2.0):C100) Uninverting(_2(7.2.0):C100) Uni= nverting(_3(7.2.0):C100) Uninverting(_4(7.2.0):C100) Uninverting(_5(7.2.0):= C100) Uninverting(_6(7.2.0):C100) Uninverting(_7(7.2.0):C100)))} [junit4] 2> 2277479 INFO (qtp132987633-21945) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.p.LogUpdateProcessorFactory [cdcr-source_shard1_replica_n1] webapp=3D/s= olr path=3D/update params=3D{_stateVer_=3Dcdcr-source:4&waitSearcher=3Dtrue= &commit=3Dtrue&softCommit=3Dfalse&wt=3Djavabin&version=3D2}{commit=3D} 0 10 [junit4] 2> 2277482 INFO (qtp132987633-21946) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.p.LogUpdateProcessorFactory [cdcr-source_shard1_replica_n1] webapp=3D/s= olr path=3D/update params=3D{_stateVer_=3Dcdcr-source:4&wt=3Djavabin&versio= n=3D2}{add=3D[source_800 (1582612176140500992), source_801 (158261217614154= 9568), source_802 (1582612176141549569), source_803 (1582612176141549570), = source_804 (1582612176141549571), source_805 (1582612176141549572), source_= 806 (1582612176141549573), source_807 (1582612176141549574), source_808 (15= 82612176141549575), source_809 (1582612176141549576), ... (100 adds)]} 0 2 [junit4] 2> 2277483 INFO (qtp132987633-21939) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.DirectUpdateHandler2 start commit{_version_=3D1582612176143646720,optimi= ze=3Dfalse,openSearcher=3Dtrue,waitSearcher=3Dtrue,expungeDeletes=3Dfalse,s= oftCommit=3Dfalse,prepareCommit=3Dfalse} [junit4] 2> 2277483 INFO (qtp132987633-21939) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.Sol= rIndexWriter@5ae8b61b commitCommandVersion:1582612176143646720 [junit4] 2> 2277493 INFO (qtp132987633-21939) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .s.SolrIndexSearcher Opening [Searcher@5007de2a[cdcr-source_shard1_replica_= n1] main] [junit4] 2> 2277493 INFO (qtp132987633-21939) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.DirectUpdateHandler2 end_commit_flush [junit4] 2> 2277494 INFO (searcherExecutor-10288-thread-1-processing-= n:127.0.0.1:50203_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-sour= ce r:core_node2) [n:127.0.0.1:50203_solr c:cdcr-source s:shard1 r:core_node= 2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_rep= lica_n1] Registered new searcher Searcher@5007de2a[cdcr-source_shard1_repli= ca_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(= _0(7.2.0):C100) Uninverting(_1(7.2.0):C100) Uninverting(_2(7.2.0):C100) Uni= nverting(_3(7.2.0):C100) Uninverting(_4(7.2.0):C100) Uninverting(_5(7.2.0):= C100) Uninverting(_6(7.2.0):C100) Uninverting(_7(7.2.0):C100) Uninverting(_= 8(7.2.0):C100)))} [junit4] 2> 2277494 INFO (qtp132987633-21939) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.p.LogUpdateProcessorFactory [cdcr-source_shard1_replica_n1] webapp=3D/s= olr path=3D/update params=3D{_stateVer_=3Dcdcr-source:4&waitSearcher=3Dtrue= &commit=3Dtrue&softCommit=3Dfalse&wt=3Djavabin&version=3D2}{commit=3D} 0 11 [junit4] 2> 2277497 INFO (qtp132987633-21942) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.p.LogUpdateProcessorFactory [cdcr-source_shard1_replica_n1] webapp=3D/s= olr path=3D/update params=3D{_stateVer_=3Dcdcr-source:4&wt=3Djavabin&versio= n=3D2}{add=3D[source_900 (1582612176156229632), source_901 (158261217615727= 8208), source_902 (1582612176157278209), source_903 (1582612176157278210), = source_904 (1582612176157278211), source_905 (1582612176157278212), source_= 906 (1582612176157278213), source_907 (1582612176157278214), source_908 (15= 82612176157278215), source_909 (1582612176157278216), ... (100 adds)]} 0 2 [junit4] 2> 2277498 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.DirectUpdateHandler2 start commit{_version_=3D1582612176159375360,optimi= ze=3Dfalse,openSearcher=3Dtrue,waitSearcher=3Dtrue,expungeDeletes=3Dfalse,s= oftCommit=3Dfalse,prepareCommit=3Dfalse} [junit4] 2> 2277498 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.Sol= rIndexWriter@5ae8b61b commitCommandVersion:1582612176159375360 [junit4] 2> 2277508 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .s.SolrIndexSearcher Opening [Searcher@67d1eece[cdcr-source_shard1_replica_= n1] main] [junit4] 2> 2277509 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.DirectUpdateHandler2 end_commit_flush [junit4] 2> 2277509 INFO (searcherExecutor-10288-thread-1-processing-= n:127.0.0.1:50203_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-sour= ce r:core_node2) [n:127.0.0.1:50203_solr c:cdcr-source s:shard1 r:core_node= 2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_rep= lica_n1] Registered new searcher Searcher@67d1eece[cdcr-source_shard1_repli= ca_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(= _0(7.2.0):C100) Uninverting(_1(7.2.0):C100) Uninverting(_2(7.2.0):C100) Uni= nverting(_3(7.2.0):C100) Uninverting(_4(7.2.0):C100) Uninverting(_5(7.2.0):= C100) Uninverting(_6(7.2.0):C100) Uninverting(_7(7.2.0):C100) Uninverting(_= 8(7.2.0):C100) Uninverting(_9(7.2.0):C100)))} [junit4] 2> 2277509 INFO (qtp132987633-21943) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .u.p.LogUpdateProcessorFactory [cdcr-source_shard1_replica_n1] webapp=3D/s= olr path=3D/update params=3D{_stateVer_=3Dcdcr-source:4&waitSearcher=3Dtrue= &commit=3Dtrue&softCommit=3Dfalse&wt=3Djavabin&version=3D2}{commit=3D} 0 11 [junit4] 2> 2277510 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.c.CdcrBootstrapTest A= dding numDocs=3D1000 [junit4] 2> 2277510 INFO (qtp132987633-21941) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .c.S.Request [cdcr-source_shard1_replica_n1] webapp=3D/solr path=3D/select= params=3D{q=3D*:*&_stateVer_=3Dcdcr-source:4&wt=3Djavabin&version=3D2} hit= s=3D1000 status=3D0 QTime=3D0 [junit4] 2> 2277511 INFO (qtp132987633-21944) [n:127.0.0.1:50203_solr= c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s= .c.S.Request [cdcr-source_shard1_replica_n1] webapp=3D/solr path=3D/get pa= rams=3D{qt=3D/get&_stateVer_=3Dcdcr-source:4&getVersions=3D1000&wt=3Djavabi= n&version=3D2} status=3D0 QTime=3D0 [junit4] 2> 2277521 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.e.j.s.AbstractConnector S= topped ServerConnector@1b736ac3{HTTP/1.1,[http/1.1]}{127.0.0.1:0} [junit4] 2> 2277523 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.c.CoreContainer Shutt= ing down CoreContainer instance=3D247072435 [junit4] 2> 2277523 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.m.SolrMetricManager C= losing metric reporters for registry=3Dsolr.node, tag=3Dnull [junit4] 2> 2277523 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.m.r.SolrJmxReporter C= losing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@68ab7fab= : rootName =3D solr_50203, domain =3D solr.node, service url =3D null, agen= t id =3D null] for registry solr.node / com.codahale.metrics.MetricRegistry= @6746d1d2 [junit4] 2> 2277528 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.m.SolrMetricManager C= losing metric reporters for registry=3Dsolr.jvm, tag=3Dnull [junit4] 2> 2277528 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.m.r.SolrJmxReporter C= losing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1b6a6b0a= : rootName =3D solr_50203, domain =3D solr.jvm, service url =3D null, agent= id =3D null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@2= faedfce [junit4] 2> 2277531 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.m.SolrMetricManager C= losing metric reporters for registry=3Dsolr.jetty, tag=3Dnull [junit4] 2> 2277531 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.m.r.SolrJmxReporter C= losing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4370131e= : rootName =3D solr_50203, domain =3D solr.jetty, service url =3D null, age= nt id =3D null] for registry solr.jetty / com.codahale.metrics.MetricRegist= ry@22f21cae [junit4] 2> 2277533 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.c.ZkController Remove= node as live in ZooKeeper:/live_nodes/127.0.0.1:50203_solr [junit4] 2> 2277533 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.m.SolrMetricManager C= losing metric reporters for registry=3Dsolr.cluster, tag=3Dnull [junit4] 2> 2277534 INFO (zkCallback-3656-thread-1) [ ] o.a.s.c.c.= ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) [junit4] 2> 2277534 INFO (coreCloseExecutor-10293-thread-1) [n:127.0.= 0.1:50203_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_rep= lica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_replica_n1] CLOSING SolrCore= org.apache.solr.core.SolrCore@44da4c02 [junit4] 2> 2277534 INFO (coreCloseExecutor-10293-thread-1) [n:127.0.= 0.1:50203_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_rep= lica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=3D= solr.core.cdcr-source.shard1.replica_n1, tag=3D1155156994 [junit4] 2> 2277534 INFO (coreCloseExecutor-10293-thread-1) [n:127.0.= 0.1:50203_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_rep= lica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metric= s.reporters.SolrJmxReporter@4dad41d9: rootName =3D solr_50203, domain =3D s= olr.core.cdcr-source.shard1.replica_n1, service url =3D null, agent id =3D = null] for registry solr.core.cdcr-source.shard1.replica_n1 / com.codahale.m= etrics.MetricRegistry@428ec86b [junit4] 2> 2277534 INFO (zkCallback-3648-thread-2-processing-n:127.0= .0.1:50203_solr) [n:127.0.0.1:50203_solr ] o.a.s.c.c.ZkStateReader Updat= ed live nodes from ZooKeeper... (1) -> (0) [junit4] 2> 2277539 INFO (coreCloseExecutor-10293-thread-1) [n:127.0.= 0.1:50203_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_rep= lica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=3D= solr.collection.cdcr-source.shard1.leader, tag=3D1155156994 [junit4] 2> 2277544 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.c.Overseer Overseer (= id=3D98913260795199491-127.0.0.1:50203_solr-n_0000000000) closing [junit4] 2> 2277544 INFO (OverseerStateUpdate-98913260795199491-127.0= .0.1:50203_solr-n_0000000000) [n:127.0.0.1:50203_solr ] o.a.s.c.Overseer= Overseer Loop exiting : 127.0.0.1:50203_solr [junit4] 2> 2277544 WARN (OverseerAutoScalingTriggerThread-9891326079= 5199491-127.0.0.1:50203_solr-n_0000000000) [n:127.0.0.1:50203_solr ] o.a= .s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are clos= ed, exiting. [junit4] 2> 2277550 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.e.j.s.h.ContextHandler St= opped o.e.j.s.ServletContextHandler@5f8e2113{/solr,null,UNAVAILABLE} [junit4] 2> 2277553 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.e.j.s.Server jetty-9.3.20= .v20170531 [junit4] 2> 2277554 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.e.j.s.h.ContextHandler St= arted o.e.j.s.ServletContextHandler@1de4f746{/solr,null,AVAILABLE} [junit4] 2> 2277556 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.e.j.s.AbstractConnector S= tarted ServerConnector@472c3185{HTTP/1.1,[http/1.1]}{127.0.0.1:50214} [junit4] 2> 2277556 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.e.j.s.Server Started @228= 1307ms [junit4] 2> 2277558 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.c.s.e.JettySolrRunner= Jetty properties: {hostContext=3D/solr, hostPort=3D50214} [junit4] 2> 2277558 ERROR (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.u.StartupLoggingUtils= Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 2277558 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.s.SolrDispatchFilter = ___ _ Welcome to Apache Solr=E2=84=A2 version 7.2.0 [junit4] 2> 2277558 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.s.SolrDispatchFilter = / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 2277558 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.s.SolrDispatchFilter = \__ \/ _ \ | '_| Install dir: null [junit4] 2> 2277559 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.s.SolrDispatchFilter = |___/\___/_|_| Start time: 2017-10-29T17:03:05.296Z [junit4] 2> 2277561 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.s.SolrDispatchFilter = solr.xml found in ZooKeeper. Loading... [junit4] 2> 2277570 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.c.ZkContainer Zookeep= er client=3D127.0.0.1:50201/solr [junit4] 2> 2277586 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [n:127.0.0.1:50214_solr ] o.a.s= .c.Overseer Overseer (id=3Dnull) closing [junit4] 2> 2277587 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [n:127.0.0.1:50214_solr ] o.a.s= .c.OverseerElectionContext I am going to be the leader 127.0.0.1:50214_solr [junit4] 2> 2277589 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [n:127.0.0.1:50214_solr ] o.a.s= .c.Overseer Overseer (id=3D98913260795199499-127.0.0.1:50214_solr-n_0000000= 001) starting [junit4] 2> 2277597 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [n:127.0.0.1:50214_solr ] o.a.s= .c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50= 214_solr [junit4] 2> 2277599 INFO (OverseerStateUpdate-98913260795199499-127.0= .0.1:50214_solr-n_0000000001) [n:127.0.0.1:50214_solr ] o.a.s.c.c.ZkStat= eReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 2277599 INFO (zkCallback-3656-thread-1) [ ] o.a.s.c.c.= ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 2277656 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [n:127.0.0.1:50214_solr ] o.a.s= .m.r.SolrJmxReporter JMX monitoring for 'solr_50214.solr.node' (registry 's= olr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5dabd4= f6 [junit4] 2> 2277663 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [n:127.0.0.1:50214_solr ] o.a.s= .m.r.SolrJmxReporter JMX monitoring for 'solr_50214.solr.jvm' (registry 'so= lr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5dabd4f6 [junit4] 2> 2277663 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [n:127.0.0.1:50214_solr ] o.a.s= .m.r.SolrJmxReporter JMX monitoring for 'solr_50214.solr.jetty' (registry '= solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5dab= d4f6 [junit4] 2> 2277665 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [n:127.0.0.1:50214_solr ] o.a.s= .c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins= /workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cl= oud.CdcrBootstrapTest_1960521F5633FD5-001/cdcr-source-001/node1/. [junit4] 2> 2277665 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [n:127.0.0.1:50214_solr ] o.a.s= .c.CorePropertiesLocator Cores are: [cdcr-source_shard1_replica_n1] [junit4] 2> 2277666 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr ] o.a.s.c.TransientSolrC= oreCacheDefault Allocating transient cache for 2147483647 transient cores [junit4] 2> 2277677 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr ] o.a.s.c.SolrConfig Usi= ng Lucene MatchVersion: 7.2.0 [junit4] 2> 2277680 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr ] o.a.s.s.ManagedIndexSc= hemaFactory The schema is configured as managed, but managed schema resourc= e managed-schema not found - loading non-managed schema schema.xml instead [junit4] 2> 2277682 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr ] o.a.s.s.IndexSchema [c= dcr-source_shard1_replica_n1] Schema name=3Dminimal [junit4] 2> 2277684 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr ] o.a.s.s.IndexSchema Lo= aded schema minimal/1.1 with uniqueid field id [junit4] 2> 2277685 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr ] o.a.s.s.ManagedIndexSc= hema Created and persisted managed schema znode at /configs/cdcr-source/man= aged-schema [junit4] 2> 2277688 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr ] o.a.s.s.ManagedIndexSc= hemaFactory After upgrading to managed schema in ZooKeeper, renamed the non= -managed schema /configs/cdcr-source/schema.xml to /configs/cdcr-source/sch= ema.xml.bak [junit4] 2> 2277795 INFO (zkCallback-3662-thread-1-processing-n:127.0= .0.1:50214_solr) [n:127.0.0.1:50214_solr ] o.a.s.c.c.ZkStateReader A clu= ster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged p= ath:/collections/cdcr-source/state.json] for collection [cdcr-source] has o= ccurred - updating... (live nodes size: [1]) [junit4] 2> 2277795 INFO (zkCallback-3662-thread-2-processing-n:127.0= .0.1:50214_solr) [n:127.0.0.1:50214_solr ] o.a.s.c.c.ZkStateReader A clu= ster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged p= ath:/collections/cdcr-source/state.json] for collection [cdcr-source] has o= ccurred - updating... (live nodes size: [1]) [junit4] 2> 2278710 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:co= re_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene M= atchVersion: 7.2.0 [junit4] 2> 2278719 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:co= re_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.IndexSchema [cdcr-source_= shard1_replica_n1] Schema name=3Dminimal [junit4] 2> 2278722 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:co= re_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema= minimal/1.1 with uniqueid field id [junit4] 2> 2278722 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:co= re_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.CoreContainer Creating So= lrCore 'cdcr-source_shard1_replica_n1' using configuration from collection = cdcr-source, trusted=3Dtrue [junit4] 2> 2278722 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:co= re_node2 x:cdcr-source_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX mon= itoring for 'solr_50214.solr.core.cdcr-source.shard1.replica_n1' (registry = 'solr.core.cdcr-source.shard1.replica_n1') enabled at server: com.sun.jmx.m= beanserver.JmxMBeanServer@5dabd4f6 [junit4] 2> 2278722 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:co= re_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStr= ategy.Builder [junit4] 2> 2278723 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:co= re_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [[cdcr-source_sh= ard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene= -Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrBootstrap= Test_1960521F5633FD5-001/cdcr-source-001/node1/cdcr-source_shard1_replica_n= 1], dataDir=3D[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/s= olr-core/test/J1/temp/solr.cloud.CdcrBootstrapTest_1960521F5633FD5-001/cdcr= -source-001/node1/./cdcr-source_shard1_replica_n1/data/] [junit4] 2> 2278865 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:co= re_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.UpdateHandler Using Updat= eLog implementation: org.apache.solr.update.CdcrUpdateLog [junit4] 2> 2278865 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:co= re_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.UpdateLog Initializing Up= dateLog: dataDir=3D defaultSyncLevel=3DFLUSH numRecordsToKeep=3D100 maxNumL= ogsToKeep=3D10 numVersionBuckets=3D65536 [junit4] 2> 2278870 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:co= re_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCo= mmit: disabled [junit4] 2> 2278870 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:co= re_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCo= mmit: disabled [junit4] 2> 2278907 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:co= re_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening= [Searcher@45738bc0[cdcr-source_shard1_replica_n1] main] [junit4] 2> 2278909 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:co= re_node2 x:cdcr-source_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Co= nfigured ZooKeeperStorageIO with znodeBase: /configs/cdcr-source [junit4] 2> 2278909 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:co= re_node2 x:cdcr-source_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Lo= aded null at path _rest_managed.json using ZooKeeperStorageIO:path=3D/confi= gs/cdcr-source [junit4] 2> 2278909 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:co= re_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creat= ing ZooKeeper watch for the managed schema at /configs/cdcr-source/managed-= schema [junit4] 2> 2278910 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:co= re_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Curre= nt schema version 0 is already the latest [junit4] 2> 2278910 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:co= re_node2 x:cdcr-source_shard1_replica_n1] o.a.s.h.ReplicationHandler Commit= s will be reserved for 10000ms. [junit4] 2> 2278919 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:co= re_node2 x:cdcr-source_shard1_replica_n1] o.a.s.h.CdcrBufferStateManager Cr= eated znode /collections/cdcr-source/cdcr/state/buffer [junit4] 2> 2278926 INFO (coreLoadExecutor-10304-thread-1-processing-= n:127.0.0.1:50214_solr) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:co= re_node2 x:cdcr-source_shard1_replica_n1] o.a.s.h.CdcrProcessStateManager C= reated znode /collections/cdcr-source/cdcr/state/process [junit4] 2> 2278964 WARN (cdcr-update-log-synchronizer-10310-thread-1= ) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source= _shard1_replica_n1] o.a.s.h.CdcrUpdateLogSynchronizer Caught unexpected exc= eption [junit4] 2> org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSol= rException: Error from server at http://127.0.0.1:50214/solr/cdcr-source_sh= ard1_replica_n1: SolrCore is loading [junit4] 2> =09at org.apache.solr.client.solrj.impl.HttpSolrClient.exe= cuteMethod(HttpSolrClient.java:626) [junit4] 2> =09at org.apache.solr.client.solrj.impl.HttpSolrClient.req= uest(HttpSolrClient.java:253) [junit4] 2> =09at org.apache.solr.client.solrj.impl.HttpSolrClient.req= uest(HttpSolrClient.java:242) [junit4] 2> =09at org.apache.solr.client.solrj.SolrClient.request(Solr= Client.java:1219) [junit4] 2> =09at org.apache.solr.handler.CdcrUpdateLogSynchronizer$Up= dateLogSynchronisation.run(CdcrUpdateLogSynchronizer.java:147) [junit4] 2> =09at java.util.concurrent.Executors$RunnableAdapter.call(= Executors.java:511) [junit4] 2> =09at java.util.concurrent.FutureTask.runAndReset(FutureTa= sk.java:308) [junit4] 2> =09at java.util.concurrent.ScheduledThreadPoolExecutor$Sch= eduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [junit4] 2> =09at java.util.concurrent.ScheduledThreadPoolExecutor$Sch= eduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [junit4] 2> =09at java.util.concurrent.ThreadPoolExecutor.runWorker(Th= readPoolExecutor.java:1149) [junit4] 2> =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(T= hreadPoolExecutor.java:624) [junit4] 2> =09at java.lang.Thread.run(Thread.java:748) [junit4] 2> 2278966 INFO (searcherExecutor-10305-thread-1-processing-= n:127.0.0.1:50214_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-sour= ce r:core_node2) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:core_node= 2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_rep= lica_n1] Registered new searcher Searcher@45738bc0[cdcr-source_shard1_repli= ca_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(= _a(7.2.0):C1000)))} [junit4] 2> 2278968 INFO (TEST-CdcrBootstrapTest.testConvertClusterTo= CdcrAndBootstrap-seed#[1960521F5633FD5]) [ ] o.a.s.c.AbstractDistribZkTe= stBase Wait for recoveries to finish - collection: cdcr-source failOnTimeou= t:true timeout (sec):330 [junit4] 1> - [junit4] 1> replica:core_node2 rstate:down live:true [junit4] 2> 2278970 INFO (coreZkRegister-10295-thread-1-processing-n:= 127.0.0.1:50214_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source= r:core_node2) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:core_node2 = x:cdcr-source_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough = replicas found to continue. [junit4] 2> 2278970 INFO (coreZkRegister-10295-thread-1-processing-n:= 127.0.0.1:50214_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source= r:core_node2) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:core_node2 = x:cdcr-source_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may b= e the new leader - try and sync [junit4] 2> 2278971 INFO (coreZkRegister-10295-thread-1-processing-n:= 127.0.0.1:50214_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source= r:core_node2) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:core_node2 = x:cdcr-source_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http= ://127.0.0.1:50214/solr/cdcr-source_shard1_replica_n1/ [junit4] 2> 2278971 INFO (coreZkRegister-10295-thread-1-processing-n:= 127.0.0.1:50214_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source= r:core_node2) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:core_node2 = x:cdcr-source_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sy= nc replicas to me [junit4] 2> 2278971 INFO (coreZkRegister-10295-thread-1-processing-n:= 127.0.0.1:50214_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source= r:core_node2) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:core_node2 = x:cdcr-source_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:5021= 4/solr/cdcr-source_shard1_replica_n1/ has no replicas [junit4] 2> 2278971 INFO (coreZkRegister-10295-thread-1-processing-n:= 127.0.0.1:50214_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source= r:core_node2) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:core_node2 = x:cdcr-source_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found a= ll replicas participating in election, clear LIR [junit4] 2> 2278972 INFO (coreZkRegister-10295-thread-1-processing-n:= 127.0.0.1:50214_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source= r:core_node2) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:core_node2 = x:cdcr-source_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am th= e new leader: http://127.0.0.1:50214/solr/cdcr-source_shard1_replica_n1/ sh= ard1 [junit4] 2> 2278973 INFO (zkCallback-3662-thread-2-processing-n:127.0= .0.1:50214_solr) [n:127.0.0.1:50214_solr ] o.a.s.h.CdcrLeaderStateManage= r Received new leader state @ cdcr-source:shard1 [junit4] 2> 2278973 INFO (coreZkRegister-10295-thread-1-processing-n:= 127.0.0.1:50214_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source= r:core_node2) [n:127.0.0.1:50214_solr c:cdcr-source s:shard1 r:core_node2 = x:cdcr-source_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no r= ecovery necessary [junit4] 2> 2279084 INFO (zkCallback-3662-thread-2-processing-n:127.0= .0.1:50214_solr) [n:127.0.0.1:50214_solr ] o.a.s.c.c.ZkStateReader A clu= ster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged p= ath:/collections/cdcr-source/state.json] for collection [cdcr-source] has o= ccurred - updating... (live nodes size: [1]) [junit4] 2> 2279084 INFO (zkCallback-3662-thread-3-processing-n:127.0= .0.1:50214_solr) [n:127.0.0.1:50214_solr ] o.a.s.c.c.ZkStateReader A clu= ster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged p= ath:/collections/cdcr-source/state.json] for collection [cdcr-source] has o= ccurred - updating... (live nodes size: [1]) [junit4] 1> - [junit4] 1> replica:core_node2 rstate:active live:true [junit4] 1> no one is recov [...truncated too long message...] .request(LBHttpSolrClient.java:460) [junit4] 2> =09at org.apache.solr.client.solrj.impl.CloudSolrClient.se= ndRequest(CloudSolrClient.java:1096) [junit4] 2> =09at org.apache.solr.client.solrj.impl.CloudSolrClient.re= questWithRetryOnStaleState(CloudSolrClient.java:875) [junit4] 2> =09at org.apache.solr.client.solrj.impl.CloudSolrClient.re= quest(CloudSolrClient.java:808) [junit4] 2> =09at org.apache.solr.client.solrj.SolrRequest.process(Sol= rRequest.java:178) [junit4] 2> =09at org.apache.solr.client.solrj.SolrRequest.process(Sol= rRequest.java:195) [junit4] 2> =09at org.apache.solr.client.solrj.impl.SolrClientCloudMan= ager.request(SolrClientCloudManager.java:99) [junit4] 2> =09... 9 more [junit4] 2> 2975342 WARN (OverseerThreadFactory-7642-thread-1-process= ing-n:127.0.0.1:50374_solr) [n:127.0.0.1:50374_solr ] o.a.s.c.MoveReplic= aCmd Timed out waiting for leader's replica to recover, collection=3DtestEx= ecute shard=3Dshard1 on node=3D127.0.0.1:50374_solr [junit4] 2> 2975356 INFO (OverseerThreadFactory-7642-thread-1-process= ing-n:127.0.0.1:50374_solr) [n:127.0.0.1:50374_solr ] o.a.s.c.OverseerTa= skQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 do= esn't exist. Requestor may have disconnected from ZooKeeper [junit4] 2> 2975361 WARN (OverseerAutoScalingTriggerThread-9891326548= 9870854-127.0.0.1:50374_solr-n_0000000001) [n:127.0.0.1:50374_solr ] o.a= .s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are clos= ed, exiting. [junit4] 2> 2975363 DEBUG (jetty-closer-5304-thread-1) [ ] o.a.s.c.= a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly [junit4] 2> 2975365 ERROR (AutoscalingActionExecutor-7641-thread-1-pro= cessing-n:127.0.0.1:50374_solr) [n:127.0.0.1:50374_solr ] o.a.s.c.a.Sche= duledTriggers Unexpected exception while waiting for pending task with requ= estid: node_lost_trigger/14f2195378ba6940Tdjz45rxyx310dc3wq3dpm26o0/0 to fi= nish [junit4] 2> java.lang.InterruptedException: sleep interrupted [junit4] 2> =09at java.lang.Thread.sleep(Native Method) [junit4] 2> =09at java.lang.Thread.sleep(Thread.java:340) [junit4] 2> =09at java.util.concurrent.TimeUnit.sleep(TimeUnit.java:38= 6) [junit4] 2> =09at org.apache.solr.cloud.autoscaling.ExecutePlanAction.= waitForTaskToFinish(ExecutePlanAction.java:155) [junit4] 2> =09at org.apache.solr.cloud.autoscaling.ScheduledTriggers.= waitForPendingTasks(ScheduledTriggers.java:289) [junit4] 2> =09at org.apache.solr.cloud.autoscaling.ScheduledTriggers.= lambda$null$2(ScheduledTriggers.java:221) [junit4] 2> =09at java.util.concurrent.Executors$RunnableAdapter.call(= Executors.java:511) [junit4] 2> =09at java.util.concurrent.FutureTask.run(FutureTask.java:= 266) [junit4] 2> =09at org.apache.solr.common.util.ExecutorUtil$MDCAwareThr= eadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) [junit4] 2> =09at java.util.concurrent.ThreadPoolExecutor.runWorker(Th= readPoolExecutor.java:1149) [junit4] 2> =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(T= hreadPoolExecutor.java:624) [junit4] 2> =09at java.lang.Thread.run(Thread.java:748) [junit4] 2> 2975371 INFO (jetty-closer-5304-thread-1) [ ] o.e.j.s.= h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6f9c919a{/solr,null,= UNAVAILABLE} [junit4] 2> 2975377 ERROR (SUITE-ExecutePlanActionTest-seed#[1960521F5= 633FD5]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not reg= istered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN ser= ver state changes [junit4] 2> 2975379 INFO (SUITE-ExecutePlanActionTest-seed#[1960521F5= 633FD5]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:50372 5= 0372 [junit4] 2> 2976569 INFO (Thread-3705) [ ] o.a.s.c.ZkTestServer co= nnecting to 127.0.0.1:50372 50372 [junit4] 2> 2976936 WARN (Thread-3705) [ ] o.a.s.c.ZkTestServer Wa= tch limit violations:=20 [junit4] 2> Maximum concurrent create/delete watches above limit: [junit4] 2>=20 [junit4] 2> =094=09/solr/aliases.json [junit4] 2> =094=09/solr/clusterprops.json [junit4] 2> =093=09/solr/configs/conf [junit4] 2> =092=09/solr/security.json [junit4] 2>=20 [junit4] 2> Maximum concurrent data watches above limit: [junit4] 2>=20 [junit4] 2> =0920=09/solr/collections/testExecute/state.json [junit4] 2> =0917=09/solr/collections/testIntegration/state.json [junit4] 2> =094=09/solr/clusterstate.json [junit4] 2> =092=09/solr/collections/testExecute/leader_elect/shard1/e= lection/98913265489870853-core_node4-n_0000000000 [junit4] 2> =092=09/solr/autoscaling.json [junit4] 2>=20 [junit4] 2> Maximum concurrent children watches above limit: [junit4] 2>=20 [junit4] 2> =094=09/solr/live_nodes [junit4] 2> =094=09/solr/collections [junit4] 2> =092=09/solr/overseer/queue [junit4] 2> =092=09/solr/autoscaling/events/.auto_add_replicas [junit4] 2> =092=09/solr/autoscaling/events/node_lost_trigger [junit4] 2> =092=09/solr/overseer/collection-queue-work [junit4] 2> =092=09/solr/overseer/queue-work [junit4] 2>=20 [junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/w= orkspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.clou= d.autoscaling.ExecutePlanActionTest_1960521F5633FD5-001 [junit4] 2> NOTE: test params are: codec=3DAsserting(Lucene70): {}, do= cValues:{}, maxPointsInLeafNode=3D624, maxMBSortInHeap=3D5.263285679130152,= sim=3DRandomSimilarity(queryNorm=3Dfalse): {}, locale=3Dko-KR, timezone=3D= Asia/Dushanbe [junit4] 2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_144= (64-bit)/cpus=3D3,threads=3D1,free=3D165975904,total=3D462946304 [junit4] 2> NOTE: All tests run in this JVM: [TestSolrConfigHandlerClo= ud, SpellCheckCollatorTest, TestOmitPositions, TestLFUCache, TestSolrCloudW= ithKerberosAlt, TestComplexPhraseQParserPlugin, TestLegacyFieldReuse, Confi= gSetsAPITest, AutoScalingHandlerTest, DefaultValueUpdateProcessorTest, Test= Join, TestManagedResource, MultiThreadedOCPTest, OverseerRolesTest, WordBre= akSolrSpellCheckerTest, SpatialHeatmapFacetsTest, ConvertedLegacyTest, AddS= chemaFieldsUpdateProcessorFactoryTest, TestRawResponseWriter, ShowFileReque= stHandlerTest, SuggesterFSTTest, TestCloudRecovery, TimeZoneUtilsTest, Clus= terStateTest, ReplicaListTransformerTest, MergeStrategyTest, TestRequestFor= warding, ExitableDirectoryReaderTest, UninvertDocValuesMergePolicyTest, Tes= tDynamicLoading, DistributedQueryComponentOptimizationTest, NumericFieldsTe= st, TestSchemaVersionResource, TestUninvertingReader, DistributedFacetPivot= LargeTest, TestScoreJoinQPNoScore, LeaderInitiatedRecoveryOnShardRestartTes= t, JvmMetricsTest, NodeLostTriggerTest, HighlighterTest, AddReplicaTest, Te= stLockTree, TestSolr4Spatial2, CdcrVersionReplicationTest, SparseHLLTest, T= estUniqueKeyFieldResource, TestRetrieveFieldsOptimizer, TestAuthenticationF= ramework, SuggesterWFSTTest, CleanupOldIndexTest, TestTestInjection, BasicD= istributedZkTest, TestCollationFieldDocValues, TestFieldCacheWithThreads, C= loneFieldUpdateProcessorFactoryTest, RecoveryZkTest, ZkStateWriterTest, Tes= tPseudoReturnFields, TestRestManager, TestLegacyTerms, HdfsChaosMonkeySafeL= eaderTest, TestNumericRangeQuery32, TestSimpleQParserPlugin, V2StandaloneTe= st, TestRealTimeGet, TestCloudNestedDocsSort, TestReversedWildcardFilterFac= tory, SolrCoreMetricManagerTest, TestStressRecovery, TestShardHandlerFactor= y, ChaosMonkeyNothingIsSafeTest, TestLMDirichletSimilarityFactory, QueryPar= singTest, TestReqParamsAPI, TestCollectionAPIs, OutputWriterTest, DistribJo= inFromCollectionTest, TestSQLHandler, SolrShardReporterTest, SignatureUpdat= eProcessorFactoryTest, TestCSVResponseWriter, TestNumericTokenStream, DateR= angeFieldTest, TriggerIntegrationTest, DistributedSpellCheckComponentTest, = HdfsBasicDistributedZkTest, TestXIncludeConfig, NotRequiredUniqueKeyTest, T= estInPlaceUpdatesDistrib, DisMaxRequestHandlerTest, ResponseLogComponentTes= t, SpellCheckComponentTest, AtomicUpdatesTest, TestRuleBasedAuthorizationPl= ugin, SliceStateTest, ShardRoutingTest, IgnoreCommitOptimizeUpdateProcessor= FactoryTest, TestSweetSpotSimilarityFactory, SolrCloudExampleTest, ClusterS= tateUpdateTest, TestMacros, TestFieldCacheSortRandom, TestFieldCacheReopen,= TolerantUpdateProcessorTest, TestRTimerTree, TestSolrCloudWithHadoopAuthPl= ugin, TestRebalanceLeaders, TestReplicationHandler, TestFileDictionaryLooku= p, TestOverriddenPrefixQueryForCustomFieldType, TestRandomFlRTGCloud, SolrG= angliaReporterTest, HttpSolrCallGetCoreTest, UniqFieldsUpdateProcessorFacto= ryTest, TestCoreDiscovery, ConjunctionSolrSpellCheckerTest, BlockDirectoryT= est, TestMultiWordSynonyms, SolrTestCaseJ4Test, TestSSLRandomization, BadCo= pyFieldTest, AutoAddReplicasIntegrationTest, TestSolrCloudSnapshots, TestUt= ils, DataDrivenBlockJoinTest, TestUnifiedSolrHighlighter, TestConfigOverlay= , RecoveryAfterSoftCommitTest, NoCacheHeaderTest, DeleteShardTest, Distribu= tedFacetPivotWhiteBoxTest, TestEmbeddedSolrServerAdminHandler, DistributedV= ersionInfoTest, SpatialFilterTest, TestMaxTokenLenTokenizer, HdfsNNFailover= Test, VMParamsZkACLAndCredentialsProvidersTest, BlockJoinFacetDistribTest, = TestPerFieldSimilarityWithDefaultOverride, BlockJoinFacetSimpleTest, TestLR= UStatsCache, SolrMetricReporterTest, ForceLeaderTest, PreAnalyzedUpdateProc= essorTest, TestClusterStateMutator, HdfsRecoveryZkTest, CollectionReloadTes= t, StatsComponentTest, TestMinMaxOnMultiValuedField, TestSolr4Spatial, Test= StressCloudBlindAtomicUpdates, TestInitQParser, TestFiltering, SortByFuncti= onTest, TestFieldTypeResource, SolrIndexMetricsTest, AssignBackwardCompatib= ilityTest, TestEmbeddedSolrServerSchemaAPI, MissingSegmentRecoveryTest, ZkC= LITest, TestUseDocValuesAsStored, CoreAdminCreateDiscoverTest, TestRandomDV= Faceting, TestUpdate, AnalyticsMergeStrategyTest, TestSolrCoreProperties, R= esourceLoaderTest, ChaosMonkeySafeLeaderWithPullReplicasTest, CachingDirect= oryFactoryTest, TestDefaultStatsCache, ExecutePlanActionTest] [junit4] Completed [523/745 (3!)] on J0 in 631.82s, 2 tests, 1 failure <= << FAILURES! [...truncated 48014 lines...] ------=_Part_10_787477228.1509299672612 Content-Type: text/plain; charset=us-ascii --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org ------=_Part_10_787477228.1509299672612--