From dev-return-322756-archive-asf-public=cust-asf.ponee.io@lucene.apache.org Sat May 19 13:58:07 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 4464118076D for ; Sat, 19 May 2018 13:58:05 +0200 (CEST) Received: (qmail 14621 invoked by uid 500); 19 May 2018 11:57:59 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 14607 invoked by uid 99); 19 May 2018 11:57:58 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 19 May 2018 11:57:58 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id DE5861A2283 for ; Sat, 19 May 2018 11:57:57 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.05 X-Spam-Level: X-Spam-Status: No, score=-0.05 tagged_above=-999 required=6.31 tests=[KAM_BADIPHTTP=2, KAM_LOTSOFHASH=0.25, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, WEIRD_PORT=0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id S4os0Z2EZJZB for ; Sat, 19 May 2018 11:57:40 +0000 (UTC) Received: from serv1.sd-datasolutions.de (serv1.sd-datasolutions.de [88.99.242.108]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 47F885F3FF for ; Sat, 19 May 2018 11:57:40 +0000 (UTC) Received: from serv1 (ip6-localhost [IPv6:::1]) by serv1.sd-datasolutions.de (Postfix) with ESMTP id D095210803CB for ; Sat, 19 May 2018 11:57:33 +0000 (UTC) Date: Sat, 19 May 2018 11:55:55 +0000 (UTC) From: Policeman Jenkins Server To: dev@lucene.apache.org Message-ID: <2015947601.393.1526731053855.JavaMail.jenkins@serv1.sd-datasolutions.de> Subject: [JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk-9.0.4) - Build # 1933 - Unstable! MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_392_1926353188.1526731053830" X-Jenkins-Job: Lucene-Solr-7.x-Linux X-Jenkins-Result: UNSTABLE ------=_Part_392_1926353188.1526731053830 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1933/ Java: 64bit/jdk-9.0.4 -XX:+UseCompressedOops -XX:+UseParallelGC 1 tests failed. FAILED: org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCa= nnotBecomeLeader Error Message: Doc with id=3D4 not found in https://127.0.0.1:35735/solr/outOfSyncReplicas= CannotBecomeLeader-false due to: Path not found: /id; rsp=3D{doc=3Dnull} Stack Trace: java.lang.AssertionError: Doc with id=3D4 not found in https://127.0.0.1:35= 735/solr/outOfSyncReplicasCannotBecomeLeader-false due to: Path not found: = /id; rsp=3D{doc=3Dnull} =09at __randomizedtesting.SeedInfo.seed([4E2446F009ACE37B:30CF66E0CACBEC41]= :0) =09at org.junit.Assert.fail(Assert.java:93) =09at org.junit.Assert.assertTrue(Assert.java:43) =09at org.apache.solr.cloud.TestCloudConsistency.assertDocExists(TestCloudC= onsistency.java:252) =09at org.apache.solr.cloud.TestCloudConsistency.assertDocsExistInAllReplic= as(TestCloudConsistency.java:236) =09at org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCanno= tBecomeLeader(TestCloudConsistency.java:129) =09at org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCanno= tBecomeLeader(TestCloudConsistency.java:92) =09at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nativ= e Method) =09at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native= MethodAccessorImpl.java:62) =09at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De= legatingMethodAccessorImpl.java:43) =09at java.base/java.lang.reflect.Method.invoke(Method.java:564) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1737) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Random= izedRunner.java:934) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(Random= izedRunner.java:970) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(Rando= mizedRunner.java:984) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:49) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:368) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:817) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:468) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:943) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:829) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Random= izedRunner.java:879) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:890) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:41) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:53) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:54) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:368) =09at java.base/java.lang.Thread.run(Thread.java:844) Build Log: [...truncated 13164 lines...] [junit4] Suite: org.apache.solr.cloud.TestCloudConsistency [junit4] 2> 566711 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test= .solr.allowed.securerandom=3Dnull & java.security.egd=3Dfile:/dev/./urandom [junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-= Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_4E2= 446F009ACE37B-001/init-core-data-001 [junit4] 2> 566711 WARN (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens= =3D46 numCloses=3D46 [junit4] 2> 566711 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINT= S_SYSPROP=3Dtrue) w/NUMERIC_DOCVALUES_SYSPROP=3Dtrue [junit4] 2> 566712 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and client= Auth (false) via: @org.apache.solr.util.RandomizeSSL(reason=3D"", ssl=3D0.0= /0.0, value=3D0.0/0.0, clientAuth=3D0.0/0.0) [junit4] 2> 566712 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 se= rvers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core= /test/J2/temp/solr.cloud.TestCloudConsistency_4E2446F009ACE37B-001/tempDir-= 001 [junit4] 2> 566712 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 566712 INFO (Thread-2414) [ ] o.a.s.c.ZkTestServer cli= ent port:0.0.0.0/0.0.0.0:0 [junit4] 2> 566712 INFO (Thread-2414) [ ] o.a.s.c.ZkTestServer Sta= rting server [junit4] 2> 566714 ERROR (Thread-2414) [ ] o.a.z.s.ZooKeeperServer = ZKShutdownHandler is not registered, so ZooKeeper server won't take any act= ion on ERROR or SHUTDOWN server state changes [junit4] 2> 566812 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:39223 [junit4] 2> 566814 INFO (zkConnectionManagerCallback-4250-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 566820 INFO (jetty-launcher-4247-thread-4) [ ] o.e.j.s= .Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59= 876e6f384329b122929e70a80934569428c; jvm 9.0.4+11 [junit4] 2> 566820 INFO (jetty-launcher-4247-thread-2) [ ] o.e.j.s= .Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59= 876e6f384329b122929e70a80934569428c; jvm 9.0.4+11 [junit4] 2> 566820 INFO (jetty-launcher-4247-thread-3) [ ] o.e.j.s= .Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59= 876e6f384329b122929e70a80934569428c; jvm 9.0.4+11 [junit4] 2> 566820 INFO (jetty-launcher-4247-thread-1) [ ] o.e.j.s= .Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59= 876e6f384329b122929e70a80934569428c; jvm 9.0.4+11 [junit4] 2> 566821 INFO (jetty-launcher-4247-thread-1) [ ] o.e.j.s= .session DefaultSessionIdManager workerName=3Dnode0 [junit4] 2> 566821 INFO (jetty-launcher-4247-thread-1) [ ] o.e.j.s= .session No SessionScavenger set, using defaults [junit4] 2> 566821 INFO (jetty-launcher-4247-thread-1) [ ] o.e.j.s= .session node0 Scavenging every 600000ms [junit4] 2> 566821 INFO (jetty-launcher-4247-thread-4) [ ] o.e.j.s= .session DefaultSessionIdManager workerName=3Dnode0 [junit4] 2> 566821 INFO (jetty-launcher-4247-thread-4) [ ] o.e.j.s= .session No SessionScavenger set, using defaults [junit4] 2> 566821 INFO (jetty-launcher-4247-thread-4) [ ] o.e.j.s= .session node0 Scavenging every 600000ms [junit4] 2> 566821 INFO (jetty-launcher-4247-thread-2) [ ] o.e.j.s= .session DefaultSessionIdManager workerName=3Dnode0 [junit4] 2> 566821 INFO (jetty-launcher-4247-thread-2) [ ] o.e.j.s= .session No SessionScavenger set, using defaults [junit4] 2> 566821 INFO (jetty-launcher-4247-thread-2) [ ] o.e.j.s= .session node0 Scavenging every 600000ms [junit4] 2> 566821 INFO (jetty-launcher-4247-thread-3) [ ] o.e.j.s= .session DefaultSessionIdManager workerName=3Dnode0 [junit4] 2> 566821 INFO (jetty-launcher-4247-thread-3) [ ] o.e.j.s= .session No SessionScavenger set, using defaults [junit4] 2> 566821 INFO (jetty-launcher-4247-thread-1) [ ] o.e.j.s= .h.ContextHandler Started o.e.j.s.ServletContextHandler@27f39767{/solr,null= ,AVAILABLE} [junit4] 2> 566821 INFO (jetty-launcher-4247-thread-3) [ ] o.e.j.s= .session node0 Scavenging every 600000ms [junit4] 2> 566821 INFO (jetty-launcher-4247-thread-4) [ ] o.e.j.s= .h.ContextHandler Started o.e.j.s.ServletContextHandler@aca718e{/solr,null,= AVAILABLE} [junit4] 2> 566821 INFO (jetty-launcher-4247-thread-2) [ ] o.e.j.s= .h.ContextHandler Started o.e.j.s.ServletContextHandler@5275319e{/solr,null= ,AVAILABLE} [junit4] 2> 566822 INFO (jetty-launcher-4247-thread-3) [ ] o.e.j.s= .h.ContextHandler Started o.e.j.s.ServletContextHandler@5c382fd4{/solr,null= ,AVAILABLE} [junit4] 2> 566823 INFO (jetty-launcher-4247-thread-4) [ ] o.e.j.s= .AbstractConnector Started ServerConnector@58c2ac0e{SSL,[ssl, http/1.1]}{12= 7.0.0.1:39689} [junit4] 2> 566823 INFO (jetty-launcher-4247-thread-1) [ ] o.e.j.s= .AbstractConnector Started ServerConnector@67faba3c{SSL,[ssl, http/1.1]}{12= 7.0.0.1:38719} [junit4] 2> 566823 INFO (jetty-launcher-4247-thread-4) [ ] o.e.j.s= .Server Started @566863ms [junit4] 2> 566823 INFO (jetty-launcher-4247-thread-3) [ ] o.e.j.s= .AbstractConnector Started ServerConnector@7e38f41b{SSL,[ssl, http/1.1]}{12= 7.0.0.1:35165} [junit4] 2> 566823 INFO (jetty-launcher-4247-thread-1) [ ] o.e.j.s= .Server Started @566863ms [junit4] 2> 566823 INFO (jetty-launcher-4247-thread-2) [ ] o.e.j.s= .AbstractConnector Started ServerConnector@68207402{SSL,[ssl, http/1.1]}{12= 7.0.0.1:36799} [junit4] 2> 566823 INFO (jetty-launcher-4247-thread-3) [ ] o.e.j.s= .Server Started @566863ms [junit4] 2> 566823 INFO (jetty-launcher-4247-thread-2) [ ] o.e.j.s= .Server Started @566863ms [junit4] 2> 566823 INFO (jetty-launcher-4247-thread-4) [ ] o.a.s.c= .s.e.JettySolrRunner Jetty properties: {hostContext=3D/solr, hostPort=3D396= 89} [junit4] 2> 566823 INFO (jetty-launcher-4247-thread-1) [ ] o.a.s.c= .s.e.JettySolrRunner Jetty properties: {hostContext=3D/solr, hostPort=3D387= 19} [junit4] 2> 566823 INFO (jetty-launcher-4247-thread-2) [ ] o.a.s.c= .s.e.JettySolrRunner Jetty properties: {hostContext=3D/solr, hostPort=3D367= 99} [junit4] 2> 566823 INFO (jetty-launcher-4247-thread-3) [ ] o.a.s.c= .s.e.JettySolrRunner Jetty properties: {hostContext=3D/solr, hostPort=3D351= 65} [junit4] 2> 566824 ERROR (jetty-launcher-4247-thread-4) [ ] o.a.s.u= .StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missi= ng or incomplete. [junit4] 2> 566824 ERROR (jetty-launcher-4247-thread-2) [ ] o.a.s.u= .StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missi= ng or incomplete. [junit4] 2> 566824 ERROR (jetty-launcher-4247-thread-1) [ ] o.a.s.u= .StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missi= ng or incomplete. [junit4] 2> 566824 INFO (jetty-launcher-4247-thread-2) [ ] o.a.s.s= .SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLogg= erFactory [junit4] 2> 566824 ERROR (jetty-launcher-4247-thread-3) [ ] o.a.s.u= .StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missi= ng or incomplete. [junit4] 2> 566824 INFO (jetty-launcher-4247-thread-4) [ ] o.a.s.s= .SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLogg= erFactory [junit4] 2> 566824 INFO (jetty-launcher-4247-thread-3) [ ] o.a.s.s= .SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLogg= erFactory [junit4] 2> 566824 INFO (jetty-launcher-4247-thread-2) [ ] o.a.s.s= .SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.4.0 [junit4] 2> 566824 INFO (jetty-launcher-4247-thread-1) [ ] o.a.s.s= .SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLogg= erFactory [junit4] 2> 566824 INFO (jetty-launcher-4247-thread-4) [ ] o.a.s.s= .SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.4.0 [junit4] 2> 566824 INFO (jetty-launcher-4247-thread-2) [ ] o.a.s.s= .SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 566824 INFO (jetty-launcher-4247-thread-3) [ ] o.a.s.s= .SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.4.0 [junit4] 2> 566824 INFO (jetty-launcher-4247-thread-1) [ ] o.a.s.s= .SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.4.0 [junit4] 2> 566824 INFO (jetty-launcher-4247-thread-2) [ ] o.a.s.s= .SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 566824 INFO (jetty-launcher-4247-thread-4) [ ] o.a.s.s= .SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 566824 INFO (jetty-launcher-4247-thread-1) [ ] o.a.s.s= .SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 566824 INFO (jetty-launcher-4247-thread-2) [ ] o.a.s.s= .SolrDispatchFilter |___/\___/_|_| Start time: 2018-05-19T11:16:56.74629= 5Z [junit4] 2> 566824 INFO (jetty-launcher-4247-thread-4) [ ] o.a.s.s= .SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 566824 INFO (jetty-launcher-4247-thread-3) [ ] o.a.s.s= .SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 566824 INFO (jetty-launcher-4247-thread-4) [ ] o.a.s.s= .SolrDispatchFilter |___/\___/_|_| Start time: 2018-05-19T11:16:56.74633= 6Z [junit4] 2> 566824 INFO (jetty-launcher-4247-thread-3) [ ] o.a.s.s= .SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 566824 INFO (jetty-launcher-4247-thread-1) [ ] o.a.s.s= .SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 566824 INFO (jetty-launcher-4247-thread-3) [ ] o.a.s.s= .SolrDispatchFilter |___/\___/_|_| Start time: 2018-05-19T11:16:56.74637= 0Z [junit4] 2> 566824 INFO (jetty-launcher-4247-thread-1) [ ] o.a.s.s= .SolrDispatchFilter |___/\___/_|_| Start time: 2018-05-19T11:16:56.74638= 1Z [junit4] 2> 566825 INFO (zkConnectionManagerCallback-4255-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 566825 INFO (zkConnectionManagerCallback-4254-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 566825 INFO (zkConnectionManagerCallback-4256-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 566825 INFO (zkConnectionManagerCallback-4258-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 566825 INFO (jetty-launcher-4247-thread-3) [ ] o.a.s.s= .SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 566825 INFO (jetty-launcher-4247-thread-4) [ ] o.a.s.s= .SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 566825 INFO (jetty-launcher-4247-thread-2) [ ] o.a.s.s= .SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 566825 INFO (jetty-launcher-4247-thread-1) [ ] o.a.s.s= .SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 566834 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ = ] o.a.z.s.NIOServerCnxn Unable to read additional data from client session= id 0x10076e353a70001, likely client has closed socket [junit4] 2> 566834 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ = ] o.a.z.s.NIOServerCnxn Unable to read additional data from client session= id 0x10076e353a70004, likely client has closed socket [junit4] 2> 566835 INFO (jetty-launcher-4247-thread-4) [ ] o.a.s.c= .ZkContainer Zookeeper client=3D127.0.0.1:39223/solr [junit4] 2> 566835 INFO (jetty-launcher-4247-thread-1) [ ] o.a.s.c= .ZkContainer Zookeeper client=3D127.0.0.1:39223/solr [junit4] 2> 566835 INFO (jetty-launcher-4247-thread-3) [ ] o.a.s.c= .ZkContainer Zookeeper client=3D127.0.0.1:39223/solr [junit4] 2> 566836 INFO (jetty-launcher-4247-thread-2) [ ] o.a.s.c= .ZkContainer Zookeeper client=3D127.0.0.1:39223/solr [junit4] 2> 566836 INFO (zkConnectionManagerCallback-4268-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 566836 INFO (zkConnectionManagerCallback-4270-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 566836 INFO (zkConnectionManagerCallback-4272-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 566836 INFO (zkConnectionManagerCallback-4274-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 566837 INFO (zkConnectionManagerCallback-4276-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 566837 INFO (zkConnectionManagerCallback-4278-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 566837 INFO (zkConnectionManagerCallback-4280-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 566837 INFO (zkConnectionManagerCallback-4282-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 566876 INFO (jetty-launcher-4247-thread-3) [n:127.0.0.1:3= 5165_solr ] o.a.s.c.Overseer Overseer (id=3Dnull) closing [junit4] 2> 566876 INFO (jetty-launcher-4247-thread-1) [n:127.0.0.1:3= 8719_solr ] o.a.s.c.Overseer Overseer (id=3Dnull) closing [junit4] 2> 566876 INFO (jetty-launcher-4247-thread-2) [n:127.0.0.1:3= 6799_solr ] o.a.s.c.Overseer Overseer (id=3Dnull) closing [junit4] 2> 566876 INFO (jetty-launcher-4247-thread-3) [n:127.0.0.1:3= 5165_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader = 127.0.0.1:35165_solr [junit4] 2> 566876 INFO (jetty-launcher-4247-thread-4) [n:127.0.0.1:3= 9689_solr ] o.a.s.c.Overseer Overseer (id=3Dnull) closing [junit4] 2> 566877 INFO (jetty-launcher-4247-thread-1) [n:127.0.0.1:3= 8719_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/liv= e_nodes/127.0.0.1:38719_solr [junit4] 2> 566877 INFO (jetty-launcher-4247-thread-2) [n:127.0.0.1:3= 6799_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/liv= e_nodes/127.0.0.1:36799_solr [junit4] 2> 566877 INFO (jetty-launcher-4247-thread-3) [n:127.0.0.1:3= 5165_solr ] o.a.s.c.Overseer Overseer (id=3D72188312771035146-127.0.0.1:= 35165_solr-n_0000000000) starting [junit4] 2> 566878 INFO (zkCallback-4279-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 566878 INFO (zkCallback-4281-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 566879 INFO (zkCallback-4277-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 566879 INFO (zkCallback-4275-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 566879 INFO (jetty-launcher-4247-thread-4) [n:127.0.0.1:3= 9689_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient c= ache for 2147483647 transient cores [junit4] 2> 566879 INFO (jetty-launcher-4247-thread-4) [n:127.0.0.1:3= 9689_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/liv= e_nodes/127.0.0.1:39689_solr [junit4] 2> 566879 INFO (zkCallback-4277-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 566879 INFO (zkCallback-4281-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 566879 INFO (zkCallback-4279-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 566886 INFO (zkCallback-4275-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 566903 INFO (zkConnectionManagerCallback-4295-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 566904 INFO (jetty-launcher-4247-thread-3) [n:127.0.0.1:3= 5165_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper...= (0) -> (3) [junit4] 2> 566905 INFO (jetty-launcher-4247-thread-3) [n:127.0.0.1:3= 5165_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.= 1:39223/solr ready [junit4] 2> 566926 INFO (jetty-launcher-4247-thread-3) [n:127.0.0.1:3= 5165_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient c= ache for 2147483647 transient cores [junit4] 2> 566926 INFO (jetty-launcher-4247-thread-3) [n:127.0.0.1:3= 5165_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/liv= e_nodes/127.0.0.1:35165_solr [junit4] 2> 566927 INFO (zkCallback-4275-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 566927 INFO (zkCallback-4281-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 566927 INFO (zkCallback-4277-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 566927 INFO (zkCallback-4279-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 566933 INFO (zkCallback-4294-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 566991 INFO (jetty-launcher-4247-thread-1) [n:127.0.0.1:3= 8719_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38719.sol= r.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.J= mxMBeanServer@460b86c3 [junit4] 2> 566992 INFO (jetty-launcher-4247-thread-2) [n:127.0.0.1:3= 6799_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36799.sol= r.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.J= mxMBeanServer@460b86c3 [junit4] 2> 566998 INFO (jetty-launcher-4247-thread-2) [n:127.0.0.1:3= 6799_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36799.sol= r.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.Jmx= MBeanServer@460b86c3 [junit4] 2> 566998 INFO (jetty-launcher-4247-thread-2) [n:127.0.0.1:3= 6799_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36799.sol= r.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver= .JmxMBeanServer@460b86c3 [junit4] 2> 566999 INFO (jetty-launcher-4247-thread-1) [n:127.0.0.1:3= 8719_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38719.sol= r.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.Jmx= MBeanServer@460b86c3 [junit4] 2> 566999 INFO (jetty-launcher-4247-thread-1) [n:127.0.0.1:3= 8719_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38719.sol= r.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver= .JmxMBeanServer@460b86c3 [junit4] 2> 566999 INFO (jetty-launcher-4247-thread-2) [n:127.0.0.1:3= 6799_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions under= neath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/te= st/J2/temp/solr.cloud.TestCloudConsistency_4E2446F009ACE37B-001/tempDir-001= /node2/. [junit4] 2> 567000 INFO (jetty-launcher-4247-thread-1) [n:127.0.0.1:3= 8719_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions under= neath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/te= st/J2/temp/solr.cloud.TestCloudConsistency_4E2446F009ACE37B-001/tempDir-001= /node1/. [junit4] 2> 567008 INFO (zkConnectionManagerCallback-4305-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 567008 INFO (zkConnectionManagerCallback-4303-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 567008 INFO (jetty-launcher-4247-thread-1) [n:127.0.0.1:3= 8719_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper...= (0) -> (4) [junit4] 2> 567009 INFO (jetty-launcher-4247-thread-2) [n:127.0.0.1:3= 6799_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper...= (0) -> (4) [junit4] 2> 567009 INFO (jetty-launcher-4247-thread-1) [n:127.0.0.1:3= 8719_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.= 1:39223/solr ready [junit4] 2> 567009 INFO (jetty-launcher-4247-thread-2) [n:127.0.0.1:3= 6799_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.= 1:39223/solr ready [junit4] 2> 567025 INFO (jetty-launcher-4247-thread-3) [n:127.0.0.1:3= 5165_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35165.sol= r.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.J= mxMBeanServer@460b86c3 [junit4] 2> 567032 INFO (jetty-launcher-4247-thread-3) [n:127.0.0.1:3= 5165_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35165.sol= r.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.Jmx= MBeanServer@460b86c3 [junit4] 2> 567033 INFO (jetty-launcher-4247-thread-3) [n:127.0.0.1:3= 5165_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35165.sol= r.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver= .JmxMBeanServer@460b86c3 [junit4] 2> 567034 INFO (jetty-launcher-4247-thread-3) [n:127.0.0.1:3= 5165_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions under= neath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/te= st/J2/temp/solr.cloud.TestCloudConsistency_4E2446F009ACE37B-001/tempDir-001= /node3/. [junit4] 2> 567063 INFO (jetty-launcher-4247-thread-4) [n:127.0.0.1:3= 9689_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39689.sol= r.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.J= mxMBeanServer@460b86c3 [junit4] 2> 567068 INFO (jetty-launcher-4247-thread-4) [n:127.0.0.1:3= 9689_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39689.sol= r.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.Jmx= MBeanServer@460b86c3 [junit4] 2> 567068 INFO (jetty-launcher-4247-thread-4) [n:127.0.0.1:3= 9689_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39689.sol= r.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver= .JmxMBeanServer@460b86c3 [junit4] 2> 567068 INFO (jetty-launcher-4247-thread-4) [n:127.0.0.1:3= 9689_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions under= neath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/te= st/J2/temp/solr.cloud.TestCloudConsistency_4E2446F009ACE37B-001/tempDir-001= /node4/. [junit4] 2> 567070 INFO (zkConnectionManagerCallback-4310-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 567071 INFO (jetty-launcher-4247-thread-4) [n:127.0.0.1:3= 9689_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper...= (0) -> (4) [junit4] 2> 567072 INFO (jetty-launcher-4247-thread-4) [n:127.0.0.1:3= 9689_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.= 1:39223/solr ready [junit4] 2> 567092 INFO (zkConnectionManagerCallback-4312-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 567094 INFO (zkConnectionManagerCallback-4317-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 567095 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKe= eper... (0) -> (4) [junit4] 2> 567095 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 1= 27.0.0.1:39223/solr ready [junit4] 2> 567097 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@682= 07402{SSL,[ssl, http/1.1]}{127.0.0.1:0} [junit4] 2> 567097 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer ins= tance=3D1684477040 [junit4] 2> 567097 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters fo= r registry=3Dsolr.node, tag=3Dnull [junit4] 2> 567098 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apach= e.solr.metrics.reporters.SolrJmxReporter@4ffd00d5: rootName =3D solr_36799,= domain =3D solr.node, service url =3D null, agent id =3D null] for registr= y solr.node / com.codahale.metrics.MetricRegistry@4ccaab7b [junit4] 2> 567101 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters fo= r registry=3Dsolr.jvm, tag=3Dnull [junit4] 2> 567101 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apach= e.solr.metrics.reporters.SolrJmxReporter@572d828f: rootName =3D solr_36799,= domain =3D solr.jvm, service url =3D null, agent id =3D null] for registry= solr.jvm / com.codahale.metrics.MetricRegistry@5835eb71 [junit4] 2> 567104 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters fo= r registry=3Dsolr.jetty, tag=3Dnull [junit4] 2> 567104 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apach= e.solr.metrics.reporters.SolrJmxReporter@264dbce3: rootName =3D solr_36799,= domain =3D solr.jetty, service url =3D null, agent id =3D null] for regist= ry solr.jetty / com.codahale.metrics.MetricRegistry@78ff37 [junit4] 2> 567105 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper= :/live_nodes/127.0.0.1:36799_solr [junit4] 2> 567105 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters fo= r registry=3Dsolr.cluster, tag=3Dnull [junit4] 2> 567105 INFO (zkCallback-4294-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567105 INFO (zkCallback-4275-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567105 INFO (zkCallback-4279-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567105 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating tran= sient cache for 2147483647 transient cores [junit4] 2> 567105 INFO (zkCallback-4277-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567105 INFO (zkCallback-4281-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567110 INFO (zkCallback-4302-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567110 INFO (zkCallback-4304-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567111 INFO (zkCallback-4316-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567111 INFO (zkCallback-4309-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567112 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletConte= xtHandler@5275319e{/solr,null,UNAVAILABLE} [junit4] 2> 567112 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.session node0 Stopped scavenging [junit4] 2> 567113 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05= -03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 9.0.4= +11 [junit4] 2> 567118 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.session DefaultSessionIdManager workerName=3D= node0 [junit4] 2> 567118 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.session No SessionScavenger set, using defaul= ts [junit4] 2> 567118 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.session node0 Scavenging every 660000ms [junit4] 2> 567118 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletConte= xtHandler@23ace5c4{/solr,null,AVAILABLE} [junit4] 2> 567119 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2e6= 63697{SSL,[ssl, http/1.1]}{127.0.0.1:40905} [junit4] 2> 567119 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.Server Started @567158ms [junit4] 2> 567119 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostCo= ntext=3D/solr, hostPort=3D44101} [junit4] 2> 567119 ERROR (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.= log.dir. Logging may be missing or incomplete. [junit4] 2> 567119 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.a= pache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 567119 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome = to Apache Solr? version 7.4.0 [junit4] 2> 567119 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting= in cloud mode on port null [junit4] 2> 567119 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install = dir: null [junit4] 2> 567119 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start ti= me: 2018-05-19T11:16:57.041535Z [junit4] 2> 567120 INFO (zkConnectionManagerCallback-4319-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 567120 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeepe= r. Loading... [junit4] 2> 567127 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.ZkContainer Zookeeper client=3D127.0.0.1:3922= 3/solr [junit4] 2> 567129 INFO (zkConnectionManagerCallback-4323-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 567134 INFO (zkConnectionManagerCallback-4325-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 567137 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:44101_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (0) -> (3) [junit4] 2> 567138 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:44101_solr ] o.a.s.c.Overseer Overseer (id= =3Dnull) closing [junit4] 2> 567139 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:44101_solr ] o.a.s.c.TransientSolrCoreCacheD= efault Allocating transient cache for 2147483647 transient cores [junit4] 2> 567139 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:44101_solr ] o.a.s.c.ZkController Register n= ode as live in ZooKeeper:/live_nodes/127.0.0.1:44101_solr [junit4] 2> 567139 INFO (zkCallback-4294-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567139 INFO (zkCallback-4309-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567139 INFO (zkCallback-4279-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567139 INFO (zkCallback-4275-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567139 INFO (zkCallback-4316-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567139 INFO (zkCallback-4304-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567139 INFO (zkCallback-4277-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567142 INFO (zkCallback-4324-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567205 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:44101_solr ] o.a.s.m.r.SolrJmxReporter JMX m= onitoring for 'solr_44101.solr.node' (registry 'solr.node') enabled at serv= er: com.sun.jmx.mbeanserver.JmxMBeanServer@460b86c3 [junit4] 2> 567210 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:44101_solr ] o.a.s.m.r.SolrJmxReporter JMX m= onitoring for 'solr_44101.solr.jvm' (registry 'solr.jvm') enabled at server= : com.sun.jmx.mbeanserver.JmxMBeanServer@460b86c3 [junit4] 2> 567210 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:44101_solr ] o.a.s.m.r.SolrJmxReporter JMX m= onitoring for 'solr_44101.solr.jetty' (registry 'solr.jetty') enabled at se= rver: com.sun.jmx.mbeanserver.JmxMBeanServer@460b86c3 [junit4] 2> 567211 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:44101_solr ] o.a.s.c.CorePropertiesLocator F= ound 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-= Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_4E2= 446F009ACE37B-001/tempDir-001/node2/. [junit4] 2> 567213 INFO (zkConnectionManagerCallback-4332-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 567213 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:44101_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (0) -> (4) [junit4] 2> 567214 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:44101_solr ] o.a.s.c.s.i.ZkClientClusterStat= eProvider Cluster at 127.0.0.1:39223/solr ready [junit4] 2> 567245 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.TestCloudConsistency Adding proxy for URL: ht= tps://127.0.0.1:40905/solr. Proxy: https://127.0.0.1:44101/solr [junit4] 2> 567246 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@67f= aba3c{SSL,[ssl, http/1.1]}{127.0.0.1:0} [junit4] 2> 567246 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer ins= tance=3D765583990 [junit4] 2> 567246 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters fo= r registry=3Dsolr.node, tag=3Dnull [junit4] 2> 567246 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apach= e.solr.metrics.reporters.SolrJmxReporter@6b3c4d7: rootName =3D solr_38719, = domain =3D solr.node, service url =3D null, agent id =3D null] for registry= solr.node / com.codahale.metrics.MetricRegistry@3b883c24 [junit4] 2> 567250 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters fo= r registry=3Dsolr.jvm, tag=3Dnull [junit4] 2> 567250 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apach= e.solr.metrics.reporters.SolrJmxReporter@59aec8af: rootName =3D solr_38719,= domain =3D solr.jvm, service url =3D null, agent id =3D null] for registry= solr.jvm / com.codahale.metrics.MetricRegistry@5835eb71 [junit4] 2> 567252 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters fo= r registry=3Dsolr.jetty, tag=3Dnull [junit4] 2> 567252 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apach= e.solr.metrics.reporters.SolrJmxReporter@473e6a55: rootName =3D solr_38719,= domain =3D solr.jetty, service url =3D null, agent id =3D null] for regist= ry solr.jetty / com.codahale.metrics.MetricRegistry@78ff37 [junit4] 2> 567254 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper= :/live_nodes/127.0.0.1:38719_solr [junit4] 2> 567254 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters fo= r registry=3Dsolr.cluster, tag=3Dnull [junit4] 2> 567254 INFO (zkCallback-4304-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567254 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating tran= sient cache for 2147483647 transient cores [junit4] 2> 567254 INFO (zkCallback-4309-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567254 INFO (zkCallback-4294-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567254 INFO (zkCallback-4277-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567254 INFO (zkCallback-4279-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567254 INFO (zkCallback-4316-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567254 INFO (zkCallback-4324-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567255 INFO (zkCallback-4275-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567255 INFO (zkCallback-4331-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567256 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletConte= xtHandler@27f39767{/solr,null,UNAVAILABLE} [junit4] 2> 567256 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.session node0 Stopped scavenging [junit4] 2> 567257 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05= -03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 9.0.4= +11 [junit4] 2> 567257 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.session DefaultSessionIdManager workerName=3D= node0 [junit4] 2> 567257 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.session No SessionScavenger set, using defaul= ts [junit4] 2> 567257 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.session node0 Scavenging every 600000ms [junit4] 2> 567257 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletConte= xtHandler@1a1ae89e{/solr,null,AVAILABLE} [junit4] 2> 567258 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.AbstractConnector Started ServerConnector@271= 6fe{SSL,[ssl, http/1.1]}{127.0.0.1:36153} [junit4] 2> 567258 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.Server Started @567297ms [junit4] 2> 567258 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostCo= ntext=3D/solr, hostPort=3D35735} [junit4] 2> 567258 ERROR (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.= log.dir. Logging may be missing or incomplete. [junit4] 2> 567258 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.a= pache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 567258 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome = to Apache Solr? version 7.4.0 [junit4] 2> 567258 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting= in cloud mode on port null [junit4] 2> 567258 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install = dir: null [junit4] 2> 567258 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start ti= me: 2018-05-19T11:16:57.180614Z [junit4] 2> 567262 INFO (zkConnectionManagerCallback-4334-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 567263 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeepe= r. Loading... [junit4] 2> 567271 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.ZkContainer Zookeeper client=3D127.0.0.1:3922= 3/solr [junit4] 2> 567272 INFO (zkConnectionManagerCallback-4338-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 567273 INFO (zkConnectionManagerCallback-4340-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 567276 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:35735_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (0) -> (3) [junit4] 2> 567277 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:35735_solr ] o.a.s.c.Overseer Overseer (id= =3Dnull) closing [junit4] 2> 567278 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:35735_solr ] o.a.s.c.TransientSolrCoreCacheD= efault Allocating transient cache for 2147483647 transient cores [junit4] 2> 567278 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:35735_solr ] o.a.s.c.ZkController Register n= ode as live in ZooKeeper:/live_nodes/127.0.0.1:35735_solr [junit4] 2> 567278 INFO (zkCallback-4331-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567278 INFO (zkCallback-4294-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567278 INFO (zkCallback-4309-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567278 INFO (zkCallback-4277-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567278 INFO (zkCallback-4316-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567278 INFO (zkCallback-4275-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567279 INFO (zkCallback-4339-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567279 INFO (zkCallback-4324-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567385 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:35735_solr ] o.a.s.m.r.SolrJmxReporter JMX m= onitoring for 'solr_35735.solr.node' (registry 'solr.node') enabled at serv= er: com.sun.jmx.mbeanserver.JmxMBeanServer@460b86c3 [junit4] 2> 567390 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:35735_solr ] o.a.s.m.r.SolrJmxReporter JMX m= onitoring for 'solr_35735.solr.jvm' (registry 'solr.jvm') enabled at server= : com.sun.jmx.mbeanserver.JmxMBeanServer@460b86c3 [junit4] 2> 567390 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:35735_solr ] o.a.s.m.r.SolrJmxReporter JMX m= onitoring for 'solr_35735.solr.jetty' (registry 'solr.jetty') enabled at se= rver: com.sun.jmx.mbeanserver.JmxMBeanServer@460b86c3 [junit4] 2> 567391 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:35735_solr ] o.a.s.c.CorePropertiesLocator F= ound 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-= Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_4E2= 446F009ACE37B-001/tempDir-001/node1/. [junit4] 2> 567393 INFO (zkConnectionManagerCallback-4347-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 567393 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:35735_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (0) -> (4) [junit4] 2> 567394 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:35735_solr ] o.a.s.c.s.i.ZkClientClusterStat= eProvider Cluster at 127.0.0.1:39223/solr ready [junit4] 2> 567417 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.TestCloudConsistency Adding proxy for URL: ht= tps://127.0.0.1:36153/solr. Proxy: https://127.0.0.1:35735/solr [junit4] 2> 567418 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@7e3= 8f41b{SSL,[ssl, http/1.1]}{127.0.0.1:0} [junit4] 2> 567418 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer ins= tance=3D2100913503 [junit4] 2> 567418 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters fo= r registry=3Dsolr.node, tag=3Dnull [junit4] 2> 567418 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apach= e.solr.metrics.reporters.SolrJmxReporter@1d507479: rootName =3D solr_35165,= domain =3D solr.node, service url =3D null, agent id =3D null] for registr= y solr.node / com.codahale.metrics.MetricRegistry@3ba0ac10 [junit4] 2> 567422 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters fo= r registry=3Dsolr.jvm, tag=3Dnull [junit4] 2> 567423 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apach= e.solr.metrics.reporters.SolrJmxReporter@364756e3: rootName =3D solr_35165,= domain =3D solr.jvm, service url =3D null, agent id =3D null] for registry= solr.jvm / com.codahale.metrics.MetricRegistry@5835eb71 [junit4] 2> 567425 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters fo= r registry=3Dsolr.jetty, tag=3Dnull [junit4] 2> 567425 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apach= e.solr.metrics.reporters.SolrJmxReporter@506203ac: rootName =3D solr_35165,= domain =3D solr.jetty, service url =3D null, agent id =3D null] for regist= ry solr.jetty / com.codahale.metrics.MetricRegistry@78ff37 [junit4] 2> 567427 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper= :/live_nodes/127.0.0.1:35165_solr [junit4] 2> 567427 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters fo= r registry=3Dsolr.cluster, tag=3Dnull [junit4] 2> 567427 INFO (zkCallback-4294-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567427 INFO (zkCallback-4331-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567427 INFO (zkCallback-4324-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567427 INFO (zkCallback-4339-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567427 INFO (zkCallback-4309-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567427 INFO (zkCallback-4275-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567427 INFO (zkCallback-4277-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567427 INFO (zkCallback-4316-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567428 INFO (zkCallback-4346-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567428 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.Overseer Overseer (id=3D72188312771035146-127= .0.0.1:35165_solr-n_0000000000) closing [junit4] 2> 567428 INFO (OverseerStateUpdate-72188312771035146-127.0.= 0.1:35165_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting = : 127.0.0.1:35165_solr [junit4] 2> 567428 WARN (OverseerAutoScalingTriggerThread-72188312771= 035146-127.0.0.1:35165_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerT= hread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 567430 INFO (zkCallback-4275-thread-1) [ ] o.a.s.c.Ove= rseerElectionContext I am going to be the leader 127.0.0.1:39689_solr [junit4] 2> 567430 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletConte= xtHandler@5c382fd4{/solr,null,UNAVAILABLE} [junit4] 2> 567431 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.session node0 Stopped scavenging [junit4] 2> 567431 INFO (zkCallback-4275-thread-1) [ ] o.a.s.c.Ove= rseer Overseer (id=3D72188312771035145-127.0.0.1:39689_solr-n_0000000003) s= tarting [junit4] 2> 567432 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05= -03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 9.0.4= +11 [junit4] 2> 567432 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.session DefaultSessionIdManager workerName=3D= node0 [junit4] 2> 567432 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.session No SessionScavenger set, using defaul= ts [junit4] 2> 567432 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.session node0 Scavenging every 660000ms [junit4] 2> 567432 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletConte= xtHandler@4ec84be7{/solr,null,AVAILABLE} [junit4] 2> 567433 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1af= 09421{SSL,[ssl, http/1.1]}{127.0.0.1:41555} [junit4] 2> 567433 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.Server Started @567472ms [junit4] 2> 567433 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostCo= ntext=3D/solr, hostPort=3D45415} [junit4] 2> 567433 ERROR (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.= log.dir. Logging may be missing or incomplete. [junit4] 2> 567433 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.a= pache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 567433 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome = to Apache Solr? version 7.4.0 [junit4] 2> 567433 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting= in cloud mode on port null [junit4] 2> 567433 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install = dir: null [junit4] 2> 567433 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start ti= me: 2018-05-19T11:16:57.355712Z [junit4] 2> 567434 INFO (zkConnectionManagerCallback-4349-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 567434 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeepe= r. Loading... [junit4] 2> 567438 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.ZkContainer Zookeeper client=3D127.0.0.1:3922= 3/solr [junit4] 2> 567439 INFO (zkConnectionManagerCallback-4353-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 567440 INFO (zkConnectionManagerCallback-4355-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 567442 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:45415_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (0) -> (3) [junit4] 2> 567443 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:45415_solr ] o.a.s.c.Overseer Overseer (id= =3Dnull) closing [junit4] 2> 567444 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:45415_solr ] o.a.s.c.TransientSolrCoreCacheD= efault Allocating transient cache for 2147483647 transient cores [junit4] 2> 567444 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:45415_solr ] o.a.s.c.ZkController Register n= ode as live in ZooKeeper:/live_nodes/127.0.0.1:45415_solr [junit4] 2> 567444 INFO (zkCallback-4316-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567444 INFO (zkCallback-4339-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567444 INFO (zkCallback-4309-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567444 INFO (zkCallback-4324-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567444 INFO (zkCallback-4346-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567444 INFO (zkCallback-4275-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567444 INFO (zkCallback-4331-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567445 INFO (zkCallback-4354-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567577 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:45415_solr ] o.a.s.m.r.SolrJmxReporter JMX m= onitoring for 'solr_45415.solr.node' (registry 'solr.node') enabled at serv= er: com.sun.jmx.mbeanserver.JmxMBeanServer@460b86c3 [junit4] 2> 567583 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:45415_solr ] o.a.s.m.r.SolrJmxReporter JMX m= onitoring for 'solr_45415.solr.jvm' (registry 'solr.jvm') enabled at server= : com.sun.jmx.mbeanserver.JmxMBeanServer@460b86c3 [junit4] 2> 567583 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:45415_solr ] o.a.s.m.r.SolrJmxReporter JMX m= onitoring for 'solr_45415.solr.jetty' (registry 'solr.jetty') enabled at se= rver: com.sun.jmx.mbeanserver.JmxMBeanServer@460b86c3 [junit4] 2> 567583 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:45415_solr ] o.a.s.c.CorePropertiesLocator F= ound 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-= Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_4E2= 446F009ACE37B-001/tempDir-001/node3/. [junit4] 2> 567585 INFO (zkConnectionManagerCallback-4362-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 567586 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:45415_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (0) -> (4) [junit4] 2> 567586 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:45415_solr ] o.a.s.c.s.i.ZkClientClusterStat= eProvider Cluster at 127.0.0.1:39223/solr ready [junit4] 2> 567610 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.TestCloudConsistency Adding proxy for URL: ht= tps://127.0.0.1:41555/solr. Proxy: https://127.0.0.1:45415/solr [junit4] 2> 567611 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@58c= 2ac0e{SSL,[ssl, http/1.1]}{127.0.0.1:0} [junit4] 2> 567611 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer ins= tance=3D2070816107 [junit4] 2> 567612 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters fo= r registry=3Dsolr.node, tag=3Dnull [junit4] 2> 567612 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apach= e.solr.metrics.reporters.SolrJmxReporter@7607d4ff: rootName =3D solr_39689,= domain =3D solr.node, service url =3D null, agent id =3D null] for registr= y solr.node / com.codahale.metrics.MetricRegistry@d6b63f9 [junit4] 2> 567615 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters fo= r registry=3Dsolr.jvm, tag=3Dnull [junit4] 2> 567615 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apach= e.solr.metrics.reporters.SolrJmxReporter@6c11d5cb: rootName =3D solr_39689,= domain =3D solr.jvm, service url =3D null, agent id =3D null] for registry= solr.jvm / com.codahale.metrics.MetricRegistry@5835eb71 [junit4] 2> 567618 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters fo= r registry=3Dsolr.jetty, tag=3Dnull [junit4] 2> 567618 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apach= e.solr.metrics.reporters.SolrJmxReporter@4c371c30: rootName =3D solr_39689,= domain =3D solr.jetty, service url =3D null, agent id =3D null] for regist= ry solr.jetty / com.codahale.metrics.MetricRegistry@78ff37 [junit4] 2> 567619 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper= :/live_nodes/127.0.0.1:39689_solr [junit4] 2> 567619 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters fo= r registry=3Dsolr.cluster, tag=3Dnull [junit4] 2> 567619 INFO (zkCallback-4316-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567619 INFO (zkCallback-4339-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567619 INFO (zkCallback-4309-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567619 INFO (zkCallback-4275-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567619 INFO (zkCallback-4346-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567619 INFO (zkCallback-4324-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567619 INFO (zkCallback-4331-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567620 INFO (zkCallback-4354-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567620 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.Overseer Overseer (id=3D72188312771035145-127= .0.0.1:39689_solr-n_0000000003) closing [junit4] 2> 567621 INFO (zkCallback-4361-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 567621 INFO (OverseerStateUpdate-72188312771035145-127.0.= 0.1:39689_solr-n_0000000003) [ ] o.a.s.c.Overseer Overseer Loop exiting = : 127.0.0.1:39689_solr [junit4] 2> 567621 WARN (OverseerAutoScalingTriggerThread-72188312771= 035145-127.0.0.1:39689_solr-n_0000000003) [ ] o.a.s.c.a.OverseerTriggerT= hread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 567624 INFO (zkCallback-4324-thread-1) [ ] o.a.s.c.Ove= rseerElectionContext I am going to be the leader 127.0.0.1:44101_solr [junit4] 2> 567624 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletConte= xtHandler@aca718e{/solr,null,UNAVAILABLE} [junit4] 2> 567624 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.session node0 Stopped scavenging [junit4] 2> 567625 INFO (zkCallback-4324-thread-1) [ ] o.a.s.c.Ove= rseer Overseer (id=3D72188312771035157-127.0.0.1:44101_solr-n_0000000004) s= tarting [junit4] 2> 567625 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05= -03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 9.0.4= +11 [junit4] 2> 567626 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.session DefaultSessionIdManager workerName=3D= node0 [junit4] 2> 567626 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.session No SessionScavenger set, using defaul= ts [junit4] 2> 567626 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.session node0 Scavenging every 660000ms [junit4] 2> 567626 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletConte= xtHandler@7e6f358{/solr,null,AVAILABLE} [junit4] 2> 567626 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.AbstractConnector Started ServerConnector@57f= 9ea69{SSL,[ssl, http/1.1]}{127.0.0.1:33935} [junit4] 2> 567626 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.e.j.s.Server Started @567666ms [junit4] 2> 567626 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostCo= ntext=3D/solr, hostPort=3D42835} [junit4] 2> 567627 ERROR (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.= log.dir. Logging may be missing or incomplete. [junit4] 2> 567627 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.a= pache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 567627 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome = to Apache Solr? version 7.4.0 [junit4] 2> 567627 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting= in cloud mode on port null [junit4] 2> 567627 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install = dir: null [junit4] 2> 567627 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start ti= me: 2018-05-19T11:16:57.549943Z [junit4] 2> 567628 INFO (zkConnectionManagerCallback-4364-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 567628 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeepe= r. Loading... [junit4] 2> 567632 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.ZkContainer Zookeeper client=3D127.0.0.1:3922= 3/solr [junit4] 2> 567633 INFO (zkConnectionManagerCallback-4368-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 567634 INFO (zkConnectionManagerCallback-4370-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 567637 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:42835_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (0) -> (3) [junit4] 2> 567638 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:42835_solr ] o.a.s.c.Overseer Overseer (id= =3Dnull) closing [junit4] 2> 567639 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:42835_solr ] o.a.s.c.TransientSolrCoreCacheD= efault Allocating transient cache for 2147483647 transient cores [junit4] 2> 567639 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:42835_solr ] o.a.s.c.ZkController Register n= ode as live in ZooKeeper:/live_nodes/127.0.0.1:42835_solr [junit4] 2> 567639 INFO (zkCallback-4361-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567639 INFO (zkCallback-4346-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567639 INFO (zkCallback-4331-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567639 INFO (zkCallback-4354-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567639 INFO (zkCallback-4324-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567639 INFO (zkCallback-4316-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567640 INFO (zkCallback-4339-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567642 INFO (zkCallback-4369-thread-1) [ ] o.a.s.c.c.Z= kStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 567727 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:42835_solr ] o.a.s.m.r.SolrJmxReporter JMX m= onitoring for 'solr_42835.solr.node' (registry 'solr.node') enabled at serv= er: com.sun.jmx.mbeanserver.JmxMBeanServer@460b86c3 [junit4] 2> 567733 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:42835_solr ] o.a.s.m.r.SolrJmxReporter JMX m= onitoring for 'solr_42835.solr.jvm' (registry 'solr.jvm') enabled at server= : com.sun.jmx.mbeanserver.JmxMBeanServer@460b86c3 [junit4] 2> 567733 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:42835_solr ] o.a.s.m.r.SolrJmxReporter JMX m= onitoring for 'solr_42835.solr.jetty' (registry 'solr.jetty') enabled at se= rver: com.sun.jmx.mbeanserver.JmxMBeanServer@460b86c3 [junit4] 2> 567734 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:42835_solr ] o.a.s.c.CorePropertiesLocator F= ound 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-= Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_4E2= 446F009ACE37B-001/tempDir-001/node4/. [junit4] 2> 567736 INFO (zkConnectionManagerCallback-4377-thread-1) [= ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 567737 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:42835_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (0) -> (4) [junit4] 2> 567737 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [n:127.0.0.1:42835_solr ] o.a.s.c.s.i.ZkClientClusterStat= eProvider Cluster at 127.0.0.1:39223/solr ready [junit4] 2> 567759 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.TestCloudConsistency Adding proxy for URL: ht= tps://127.0.0.1:33935/solr. Proxy: https://127.0.0.1:42835/solr [junit4] 2> 567776 INFO (TEST-TestCloudConsistency.testOutOfSyncRepli= casCannotBecomeLeaderAfterRestart-seed#[4E2446F009ACE37B]) [ ] o.a.s.Sol= rTestCaseJ4 ###Starting testOutOfSyncReplicasCannotBecomeLeaderAfterRestart [junit4] 2> 567777 INFO (SocketProxy-Acceptor-35735) [ ] o.a.s.c.S= ocketProxy accepted Socket[addr=3D/127.0.0.1,port=3D37056,localport=3D35735= ], receiveBufferSize:531000 [junit4] 2> 567777 INFO (SocketProxy-Acceptor-35735) [ ] o.a.s.c.S= ocketProxy proxy connection Socket[addr=3D/127.0.0.1,port=3D36153,localport= =3D55728], receiveBufferSize=3D530904 [junit4] 2> 567871 INFO (qtp568295374-11127) [n:127.0.0.1:35735_solr = ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with pa= rams pullReplicas=3D0&replicationFactor=3D3&name=3DoutOfSyncReplicasCannotB= ecomeLeader-true&nrtReplicas=3D3&action=3DCREATE&numShards=3D1&tlogReplicas= =3D0&createNodeSet=3D&wt=3Djavabin&version=3D2 and sendToOCPQueue=3Dtrue [junit4] 2> 567872 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.a.c.CreateCollectionCmd Create collection outOfSyncReplicasCannotBe= comeLeader-true [junit4] 2> 567873 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt t= o /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/protwords.t= xt [junit4] 2> 567874 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema = to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/managed-sc= hema [junit4] 2> 567875 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml = to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/solrconfig= .xml [junit4] 2> 567875 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to= /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/synonyms.txt [junit4] 2> 567876 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt t= o /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/stopwords.t= xt [junit4] 2> 567877 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractio= ns_it.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/= lang/contractions_it.txt [junit4] 2> 567877 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_n= l.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang= /stemdict_nl.txt [junit4] 2> 567878 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= hy.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_hy.txt [junit4] 2> 567878 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= no.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_no.txt [junit4] 2> 567879 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractio= ns_ca.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/= lang/contractions_ca.txt [junit4] 2> 567879 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= id.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_id.txt [junit4] 2> 567880 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= ga.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_ga.txt [junit4] 2> 567880 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= hi.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_hi.txt [junit4] 2> 567881 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= da.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_da.txt [junit4] 2> 567882 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= ja.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_ja.txt [junit4] 2> 567882 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= pt.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_pt.txt [junit4] 2> 567883 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= hu.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_hu.txt [junit4] 2> 567883 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= el.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_el.txt [junit4] 2> 567884 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= ru.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_ru.txt [junit4] 2> 567884 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= tr.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_tr.txt [junit4] 2> 567885 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= ar.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_ar.txt [junit4] 2> 567885 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_j= a.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang= /userdict_ja.txt [junit4] 2> 567886 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= eu.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_eu.txt [junit4] 2> 567886 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= it.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_it.txt [junit4] 2> 567887 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= cz.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_cz.txt [junit4] 2> 567887 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_j= a.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang= /stoptags_ja.txt [junit4] 2> 567888 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractio= ns_fr.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/= lang/contractions_fr.txt [junit4] 2> 567889 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= de.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_de.txt [junit4] 2> 567889 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= fa.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_fa.txt [junit4] 2> 567890 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractio= ns_ga.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/= lang/contractions_ga.txt [junit4] 2> 567890 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= ca.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_ca.txt [junit4] 2> 567891 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= nl.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_nl.txt [junit4] 2> 567891 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= bg.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_bg.txt [junit4] 2> 567892 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= lv.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_lv.txt [junit4] 2> 567892 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= en.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_en.txt [junit4] 2> 567893 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= es.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_es.txt [junit4] 2> 567893 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= th.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_th.txt [junit4] 2> 567894 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= ro.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_ro.txt [junit4] 2> 567894 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= fr.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_fr.txt [junit4] 2> 567895 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= sv.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_sv.txt [junit4] 2> 567895 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= fi.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_fi.txt [junit4] 2> 567896 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenatio= ns_ga.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/= lang/hyphenations_ga.txt [junit4] 2> 567896 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_= gl.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lan= g/stopwords_gl.txt [junit4] 2> 567897 INFO (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/params.json to = /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/params.json [junit4] 2> 567898 WARN (OverseerThreadFactory-2883-thread-1) [ ] = o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (outOf= SyncReplicasCannotBecomeLeader-true) without cores. [junit4] 2> 568005 INFO (qtp568295374-11127) [n:127.0.0.1:35735_solr = ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for = at most 30 seconds. Check all shard replicas [junit4] 2> 568005 INFO (qtp568295374-11127) [n:127.0.0.1:35735_solr = ] o.a.s.s.HttpSolrCall [admin] webapp=3Dnull path=3D/admin/collections p= arams=3D{pullReplicas=3D0&replicationFactor=3D3&name=3DoutOfSyncReplicasCan= notBecomeLeader-true&nrtReplicas=3D3&action=3DCREATE&numShards=3D1&tlogRepl= icas=3D0&createNodeSet=3D&wt=3Djavabin&version=3D2} status=3D0 QTime=3D134 [junit4] 2> 568006 INFO (SocketProxy-Acceptor-45415) [ ] o.a.s.c.S= ocketProxy accepted Socket[addr=3D/127.0.0.1,port=3D54254,localport=3D45415= ], receiveBufferSize:531000 [junit4] 2> 568006 INFO (SocketProxy-Acceptor-45415) [ ] o.a.s.c.S= ocketProxy proxy connection Socket[addr=3D/127.0.0.1,port=3D41555,localport= =3D40598], receiveBufferSize=3D530904 [junit4] 2> 568098 INFO (qtp2049357067-11159) [n:127.0.0.1:45415_solr= ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica wi= th params node=3D127.0.0.1:44101_solr&action=3DADDREPLICA&collection=3DoutO= fSyncReplicasCannotBecomeLeader-true&shard=3Dshard1&type=3DNRT&wt=3Djavabin= &version=3D2 and sendToOCPQueue=3Dtrue [junit4] 2> 568100 INFO (OverseerCollectionConfigSetProcessor-7218831= 2771035157-127.0.0.1:44101_solr-n_0000000004) [ ] o.a.s.c.OverseerTaskQu= eue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn'= t exist. Requestor may have disconnected from ZooKeeper [junit4] 2> 568100 INFO (OverseerThreadFactory-2883-thread-2) [ c:out= OfSyncReplicasCannotBecomeLeader-true s:shard1 ] o.a.s.c.a.c.AddReplicaCmd= Node Identified 127.0.0.1:44101_solr for creating new replica [junit4] 2> 568101 INFO (OverseerStateUpdate-72188312771035157-127.0.= 0.1:44101_solr-n_0000000004) [ ] o.a.s.c.o.SliceMutator createReplica() = { [junit4] 2> "operation":"addreplica", [junit4] 2> "collection":"outOfSyncReplicasCannotBecomeLeader-true", [junit4] 2> "shard":"shard1", [junit4] 2> "core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_= replica_n61", [junit4] 2> "state":"down", [junit4] 2> "base_url":"https://127.0.0.1:44101/solr", [junit4] 2> "node_name":"127.0.0.1:44101_solr", [junit4] 2> "type":"NRT"}=20 [junit4] 2> 568303 INFO (SocketProxy-Acceptor-44101) [ ] o.a.s.c.S= ocketProxy accepted Socket[addr=3D/127.0.0.1,port=3D36584,localport=3D44101= ], receiveBufferSize:531000 [junit4] 2> 568303 INFO (SocketProxy-Acceptor-44101) [ ] o.a.s.c.S= ocketProxy proxy connection Socket[addr=3D/127.0.0.1,port=3D40905,localport= =3D42122], receiveBufferSize=3D530904 [junit4] 2> 568395 INFO (qtp81574391-11096) [n:127.0.0.1:44101_solr = x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n61] o.a.s.h.a.= CoreAdminOperation core create command qt=3D/admin/cores&coreNodeName=3Dcor= e_node62&collection.configName=3DoutOfSyncReplicasCannotBecomeLeader-true.A= UTOCREATED&name=3DoutOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n= 61&action=3DCREATE&collection=3DoutOfSyncReplicasCannotBecomeLeader-true&sh= ard=3Dshard1&wt=3Djavabin&version=3D2&replicaType=3DNRT [junit4] 2> 568401 INFO (qtp81574391-11096) [n:127.0.0.1:44101_solr c= :outOfSyncReplicasCannotBecomeLeader-true s:shard1 r:core_node62 x:outOfSyn= cReplicasCannotBecomeLeader-true_shard1_replica_n61] o.a.s.c.RequestParams = conf resource params.json loaded . version : 0=20 [junit4] 2> 568401 INFO (qtp81574391-11096) [n:127.0.0.1:44101_solr c= :outOfSyncReplicasCannotBecomeLeader-true s:shard1 r:core_node62 x:outOfSyn= cReplicasCannotBecomeLeader-true_shard1_replica_n61] o.a.s.c.RequestParams = request params refreshed to version 0 [junit4] 2> 568401 WARN (qtp81574391-11096) [n:127.0.0.1:44101_solr c= :outOfSyncReplicasCannot [...truncated too long message...] otBecomeLeader-false s:shard1 r:core_node66 x:outOfSyncReplicasCannotBecome= Leader-false_shard1_replica_n65] o.a.s.c.RecoveryStrategy Stopping recovery= for core=3D[outOfSyncReplicasCannotBecomeLeader-false_shard1_replica_n65] = coreNodeName=3D[core_node66] [junit4] 2> 616147 INFO (coreCloseExecutor-2979-thread-1) [n:127.0.0.= 1:35735_solr c:outOfSyncReplicasCannotBecomeLeader-false s:shard1 r:core_no= de64 x:outOfSyncReplicasCannotBecomeLeader-false_shard1_replica_n63] o.a.s.= m.SolrMetricManager Closing metric reporters for registry=3Dsolr.collection= .outOfSyncReplicasCannotBecomeLeader-false.shard1.leader, tag=3D428596c7 [junit4] 2> 616150 WARN (coreCloseExecutor-2979-thread-1) [n:127.0.0.= 1:35735_solr c:outOfSyncReplicasCannotBecomeLeader-false s:shard1 r:core_no= de64 x:outOfSyncReplicasCannotBecomeLeader-false_shard1_replica_n63] o.a.s.= c.RecoveryStrategy Stopping recovery for core=3D[outOfSyncReplicasCannotBec= omeLeader-false_shard1_replica_n63] coreNodeName=3D[core_node64] [junit4] 2> 616150 INFO (jetty-closer-4248-thread-1) [ ] o.e.j.s.h= .ContextHandler Stopped o.e.j.s.ServletContextHandler@1c6a8319{/solr,null,U= NAVAILABLE} [junit4] 2> 616151 INFO (jetty-closer-4248-thread-1) [ ] o.e.j.s.s= ession node0 Stopped scavenging [junit4] 2> 619568 ERROR (recoveryExecutor-4383-thread-1-processing-n:= 127.0.0.1:35735_solr x:outOfSyncReplicasCannotBecomeLeader-false_shard1_rep= lica_n63 c:outOfSyncReplicasCannotBecomeLeader-false s:shard1 r:core_node64= ) [n:127.0.0.1:35735_solr c:outOfSyncReplicasCannotBecomeLeader-false s:sha= rd1 r:core_node64 x:outOfSyncReplicasCannotBecomeLeader-false_shard1_replic= a_n63] o.a.s.c.RecoveryStrategy SolrCore not found - cannot recover:outOfSy= ncReplicasCannotBecomeLeader-false_shard1_replica_n63 [junit4] 2> 619570 INFO (zkCallback-4401-thread-1) [ ] o.a.s.c.Ove= rseerElectionContext I am going to be the leader 127.0.0.1:45415_solr [junit4] 2> 619570 INFO (jetty-closer-4248-thread-2) [ ] o.e.j.s.h= .ContextHandler Stopped o.e.j.s.ServletContextHandler@7a3d5de0{/solr,null,U= NAVAILABLE} [junit4] 2> 619570 INFO (jetty-closer-4248-thread-2) [ ] o.e.j.s.s= ession node0 Stopped scavenging [junit4] 2> 619957 ERROR (recoveryExecutor-4398-thread-1-processing-n:= 127.0.0.1:45415_solr x:outOfSyncReplicasCannotBecomeLeader-false_shard1_rep= lica_n65 c:outOfSyncReplicasCannotBecomeLeader-false s:shard1 r:core_node66= ) [n:127.0.0.1:45415_solr c:outOfSyncReplicasCannotBecomeLeader-false s:sha= rd1 r:core_node66 x:outOfSyncReplicasCannotBecomeLeader-false_shard1_replic= a_n65] o.a.s.c.RecoveryStrategy SolrCore not found - cannot recover:outOfSy= ncReplicasCannotBecomeLeader-false_shard1_replica_n65 [junit4] 2> 619959 INFO (jetty-closer-4248-thread-3) [ ] o.e.j.s.h= .ContextHandler Stopped o.e.j.s.ServletContextHandler@679b1abc{/solr,null,U= NAVAILABLE} [junit4] 2> 619959 INFO (jetty-closer-4248-thread-3) [ ] o.e.j.s.s= ession node0 Stopped scavenging [junit4] 2> 619960 ERROR (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not regi= stered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN serv= er state changes [junit4] 2> 619960 INFO (SUITE-TestCloudConsistency-seed#[4E2446F009A= CE37B]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39223 39= 223 [junit4] 2> 620073 INFO (Thread-2414) [ ] o.a.s.c.ZkTestServer con= necting to 127.0.0.1:39223 39223 [junit4] 2> 620073 WARN (Thread-2414) [ ] o.a.s.c.ZkTestServer Wat= ch limit violations:=20 [junit4] 2> Maximum concurrent create/delete watches above limit: [junit4] 2>=20 [junit4] 2> =0945=09/solr/collections/outOfSyncReplicasCannotBecomeLea= der-true/terms/shard1 [junit4] 2> =0927=09/solr/collections/outOfSyncReplicasCannotBecomeLea= der-false/terms/shard1 [junit4] 2> =0925=09/solr/aliases.json [junit4] 2> =0912=09/solr/security.json [junit4] 2> =096=09/solr/configs/outOfSyncReplicasCannotBecomeLeader-t= rue.AUTOCREATED [junit4] 2> =096=09/solr/configs/outOfSyncReplicasCannotBecomeLeader-t= rue.AUTOCREATED/managed-schema [junit4] 2> =094=09/solr/configs/outOfSyncReplicasCannotBecomeLeader-f= alse.AUTOCREATED/managed-schema [junit4] 2> =094=09/solr/configs/outOfSyncReplicasCannotBecomeLeader-f= alse.AUTOCREATED [junit4] 2>=20 [junit4] 2> Maximum concurrent data watches above limit: [junit4] 2>=20 [junit4] 2> =0931=09/solr/collections/outOfSyncReplicasCannotBecomeLea= der-true/state.json [junit4] 2> =0930=09/solr/collections/outOfSyncReplicasCannotBecomeLea= der-false/state.json [junit4] 2> =0925=09/solr/clusterprops.json [junit4] 2> =0925=09/solr/clusterstate.json [junit4] 2> =094=09/solr/autoscaling.json [junit4] 2> =093=09/solr/overseer_elect/election/72188312771035157-127= .0.0.1:44101_solr-n_0000000004 [junit4] 2> =092=09/solr/overseer_elect/election/72188312771035177-127= .0.0.1:45415_solr-n_0000000009 [junit4] 2> =092=09/solr/collections/outOfSyncReplicasCannotBecomeLead= er-true/leader_elect/shard1/election/72188312771035157-core_node62-n_000000= 0000 [junit4] 2> =092=09/solr/overseer_elect/election/72188312771035146-127= .0.0.1:35165_solr-n_0000000000 [junit4] 2> =092=09/solr/overseer_elect/election/72188312771035147-127= .0.0.1:38719_solr-n_0000000001 [junit4] 2>=20 [junit4] 2> Maximum concurrent children watches above limit: [junit4] 2>=20 [junit4] 2> =0925=09/solr/live_nodes [junit4] 2> =0925=09/solr/collections [junit4] 2> =094=09/solr/overseer/queue [junit4] 2> =094=09/solr/autoscaling/events/.scheduled_maintenance [junit4] 2> =094=09/solr/autoscaling/events/.auto_add_replicas [junit4] 2> =094=09/solr/overseer/queue-work [junit4] 2> =094=09/solr/overseer/collection-queue-work [junit4] 2>=20 [junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/wo= rkspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.= TestCloudConsistency_4E2446F009ACE37B-001 [junit4] 2> May 19, 2018 11:17:49 AM com.carrotsearch.randomizedtestin= g.ThreadLeakControl checkThreadLeaks [junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thre= ad(s). [junit4] 2> NOTE: test params are: codec=3DAsserting(Lucene70): {}, do= cValues:{}, maxPointsInLeafNode=3D1584, maxMBSortInHeap=3D6.180377921426032= , sim=3DRandomSimilarity(queryNorm=3Dtrue): {}, locale=3Ddsb-DE, timezone= =3DAmerica/Porto_Velho [junit4] 2> NOTE: Linux 4.13.0-39-generic amd64/Oracle Corporation 9.0= .4 (64-bit)/cpus=3D8,threads=3D1,free=3D286818184,total=3D530055168 [junit4] 2> NOTE: All tests run in this JVM: [TermVectorComponentTest,= TestCodecSupport, MetricUtilsTest, SolrCmdDistributorTest, TestPayloadScor= eQParserPlugin, RestartWhileUpdatingTest, SolrTestCaseJ4Test, TestFaceting,= TestValueSourceCache, TestFieldCacheReopen, TestRestManager, AddSchemaFiel= dsUpdateProcessorFactoryTest, SaslZkACLProviderTest, TestCoreAdminApis, Tes= tAtomicUpdateErrorCases, TestLockTree, DataDrivenBlockJoinTest, UniqFieldsU= pdateProcessorFactoryTest, TestSortByMinMaxFunction, TestHdfsUpdateLog, Tes= tMultiValuedNumericRangeQuery, ReplicaListTransformerTest, TestExactStatsCa= che, TimeRoutedAliasUpdateProcessorTest, PingRequestHandlerTest, Overridden= ZkACLAndCredentialsProvidersTest, SearchRateTriggerTest, CustomCollectionTe= st, TestImplicitCoreProperties, MinimalSchemaTest, TestSolrCloudSnapshots, = DistributedFacetPivotLongTailTest, TestNodeAddedTrigger, TestBadConfig, Ind= exSchemaRuntimeFieldTest, TestCloudNestedDocsSort, TestSubQueryTransformerD= istrib, HttpPartitionOnCommitTest, AutoScalingHandlerTest, TestNonDefinedSi= milarityFactory, ClusterStateUpdateTest, TestDynamicFieldCollectionResource= , ResponseBuilderTest, TestSolrDeletionPolicy2, TestLeaderElectionWithEmpty= Replica, TestRawTransformer, SolrCloudExampleTest, TestUtils, TestFieldCach= eVsDocValues, HdfsRecoverLeaseTest, RegexBoostProcessorTest, TestZkAclsWith= HadoopAuth, TestNRTOpen, SearchHandlerTest, DocValuesTest, AsyncCallRequest= StatusResponseTest, TestLazyCores, TestSQLHandler, ScheduledTriggerIntegrat= ionTest, SolrMetricReporterTest, AssignTest, MetricsConfigTest, HLLSerializ= ationTest, NotRequiredUniqueKeyTest, BlobRepositoryCloudTest, CdcrBidirecti= onalTest, TestChildDocTransformer, TestRequestForwarding, DistanceFunctionT= est, TriggerCooldownIntegrationTest, HdfsUnloadDistributedZkTest, TestSolrC= loudWithDelegationTokens, PeerSyncReplicationTest, SuggestComponentContextF= ilterQueryTest, CopyFieldTest, TestLegacyFieldReuse, TestHashQParserPlugin,= DistributedFacetSimpleRefinementLongTailTest, DeleteLastCustomShardedRepli= caTest, SmileWriterTest, TimeZoneUtilsTest, TestHdfsCloudBackupRestore, Sor= tSpecParsingTest, TestCloudRecovery, TestCloudConsistency] [junit4] Completed [217/805 (1!)] on J2 in 53.62s, 2 tests, 1 failure <<= < FAILURES! [...truncated 45850 lines...] [repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Li= nux/1933/consoleText [repro] Revision: 1e661ed97aed0cc77869b01134d80c761c6b5295 [repro] Ant options: "-Dargs=3D-XX:+UseCompressedOops -XX:+UseParallelGC" [repro] Repro line: ant test -Dtestcase=3DTestCloudConsistency -Dtests.me= thod=3DtestOutOfSyncReplicasCannotBecomeLeader -Dtests.seed=3D4E2446F009ACE= 37B -Dtests.multiplier=3D3 -Dtests.slow=3Dtrue -Dtests.locale=3Ddsb-DE -Dte= sts.timezone=3DAmerica/Porto_Velho -Dtests.asserts=3Dtrue -Dtests.file.enco= ding=3DISO-8859-1 [repro] ant clean [...truncated 6 lines...] [repro] Test suites by module: [repro] solr/core [repro] TestCloudConsistency [repro] ant compile-test [...truncated 3321 lines...] [repro] ant test-nocompile -Dtests.dups=3D5 -Dtests.maxfailures=3D5 -Dtests= .class=3D"*.TestCloudConsistency" -Dtests.showOutput=3Donerror "-Dargs=3D-X= X:+UseCompressedOops -XX:+UseParallelGC" -Dtests.seed=3D4E2446F009ACE37B -D= tests.multiplier=3D3 -Dtests.slow=3Dtrue -Dtests.locale=3Ddsb-DE -Dtests.ti= mezone=3DAmerica/Porto_Velho -Dtests.asserts=3Dtrue -Dtests.file.encoding= =3DISO-8859-1 [...truncated 81 lines...] [repro] Failures: [repro] 0/5 failed: org.apache.solr.cloud.TestCloudConsistency [repro] Exiting with code 0 [...truncated 40 lines...] ------=_Part_392_1926353188.1526731053830 Content-Type: text/plain; charset=us-ascii --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org ------=_Part_392_1926353188.1526731053830--