Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 48EA7200BE1 for ; Mon, 19 Dec 2016 17:00:20 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 475A6160B21; Mon, 19 Dec 2016 16:00:20 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id CA335160B14 for ; Mon, 19 Dec 2016 17:00:17 +0100 (CET) Received: (qmail 54350 invoked by uid 500); 19 Dec 2016 16:00:16 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 54336 invoked by uid 99); 19 Dec 2016 16:00:16 -0000 Received: from crius.apache.org (HELO crius.apache.org) (140.211.11.14) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 19 Dec 2016 16:00:16 +0000 Received: from crius.apache.org (localhost [127.0.0.1]) by crius.apache.org (ASF Mail Server at crius.apache.org) with ESMTP id 7751E9C0041 for ; Mon, 19 Dec 2016 16:00:14 +0000 (UTC) Date: Mon, 19 Dec 2016 15:54:31 +0000 (UTC) From: Apache Jenkins Server To: dev@lucene.apache.org Message-ID: <55936032.1820.1482163214492.JavaMail.jenkins@crius> In-Reply-To: <1646551858.1499.1482085550012.JavaMail.jenkins@crius> References: <1646551858.1499.1482085550012.JavaMail.jenkins@crius> Subject: [JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 232 - Still unstable MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_1819_1464394168.1482163214085" X-Jenkins-Job: Lucene-Solr-NightlyTests-6.x X-Jenkins-Result: UNSTABLE archived-at: Mon, 19 Dec 2016 16:00:20 -0000 ------=_Part_1819_1464394168.1482163214085 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/232/ 5 tests failed. FAILED: org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testUpdateL= ogSynchronisation Error Message: Timeout waiting for CDCR replication to complete @source_collection:shard2 Stack Trace: java.lang.RuntimeException: Timeout waiting for CDCR replication to complet= e @source_collection:shard2 =09at __randomizedtesting.SeedInfo.seed([E9985D3E8D701DC9:17F7059D4F503ED8]= :0) =09at org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForReplicationToC= omplete(BaseCdcrDistributedZkTest.java:795) =09at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testUpdateLogS= ynchronisation(CdcrReplicationDistributedZkTest.java:377) =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.= java:62) =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces= sorImpl.java:43) =09at java.lang.reflect.Method.invoke(Method.java:498) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1713) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Random= izedRunner.java:907) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(Random= izedRunner.java:943) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(Rando= mizedRunner.java:957) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= FixedStatement.callStatement(BaseDistributedSearchTestCase.java:992) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= Statement.evaluate(BaseDistributedSearchTestCase.java:967) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:49) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:367) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:811) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:462) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:916) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:802) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Random= izedRunner.java:852) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:863) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:41) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:53) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:54) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:367) =09at java.lang.Thread.run(Thread.java:745) FAILED: org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_dv_st= ored_idx Error Message: There are still nodes recoverying - waited for 330 seconds Stack Trace: java.lang.AssertionError: There are still nodes recoverying - waited for 33= 0 seconds =09at __randomizedtesting.SeedInfo.seed([E9985D3E8D701DC9:E3BF0C1EF206BE9E]= :0) =09at org.junit.Assert.fail(Assert.java:93) =09at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFi= nish(AbstractDistribZkTestBase.java:184) =09at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.waitForRecove= riesToFinish(TestStressCloudBlindAtomicUpdates.java:459) =09at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.checkField(Te= stStressCloudBlindAtomicUpdates.java:304) =09at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_dv_store= d_idx(TestStressCloudBlindAtomicUpdates.java:214) =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.= java:62) =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces= sorImpl.java:43) =09at java.lang.reflect.Method.invoke(Method.java:498) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1713) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Random= izedRunner.java:907) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(Random= izedRunner.java:943) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(Rando= mizedRunner.java:957) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:49) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:367) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:811) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:462) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:916) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:802) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Random= izedRunner.java:852) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:863) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:41) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:53) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:54) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:367) =09at java.lang.Thread.run(Thread.java:745) FAILED: org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_store= d_idx Error Message: There are still nodes recoverying - waited for 330 seconds Stack Trace: java.lang.AssertionError: There are still nodes recoverying - waited for 33= 0 seconds =09at __randomizedtesting.SeedInfo.seed([E9985D3E8D701DC9:F9F9F0C798D258E7]= :0) =09at org.junit.Assert.fail(Assert.java:93) =09at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFi= nish(AbstractDistribZkTestBase.java:184) =09at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.waitForRecove= riesToFinish(TestStressCloudBlindAtomicUpdates.java:459) =09at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.checkField(Te= stStressCloudBlindAtomicUpdates.java:304) =09at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_stored_i= dx(TestStressCloudBlindAtomicUpdates.java:234) =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.= java:62) =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces= sorImpl.java:43) =09at java.lang.reflect.Method.invoke(Method.java:498) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1713) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Random= izedRunner.java:907) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(Random= izedRunner.java:943) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(Rando= mizedRunner.java:957) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:49) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:367) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:811) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:462) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:916) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:802) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Random= izedRunner.java:852) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:863) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:41) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:53) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:54) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:367) =09at java.lang.Thread.run(Thread.java:745) FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.tes= tSpecificConfigsets Error Message: KeeperErrorCode =3D NoNode for /collections/withconfigset2 Stack Trace: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode =3D N= oNode for /collections/withconfigset2 =09at __randomizedtesting.SeedInfo.seed([E9985D3E8D701DC9:C4E612647A54A7C5]= :0) =09at org.apache.zookeeper.KeeperException.create(KeeperException.java:111) =09at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) =09at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155) =09at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java= :356) =09at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java= :353) =09at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecut= or.java:60) =09at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:3= 53) =09at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testSpecificCon= figsets(CollectionsAPIDistributedZkTest.java:425) =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.= java:62) =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces= sorImpl.java:43) =09at java.lang.reflect.Method.invoke(Method.java:498) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1713) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Random= izedRunner.java:907) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(Random= izedRunner.java:943) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(Rando= mizedRunner.java:957) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:49) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:367) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:811) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:462) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:916) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:802) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Random= izedRunner.java:852) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:863) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:41) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:53) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:54) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:367) =09at java.lang.Thread.run(Thread.java:745) FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.tes= tCollectionsAPI Error Message: Expected to see collection awhollynewcollection_0 null Last available state= : DocCollection(awhollynewcollection_0//collections/awhollynewcollection_0/= state.json/8)=3D{ "replicationFactor":"3", "shards":{ "shard1":{ = "range":"80000000-bfffffff", "state":"active", "replicas":{= }}, "shard2":{ "range":"c0000000-ffffffff", "state":"active= ", "replicas":{}}, "shard3":{ "range":"0-3fffffff", "= state":"active", "replicas":{}}, "shard4":{ "range":"400000= 00-7fffffff", "state":"active", "replicas":{}}}, "router":{"n= ame":"compositeId"}, "maxShardsPerNode":"4", "autoAddReplicas":"false"} Stack Trace: java.lang.AssertionError: Expected to see collection awhollynewcollection_0 null Last available state: DocCollection(awhollynewcollection_0//collections/awh= ollynewcollection_0/state.json/8)=3D{ "replicationFactor":"3", "shards":{ "shard1":{ "range":"80000000-bfffffff", "state":"active", "replicas":{}}, "shard2":{ "range":"c0000000-ffffffff", "state":"active", "replicas":{}}, "shard3":{ "range":"0-3fffffff", "state":"active", "replicas":{}}, "shard4":{ "range":"40000000-7fffffff", "state":"active", "replicas":{}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"4", "autoAddReplicas":"false"} =09at __randomizedtesting.SeedInfo.seed([E9985D3E8D701DC9:A1ED298A8B43325C]= :0) =09at org.junit.Assert.fail(Assert.java:93) =09at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCas= e.java:237) =09at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollections= API(CollectionsAPIDistributedZkTest.java:496) =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.= java:62) =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces= sorImpl.java:43) =09at java.lang.reflect.Method.invoke(Method.java:498) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1713) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Random= izedRunner.java:907) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(Random= izedRunner.java:943) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(Rando= mizedRunner.java:957) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:49) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:367) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:811) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:462) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:916) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:802) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Random= izedRunner.java:852) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:863) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:41) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:53) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:54) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:367) =09at java.lang.Thread.run(Thread.java:745) Build Log: [...truncated 11585 lines...] [junit4] Suite: org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates [junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Luce= ne-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cl= oud.TestStressCloudBlindAtomicUpdates_E9985D3E8D701DC9-001/init-core-data-0= 01 [junit4] 2> 243569 INFO (SUITE-TestStressCloudBlindAtomicUpdates-seed= #[E9985D3E8D701DC9]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (fal= se) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL= (bugUrl=3DSSL overhead seems to cause OutOfMemory when stress testing) [junit4] 2> 243573 INFO (SUITE-TestStressCloudBlindAtomicUpdates-seed= #[E9985D3E8D701DC9]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cl= uster of 10 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Nigh= tlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.TestStre= ssCloudBlindAtomicUpdates_E9985D3E8D701DC9-001/tempDir-001 [junit4] 2> 243573 INFO (SUITE-TestStressCloudBlindAtomicUpdates-seed= #[E9985D3E8D701DC9]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SE= RVER [junit4] 2> 243574 INFO (Thread-2066) [ ] o.a.s.c.ZkTestServer cli= ent port:0.0.0.0/0.0.0.0:0 [junit4] 2> 243574 INFO (Thread-2066) [ ] o.a.s.c.ZkTestServer Sta= rting server [junit4] 2> 243674 INFO (SUITE-TestStressCloudBlindAtomicUpdates-seed= #[E9985D3E8D701DC9]-worker) [ ] o.a.s.c.ZkTestServer start zk server on = port:54332 [junit4] 2> 243699 INFO (jetty-launcher-216-thread-1) [ ] o.e.j.s.= Server jetty-9.3.14.v20161028 [junit4] 2> 243701 INFO (jetty-launcher-216-thread-2) [ ] o.e.j.s.= Server jetty-9.3.14.v20161028 [junit4] 2> 243706 INFO (jetty-launcher-216-thread-3) [ ] o.e.j.s.= Server jetty-9.3.14.v20161028 [junit4] 2> 243717 INFO (jetty-launcher-216-thread-5) [ ] o.e.j.s.= Server jetty-9.3.14.v20161028 [junit4] 2> 243717 INFO (jetty-launcher-216-thread-4) [ ] o.e.j.s.= Server jetty-9.3.14.v20161028 [junit4] 2> 243733 INFO (jetty-launcher-216-thread-6) [ ] o.e.j.s.= Server jetty-9.3.14.v20161028 [junit4] 2> 243738 INFO (jetty-launcher-216-thread-7) [ ] o.e.j.s.= Server jetty-9.3.14.v20161028 [junit4] 2> 243757 INFO (jetty-launcher-216-thread-8) [ ] o.e.j.s.= Server jetty-9.3.14.v20161028 [junit4] 2> 243768 INFO (jetty-launcher-216-thread-9) [ ] o.e.j.s.= Server jetty-9.3.14.v20161028 [junit4] 2> 243770 INFO (jetty-launcher-216-thread-10) [ ] o.e.j.s= .Server jetty-9.3.14.v20161028 [junit4] 2> 243786 INFO (jetty-launcher-216-thread-8) [ ] o.e.j.s.= h.ContextHandler Started o.e.j.s.ServletContextHandler@69860c49{/solr,null,= AVAILABLE} [junit4] 2> 243787 INFO (jetty-launcher-216-thread-8) [ ] o.e.j.s.= AbstractConnector Started ServerConnector@30ddc926{HTTP/1.1,[http/1.1]}{127= .0.0.1:41690} [junit4] 2> 243787 INFO (jetty-launcher-216-thread-8) [ ] o.e.j.s.= Server Started @247573ms [junit4] 2> 243787 INFO (jetty-launcher-216-thread-8) [ ] o.a.s.c.= s.e.JettySolrRunner Jetty properties: {hostContext=3D/solr, hostPort=3D4169= 0} [junit4] 2> 243788 ERROR (jetty-launcher-216-thread-8) [ ] o.a.s.s.= StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missin= g or incomplete. [junit4] 2> 243788 INFO (jetty-launcher-216-thread-8) [ ] o.a.s.s.= SolrDispatchFilter ___ _ Welcome to Apache Solr=E2=84=A2 versio= n 6.4.0 [junit4] 2> 243788 INFO (jetty-launcher-216-thread-8) [ ] o.a.s.s.= SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 243788 INFO (jetty-launcher-216-thread-8) [ ] o.a.s.s.= SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 243788 INFO (jetty-launcher-216-thread-8) [ ] o.a.s.s.= SolrDispatchFilter |___/\___/_|_| Start time: 2016-12-19T14:14:06.768Z [junit4] 2> 243807 INFO (jetty-launcher-216-thread-4) [ ] o.e.j.s.= h.ContextHandler Started o.e.j.s.ServletContextHandler@311642a0{/solr,null,= AVAILABLE} [junit4] 2> 243808 INFO (jetty-launcher-216-thread-4) [ ] o.e.j.s.= AbstractConnector Started ServerConnector@619ca835{HTTP/1.1,[http/1.1]}{127= .0.0.1:34871} [junit4] 2> 243808 INFO (jetty-launcher-216-thread-4) [ ] o.e.j.s.= Server Started @247594ms [junit4] 2> 243808 INFO (jetty-launcher-216-thread-4) [ ] o.a.s.c.= s.e.JettySolrRunner Jetty properties: {hostContext=3D/solr, hostPort=3D3487= 1} [junit4] 2> 243808 ERROR (jetty-launcher-216-thread-4) [ ] o.a.s.s.= StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missin= g or incomplete. [junit4] 2> 243808 INFO (jetty-launcher-216-thread-4) [ ] o.a.s.s.= SolrDispatchFilter ___ _ Welcome to Apache Solr=E2=84=A2 versio= n 6.4.0 [junit4] 2> 243808 INFO (jetty-launcher-216-thread-4) [ ] o.a.s.s.= SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 243808 INFO (jetty-launcher-216-thread-4) [ ] o.a.s.s.= SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 243809 INFO (jetty-launcher-216-thread-4) [ ] o.a.s.s.= SolrDispatchFilter |___/\___/_|_| Start time: 2016-12-19T14:14:06.788Z [junit4] 2> 243843 INFO (jetty-launcher-216-thread-3) [ ] o.e.j.s.= h.ContextHandler Started o.e.j.s.ServletContextHandler@351ebeab{/solr,null,= AVAILABLE} [junit4] 2> 243844 INFO (jetty-launcher-216-thread-3) [ ] o.e.j.s.= AbstractConnector Started ServerConnector@6f21e805{HTTP/1.1,[http/1.1]}{127= .0.0.1:54890} [junit4] 2> 243844 INFO (jetty-launcher-216-thread-3) [ ] o.e.j.s.= Server Started @247630ms [junit4] 2> 243844 INFO (jetty-launcher-216-thread-3) [ ] o.a.s.c.= s.e.JettySolrRunner Jetty properties: {hostContext=3D/solr, hostPort=3D5489= 0} [junit4] 2> 243844 ERROR (jetty-launcher-216-thread-3) [ ] o.a.s.s.= StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missin= g or incomplete. [junit4] 2> 243844 INFO (jetty-launcher-216-thread-3) [ ] o.a.s.s.= SolrDispatchFilter ___ _ Welcome to Apache Solr=E2=84=A2 versio= n 6.4.0 [junit4] 2> 243844 INFO (jetty-launcher-216-thread-3) [ ] o.a.s.s.= SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 243844 INFO (jetty-launcher-216-thread-3) [ ] o.a.s.s.= SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 243845 INFO (jetty-launcher-216-thread-3) [ ] o.a.s.s.= SolrDispatchFilter |___/\___/_|_| Start time: 2016-12-19T14:14:06.825Z [junit4] 2> 243868 INFO (jetty-launcher-216-thread-9) [ ] o.e.j.s.= h.ContextHandler Started o.e.j.s.ServletContextHandler@3b6dded7{/solr,null,= AVAILABLE} [junit4] 2> 243868 INFO (jetty-launcher-216-thread-9) [ ] o.e.j.s.= AbstractConnector Started ServerConnector@636c4517{HTTP/1.1,[http/1.1]}{127= .0.0.1:52424} [junit4] 2> 243869 INFO (jetty-launcher-216-thread-9) [ ] o.e.j.s.= Server Started @247655ms [junit4] 2> 243869 INFO (jetty-launcher-216-thread-9) [ ] o.a.s.c.= s.e.JettySolrRunner Jetty properties: {hostContext=3D/solr, hostPort=3D5242= 4} [junit4] 2> 243869 ERROR (jetty-launcher-216-thread-9) [ ] o.a.s.s.= StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missin= g or incomplete. [junit4] 2> 243869 INFO (jetty-launcher-216-thread-9) [ ] o.a.s.s.= SolrDispatchFilter ___ _ Welcome to Apache Solr=E2=84=A2 versio= n 6.4.0 [junit4] 2> 243869 INFO (jetty-launcher-216-thread-9) [ ] o.a.s.s.= SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 243869 INFO (jetty-launcher-216-thread-9) [ ] o.a.s.s.= SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 243869 INFO (jetty-launcher-216-thread-9) [ ] o.a.s.s.= SolrDispatchFilter |___/\___/_|_| Start time: 2016-12-19T14:14:06.849Z [junit4] 2> 243893 INFO (jetty-launcher-216-thread-5) [ ] o.e.j.s.= h.ContextHandler Started o.e.j.s.ServletContextHandler@1ea52f82{/solr,null,= AVAILABLE} [junit4] 2> 243894 INFO (jetty-launcher-216-thread-5) [ ] o.e.j.s.= AbstractConnector Started ServerConnector@622b3e03{HTTP/1.1,[http/1.1]}{127= .0.0.1:56843} [junit4] 2> 243894 INFO (jetty-launcher-216-thread-5) [ ] o.e.j.s.= Server Started @247680ms [junit4] 2> 243894 INFO (jetty-launcher-216-thread-5) [ ] o.a.s.c.= s.e.JettySolrRunner Jetty properties: {hostContext=3D/solr, hostPort=3D5684= 3} [junit4] 2> 243894 ERROR (jetty-launcher-216-thread-5) [ ] o.a.s.s.= StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missin= g or incomplete. [junit4] 2> 243894 INFO (jetty-launcher-216-thread-5) [ ] o.a.s.s.= SolrDispatchFilter ___ _ Welcome to Apache Solr=E2=84=A2 versio= n 6.4.0 [junit4] 2> 243894 INFO (jetty-launcher-216-thread-5) [ ] o.a.s.s.= SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 243894 INFO (jetty-launcher-216-thread-5) [ ] o.a.s.s.= SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 243894 INFO (jetty-launcher-216-thread-5) [ ] o.a.s.s.= SolrDispatchFilter |___/\___/_|_| Start time: 2016-12-19T14:14:06.874Z [junit4] 2> 243933 INFO (jetty-launcher-216-thread-10) [ ] o.e.j.s= .h.ContextHandler Started o.e.j.s.ServletContextHandler@6ec2d5ed{/solr,null= ,AVAILABLE} [junit4] 2> 243933 INFO (jetty-launcher-216-thread-10) [ ] o.e.j.s= .AbstractConnector Started ServerConnector@1bca80ab{HTTP/1.1,[http/1.1]}{12= 7.0.0.1:39494} [junit4] 2> 243933 INFO (jetty-launcher-216-thread-10) [ ] o.e.j.s= .Server Started @247719ms [junit4] 2> 243933 INFO (jetty-launcher-216-thread-10) [ ] o.a.s.c= .s.e.JettySolrRunner Jetty properties: {hostContext=3D/solr, hostPort=3D394= 94} [junit4] 2> 243933 ERROR (jetty-launcher-216-thread-10) [ ] o.a.s.s= .StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missi= ng or incomplete. [junit4] 2> 243934 INFO (jetty-launcher-216-thread-10) [ ] o.a.s.s= .SolrDispatchFilter ___ _ Welcome to Apache Solr=E2=84=A2 versi= on 6.4.0 [junit4] 2> 243934 INFO (jetty-launcher-216-thread-10) [ ] o.a.s.s= .SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 243934 INFO (jetty-launcher-216-thread-10) [ ] o.a.s.s= .SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 243934 INFO (jetty-launcher-216-thread-10) [ ] o.a.s.s= .SolrDispatchFilter |___/\___/_|_| Start time: 2016-12-19T14:14:06.914Z [junit4] 2> 243946 INFO (jetty-launcher-216-thread-1) [ ] o.e.j.s.= h.ContextHandler Started o.e.j.s.ServletContextHandler@1a9d0b6{/solr,null,A= VAILABLE} [junit4] 2> 243947 INFO (jetty-launcher-216-thread-1) [ ] o.e.j.s.= AbstractConnector Started ServerConnector@29504287{HTTP/1.1,[http/1.1]}{127= .0.0.1:35780} [junit4] 2> 243947 INFO (jetty-launcher-216-thread-1) [ ] o.e.j.s.= Server Started @247733ms [junit4] 2> 243947 INFO (jetty-launcher-216-thread-1) [ ] o.a.s.c.= s.e.JettySolrRunner Jetty properties: {hostContext=3D/solr, hostPort=3D3578= 0} [junit4] 2> 243947 ERROR (jetty-launcher-216-thread-1) [ ] o.a.s.s.= StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missin= g or incomplete. [junit4] 2> 243947 INFO (jetty-launcher-216-thread-1) [ ] o.a.s.s.= SolrDispatchFilter ___ _ Welcome to Apache Solr=E2=84=A2 versio= n 6.4.0 [junit4] 2> 243947 INFO (jetty-launcher-216-thread-1) [ ] o.a.s.s.= SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 243947 INFO (jetty-launcher-216-thread-1) [ ] o.a.s.s.= SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 243947 INFO (jetty-launcher-216-thread-1) [ ] o.a.s.s.= SolrDispatchFilter |___/\___/_|_| Start time: 2016-12-19T14:14:06.927Z [junit4] 2> 243952 INFO (jetty-launcher-216-thread-6) [ ] o.e.j.s.= h.ContextHandler Started o.e.j.s.ServletContextHandler@2adc2079{/solr,null,= AVAILABLE} [junit4] 2> 243952 INFO (jetty-launcher-216-thread-6) [ ] o.e.j.s.= AbstractConnector Started ServerConnector@4881af4e{HTTP/1.1,[http/1.1]}{127= .0.0.1:49979} [junit4] 2> 243952 INFO (jetty-launcher-216-thread-6) [ ] o.e.j.s.= Server Started @247738ms [junit4] 2> 243952 INFO (jetty-launcher-216-thread-6) [ ] o.a.s.c.= s.e.JettySolrRunner Jetty properties: {hostContext=3D/solr, hostPort=3D4997= 9} [junit4] 2> 243952 ERROR (jetty-launcher-216-thread-6) [ ] o.a.s.s.= StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missin= g or incomplete. [junit4] 2> 243952 INFO (jetty-launcher-216-thread-6) [ ] o.a.s.s.= SolrDispatchFilter ___ _ Welcome to Apache Solr=E2=84=A2 versio= n 6.4.0 [junit4] 2> 243953 INFO (jetty-launcher-216-thread-6) [ ] o.a.s.s.= SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 243953 INFO (jetty-launcher-216-thread-6) [ ] o.a.s.s.= SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 243953 INFO (jetty-launcher-216-thread-6) [ ] o.a.s.s.= SolrDispatchFilter |___/\___/_|_| Start time: 2016-12-19T14:14:06.933Z [junit4] 2> 243957 INFO (jetty-launcher-216-thread-7) [ ] o.e.j.s.= h.ContextHandler Started o.e.j.s.ServletContextHandler@5c2cbc7a{/solr,null,= AVAILABLE} [junit4] 2> 243957 INFO (jetty-launcher-216-thread-7) [ ] o.e.j.s.= AbstractConnector Started ServerConnector@76b4d14c{HTTP/1.1,[http/1.1]}{127= .0.0.1:35976} [junit4] 2> 243957 INFO (jetty-launcher-216-thread-7) [ ] o.e.j.s.= Server Started @247743ms [junit4] 2> 243957 INFO (jetty-launcher-216-thread-7) [ ] o.a.s.c.= s.e.JettySolrRunner Jetty properties: {hostContext=3D/solr, hostPort=3D3597= 6} [junit4] 2> 243958 ERROR (jetty-launcher-216-thread-7) [ ] o.a.s.s.= StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missin= g or incomplete. [junit4] 2> 243958 INFO (jetty-launcher-216-thread-7) [ ] o.a.s.s.= SolrDispatchFilter ___ _ Welcome to Apache Solr=E2=84=A2 versio= n 6.4.0 [junit4] 2> 243958 INFO (jetty-launcher-216-thread-7) [ ] o.a.s.s.= SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 243958 INFO (jetty-launcher-216-thread-7) [ ] o.a.s.s.= SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 243958 INFO (jetty-launcher-216-thread-7) [ ] o.a.s.s.= SolrDispatchFilter |___/\___/_|_| Start time: 2016-12-19T14:14:06.938Z [junit4] 2> 243990 INFO (jetty-launcher-216-thread-2) [ ] o.e.j.s.= h.ContextHandler Started o.e.j.s.ServletContextHandler@5e89a284{/solr,null,= AVAILABLE} [junit4] 2> 243990 INFO (jetty-launcher-216-thread-2) [ ] o.e.j.s.= AbstractConnector Started ServerConnector@fa62ec5{HTTP/1.1,[http/1.1]}{127.= 0.0.1:40894} [junit4] 2> 243990 INFO (jetty-launcher-216-thread-2) [ ] o.e.j.s.= Server Started @247777ms [junit4] 2> 243991 INFO (jetty-launcher-216-thread-2) [ ] o.a.s.c.= s.e.JettySolrRunner Jetty properties: {hostContext=3D/solr, hostPort=3D4089= 4} [junit4] 2> 243991 ERROR (jetty-launcher-216-thread-2) [ ] o.a.s.s.= StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missin= g or incomplete. [junit4] 2> 243991 INFO (jetty-launcher-216-thread-2) [ ] o.a.s.s.= SolrDispatchFilter ___ _ Welcome to Apache Solr=E2=84=A2 versio= n 6.4.0 [junit4] 2> 243991 INFO (jetty-launcher-216-thread-2) [ ] o.a.s.s.= SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 243991 INFO (jetty-launcher-216-thread-2) [ ] o.a.s.s.= SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 243991 INFO (jetty-launcher-216-thread-2) [ ] o.a.s.s.= SolrDispatchFilter |___/\___/_|_| Start time: 2016-12-19T14:14:06.971Z [junit4] 2> 243997 INFO (jetty-launcher-216-thread-5) [ ] o.a.s.s.= SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 243998 INFO (jetty-launcher-216-thread-3) [ ] o.a.s.s.= SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 244003 INFO (jetty-launcher-216-thread-4) [ ] o.a.s.s.= SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 244019 INFO (jetty-launcher-216-thread-8) [ ] o.a.s.s.= SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 244031 INFO (jetty-launcher-216-thread-9) [ ] o.a.s.s.= SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 244031 INFO (jetty-launcher-216-thread-2) [ ] o.a.s.s.= SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 244042 INFO (jetty-launcher-216-thread-3) [ ] o.a.s.u.= UpdateShardHandler Creating UpdateShardHandler HTTP client with params: soc= ketTimeout=3D340000&connTimeout=3D45000&retry=3Dtrue [junit4] 2> 244051 INFO (jetty-launcher-216-thread-4) [ ] o.a.s.u.= UpdateShardHandler Creating UpdateShardHandler HTTP client with params: soc= ketTimeout=3D340000&connTimeout=3D45000&retry=3Dtrue [junit4] 2> 244055 INFO (jetty-launcher-216-thread-4) [ ] o.a.s.c.= ZkContainer Zookeeper client=3D127.0.0.1:54332/solr [junit4] 2> 244062 INFO (jetty-launcher-216-thread-9) [ ] o.a.s.u.= UpdateShardHandler Creating UpdateShardHandler HTTP client with params: soc= ketTimeout=3D340000&connTimeout=3D45000&retry=3Dtrue [junit4] 2> 244077 INFO (jetty-launcher-216-thread-2) [ ] o.a.s.u.= UpdateShardHandler Creating UpdateShardHandler HTTP client with params: soc= ketTimeout=3D340000&connTimeout=3D45000&retry=3Dtrue [junit4] 2> 244077 INFO (jetty-launcher-216-thread-6) [ ] o.a.s.s.= SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 244076 INFO (jetty-launcher-216-thread-10) [ ] o.a.s.s= .SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 244078 INFO (jetty-launcher-216-thread-3) [ ] o.a.s.c.= ZkContainer Zookeeper client=3D127.0.0.1:54332/solr [junit4] 2> 244065 INFO (jetty-launcher-216-thread-5) [ ] o.a.s.u.= UpdateShardHandler Creating UpdateShardHandler HTTP client with params: soc= ketTimeout=3D340000&connTimeout=3D45000&retry=3Dtrue [junit4] 2> 244081 INFO (jetty-launcher-216-thread-8) [ ] o.a.s.u.= UpdateShardHandler Creating UpdateShardHandler HTTP client with params: soc= ketTimeout=3D340000&connTimeout=3D45000&retry=3Dtrue [junit4] 2> 244079 INFO (jetty-launcher-216-thread-7) [ ] o.a.s.s.= SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 244078 INFO (jetty-launcher-216-thread-1) [ ] o.a.s.s.= SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 244090 INFO (jetty-launcher-216-thread-9) [ ] o.a.s.c.= ZkContainer Zookeeper client=3D127.0.0.1:54332/solr [junit4] 2> 244091 INFO (jetty-launcher-216-thread-2) [ ] o.a.s.c.= ZkContainer Zookeeper client=3D127.0.0.1:54332/solr [junit4] 2> 244130 INFO (jetty-launcher-216-thread-5) [ ] o.a.s.c.= ZkContainer Zookeeper client=3D127.0.0.1:54332/solr [junit4] 2> 244140 INFO (jetty-launcher-216-thread-10) [ ] o.a.s.u= .UpdateShardHandler Creating UpdateShardHandler HTTP client with params: so= cketTimeout=3D340000&connTimeout=3D45000&retry=3Dtrue [junit4] 2> 244137 INFO (jetty-launcher-216-thread-1) [ ] o.a.s.u.= UpdateShardHandler Creating UpdateShardHandler HTTP client with params: soc= ketTimeout=3D340000&connTimeout=3D45000&retry=3Dtrue [junit4] 2> 244133 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ = ] o.a.z.s.NIOServerCnxn caught end of stream exception [junit4] 2> EndOfStreamException: Unable to read additional data from = client sessionid 0x159176eaddb000b, likely client has closed socket [junit4] 2> =09at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOSe= rverCnxn.java:228) [junit4] 2> =09at org.apache.zookeeper.server.NIOServerCnxnFactory.run= (NIOServerCnxnFactory.java:208) [junit4] 2> =09at java.lang.Thread.run(Thread.java:745) [junit4] 2> 244170 INFO (jetty-launcher-216-thread-1) [ ] o.a.s.c.= ZkContainer Zookeeper client=3D127.0.0.1:54332/solr [junit4] 2> 244170 INFO (jetty-launcher-216-thread-10) [ ] o.a.s.c= .ZkContainer Zookeeper client=3D127.0.0.1:54332/solr [junit4] 2> 244146 INFO (jetty-launcher-216-thread-7) [ ] o.a.s.u.= UpdateShardHandler Creating UpdateShardHandler HTTP client with params: soc= ketTimeout=3D340000&connTimeout=3D45000&retry=3Dtrue [junit4] 2> 244146 INFO (jetty-launcher-216-thread-6) [ ] o.a.s.u.= UpdateShardHandler Creating UpdateShardHandler HTTP client with params: soc= ketTimeout=3D340000&connTimeout=3D45000&retry=3Dtrue [junit4] 2> 244145 INFO (jetty-launcher-216-thread-8) [ ] o.a.s.c.= ZkContainer Zookeeper client=3D127.0.0.1:54332/solr [junit4] 2> 244178 INFO (jetty-launcher-216-thread-6) [ ] o.a.s.c.= ZkContainer Zookeeper client=3D127.0.0.1:54332/solr [junit4] 2> 244179 INFO (jetty-launcher-216-thread-7) [ ] o.a.s.c.= ZkContainer Zookeeper client=3D127.0.0.1:54332/solr [junit4] 2> 244194 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ = ] o.a.z.s.NIOServerCnxn caught end of stream exception [junit4] 2> EndOfStreamException: Unable to read additional data from = client sessionid 0x159176eaddb000c, likely client has closed socket [junit4] 2> =09at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOSe= rverCnxn.java:228) [junit4] 2> =09at org.apache.zookeeper.server.NIOServerCnxnFactory.run= (NIOServerCnxnFactory.java:208) [junit4] 2> =09at java.lang.Thread.run(Thread.java:745) [junit4] 2> 244205 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ = ] o.a.z.s.NIOServerCnxn caught end of stream exception [junit4] 2> EndOfStreamException: Unable to read additional data from = client sessionid 0x159176eaddb0011, likely client has closed socket [junit4] 2> =09at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOSe= rverCnxn.java:228) [junit4] 2> =09at org.apache.zookeeper.server.NIOServerCnxnFactory.run= (NIOServerCnxnFactory.java:208) [junit4] 2> =09at java.lang.Thread.run(Thread.java:745) [junit4] 2> 244291 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ = ] o.a.z.s.NIOServerCnxn caught end of stream exception [junit4] 2> EndOfStreamException: Unable to read additional data from = client sessionid 0x159176eaddb0014, likely client has closed socket [junit4] 2> =09at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOSe= rverCnxn.java:228) [junit4] 2> =09at org.apache.zookeeper.server.NIOServerCnxnFactory.run= (NIOServerCnxnFactory.java:208) [junit4] 2> =09at java.lang.Thread.run(Thread.java:745) [junit4] 2> 244293 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ = ] o.a.z.s.NIOServerCnxn caught end of stream exception [junit4] 2> EndOfStreamException: Unable to read additional data from = client sessionid 0x159176eaddb000f, likely client has closed socket [junit4] 2> =09at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOSe= rverCnxn.java:228) [junit4] 2> =09at org.apache.zookeeper.server.NIOServerCnxnFactory.run= (NIOServerCnxnFactory.java:208) [junit4] 2> =09at java.lang.Thread.run(Thread.java:745) [junit4] 2> 244293 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ = ] o.a.z.s.NIOServerCnxn caught end of stream exception [junit4] 2> EndOfStreamException: Unable to read additional data from = client sessionid 0x159176eaddb0015, likely client has closed socket [junit4] 2> =09at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOSe= rverCnxn.java:228) [junit4] 2> =09at org.apache.zookeeper.server.NIOServerCnxnFactory.run= (NIOServerCnxnFactory.java:208) [junit4] 2> =09at java.lang.Thread.run(Thread.java:745) [junit4] 2> 244293 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ = ] o.a.z.s.NIOServerCnxn caught end of stream exception [junit4] 2> EndOfStreamException: Unable to read additional data from = client sessionid 0x159176eaddb0013, likely client has closed socket [junit4] 2> =09at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOSe= rverCnxn.java:228) [junit4] 2> =09at org.apache.zookeeper.server.NIOServerCnxnFactory.run= (NIOServerCnxnFactory.java:208) [junit4] 2> =09at java.lang.Thread.run(Thread.java:745) [junit4] 2> 244317 INFO (jetty-launcher-216-thread-9) [n:127.0.0.1:52= 424_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 1= 27.0.0.1:52424_solr [junit4] 2> 244319 INFO (jetty-launcher-216-thread-3) [n:127.0.0.1:54= 890_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live= _nodes/127.0.0.1:54890_solr [junit4] 2> 244320 INFO (jetty-launcher-216-thread-4) [n:127.0.0.1:34= 871_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live= _nodes/127.0.0.1:34871_solr [junit4] 2> 244322 INFO (jetty-launcher-216-thread-9) [n:127.0.0.1:52= 424_solr ] o.a.s.c.Overseer Overseer (id=3D97134631095828502-127.0.0.1:5= 2424_solr-n_0000000000) starting [junit4] 2> 244378 INFO (zkCallback-260-thread-1-processing-n:127.0.0= .1:52424_solr) [n:127.0.0.1:52424_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 244378 INFO (zkCallback-259-thread-1-processing-n:127.0.0= .1:54890_solr) [n:127.0.0.1:54890_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 244390 INFO (zkCallback-246-thread-1-processing-n:127.0.0= .1:34871_solr) [n:127.0.0.1:34871_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 244396 INFO (jetty-launcher-216-thread-10) [n:127.0.0.1:3= 9494_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper...= (0) -> (2) [junit4] 2> 244396 INFO (jetty-launcher-216-thread-5) [n:127.0.0.1:56= 843_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... = (0) -> (2) [junit4] 2> 244416 INFO (jetty-launcher-216-thread-10) [n:127.0.0.1:3= 9494_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/liv= e_nodes/127.0.0.1:39494_solr [junit4] 2> 244417 INFO (jetty-launcher-216-thread-5) [n:127.0.0.1:56= 843_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live= _nodes/127.0.0.1:56843_solr [junit4] 2> 244427 INFO (jetty-launcher-216-thread-8) [n:127.0.0.1:41= 690_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... = (0) -> (3) [junit4] 2> 244432 INFO (zkCallback-259-thread-1-processing-n:127.0.0= .1:54890_solr) [n:127.0.0.1:54890_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (2) -> (4) [junit4] 2> 244433 INFO (zkCallback-260-thread-1-processing-n:127.0.0= .1:52424_solr) [n:127.0.0.1:52424_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (2) -> (4) [junit4] 2> 244434 INFO (zkCallback-246-thread-1-processing-n:127.0.0= .1:34871_solr) [n:127.0.0.1:34871_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (2) -> (4) [junit4] 2> 244448 INFO (jetty-launcher-216-thread-4) [n:127.0.0.1:34= 871_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions undern= eath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/check= out/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomic= Updates_E9985D3E8D701DC9-001/tempDir-001/node4/. [junit4] 2> 244453 INFO (zkCallback-263-thread-1-processing-n:127.0.0= .1:56843_solr) [n:127.0.0.1:56843_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (2) -> (4) [junit4] 2> 244453 INFO (zkCallback-262-thread-1-processing-n:127.0.0= .1:39494_solr) [n:127.0.0.1:39494_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (2) -> (4) [junit4] 2> 244462 INFO (jetty-launcher-216-thread-1) [n:127.0.0.1:35= 780_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... = (0) -> (4) [junit4] 2> 244462 INFO (jetty-launcher-216-thread-2) [n:127.0.0.1:40= 894_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... = (0) -> (4) [junit4] 2> 244501 INFO (jetty-launcher-216-thread-9) [n:127.0.0.1:52= 424_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live= _nodes/127.0.0.1:52424_solr [junit4] 2> 244502 INFO (zkCallback-264-thread-1-processing-n:127.0.0= .1:41690_solr) [n:127.0.0.1:41690_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 244507 INFO (zkCallback-259-thread-1-processing-n:127.0.0= .1:54890_solr) [n:127.0.0.1:54890_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (4) -> (5) [junit4] 2> 244507 INFO (zkCallback-262-thread-1-processing-n:127.0.0= .1:39494_solr) [n:127.0.0.1:39494_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (4) -> (5) [junit4] 2> 244507 INFO (zkCallback-263-thread-1-processing-n:127.0.0= .1:56843_solr) [n:127.0.0.1:56843_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (4) -> (5) [junit4] 2> 244508 INFO (zkCallback-269-thread-1-processing-n:127.0.0= .1:40894_solr) [n:127.0.0.1:40894_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (4) -> (5) [junit4] 2> 244514 INFO (zkCallback-246-thread-1-processing-n:127.0.0= .1:34871_solr) [n:127.0.0.1:34871_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (4) -> (5) [junit4] 2> 244515 INFO (zkCallback-265-thread-1-processing-n:127.0.0= .1:35780_solr) [n:127.0.0.1:35780_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (4) -> (5) [junit4] 2> 244515 INFO (zkCallback-260-thread-1-processing-n:127.0.0= .1:52424_solr) [n:127.0.0.1:52424_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (4) -> (5) [junit4] 2> 244517 INFO (zkCallback-264-thread-1-processing-n:127.0.0= .1:41690_solr) [n:127.0.0.1:41690_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (4) -> (5) [junit4] 2> 244525 INFO (jetty-launcher-216-thread-7) [n:127.0.0.1:35= 976_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... = (0) -> (5) [junit4] 2> 244526 INFO (jetty-launcher-216-thread-6) [n:127.0.0.1:49= 979_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... = (0) -> (5) [junit4] 2> 244526 INFO (jetty-launcher-216-thread-8) [n:127.0.0.1:41= 690_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live= _nodes/127.0.0.1:41690_solr [junit4] 2> 244530 INFO (jetty-launcher-216-thread-1) [n:127.0.0.1:35= 780_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live= _nodes/127.0.0.1:35780_solr [junit4] 2> 244534 INFO (zkCallback-262-thread-1-processing-n:127.0.0= .1:39494_solr) [n:127.0.0.1:39494_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (5) -> (6) [junit4] 2> 244534 INFO (zkCallback-246-thread-1-processing-n:127.0.0= .1:34871_solr) [n:127.0.0.1:34871_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (5) -> (6) [junit4] 2> 244534 INFO (zkCallback-259-thread-1-processing-n:127.0.0= .1:54890_solr) [n:127.0.0.1:54890_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (5) -> (6) [junit4] 2> 244534 INFO (zkCallback-263-thread-1-processing-n:127.0.0= .1:56843_solr) [n:127.0.0.1:56843_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (5) -> (6) [junit4] 2> 244535 INFO (zkCallback-265-thread-1-processing-n:127.0.0= .1:35780_solr) [n:127.0.0.1:35780_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (5) -> (6) [junit4] 2> 244535 INFO (zkCallback-264-thread-1-processing-n:127.0.0= .1:41690_solr) [n:127.0.0.1:41690_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (5) -> (6) [junit4] 2> 244537 INFO (zkCallback-269-thread-1-processing-n:127.0.0= .1:40894_solr) [n:127.0.0.1:40894_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (5) -> (6) [junit4] 2> 244541 INFO (jetty-launcher-216-thread-5) [n:127.0.0.1:56= 843_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions undern= eath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/check= out/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomic= Updates_E9985D3E8D701DC9-001/tempDir-001/node5/. [junit4] 2> 244548 INFO (jetty-launcher-216-thread-2) [n:127.0.0.1:40= 894_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live= _nodes/127.0.0.1:40894_solr [junit4] 2> 244549 INFO (zkCallback-263-thread-1-processing-n:127.0.0= .1:56843_solr) [n:127.0.0.1:56843_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (6) -> (7) [junit4] 2> 244549 INFO (zkCallback-259-thread-1-processing-n:127.0.0= .1:54890_solr) [n:127.0.0.1:54890_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (6) -> (7) [junit4] 2> 244549 INFO (zkCallback-246-thread-1-processing-n:127.0.0= .1:34871_solr) [n:127.0.0.1:34871_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (6) -> (7) [junit4] 2> 244549 INFO (zkCallback-262-thread-1-processing-n:127.0.0= .1:39494_solr) [n:127.0.0.1:39494_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (6) -> (7) [junit4] 2> 244549 INFO (zkCallback-269-thread-1-processing-n:127.0.0= .1:40894_solr) [n:127.0.0.1:40894_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (6) -> (7) [junit4] 2> 244550 INFO (zkCallback-265-thread-1-processing-n:127.0.0= .1:35780_solr) [n:127.0.0.1:35780_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (6) -> (7) [junit4] 2> 244550 INFO (zkCallback-264-thread-1-processing-n:127.0.0= .1:41690_solr) [n:127.0.0.1:41690_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (6) -> (7) [junit4] 2> 244559 INFO (zkCallback-259-thread-1-processing-n:127.0.0= .1:54890_solr) [n:127.0.0.1:54890_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (7) -> (8) [junit4] 2> 244560 INFO (zkCallback-265-thread-1-processing-n:127.0.0= .1:35780_solr) [n:127.0.0.1:35780_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (7) -> (8) [junit4] 2> 244560 INFO (zkCallback-269-thread-1-processing-n:127.0.0= .1:40894_solr) [n:127.0.0.1:40894_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (7) -> (8) [junit4] 2> 244560 INFO (zkCallback-263-thread-1-processing-n:127.0.0= .1:56843_solr) [n:127.0.0.1:56843_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (7) -> (8) [junit4] 2> 244560 INFO (zkCallback-264-thread-1-processing-n:127.0.0= .1:41690_solr) [n:127.0.0.1:41690_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (7) -> (8) [junit4] 2> 244561 INFO (zkCallback-262-thread-1-processing-n:127.0.0= .1:39494_solr) [n:127.0.0.1:39494_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (7) -> (8) [junit4] 2> 244561 INFO (zkCallback-246-thread-1-processing-n:127.0.0= .1:34871_solr) [n:127.0.0.1:34871_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (7) -> (8) [junit4] 2> 244570 INFO (jetty-launcher-216-thread-7) [n:127.0.0.1:35= 976_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live= _nodes/127.0.0.1:35976_solr [junit4] 2> 244571 INFO (jetty-launcher-216-thread-6) [n:127.0.0.1:49= 979_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live= _nodes/127.0.0.1:49979_solr [junit4] 2> 244572 INFO (zkCallback-259-thread-1-processing-n:127.0.0= .1:54890_solr) [n:127.0.0.1:54890_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (8) -> (9) [junit4] 2> 244572 INFO (zkCallback-265-thread-1-processing-n:127.0.0= .1:35780_solr) [n:127.0.0.1:35780_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (8) -> (9) [junit4] 2> 244572 INFO (zkCallback-262-thread-1-processing-n:127.0.0= .1:39494_solr) [n:127.0.0.1:39494_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (8) -> (9) [junit4] 2> 244572 INFO (zkCallback-269-thread-1-processing-n:127.0.0= .1:40894_solr) [n:127.0.0.1:40894_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (8) -> (9) [junit4] 2> 244573 INFO (zkCallback-264-thread-1-processing-n:127.0.0= .1:41690_solr) [n:127.0.0.1:41690_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (8) -> (9) [junit4] 2> 244573 INFO (zkCallback-246-thread-1-processing-n:127.0.0= .1:34871_solr) [n:127.0.0.1:34871_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (8) -> (9) [junit4] 2> 244573 INFO (zkCallback-263-thread-1-processing-n:127.0.0= .1:56843_solr) [n:127.0.0.1:56843_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (8) -> (9) [junit4] 2> 244579 INFO (zkCallback-265-thread-1-processing-n:127.0.0= .1:35780_solr) [n:127.0.0.1:35780_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (9) -> (10) [junit4] 2> 244579 INFO (zkCallback-259-thread-1-processing-n:127.0.0= .1:54890_solr) [n:127.0.0.1:54890_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (9) -> (10) [junit4] 2> 244579 INFO (zkCallback-262-thread-1-processing-n:127.0.0= .1:39494_solr) [n:127.0.0.1:39494_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (9) -> (10) [junit4] 2> 244579 INFO (zkCallback-269-thread-1-processing-n:127.0.0= .1:40894_solr) [n:127.0.0.1:40894_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (9) -> (10) [junit4] 2> 244579 INFO (zkCallback-264-thread-1-processing-n:127.0.0= .1:41690_solr) [n:127.0.0.1:41690_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (9) -> (10) [junit4] 2> 244579 INFO (zkCallback-246-thread-1-processing-n:127.0.0= .1:34871_solr) [n:127.0.0.1:34871_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (9) -> (10) [junit4] 2> 244579 INFO (zkCallback-263-thread-1-processing-n:127.0.0= .1:56843_solr) [n:127.0.0.1:56843_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (9) -> (10) [junit4] 2> 244589 INFO (zkCallback-260-thread-2-processing-n:127.0.0= .1:52424_solr) [n:127.0.0.1:52424_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (5) -> (10) [junit4] 2> 244600 INFO (jetty-launcher-216-thread-1) [n:127.0.0.1:35= 780_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions undern= eath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/check= out/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomic= Updates_E9985D3E8D701DC9-001/tempDir-001/node1/. [junit4] 2> 244611 INFO (zkCallback-270-thread-1-processing-n:127.0.0= .1:35976_solr) [n:127.0.0.1:35976_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (5) -> (10) [junit4] 2> 244611 INFO (zkCallback-268-thread-1-processing-n:127.0.0= .1:49979_solr) [n:127.0.0.1:49979_solr ] o.a.s.c.c.ZkStateReader Updated= live nodes from ZooKeeper... (5) -> (10) [junit4] 2> 244626 INFO (jetty-launcher-216-thread-7) [n:127.0.0.1:35= 976_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions undern= eath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/check= out/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomic= Updates_E9985D3E8D701DC9-001/tempDir-001/node7/. [junit4] 2> 244663 INFO (jetty-launcher-216-thread-3) [n:127.0.0.1:54= 890_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions undern= eath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/check= out/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomic= Updates_E9985D3E8D701DC9-001/tempDir-001/node3/. [junit4] 2> 244679 INFO (jetty-launcher-216-thread-10) [n:127.0.0.1:3= 9494_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions under= neath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/chec= kout/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomi= cUpdates_E9985D3E8D701DC9-001/tempDir-001/node10/. [junit4] 2> 244690 INFO (jetty-launcher-216-thread-8) [n:127.0.0.1:41= 690_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions undern= eath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/check= out/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomic= Updates_E9985D3E8D701DC9-001/tempDir-001/node8/. [junit4] 2> 244705 INFO (jetty-launcher-216-thread-2) [n:127.0.0.1:40= 894_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions undern= eath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/check= out/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomic= Updates_E9985D3E8D701DC9-001/tempDir-001/node2/. [junit4] 2> 244715 INFO (jetty-launcher-216-thread-6) [n:127.0.0.1:49= 979_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions undern= eath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/check= out/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomic= Updates_E9985D3E8D701DC9-001/tempDir-001/node6/. [junit4] 2> 244766 INFO (jetty-launcher-216-thread-9) [n:127.0.0.1:52= 424_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions undern= eath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/check= out/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomic= Updates_E9985D3E8D701DC9-001/tempDir-001/node9/. [junit4] 2> 244779 INFO (SUITE-TestStressCloudBlindAtomicUpdates-seed= #[E9985D3E8D701DC9]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nod= es from ZooKeeper... (0) -> (10) [junit4] 2> 244780 INFO (SUITE-TestStressCloudBlindAtomicUpdates-seed= #[E9985D3E8D701DC9]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider= Cluster at 127.0.0.1:54332/solr ready [junit4] 2> 245412 INFO (qtp696216198-3175) [n:127.0.0.1:56843_solr = ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with par= ams replicationFactor=3D2&property.config=3Dsolrconfig-tlog.xml&property.sc= hema=3Dschema-minimal-atomic-stress.xml&collection.configName=3Dorg.apache.= solr.cloud.TestStressCloudBlindAtomicUpdates_config-set&name=3Dtest_col&act= ion=3DCREATE&numShards=3D5&wt=3Djavabin&version=3D2 and sendToOCPQueue=3Dtr= ue [junit4] 2> 245446 INFO (OverseerThreadFactory-584-thread-1-processin= g-n:127.0.0.1:52424_solr) [n:127.0.0.1:52424_solr ] o.a.s.c.CreateCollec= tionCmd Create collection test_col [junit4] 2> 245663 INFO (qtp696216198-3177) [n:127.0.0.1:56843_solr = ] o.a.s.h.a.CoreAdminOperation core create command property.config=3Dsolr= config-tlog.xml&property.schema=3Dschema-minimal-atomic-stress.xml&qt=3D/ad= min/cores&collection.configName=3Dorg.apache.solr.cloud.TestStressCloudBlin= dAtomicUpdates_config-set&newCollection=3Dtrue&name=3Dtest_col_shard3_repli= ca2&action=3DCREATE&numShards=3D5&collection=3Dtest_col&shard=3Dshard3&wt= =3Djavabin&version=3D2 [junit4] 2> 245677 INFO (qtp473603907-3211) [n:127.0.0.1:35780_solr = ] o.a.s.h.a.CoreAdminOperation core create command property.config=3Dsolr= config-tlog.xml&property.schema=3Dschema-minimal-atomic-stress.xml&qt=3D/ad= min/cores&collection.configName=3Dorg.apache.solr.cloud.TestStressCloudBlin= dAtomicUpdates_config-set&newCollection=3Dtrue&name=3Dtest_col_shard3_repli= ca1&action=3DCREATE&numShards=3D5&collection=3Dtest_col&shard=3Dshard3&wt= =3Djavabin&version=3D2 [junit4] 2> 245678 INFO (qtp519066800-3251) [n:127.0.0.1:40894_solr = ] o.a.s.h.a.CoreAdminOperation core create command property.config=3Dsolr= config-tlog.xml&property.schema=3Dschema-minimal-atomic-stress.xml&qt=3D/ad= min/cores&collection.configName=3Dorg.apache.solr.cloud.TestStressCloudBlin= dAtomicUpdates_config-set&newCollection=3Dtrue&name=3Dtest_col_shard5_repli= ca1&action=3DCREATE&numShards=3D5&collection=3Dtest_col&shard=3Dshard5&wt= =3Djavabin&version=3D2 [junit4] 2> 245678 INFO (qtp1078800451-3162) [n:127.0.0.1:49979_solr = ] o.a.s.h.a.CoreAdminOperation core create command property.config=3Dsol= rconfig-tlog.xml&property.schema=3Dschema-minimal-atomic-stress.xml&qt=3D/a= dmin/cores&collection.configName=3Dorg.apache.solr.cloud.TestStressCloudBli= ndAtomicUpdates_config-set&newCollection=3Dtrue&name=3Dtest_col_shard4_repl= ica2&action=3DCREATE&numShards=3D5&collection=3Dtest_col&shard=3Dshard4&wt= =3Djavabin&version=3D2 [junit4] 2> 245678 INFO (qtp1341837230-3185) [n:127.0.0.1:54890_solr = ] o.a.s.h.a.CoreAdminOperation core create command property.config=3Dsol= rconfig-tlog.xml&property.schema=3Dschema-minimal-atomic-stress.xml&qt=3D/a= dmin/cores&collection.configName=3Dorg.apache.solr.cloud.TestStressCloudBli= ndAtomicUpdates_config-set&newCollection=3Dtrue&name=3Dtest_col_shard2_repl= ica2&action=3DCREATE&numShards=3D5&collection=3Dtest_col&shard=3Dshard2&wt= =3Djavabin&version=3D2 [junit4] 2> 245678 INFO (qtp1402353960-3200) [n:127.0.0.1:52424_solr = ] o.a.s.h.a.CoreAdminOperation core create command property.config=3Dsol= rconfig-tlog.xml&property.schema=3Dschema-minimal-atomic-stress.xml&qt=3D/a= dmin/cores&collection.configName=3Dorg.apache.solr.cloud.TestStressCloudBli= ndAtomicUpdates_config-set&newCollection=3Dtrue&name=3Dtest_col_shard1_repl= ica2&action=3DCREATE&numShards=3D5&collection=3Dtest_col&shard=3Dshard1&wt= =3Djavabin&version=3D2 [junit4] 2> 245679 INFO (qtp1725646367-3235) [n:127.0.0.1:39494_solr = ] o.a.s.h.a.CoreAdminOperation core create command property.config=3Dsol= rconfig-tlog.xml&property.schema=3Dschema-minimal-atomic-stress.xml&qt=3D/a= dmin/cores&collection.configName=3Dorg.apache.solr.cloud.TestStressCloudBli= ndAtomicUpdates_config-set&newCollection=3Dtrue&name=3Dtest_col_shard4_repl= ica1&action=3DCREATE&numShards=3D5&collection=3Dtest_col&shard=3Dshard4&wt= =3Djavabin&version=3D2 [junit4] 2> 245679 INFO (qtp2059527498-3167) [n:127.0.0.1:34871_solr = ] o.a.s.h.a.CoreAdminOperation core create command property.config=3Dsol= rconfig-tlog.xml&property.schema=3Dschema-minimal-atomic-stress.xml&qt=3D/a= dmin/cores&collection.configName=3Dorg.apache.solr.cloud.TestStressCloudBli= ndAtomicUpdates_config-set&newCollection=3Dtrue&name=3Dtest_col_shard5_repl= ica2&action=3DCREATE&numShards=3D5&collection=3Dtest_col&shard=3Dshard5&wt= =3Djavabin&version=3D2 [junit4] 2> 245679 INFO (qtp441492096-3150) [n:127.0.0.1:41690_solr = ] o.a.s.h.a.CoreAdminOperation core create command property.config=3Dsolr= config-tlog.xml&property.schema=3Dschema-minimal-atomic-stress.xml&qt=3D/ad= min/cores&collection.configName=3Dorg.apache.solr.cloud.TestStressCloudBlin= dAtomicUpdates_config-set&newCollection=3Dtrue&name=3Dtest_col_shard1_repli= ca1&action=3DCREATE&numShards=3D5&collection=3Dtest_col&shard=3Dshard1&wt= =3Djavabin&version=3D2 [junit4] 2> 245680 INFO (qtp386454879-3214) [n:127.0.0.1:35976_solr = ] o.a.s.h.a.CoreAdminOperation core create command property.config=3Dsolr= config-tlog.xml&property.schema=3Dschema-minimal-atomic-stress.xml&qt=3D/ad= min/cores&collection.configName=3Dorg.apache.solr.cloud.TestStressCloudBlin= dAtomicUpdates_config-set&newCollection=3Dtrue&name=3Dtest_col_shard2_repli= ca1&action=3DCREATE&numShards=3D5&collection=3Dtest_col&shard=3Dshard2&wt= =3Djavabin&version=3D2 [junit4] 2> 245909 INFO (zkCallback-265-thread-1-processing-n:127.0.0= .1:35780_solr) [n:127.0.0.1:35780_solr ] o.a.s.c.c.ZkStateReader A clust= er state change: [WatchedEvent state:SyncConnected type:NodeDataChanged pat= h:/collections/test_col/state.json] for collection [test_col] has occurred = - updating... (live nodes size: [10]) [junit4] 2> 245909 INFO (zkCallback-263-thread-1-processing-n:127.0.0= .1:56843_solr) [n:127.0.0.1:56843_solr ] o.a.s.c.c.ZkStateReader A clust= er state change: [WatchedEvent state:SyncConnected type:NodeDataChanged pat= h:/collections/test_col/state.json] for collection [test_col] has occurred = - updating... (live nodes size: [10]) [junit4] 2> 245910 INFO (zkCallback-259-thread-1-processing-n:127.0.0= .1:54890_solr) [n:127.0.0.1:54890_solr ] o.a.s.c.c.ZkStateReader A clust= er state change: [WatchedEvent state:SyncConnected type:NodeDataChanged pat= h:/collections/test_col/state.json] for collection [test_col] has occurred = - updating... (live nodes size: [10]) [junit4] 2> 245910 INFO (zkCallback-268-thread-1-processing-n:127.0.0= .1:49979_solr) [n:127.0.0.1:49979_solr ] o.a.s.c.c.ZkStateReader A clust= er state change: [WatchedEvent state:SyncConnected type:NodeDataChanged pat= h:/collections/test_col/state.json] for collection [test_col] has occurred = - updating... (live nodes size: [10]) [junit4] 2> 245911 INFO (zkCallback-264-thread-1-processing-n:127.0.0= .1:41690_solr) [n:127.0.0.1:41690_solr ] o.a.s.c.c.ZkStateReader A clust= er state change: [WatchedEvent state:SyncConnected type:NodeDataChanged pat= h:/collections/test_col/state.json] for collection [test_col] has occurred = - updating... (live nodes size: [10]) [junit4] 2> 245911 INFO (zkCallback-262-thread-1-processing-n:127.0.0= .1:39494_solr) [n:127.0.0.1:39494_solr ] o.a.s.c.c.ZkStateReader A clust= er state change: [WatchedEvent state:SyncConnected type:NodeDataChanged pat= h:/collections/test_col/state.json] for collection [test_col] has occurred = - updating... (live nodes size: [10]) [junit4] 2> 245911 INFO (zkCallback-269-thread-1-processing-n:127.0.0= .1:40894_solr) [n:127.0.0.1:40894_solr ] o.a.s.c.c.ZkStateReader A clust= er state change: [WatchedEvent state:SyncConnected type:NodeDataChanged pat= h:/collections/test_col/state.json] for collection [test_col] has occurred = - updating... (live nodes size: [10]) [junit4] 2> 245911 INFO (zkCallback-246-thread-1-processing-n:127.0.0= .1:34871_solr) [n:127.0.0.1:34871_solr ] o.a.s.c.c.ZkStateReader A clust= er state change: [WatchedEvent state:SyncConnected type:NodeDataChanged pat= h:/collections/test_col/state.json] for collection [test_col] has occurred = - updating... (live nodes size: [10]) [junit4] 2> 245911 INFO (zkCallback-270-thread-2-processing-n:127.0.0= .1:35976_solr) [n:127.0.0.1:35976_solr ] o.a.s.c.c.ZkStateReader A clust= er state change: [WatchedEvent state:SyncConnected type:NodeDataChanged pat= h:/collections/test_col/state.json] for collection [test_col] has occurred = - updating... (live nodes size: [10]) [junit4] 2> 245915 INFO (zkCallback-260-thread-4-processing-n:127.0.0= .1:52424_solr) [n:127.0.0.1:52424_solr ] o.a.s.c.c.ZkStateReader A clust= er state change: [WatchedEvent state:SyncConnected type:NodeDataChanged pat= h:/collections/test_col/state.json] for collection [test_col] has occurred = - updating... (live nodes size: [10]) [junit4] 2> 246694 WARN (qtp696216198-3177) [n:127.0.0.1:56843_solr c= :test_col s:shard3 x:test_col_shard3_replica2] o.a.s.c.Config Beginning wi= th Solr 5.5, is deprecated, use instead. [junit4] 2> 246702 INFO (qtp696216198-3177) [n:127.0.0.1:56843_solr c= :test_col s:shard3 x:test_col_shard3_replica2] o.a.s.c.SolrConfig Using Lu= cene MatchVersion: 6.4.0 [junit4] 2> 246726 WARN (qtp386454879-3214) [n:127.0.0.1:35976_solr c= :test_col s:shard2 x:test_col_shard2_replica1] o.a.s.c.Config Beginning wi= th Solr 5.5, is deprecated, use instead. [junit4] 2> 246749 INFO (qtp386454879-3214) [n:127.0.0.1:35976_solr c= :test_col s:shard2 x:test_col_shard2_replica1] o.a.s.c.SolrConfig Using Lu= cene MatchVersion: 6.4.0 [junit4] 2> 246748 INFO (qtp696216198-3177) [n:127.0.0.1:56843_solr c= :test_col s:shard3 x:test_col_shard3_replica2] o.a.s.s.IndexSchema [test_c= ol_shard3_replica2] Schema name=3Dminimal-atomic-stress [junit4] 2> 246737 WARN (qtp1402353960-3200) [n:127.0.0.1:52424_solr = c:test_col s:shard1 x:test_col_shard1_replica2] o.a.s.c.Config Beginning w= ith Solr 5.5, is deprecated, use instead= . [junit4] 2> 246757 INFO (qtp1402353960-3200) [n:127.0.0.1:52424_solr = c:test_col s:shard1 x:test_col_shard1_replica2] o.a.s.c.SolrConfig Using L= ucene MatchVersion: 6.4.0 [junit4] 2> 246758 INFO (qtp696216198-3177) [n:127.0.0.1:56843_solr c= :test_col s:shard3 x:test_col_shard3_replica2] o.a.s.s.IndexSchema Loaded = schema minimal-atomic-stress/1.6 with uniqueid field id [junit4] 2> 246803 INFO (qtp696216198-3177) [n:127.0.0.1:56843_solr c= :test_col s:shard3 x:test_col_shard3_replica2] o.a.s.c.CoreContainer Creat= ing SolrCore 'test_col_shard3_replica2' using configuration from collection= test_col [junit4] 2> 246803 INFO (qtp696216198-3177) [n:127.0.0.1:56843_solr c= :test_col s:shard3 x:test_col_shard3_replica2] o.a.s.c.SolrCore [[test_col= _shard3_replica2] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/work= space/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/te= mp/solr.cloud.TestStressCloudBlindAtomicUpdates_E9985D3E8D701DC9-001/tempDi= r-001/node5/test_col_shard3_replica2], dataDir=3D[/x1/jenkins/jenkins-slave= /workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/= J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_E9985D3E8D701DC9-001/t= empDir-001/node5/./test_col_shard3_replica2/data/] [junit4] 2> 246805 WARN (qtp441492096-3150) [n:127.0.0.1:41690_solr c= :test_col s:shard1 x:test_col_shard1_replica1] o.a.s.c.Config Beginning wi= th Solr 5.5, is deprecated, use instead. [junit4] 2> 246806 INFO (qtp441492096-3150) [n:127.0.0.1:41690_solr c= :test_col s:shard1 x:test_col_shard1_replica1] o.a.s.c.SolrConfig Using Lu= cene MatchVersion: 6.4.0 [junit4] 2> 246812 WARN (qtp473603907-3211) [n:127.0.0.1:35780_solr c= :test_col s:shard3 x:test_col_shard3_replica1] o.a.s.c.Config Beginning wi= th Solr 5.5, is deprecated, use instead. [junit4] 2> 246816 INFO (qtp386454879-3214) [n:127.0.0.1:35976_solr c= :test_col s:shard2 x:test_col_shard2_replica1] o.a.s.s.IndexSchema [test_c= ol_shard2_replica1] Schema name=3Dminimal-atomic-stress [junit4] 2> 246818 INFO (qtp386454879-3214) [n:127.0.0.1:35976_solr c= :test_col s:shard2 x:test_col_shard2_replica1] o.a.s.s.IndexSchema Loaded = schema minimal-atomic-stress/1.6 with uniqueid field id [junit4] 2> 246831 INFO (qtp473603907-3211) [n:127.0.0.1:35780_solr c= :test_col s:shard3 x:test_col_shard3_replica1] o.a.s.c.SolrConfig Using Lu= cene MatchVersion: 6.4.0 [junit4] 2> 246843 INFO (qtp1402353960-3200) [n:127.0.0.1:52424_solr = c:test_col s:shard1 x:test_col_shard1_replica2] o.a.s.s.IndexSchema [test_= col_shard1_replica2] Schema name=3Dminimal-atomic-stress [junit4] 2> 246846 INFO (qtp1402353960-3200) [n:127.0.0.1:52424_solr = c:test_col s:shard1 x:test_col_shard1_replica2] o.a.s.s.IndexSchema Loaded= schema minimal-atomic-stress/1.6 with uniqueid field id [junit4] 2> 246855 INFO (qtp441492096-3150) [n:127.0.0.1:41690_solr c= :test_col s:shard1 x:test_col_shard1_replica1] o.a.s.s.IndexSchema [test_c= ol_shard1_replica1] Schema name=3Dminimal-atomic-stress [junit4] 2> 246855 INFO (qtp473603907-3211) [n:127.0.0.1:35780_solr c= :test_col s:shard3 x:test_col_shard3_replica1] o.a.s.s.IndexSchema [test_c= ol_shard3_replica1] Schema name=3Dminimal-atomic-stress [junit4] 2> 246857 INFO (qtp441492096-3150) [n:127.0.0.1:41690_solr c= :test_col s:shard1 x:test_col_shard1_replica1] o.a.s.s.IndexSchema Loaded = schema minimal-atomic-stress/1.6 with uniqueid field id [junit4] 2> 246858 INFO (qtp696216198-3177) [n:127.0.0.1:56843_solr c= :test_col s:shard3 x:test_col_shard3_replica2] o.a.s.c.JmxMonitoredMap JMX= monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbean= server.JmxMBeanServer@75fb326c [junit4] 2> 246858 INFO (qtp1402353960-3200) [n:127.0.0.1:52424_solr = c:test_col s:shard1 x:test_col_shard1_replica2] o.a.s.c.CoreContainer Crea= ting SolrCore 'test_col_shard1_replica2' using configuration from collectio= n test_col [junit4] 2> 246859 INFO (qtp441492096-3150) [n:127.0.0.1:41690_solr c= :test_col s:shard1 x:test_col_shard1_replica1] o.a.s.c.CoreContainer Creat= ing SolrCore 'test_col_shard1_replica1' using configuration from collection= test_col [junit4] 2> 246859 INFO (qtp1402353960-3200) [n:127.0.0.1:52424_solr = c:test_col s:shard1 x:test_col_shard1_replica2] o.a.s.c.SolrCore [[test_co= l_shard1_replica2] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/wor= kspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/t= emp/solr.cloud.TestStressCloudBlindAtomicUpdates_E9985D3E8D701DC9-001/tempD= ir-001/node9/test_col_shard1_replica2], dataDir=3D[/x1/jenkins/jenkins-slav= e/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test= /J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_E9985D3E8D701DC9-001/= tempDir-001/node9/./test_col_shard1_replica2/data/] [junit4] 2> 246859 INFO (qtp1402353960-3200) [n:127.0.0.1:52424_solr = c:test_col s:shard1 x:test_col_shard1_replica2] o.a.s.c.JmxMonitoredMap JM= X monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbea= nserver.JmxMBeanServer@75fb326c [junit4] 2> 246861 INFO (qtp441492096-3150) [n:127.0.0.1:41690_solr c= :test_col s:shard1 x:test_col_shard1_replica1] o.a.s.c.SolrCore [[test_col= _shard1_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/work= space/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/te= mp/solr.cloud.TestStressCloudBlindAtomicUpdates_E9985D3E8D701DC9-001/tempDi= r-001/node8/test_col_shard1_replica1], dataDir=3D[/x1/jenkins/jenkins-slave= /workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/= J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_E9985D3E8D701DC9-001/t= empDir-001/node8/./test_col_shard1_replica1/data/] [junit4] 2> 246868 INFO (qtp473603907-3211) [n:127.0.0.1:35780_solr c= :test_col s:shard3 x:test_col_shard3_replica1] o.a.s.s.IndexSchema Loaded = schema minimal-atomic-stress/1.6 with uniqueid field id [junit4] 2> 246868 INFO (qtp386454879-3214) [n:127.0.0.1:35976_solr c= :test_col s:shard2 x:test_col_shard2_replica1] o.a.s.c.CoreContainer Creat= ing SolrCore 'test_col_shard2_replica1' using configuration from collection= test_col [junit4] 2> 246872 WARN (qtp519066800-3251) [n:127.0.0.1:40894_solr c= :test_col s:shard5 x:test_col_shard5_replica1] o.a.s.c.Config Beginning wi= th Solr 5.5, is deprecated, use instead. [junit4] 2> 246872 INFO (qtp519066800-3251) [n:127.0.0.1:40894_solr c= :test_col s:shard5 x:test_col_shard5_replica1] o.a.s.c.SolrConfig Using Lu= cene MatchVersion: 6.4.0 [junit4] 2> 246876 WARN (qtp2059527498-3167) [n:127.0.0.1:34871_solr = c:test_col s:shard5 x:test_col_shard5_replica2] o.a.s.c.Config Beginning w= ith Solr 5.5, is deprecated, use instead= . [junit4] 2> 246884 INFO (qtp2059527498-3167) [n:127.0.0.1:34871_solr = c:test_col s:shard5 x:test_col_shard5_replica2] o.a.s.c.SolrConfig Using L= ucene MatchVersion: 6.4.0 [junit4] 2> 246881 WARN (qtp1341837230-3185) [n:127.0.0.1:54890_solr = c:test_col s:shard2 x:test_col_shard2_replica2] o.a.s.c.Config Beginning w= ith Solr 5.5, is deprecated, use instead= . [junit4] 2> 246905 INFO (qtp1341837230-3185) [n:127.0.0.1:54890_solr = c:test_col s:shard2 x:test_col_shard2_replica2] o.a.s.c.SolrConfig Using L= ucene MatchVersion: 6.4.0 [junit4] 2> 246881 INFO (qtp473603907-3211) [n:127.0.0.1:35780_solr c= :test_col s:shard3 x:test_col_shard3_replica1] o.a.s.c.CoreContainer Creat= ing SolrCore 'test_col_shard3_replica1' using configuration from collection= test_col [junit4] 2> 246901 WARN (qtp1078800451-3162) [n:127.0.0.1:49979_solr = c:test_col s:shard4 x:test_col_shard4_replica2] o.a.s.c.Config Beginning w= ith Solr 5.5, is deprecated, use instead= . [junit4] 2> 246909 INFO (qtp386454879-3214) [n:127.0.0.1:35976_solr c= :test_col s:shard2 x:test_col_shard2_replica1] o.a.s.c.SolrCore [[test_col= _shard2_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/work= space/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/te= mp/solr.cloud.TestStressCloudBlindAtomicUpdates_E9985D3E8D701DC9-001/tempDi= r-001/node7/test_col_shard2_replica1], dataDir=3D[/x1/jenkins/jenkins-slave= /workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/= J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_E9985D3E8D701DC9-001/t= empDir-001/node7/./test_col_shard2_replica1/data/] [junit4] 2> 246909 INFO (qtp386454879-3214) [n:127.0.0.1:35976_solr c= :test_col s:shard2 x:test_col_shard2_replica1] o.a.s.c.JmxMonitoredMap JMX= monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbean= server.JmxMBeanServer@75fb326c [junit4] 2> 246910 INFO (qtp1078800451-3162) [n:127.0.0.1:49979_solr = c:test_col s:shard4 x:test_col_shard4_replica2] o.a.s.c.SolrConfig Using L= ucene MatchVersion: 6.4.0 [junit4] 2> 246912 INFO (qtp441492096-3150) [n:127.0.0.1:41690_solr c= :test_col s:shard1 x:test_col_shard1_replica1] o.a.s.c.JmxMonitoredMap JMX= monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbean= server.JmxMBeanServer@75fb326c [junit4] 2> 246913 INFO (qtp473603907-3211) [n:127.0.0.1:35780_solr c= :test_col s:shard3 x:test_col_shard3_replica1] o.a.s.c.SolrCore [[test_col= _shard3_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/work= space/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/te= mp/solr.cloud.TestStressCloudBlindAtomicUpdates_E9985D3E8D701DC9-001/tempDi= r-001/node1/test_col_shard3_replica1], dataDir=3D[/x1/jenkins/jenkins-slave= /workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/= J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_E9985D3E8D701DC9-001/t= empDir-001/node1/./test_col_shard3_replica1/data/] [junit4] 2> 246913 INFO (qtp473603907-3211) [n:127.0.0.1:35780_solr c= :test_col s:shard3 x:test_col_shard3_replica1] o.a.s.c.JmxMonitoredMap JMX= monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbean= server.JmxMBeanServer@75fb326c [junit4] 2> 246915 INFO (qtp386454879-3214) [n:127.0.0.1:35976_solr c= :test_col s:shard2 x:test_col_shard2_replica1] o.a.s.u.RandomMergePolicy R= andomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePoli= cy: org.apache.lucene.index.MockRandomMergePolicy@2a5ea508 [junit4] 2> 246917 INFO (qtp696216198-3177) [n:127.0.0.1:56843_solr c= :test_col s:shard3 x:test_col_shard3_replica2] o.a.s.u.RandomMergePolicy R= andomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePoli= cy: org.apache.lucene.index.MockRandomMergePolicy@55fea21 [junit4] 2> 246918 WARN (qtp1725646367-3235) [n:127.0.0.1:39494_solr = c:test_col s:shard4 x:test_col_shard4_replica1] o.a.s.c.Config Beginning w= ith Solr 5.5, is deprecated, use instead= . [junit4] 2> 246919 INFO (qtp1725646367-3235) [n:127.0.0.1:39494_solr = c:test_col s:shard4 x:test_col_shard4_replica1] o.a.s.c.SolrConfig Using L= ucene MatchVersion: 6.4.0 [junit4] 2> 246921 INFO (qtp1402353960-3200) [n:127.0.0.1:52424_solr = c:test_col s:shard1 x:test_col_shard1_replica2] o.a.s.u.RandomMergePolicy = RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePol= icy: org.apache.lucene.index.MockRandomMergePolicy@6b9fc06b [junit4] 2> 246921 INFO (qtp441492096-3150) [n:127.0.0.1:41690_solr c= :test_col s:shard1 x:test_col_shard1_replica1] o.a.s.u.RandomMergePolicy R= andomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePoli= cy: org.apache.lucene.index.MockRandomMergePolicy@21a162bf [junit4] 2> 246923 INFO (qtp473603907-3211) [n:127.0.0.1:35780_solr c= :test_col s:shard3 x:test_col_shard3_replica1] o.a.s.u.RandomMergePolicy R= andomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePoli= cy: org.apache.lucene.index.MockRandomMergePolicy@1d8ae9d [junit4] 2> 246943 INFO (qtp1725646367-3235) [n:127.0.0.1:39494_solr = c:test_col s:shard4 x:test_col_shard4_replica1] o.a.s.s.IndexSchema [test_= col_shard4_replica1] Schema name=3Dminimal-atomic-stress [junit4] 2> 246945 INFO (qtp1725646367-3235) [n:127.0.0.1:39494_solr = c:test_col s:shard4 x:test_col_shard4_replica1] o.a.s.s.IndexSchema Loaded= schema minimal-atomic-stress/1.6 with uniqueid field id [junit4] 2> 246947 INFO (qtp1725646367-3235) [n:127.0.0.1:39494_solr = c:test_col s:shard4 x:test_col_shard4_replica1] o.a.s.c.CoreContainer Crea= ting SolrCore 'test_col_shard4_replica1' using configuration from collectio= n test_col [junit4] 2> 246948 INFO (qtp1725646367-3235) [n:127.0.0.1:39494_solr = c:test_col s:shard4 x:test_col_shard4_replica1] o.a.s.c.SolrCore [[test_co= l_shard4_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/wor= kspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/t= emp/solr.cloud.TestStressCloudBlindAtomicUpdates_E9985D3E8D701DC9-001/tempD= ir-001/node10/test_col_shard4_replica1], dataDir=3D[/x1/jenkins/jenkins-sla= ve/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/tes= t/J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_E9985D3E8D701DC9-001= /tempDir-001/node10/./test_col_shard4_replica1/data/] [junit4] 2> 246948 INFO (qtp1725646367-3235) [n:127.0.0.1:39494_solr = c:test_col s:shard4 x:test_col_shard4_replica1] o.a.s.c.JmxMonitoredMap JM= X monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbea= nserver.JmxMBeanServer@75fb326c [junit4] 2> 246953 INFO (qtp1078800451-3162) [n:127.0.0.1:49979_solr = c:test_col s:shard4 x:test_col_shard4_replica2] o.a.s.s.IndexSchema [test_= col_shard4_replica2] Schema name=3Dminimal-atomic-stress [junit4] 2> 246957 WARN (qtp386454879-3214) [n:127.0.0.1:35976_solr c= :test_col s:shard2 x:test_col_shard2_replica1] o.a.s.c.RequestHandlers INV= ALID paramSet a in requestHandler {type =3D requestHandler,name =3D /dump,c= lass =3D DumpRequestHandler,args =3D {defaults=3D{a=3DA,b=3DB}}} [junit4] 2> 246957 INFO (qtp1725646367-3235) [n:127.0.0.1:39494_solr = c:test_col s:shard4 x:test_col_shard4_replica1] o.a.s.u.RandomMergePolicy = RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePol= icy: org.apache.lucene.index.Mock [...truncated too long message...] Fa) [n:127.0.0.1:52981_rf_%2Fa ] o.a.s.h.CdcrLeaderStateManager Received= new leader state @ target_collection:shard1 [junit4] 2> 3059177 INFO (zkCallback-2896-thread-1-processing-n:127.0= .0.1:52981_rf_%2Fa) [n:127.0.0.1:52981_rf_%2Fa c:target_collection s:shard1= r:core_node2 x:target_collection_shard1_replica1] o.a.s.c.ShardLeaderElect= ionContext I am the new leader: http://127.0.0.1:52981/rf_/a/target_collect= ion_shard1_replica1/ shard1 [junit4] 2> 3059257 WARN (zkCallback-2978-thread-3-processing-n:127.0= .0.1:37476_rf_%2Fa) [n:127.0.0.1:37476_rf_%2Fa c:target_collection s:shard2= r:core_node1 x:target_collection_shard2_replica2] o.a.s.c.SyncStrategy Clo= sed, skipping sync up. [junit4] 2> 3059257 INFO (zkCallback-2978-thread-3-processing-n:127.0= .0.1:37476_rf_%2Fa) [n:127.0.0.1:37476_rf_%2Fa c:target_collection s:shard2= r:core_node1 x:target_collection_shard2_replica2] o.a.s.c.ShardLeaderElect= ionContext We failed sync, but we have no versions - we can't sync in that = case - we were active before, so become leader anyway [junit4] 2> 3059257 INFO (zkCallback-2978-thread-3-processing-n:127.0= .0.1:37476_rf_%2Fa) [n:127.0.0.1:37476_rf_%2Fa c:target_collection s:shard2= r:core_node1 x:target_collection_shard2_replica2] o.a.s.c.SolrCore [target= _collection_shard2_replica2] CLOSING SolrCore org.apache.solr.core.SolrCor= e@52ef6f9e [junit4] 2> 3059257 INFO (zkCallback-2978-thread-3-processing-n:127.0= .0.1:37476_rf_%2Fa) [n:127.0.0.1:37476_rf_%2Fa c:target_collection s:shard2= r:core_node1 x:target_collection_shard2_replica2] o.a.s.h.CdcrRequestHandl= er Solr core is being closed - shutting down CDCR handler @ target_collecti= on:shard2 [junit4] 2> 3059280 INFO (zkCallback-2896-thread-1-processing-n:127.0= .0.1:52981_rf_%2Fa) [n:127.0.0.1:52981_rf_%2Fa ] o.a.s.c.c.ZkStateReader= A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataCha= nged path:/collections/target_collection/state.json] for collection [target= _collection] has occurred - updating... (live nodes size: [1]) [junit4] 2> 3059740 WARN (zkCallback-2978-thread-1-processing-n:127.0= .0.1:37476_rf_%2Fa) [n:127.0.0.1:37476_rf_%2Fa ] o.a.s.c.c.ZkStateReader= ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = =3D Session expired for /live_nodes] [junit4] 2> 3059741 INFO (TEST-CdcrReplicationDistributedZkTest.testD= eleteCreateSourceCollection-seed#[E9985D3E8D701DC9]) [ ] o.e.j.s.Abstrac= tConnector Stopped ServerConnector@7b1bbfe6{HTTP/1.1,[http/1.1]}{127.0.0.1:= 37476} [junit4] 2> 3059742 INFO (TEST-CdcrReplicationDistributedZkTest.testD= eleteCreateSourceCollection-seed#[E9985D3E8D701DC9]) [ ] o.e.j.s.h.Conte= xtHandler Stopped o.e.j.s.ServletContextHandler@535fb558{/rf_/a,null,UNAVAI= LABLE} [junit4] 2> 3059742 INFO (TEST-CdcrReplicationDistributedZkTest.testD= eleteCreateSourceCollection-seed#[E9985D3E8D701DC9]) [ ] o.a.s.c.ChaosMo= nkey monkey: stop shard! 52981 [junit4] 2> 3059742 INFO (TEST-CdcrReplicationDistributedZkTest.testD= eleteCreateSourceCollection-seed#[E9985D3E8D701DC9]) [ ] o.a.s.c.CoreCon= tainer Shutting down CoreContainer instance=3D1448082072 [junit4] 2> 3059744 INFO (coreCloseExecutor-4279-thread-1) [n:127.0.0= .1:52981_rf_%2Fa c:target_collection s:shard1 r:core_node2 x:target_collect= ion_shard1_replica1] o.a.s.c.SolrCore [target_collection_shard1_replica1] = CLOSING SolrCore org.apache.solr.core.SolrCore@49cf4d9 [junit4] 2> 3059744 INFO (coreCloseExecutor-4279-thread-1) [n:127.0.0= .1:52981_rf_%2Fa c:target_collection s:shard1 r:core_node2 x:target_collect= ion_shard1_replica1] o.a.s.h.CdcrRequestHandler Solr core is being closed -= shutting down CDCR handler @ target_collection:shard1 [junit4] 2> 3059755 INFO (TEST-CdcrReplicationDistributedZkTest.testD= eleteCreateSourceCollection-seed#[E9985D3E8D701DC9]) [ ] o.a.s.c.Oversee= r Overseer (id=3D97134810575339552-127.0.0.1:52981_rf_%2Fa-n_0000000007) cl= osing [junit4] 2> 3059755 INFO (OverseerStateUpdate-97134810575339552-127.0= .0.1:52981_rf_%2Fa-n_0000000007) [n:127.0.0.1:52981_rf_%2Fa ] o.a.s.c.Ov= erseer Overseer Loop exiting : 127.0.0.1:52981_rf_%2Fa [junit4] 2> 3061257 WARN (zkCallback-2896-thread-3-processing-n:127.0= .0.1:52981_rf_%2Fa) [n:127.0.0.1:52981_rf_%2Fa ] o.a.s.c.c.ZkStateReader= ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = =3D Session expired for /live_nodes] [junit4] 2> 3061258 INFO (TEST-CdcrReplicationDistributedZkTest.testD= eleteCreateSourceCollection-seed#[E9985D3E8D701DC9]) [ ] o.e.j.s.Abstrac= tConnector Stopped ServerConnector@403daa25{HTTP/1.1,[http/1.1]}{127.0.0.1:= 0} [junit4] 2> 3061258 INFO (TEST-CdcrReplicationDistributedZkTest.testD= eleteCreateSourceCollection-seed#[E9985D3E8D701DC9]) [ ] o.e.j.s.h.Conte= xtHandler Stopped o.e.j.s.ServletContextHandler@2f0528f2{/rf_/a,null,UNAVAI= LABLE} [junit4] 2> 3061259 INFO (TEST-CdcrReplicationDistributedZkTest.testD= eleteCreateSourceCollection-seed#[E9985D3E8D701DC9]) [ ] o.a.s.SolrTestC= aseJ4 ###Ending testDeleteCreateSourceCollection [junit4] 2> 3061260 INFO (TEST-CdcrReplicationDistributedZkTest.testD= eleteCreateSourceCollection-seed#[E9985D3E8D701DC9]) [ ] o.a.s.c.ZkTestS= erver connecting to 127.0.0.1:40929 40929 [junit4] 2> 3061375 INFO (Thread-157004) [ ] o.a.s.c.ZkTestServer = connecting to 127.0.0.1:40929 40929 [junit4] 2> 3061376 WARN (Thread-157004) [ ] o.a.s.c.ZkTestServer = Watch limit violations:=20 [junit4] 2> Maximum concurrent create/delete watches above limit: [junit4] 2>=20 [junit4] 2> =0948=09/solr/clusterprops.json [junit4] 2> =0948=09/solr/aliases.json [junit4] 2> =0926=09/solr/configs/conf1 [junit4] 2> =0910=09/solr/security.json [junit4] 2> =098=09/solr/collections/tmp_collection/state.json [junit4] 2> =093=09/solr/collections/source_collection/leaders/shard1/= leader [junit4] 2> =093=09/solr/collections/target_collection/leaders/shard1/= leader [junit4] 2> =092=09/solr/collections/source_collection/leaders/shard2/= leader [junit4] 2> =092=09/solr/collections/tmp_collection/leaders/shard2/lea= der [junit4] 2> =092=09/solr/collections/target_collection/leaders/shard2/= leader [junit4] 2> =092=09/solr/collections/tmp_collection/leaders/shard1/lea= der [junit4] 2>=20 [junit4] 2> Maximum concurrent data watches above limit: [junit4] 2>=20 [junit4] 2> =0948=09/solr/clusterstate.json [junit4] 2> =0910=09/solr/collections/target_collection/cdcr/state/buf= fer [junit4] 2> =0910=09/solr/collections/source_collection/cdcr/state/buf= fer [junit4] 2> =0910=09/solr/collections/source_collection/cdcr/state/pro= cess [junit4] 2> =0910=09/solr/collections/target_collection/cdcr/state/pro= cess [junit4] 2> =099=09/solr/collections/source_collection/state.json [junit4] 2> =099=09/solr/collections/target_collection/state.json [junit4] 2> =098=09/solr/collections/tmp_collection/cdcr/state/process [junit4] 2> =098=09/solr/collections/tmp_collection/cdcr/state/buffer [junit4] 2> =092=09/solr/overseer_elect/election/97134810575339546-127= .0.0.1:40536_rf_%2Fa-n_0000000005 [junit4] 2> =092=09/solr/overseer_elect/election/97134810575339552-127= .0.0.1:52981_rf_%2Fa-n_0000000007 [junit4] 2> =092=09/solr/overseer_elect/election/97134810575339530-127= .0.0.1:38797_rf_%2Fa-n_0000000002 [junit4] 2>=20 [junit4] 2> Maximum concurrent children watches above limit: [junit4] 2>=20 [junit4] 2> =09102=09/solr/overseer/queue [junit4] 2> =0965=09/solr/overseer/collection-queue-work [junit4] 2> =0948=09/solr/collections [junit4] 2> =0946=09/solr/live_nodes [junit4] 2> =0926=09/solr/overseer/queue-work [junit4] 2>=20 [junit4] 2> 3061576 INFO (SUITE-CdcrReplicationDistributedZkTest-seed= #[E9985D3E8D701DC9]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore [junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenk= ins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-c= ore/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_E9985D3E8D701D= C9-001 [junit4] 2> Dec 19, 2016 3:01:05 PM com.carrotsearch.randomizedtesting= .ThreadLeakControl checkThreadLeaks [junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thre= ad(s). [junit4] 2> NOTE: test params are: codec=3DFastCompressingStoredFields= (storedFieldsFormat=3DCompressingStoredFieldsFormat(compressionMode=3DFAST,= chunkSize=3D2, maxDocsPerChunk=3D2, blockSize=3D5), termVectorsFormat=3DCo= mpressingTermVectorsFormat(compressionMode=3DFAST, chunkSize=3D2, blockSize= =3D5)), sim=3DRandomSimilarity(queryNorm=3Dfalse,coord=3Dyes): {}, locale= =3Dar-DZ, timezone=3DEurope/Warsaw [junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8= .0_102 (64-bit)/cpus=3D4,threads=3D1,free=3D128502512,total=3D503840768 [junit4] 2> NOTE: All tests run in this JVM: [TestBinaryResponseWriter= , TestStressUserVersions, TestFieldCollectionResource, ZkNodePropsTest, Tes= tNRTOpen, CloudExitableDirectoryReaderTest, HdfsWriteToMultipleCollectionsT= est, AlternateDirectoryTest, TestFieldTypeResource, ShufflingReplicaListTra= nsformerTest, TestSearcherReuse, HighlighterConfigTest, TestQuerySenderNoQu= ery, DateFieldTest, TestSchemaSimilarityResource, ExplicitHLLTest, TestUnin= vertingReader, TestPKIAuthenticationPlugin, CdcrUpdateLogTest, SuggestCompo= nentTest, TestConfigSetsAPI, DistribDocExpirationUpdateProcessorTest, Curre= ncyFieldOpenExchangeTest, BooleanFieldTest, TestDistributedSearch, TestClou= dManagedSchema, TestMacroExpander, HdfsBasicDistributedZkTest, TestHighligh= tDedupGrouping, TestQueryWrapperFilter, SolrRequestParserTest, FileBasedSpe= llCheckerTest, SimpleCollectionCreateDeleteTest, RegexBoostProcessorTest, S= olrCoreTest, TestUseDocValuesAsStored2, ExternalFileFieldSortTest, HdfsColl= ectionsAPIDistributedZkTest, PreAnalyzedFieldManagedSchemaCloudTest, Distri= butedSuggestComponentTest, SyncSliceTest, QueryElevationComponentTest, Scri= ptEngineTest, CdcrReplicationDistributedZkTest] [junit4] Completed [404/662 (3!)] on J0 in 1798.90s, 11 tests, 1 error <= << FAILURES! [...truncated 63231 lines...] ------=_Part_1819_1464394168.1482163214085 Content-Type: text/plain; charset=us-ascii --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org ------=_Part_1819_1464394168.1482163214085--