Return-Path: X-Original-To: apmail-lucene-dev-archive@www.apache.org Delivered-To: apmail-lucene-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D8F7918D6F for ; Sun, 13 Sep 2015 19:20:05 +0000 (UTC) Received: (qmail 44612 invoked by uid 500); 13 Sep 2015 19:20:04 -0000 Delivered-To: apmail-lucene-dev-archive@lucene.apache.org Received: (qmail 44549 invoked by uid 500); 13 Sep 2015 19:20:04 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 44535 invoked by uid 99); 13 Sep 2015 19:20:04 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 13 Sep 2015 19:20:04 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id CA84EC098E; Sun, 13 Sep 2015 19:20:03 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.001 X-Spam-Level: X-Spam-Status: No, score=0.001 tagged_above=-999 required=6.31 tests=[FSL_HELO_NON_FQDN_1=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id bN5hiBTsnuxC; Sun, 13 Sep 2015 19:19:48 +0000 (UTC) Received: from serv1 (serv1.sd-datasolutions.de [188.138.57.78]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 1757A42B46; Sun, 13 Sep 2015 19:19:48 +0000 (UTC) Received: from localhost.localdomain ([127.0.0.1] helo=serv1) by serv1 with esmtp (Exim 4.82) (envelope-from ) id 1ZbCoU-0004ff-MJ; Sun, 13 Sep 2015 19:19:46 +0000 Date: Sun, 13 Sep 2015 19:19:33 +0000 (UTC) From: Policeman Jenkins Server To: mikemccand@apache.org, dev@lucene.apache.org Message-ID: <1840045271.23.1442171986689.JavaMail.jenkins@serv1> In-Reply-To: <681355323.5.1442154570179.JavaMail.jenkins@serv1> References: <681355323.5.1442154570179.JavaMail.jenkins@serv1> Subject: [JENKINS] Lucene-Solr-5.x-MacOSX (64bit/jdk1.7.0) - Build # 2672 - Still Failing! MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_22_1432817535.1442171986639" X-Jenkins-Job: Lucene-Solr-5.x-MacOSX X-Jenkins-Result: FAILURE ------=_Part_22_1432817535.1442171986639 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-MacOSX/2672/ Java: 64bit/jdk1.7.0 -XX:+UseCompressedOops -XX:+UseParallelGC 27 tests failed. FAILED: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test Error Message: No registered leader was found after waiting for 10000ms , collection: coll= ection1 slice: shard1 Stack Trace: org.apache.solr.common.SolrException: No registered leader was found after = waiting for 10000ms , collection: collection1 slice: shard1 =09at __randomizedtesting.SeedInfo.seed([B5F14C2F15BA983A:3DA573F5BB46F5C2]= :0) =09at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateRead= er.java:642) =09at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(Abst= ractFullDistribZkTestBase.java:405) =09at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(Abs= tractFullDistribZkTestBase.java:310) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= FixedStatement.callStatement(BaseDistributedSearchTestCase.java:961) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= Statement.evaluate(BaseDistributedSearchTestCase.java:938) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:50) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:49) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:798) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:458) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:845) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Random= izedRunner.java:747) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Random= izedRunner.java:781) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:792) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:42) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:54) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:55) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at java.lang.Thread.run(Thread.java:745) FAILED: org.apache.solr.cloud.CollectionStateFormat2Test.test Error Message: No registered leader was found after waiting for 10000ms , collection: coll= ection1 slice: shard1 Stack Trace: org.apache.solr.common.SolrException: No registered leader was found after = waiting for 10000ms , collection: collection1 slice: shard1 =09at __randomizedtesting.SeedInfo.seed([B5F14C2F15BA983A:3DA573F5BB46F5C2]= :0) =09at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateRead= er.java:642) =09at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(Abst= ractFullDistribZkTestBase.java:405) =09at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(Abs= tractFullDistribZkTestBase.java:310) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= FixedStatement.callStatement(BaseDistributedSearchTestCase.java:961) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= Statement.evaluate(BaseDistributedSearchTestCase.java:938) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:50) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:49) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:798) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:458) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:845) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Random= izedRunner.java:747) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Random= izedRunner.java:781) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:792) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:42) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:54) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:55) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at java.lang.Thread.run(Thread.java:745) FAILED: org.apache.solr.cloud.CollectionTooManyReplicasTest.testDownedShar= ds Error Message: No registered leader was found after waiting for 10000ms , collection: coll= ection1 slice: shard1 Stack Trace: org.apache.solr.common.SolrException: No registered leader was found after = waiting for 10000ms , collection: collection1 slice: shard1 =09at __randomizedtesting.SeedInfo.seed([B5F14C2F15BA983A:D7D9E47A9E41D57E]= :0) =09at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateRead= er.java:642) =09at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(Abst= ractFullDistribZkTestBase.java:405) =09at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(Abs= tractFullDistribZkTestBase.java:310) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= FixedStatement.callStatement(BaseDistributedSearchTestCase.java:961) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= Statement.evaluate(BaseDistributedSearchTestCase.java:938) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:50) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:49) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:798) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:458) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:845) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Random= izedRunner.java:747) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Random= izedRunner.java:781) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:792) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:42) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:54) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:55) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at java.lang.Thread.run(Thread.java:745) FAILED: org.apache.solr.cloud.CollectionTooManyReplicasTest.testAddShard Error Message: No registered leader was found after waiting for 10000ms , collection: coll= ection1 slice: shard1 Stack Trace: org.apache.solr.common.SolrException: No registered leader was found after = waiting for 10000ms , collection: collection1 slice: shard1 =09at __randomizedtesting.SeedInfo.seed([B5F14C2F15BA983A:91B42A8E4DAF4671]= :0) =09at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateRead= er.java:642) =09at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(Abst= ractFullDistribZkTestBase.java:405) =09at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(Abs= tractFullDistribZkTestBase.java:310) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= FixedStatement.callStatement(BaseDistributedSearchTestCase.java:961) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= Statement.evaluate(BaseDistributedSearchTestCase.java:938) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:50) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:49) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:798) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:458) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:845) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Random= izedRunner.java:747) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Random= izedRunner.java:781) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:792) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:42) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:54) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:55) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at java.lang.Thread.run(Thread.java:745) FAILED: org.apache.solr.cloud.CollectionTooManyReplicasTest.testAddTooMany= Replicas Error Message: No registered leader was found after waiting for 10000ms , collection: coll= ection1 slice: shard1 Stack Trace: org.apache.solr.common.SolrException: No registered leader was found after = waiting for 10000ms , collection: collection1 slice: shard1 =09at __randomizedtesting.SeedInfo.seed([B5F14C2F15BA983A:38A338F75B5CA78B]= :0) =09at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateRead= er.java:642) =09at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(Abst= ractFullDistribZkTestBase.java:405) =09at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(Abs= tractFullDistribZkTestBase.java:310) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= FixedStatement.callStatement(BaseDistributedSearchTestCase.java:961) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= Statement.evaluate(BaseDistributedSearchTestCase.java:938) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:50) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:49) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:798) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:458) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:845) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Random= izedRunner.java:747) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Random= izedRunner.java:781) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:792) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:42) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:54) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:55) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at java.lang.Thread.run(Thread.java:745) FAILED: org.apache.solr.cloud.CollectionsAPIAsyncDistributedZkTest.testSol= rJAPICalls Error Message: No registered leader was found after waiting for 10000ms , collection: coll= ection1 slice: shard1 Stack Trace: org.apache.solr.common.SolrException: No registered leader was found after = waiting for 10000ms , collection: collection1 slice: shard1 =09at __randomizedtesting.SeedInfo.seed([B5F14C2F15BA983A:ED95C04E13D030EE]= :0) =09at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateRead= er.java:642) =09at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(Abst= ractFullDistribZkTestBase.java:405) =09at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(Abs= tractFullDistribZkTestBase.java:310) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= FixedStatement.callStatement(BaseDistributedSearchTestCase.java:961) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= Statement.evaluate(BaseDistributedSearchTestCase.java:938) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:50) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:49) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:798) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:458) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:845) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Random= izedRunner.java:747) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Random= izedRunner.java:781) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:792) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:42) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:54) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:55) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at java.lang.Thread.run(Thread.java:745) FAILED: org.apache.solr.cloud.CustomCollectionTest.test Error Message: No registered leader was found after waiting for 10000ms , collection: coll= ection1 slice: shard1 Stack Trace: org.apache.solr.common.SolrException: No registered leader was found after = waiting for 10000ms , collection: collection1 slice: shard1 =09at __randomizedtesting.SeedInfo.seed([B5F14C2F15BA983A:3DA573F5BB46F5C2]= :0) =09at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateRead= er.java:642) =09at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(Abst= ractFullDistribZkTestBase.java:405) =09at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(Abs= tractFullDistribZkTestBase.java:310) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= FixedStatement.callStatement(BaseDistributedSearchTestCase.java:961) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= Statement.evaluate(BaseDistributedSearchTestCase.java:938) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:50) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:49) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:798) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:458) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:845) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Random= izedRunner.java:747) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Random= izedRunner.java:781) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:792) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:42) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:54) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:55) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at java.lang.Thread.run(Thread.java:745) FAILED: org.apache.solr.cloud.DeleteShardTest.test Error Message: No registered leader was found after waiting for 10000ms , collection: coll= ection1 slice: shard1 Stack Trace: org.apache.solr.common.SolrException: No registered leader was found after = waiting for 10000ms , collection: collection1 slice: shard1 =09at __randomizedtesting.SeedInfo.seed([B5F14C2F15BA983A:3DA573F5BB46F5C2]= :0) =09at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateRead= er.java:642) =09at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(Abst= ractFullDistribZkTestBase.java:405) =09at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(Abs= tractFullDistribZkTestBase.java:310) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= FixedStatement.callStatement(BaseDistributedSearchTestCase.java:961) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= Statement.evaluate(BaseDistributedSearchTestCase.java:938) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:50) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:49) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:798) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:458) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:845) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Random= izedRunner.java:747) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Random= izedRunner.java:781) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:792) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:42) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:54) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:55) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at java.lang.Thread.run(Thread.java:745) FAILED: org.apache.solr.cloud.DistribJoinFromCollectionTest.test Error Message: No registered leader was found after waiting for 10000ms , collection: coll= ection1 slice: shard1 Stack Trace: org.apache.solr.common.SolrException: No registered leader was found after = waiting for 10000ms , collection: collection1 slice: shard1 =09at __randomizedtesting.SeedInfo.seed([B5F14C2F15BA983A:3DA573F5BB46F5C2]= :0) =09at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateRead= er.java:642) =09at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(Abst= ractFullDistribZkTestBase.java:405) =09at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(Abs= tractFullDistribZkTestBase.java:310) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= FixedStatement.callStatement(BaseDistributedSearchTestCase.java:961) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= Statement.evaluate(BaseDistributedSearchTestCase.java:938) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:50) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:49) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:798) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:458) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:845) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Random= izedRunner.java:747) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Random= izedRunner.java:781) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:792) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:42) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:54) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:55) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at java.lang.Thread.run(Thread.java:745) FAILED: org.apache.solr.cloud.LeaderElectionIntegrationTest.testLeaderElec= tionAfterClientTimeout Error Message: Could not start container:7000. Reason:class org.apache.solr.common.SolrExc= eption Unable to create core [collection1] Stack Trace: java.lang.AssertionError: Could not start container:7000. Reason:class org.= apache.solr.common.SolrException Unable to create core [collection1] =09at __randomizedtesting.SeedInfo.seed([B5F14C2F15BA983A:1CC6E98C329F10D1]= :0) =09at org.junit.Assert.fail(Assert.java:93) =09at org.apache.solr.cloud.LeaderElectionIntegrationTest.setUp(LeaderElect= ionIntegrationTest.java:101) =09at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source) =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces= sorImpl.java:43) =09at java.lang.reflect.Method.invoke(Method.java:606) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1627) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:870) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Random= izedRunner.java:886) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:50) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:49) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:798) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:458) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:845) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Random= izedRunner.java:747) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Random= izedRunner.java:781) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:792) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:42) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:54) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:55) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at java.lang.Thread.run(Thread.java:745) FAILED: org.apache.solr.cloud.LeaderElectionIntegrationTest.testSimpleSlic= eLeaderElection Error Message: Could not start container:7000. Reason:class org.apache.solr.common.SolrExc= eption Unable to create core [collection1] Stack Trace: java.lang.AssertionError: Could not start container:7000. Reason:class org.= apache.solr.common.SolrException Unable to create core [collection1] =09at __randomizedtesting.SeedInfo.seed([B5F14C2F15BA983A:EBC5816156C504DD]= :0) =09at org.junit.Assert.fail(Assert.java:93) =09at org.apache.solr.cloud.LeaderElectionIntegrationTest.setUp(LeaderElect= ionIntegrationTest.java:101) =09at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source) =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces= sorImpl.java:43) =09at java.lang.reflect.Method.invoke(Method.java:606) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1627) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:870) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Random= izedRunner.java:886) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:50) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:49) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:798) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:458) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:845) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Random= izedRunner.java:747) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Random= izedRunner.java:781) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:792) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:46) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:42) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:54) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:65) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:55) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:365) =09at java.lang.Thread.run(Thread.java:745) FAILED: junit.framework.TestSuite.org.apache.solr.cloud.LeaderElectionInte= grationTest Error Message: 20 threads leaked from SUITE scope at org.apache.solr.cloud.LeaderElectionI= ntegrationTest: 1) Thread[id=3D1350, name=3DTEST-LeaderElectionIntegrat= ionTest.testSimpleSliceLeaderElection-seed#[B5F14C2F15BA983A]-SendThread(12= 7.0.0.1:53484), state=3DTIMED_WAITING, group=3DTGRP-LeaderElectionIntegrati= onTest] at java.lang.Thread.sleep(Native Method) at org.apa= che.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) = at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnx= n.java:940) at org.apache.zookeeper.ClientCnxn$SendThread.run(Clien= tCnxn.java:1003) 2) Thread[id=3D1326, name=3DTEST-LeaderElectionIntegrat= ionTest.testLeaderElectionAfterClientTimeout-seed#[B5F14C2F15BA983A]-SendTh= read(127.0.0.1:53473), state=3DTIMED_WAITING, group=3DTGRP-LeaderElectionIn= tegrationTest] at java.lang.Thread.sleep(Native Method) at = org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:2= 30) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnx= n.java:1185) at org.apache.zookeeper.ClientCnxn$SendThread.run(Clie= ntCnxn.java:1110) 3) Thread[id=3D1352, name=3DzkCallback-194-thread-1, s= tate=3DTIMED_WAITING, group=3DTGRP-LeaderElectionIntegrationTest] a= t sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks= .LockSupport.parkNanos(LockSupport.java:226) at java.util.concurren= t.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) = at java.util.concurrent.SynchronousQueue$TransferStack.transfer(Synch= ronousQueue.java:359) at java.util.concurrent.SynchronousQueue.poll= (SynchronousQueue.java:942) at java.util.concurrent.ThreadPoolExecu= tor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.T= hreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.u= til.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) = at java.lang.Thread.run(Thread.java:745) 4) Thread[id=3D1327, nam= e=3DTEST-LeaderElectionIntegrationTest.testLeaderElectionAfterClientTimeout= -seed#[B5F14C2F15BA983A]-EventThread, state=3DWAITING, group=3DTGRP-LeaderE= lectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) = at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) = at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObj= ect.await(AbstractQueuedSynchronizer.java:2043) at java.util.concur= rent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.= apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) 5) Thre= ad[id=3D1354, name=3DOverseerCollectionConfigSetProcessor-94514128404217859= -127.0.0.1:7000_solr-n_0000000000, state=3DTIMED_WAITING, group=3DOverseer = collection creation process.] at java.lang.Thread.sleep(Native Meth= od) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdE= xecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.ret= ryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.= SolrZkClient.getChildren(SolrZkClient.java:325) at org.apache.solr.= cloud.DistributedQueue.fetchZkChildren(DistributedQueue.java:311) a= t org.apache.solr.cloud.DistributedQueue.firstChild(DistributedQueue.java:2= 90) at org.apache.solr.cloud.DistributedQueue.firstElement(Distribu= tedQueue.java:359) at org.apache.solr.cloud.DistributedQueue.getChi= ldren(DistributedQueue.java:338) at org.apache.solr.cloud.OverseerT= askQueue.peekTopN(OverseerTaskQueue.java:210) at org.apache.solr.cl= oud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:197) at ja= va.lang.Thread.run(Thread.java:745) 6) Thread[id=3D1351, name=3DTEST-Lea= derElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[B5F14C2F15BA= 983A]-EventThread, state=3DWAITING, group=3DTGRP-LeaderElectionIntegrationT= est] at sun.misc.Unsafe.park(Native Method) at java.util.co= ncurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.= concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQ= ueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlocking= Queue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.Cl= ientCnxn$EventThread.run(ClientCnxn.java:494) 7) Thread[id=3D1357, name= =3DzkCallback-194-thread-2, state=3DTIMED_WAITING, group=3DTGRP-LeaderElect= ionIntegrationTest] at sun.misc.Unsafe.park(Native Method) = at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) = at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(= SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue= $TransferStack.transfer(SynchronousQueue.java:359) at java.util.con= current.SynchronousQueue.poll(SynchronousQueue.java:942) at java.ut= il.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) = at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor= .java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(T= hreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745= ) 8) Thread[id=3D1335, name=3DzkCallback-189-thread-4, state=3DTIMED_WAI= TING, group=3DTGRP-LeaderElectionIntegrationTest] at sun.misc.Unsaf= e.park(Native Method) at java.util.concurrent.locks.LockSupport.par= kNanos(LockSupport.java:226) at java.util.concurrent.SynchronousQue= ue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.ut= il.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java= :359) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueu= e.java:942) at java.util.concurrent.ThreadPoolExecutor.getTask(Thre= adPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecuto= r.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.T= hreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.l= ang.Thread.run(Thread.java:745) 9) Thread[id=3D1333, name=3DzkCallback-1= 89-thread-2, state=3DTIMED_WAITING, group=3DTGRP-LeaderElectionIntegrationT= est] at sun.misc.Unsafe.park(Native Method) at java.util.co= ncurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.= util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueu= e.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.= transfer(SynchronousQueue.java:359) at java.util.concurrent.Synchro= nousQueue.poll(SynchronousQueue.java:942) at java.util.concurrent.T= hreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.uti= l.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) = at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecut= or.java:615) at java.lang.Thread.run(Thread.java:745) 10) Thread[= id=3D1331, name=3DOverseerHdfsCoreFailoverThread-94514128225763331-127.0.0.= 1:7000_solr-n_0000000000, state=3DTIMED_WAITING, group=3DOverseer Hdfs Solr= Core Failover Thread.] at java.lang.Thread.sleep(Native Method) = at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor= .java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOpera= tion(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkC= lient.exists(SolrZkClient.java:308) at org.apache.solr.common.cloud= .ZkStateReader.getClusterProps(ZkStateReader.java:730) at org.apach= e.solr.cloud.OverseerAutoReplicaFailoverThread.doWork(OverseerAutoReplicaFa= iloverThread.java:152) at org.apache.solr.cloud.OverseerAutoReplica= FailoverThread.run(OverseerAutoReplicaFailoverThread.java:131) at j= ava.lang.Thread.run(Thread.java:745) 11) Thread[id=3D1329, name=3DOversee= rStateUpdate-94514128225763331-127.0.0.1:7000_solr-n_0000000000, state=3DTI= MED_WAITING, group=3DOverseer state updater.] at java.lang.Thread.s= leep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.r= etryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.Z= kCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.so= lr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:325) at = org.apache.solr.cloud.DistributedQueue.fetchZkChildren(DistributedQueue.jav= a:311) at org.apache.solr.cloud.DistributedQueue.firstChild(Distrib= utedQueue.java:290) at org.apache.solr.cloud.DistributedQueue.first= Element(DistributedQueue.java:359) at org.apache.solr.cloud.Distrib= utedQueue.peek(DistributedQueue.java:166) at org.apache.solr.cloud.= DistributedQueue.peek(DistributedQueue.java:144) at org.apache.solr= .cloud.Overseer$ClusterStateUpdater.run(Overseer.java:193) at java.= lang.Thread.run(Thread.java:745) 12) Thread[id=3D1359, name=3DzkCallback-= 194-thread-4, state=3DTIMED_WAITING, group=3DTGRP-LeaderElectionIntegration= Test] at sun.misc.Unsafe.park(Native Method) at java.util.c= oncurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java= .util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQue= ue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack= .transfer(SynchronousQueue.java:359) at java.util.concurrent.Synchr= onousQueue.poll(SynchronousQueue.java:942) at java.util.concurrent.= ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.ut= il.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) = at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecu= tor.java:615) at java.lang.Thread.run(Thread.java:745) 13) Thread= [id=3D1330, name=3DOverseerCollectionConfigSetProcessor-94514128225763331-1= 27.0.0.1:7000_solr-n_0000000000, state=3DTIMED_WAITING, group=3DOverseer co= llection creation process.] at java.lang.Thread.sleep(Native Method= ) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExe= cutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retry= Operation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.So= lrZkClient.getChildren(SolrZkClient.java:325) at org.apache.solr.cl= oud.DistributedQueue.fetchZkChildren(DistributedQueue.java:311) at = org.apache.solr.cloud.DistributedQueue.firstChild(DistributedQueue.java:290= ) at org.apache.solr.cloud.DistributedQueue.firstElement(Distribute= dQueue.java:359) at org.apache.solr.cloud.DistributedQueue.getChild= ren(DistributedQueue.java:338) at org.apache.solr.cloud.OverseerTas= kQueue.peekTopN(OverseerTaskQueue.java:210) at org.apache.solr.clou= d.OverseerTaskProcessor.run(OverseerTaskProcessor.java:197) at java= .lang.Thread.run(Thread.java:745) 14) Thread[id=3D1355, name=3DOverseerHd= fsCoreFailoverThread-94514128404217859-127.0.0.1:7000_solr-n_0000000000, st= ate=3DTIMED_WAITING, group=3DOverseer Hdfs SolrCore Failover Thread.] = at java.lang.Thread.sleep(Native Method) at org.apache.solr.comm= on.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.ap= ache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) = at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.ja= va:308) at org.apache.solr.common.cloud.ZkStateReader.getClusterPro= ps(ZkStateReader.java:730) at org.apache.solr.cloud.OverseerAutoRep= licaFailoverThread.doWork(OverseerAutoReplicaFailoverThread.java:152) = at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerA= utoReplicaFailoverThread.java:131) at java.lang.Thread.run(Thread.j= ava:745) 15) Thread[id=3D1334, name=3DzkCallback-189-thread-3, state=3DTI= MED_WAITING, group=3DTGRP-LeaderElectionIntegrationTest] at sun.mis= c.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupp= ort.parkNanos(LockSupport.java:226) at java.util.concurrent.Synchro= nousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at = java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQue= ue.java:359) at java.util.concurrent.SynchronousQueue.poll(Synchron= ousQueue.java:942) at java.util.concurrent.ThreadPoolExecutor.getTa= sk(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPool= Executor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concu= rrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at= java.lang.Thread.run(Thread.java:745) 16) Thread[id=3D1358, name=3DzkCal= lback-194-thread-3, state=3DTIMED_WAITING, group=3DTGRP-LeaderElectionInteg= rationTest] at sun.misc.Unsafe.park(Native Method) at java.= util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) a= t java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(Synchron= ousQueue.java:460) at java.util.concurrent.SynchronousQueue$Transfe= rStack.transfer(SynchronousQueue.java:359) at java.util.concurrent.= SynchronousQueue.poll(SynchronousQueue.java:942) at java.util.concu= rrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at j= ava.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:11= 30) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoo= lExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 17) = Thread[id=3D1356, name=3DThread-449, state=3DWAITING, group=3DTGRP-LeaderEl= ectionIntegrationTest] at java.lang.Object.wait(Native Method) = at java.lang.Object.wait(Object.java:503) at org.apache.solr.co= re.CloserThread.run(CoreContainer.java:1153) 18) Thread[id=3D1332, name= =3DThread-447, state=3DWAITING, group=3DTGRP-LeaderElectionIntegrationTest]= at java.lang.Object.wait(Native Method) at java.lang.Objec= t.wait(Object.java:503) at org.apache.solr.core.CloserThread.run(Co= reContainer.java:1153) 19) Thread[id=3D1353, name=3DOverseerStateUpdate-9= 4514128404217859-127.0.0.1:7000_solr-n_0000000000, state=3DTIMED_WAITING, g= roup=3DOverseer state updater.] at java.lang.Thread.sleep(Native Me= thod) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCm= dExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.r= etryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.clou= d.SolrZkClient.getChildren(SolrZkClient.java:325) at org.apache.sol= r.cloud.DistributedQueue.fetchZkChildren(DistributedQueue.java:311) = at org.apache.solr.cloud.DistributedQueue.firstChild(DistributedQueue.java= :290) at org.apache.solr.cloud.DistributedQueue.firstElement(Distri= butedQueue.java:359) at org.apache.solr.cloud.DistributedQueue.peek= (DistributedQueue.java:166) at org.apache.solr.cloud.DistributedQue= ue.peek(DistributedQueue.java:144) at org.apache.solr.cloud.Oversee= r$ClusterStateUpdater.run(Overseer.java:193) at java.lang.Thread.ru= n(Thread.java:745) 20) Thread[id=3D1328, name=3DzkCallback-189-thread-1, = state=3DTIMED_WAITING, group=3DTGRP-LeaderElectionIntegrationTest] = at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.lock= s.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurre= nt.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) = at java.util.concurrent.SynchronousQueue$TransferStack.transfer(Sync= hronousQueue.java:359) at java.util.concurrent.SynchronousQueue.pol= l(SynchronousQueue.java:942) at java.util.concurrent.ThreadPoolExec= utor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.= ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.= util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) = at java.lang.Thread.run(Thread.java:745) Stack Trace: com.carrotsearch.randomizedtesting.ThreadLeakError: 20 threads leaked from = SUITE scope at org.apache.solr.cloud.LeaderElectionIntegrationTest:=20 1) Thread[id=3D1350, name=3DTEST-LeaderElectionIntegrationTest.testSimpl= eSliceLeaderElection-seed#[B5F14C2F15BA983A]-SendThread(127.0.0.1:53484), s= tate=3DTIMED_WAITING, group=3DTGRP-LeaderElectionIntegrationTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostPr= ovider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCn= xn.java:940) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1= 003) 2) Thread[id=3D1326, name=3DTEST-LeaderElectionIntegrationTest.testLeade= rElectionAfterClientTimeout-seed#[B5F14C2F15BA983A]-SendThread(127.0.0.1:53= 473), state=3DTIMED_WAITING, group=3DTGRP-LeaderElectionIntegrationTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocke= tNIO.java:230) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.ja= va:1185) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1= 110) 3) Thread[id=3D1352, name=3DzkCallback-194-thread-1, state=3DTIMED_WAITI= NG, group=3DTGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.jav= a:226) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill= (SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(Syn= chronousQueue.java:359) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java= :942) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecut= or.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec= utor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:615) at java.lang.Thread.run(Thread.java:745) 4) Thread[id=3D1327, name=3DTEST-LeaderElectionIntegrationTest.testLeade= rElectionAfterClientTimeout-seed#[B5F14C2F15BA983A]-EventThread, state=3DWA= ITING, group=3DTGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186= ) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionO= bject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueu= e.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:= 494) 5) Thread[id=3D1354, name=3DOverseerCollectionConfigSetProcessor-9451412= 8404217859-127.0.0.1:7000_solr-n_0000000000, state=3DTIMED_WAITING, group= =3DOverseer collection creation process.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecu= tor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdE= xecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClie= nt.java:325) at org.apache.solr.cloud.DistributedQueue.fetchZkChildren(Distribut= edQueue.java:311) at org.apache.solr.cloud.DistributedQueue.firstChild(DistributedQue= ue.java:290) at org.apache.solr.cloud.DistributedQueue.firstElement(DistributedQ= ueue.java:359) at org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQu= eue.java:338) at org.apache.solr.cloud.OverseerTaskQueue.peekTopN(OverseerTaskQue= ue.java:210) at org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProc= essor.java:197) at java.lang.Thread.run(Thread.java:745) 6) Thread[id=3D1351, name=3DTEST-LeaderElectionIntegrationTest.testSimpl= eSliceLeaderElection-seed#[B5F14C2F15BA983A]-EventThread, state=3DWAITING, = group=3DTGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186= ) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionO= bject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueu= e.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:= 494) 7) Thread[id=3D1357, name=3DzkCallback-194-thread-2, state=3DTIMED_WAITI= NG, group=3DTGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.jav= a:226) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill= (SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(Syn= chronousQueue.java:359) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java= :942) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecut= or.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec= utor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:615) at java.lang.Thread.run(Thread.java:745) 8) Thread[id=3D1335, name=3DzkCallback-189-thread-4, state=3DTIMED_WAITI= NG, group=3DTGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.jav= a:226) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill= (SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(Syn= chronousQueue.java:359) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java= :942) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecut= or.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec= utor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:615) at java.lang.Thread.run(Thread.java:745) 9) Thread[id=3D1333, name=3DzkCallback-189-thread-2, state=3DTIMED_WAITI= NG, group=3DTGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.jav= a:226) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill= (SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(Syn= chronousQueue.java:359) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java= :942) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecut= or.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec= utor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:615) at java.lang.Thread.run(Thread.java:745) 10) Thread[id=3D1331, name=3DOverseerHdfsCoreFailoverThread-9451412822576= 3331-127.0.0.1:7000_solr-n_0000000000, state=3DTIMED_WAITING, group=3DOvers= eer Hdfs SolrCore Failover Thread.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecu= tor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdE= xecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.ja= va:308) at org.apache.solr.common.cloud.ZkStateReader.getClusterProps(ZkSta= teReader.java:730) at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.doWork(O= verseerAutoReplicaFailoverThread.java:152) at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(Over= seerAutoReplicaFailoverThread.java:131) at java.lang.Thread.run(Thread.java:745) 11) Thread[id=3D1329, name=3DOverseerStateUpdate-94514128225763331-127.0.= 0.1:7000_solr-n_0000000000, state=3DTIMED_WAITING, group=3DOverseer state u= pdater.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecu= tor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdE= xecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClie= nt.java:325) at org.apache.solr.cloud.DistributedQueue.fetchZkChildren(Distribut= edQueue.java:311) at org.apache.solr.cloud.DistributedQueue.firstChild(DistributedQue= ue.java:290) at org.apache.solr.cloud.DistributedQueue.firstElement(DistributedQ= ueue.java:359) at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.jav= a:166) at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.jav= a:144) at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.= java:193) at java.lang.Thread.run(Thread.java:745) 12) Thread[id=3D1359, name=3DzkCallback-194-thread-4, state=3DTIMED_WAITI= NG, group=3DTGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.jav= a:226) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill= (SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(Syn= chronousQueue.java:359) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java= :942) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecut= or.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec= utor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:615) at java.lang.Thread.run(Thread.java:745) 13) Thread[id=3D1330, name=3DOverseerCollectionConfigSetProcessor-9451412= 8225763331-127.0.0.1:7000_solr-n_0000000000, state=3DTIMED_WAITING, group= =3DOverseer collection creation process.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecu= tor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdE= xecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClie= nt.java:325) at org.apache.solr.cloud.DistributedQueue.fetchZkChildren(Distribut= edQueue.java:311) at org.apache.solr.cloud.DistributedQueue.firstChild(DistributedQue= ue.java:290) at org.apache.solr.cloud.DistributedQueue.firstElement(DistributedQ= ueue.java:359) at org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQu= eue.java:338) at org.apache.solr.cloud.OverseerTaskQueue.peekTopN(OverseerTaskQue= ue.java:210) at org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProc= essor.java:197) at java.lang.Thread.run(Thread.java:745) 14) Thread[id=3D1355, name=3DOverseerHdfsCoreFailoverThread-9451412840421= 7859-127.0.0.1:7000_solr-n_0000000000, state=3DTIMED_WAITING, group=3DOvers= eer Hdfs SolrCore Failover Thread.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecu= tor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdE= xecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.ja= va:308) at org.apache.solr.common.cloud.ZkStateReader.getClusterProps(ZkSta= teReader.java:730) at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.doWork(O= verseerAutoReplicaFailoverThread.java:152) at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(Over= seerAutoReplicaFailoverThread.java:131) at java.lang.Thread.run(Thread.java:745) 15) Thread[id=3D1334, name=3DzkCallback-189-thread-3, state=3DTIMED_WAITI= NG, group=3DTGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.jav= a:226) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill= (SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(Syn= chronousQueue.java:359) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java= :942) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecut= or.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec= utor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:615) at java.lang.Thread.run(Thread.java:745) 16) Thread[id=3D1358, name=3DzkCallback-194-thread-3, state=3DTIMED_WAITI= NG, group=3DTGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.jav= a:226) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill= (SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(Syn= chronousQueue.java:359) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java= :942) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecut= or.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec= utor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:615) at java.lang.Thread.run(Thread.java:745) 17) Thread[id=3D1356, name=3DThread-449, state=3DWAITING, group=3DTGRP-Le= aderElectionIntegrationTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:503) at org.apache.solr.core.CloserThread.run(CoreContainer.java:1153) 18) Thread[id=3D1332, name=3DThread-447, state=3DWAITING, group=3DTGRP-Le= aderElectionIntegrationTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:503) at org.apache.solr.core.CloserThread.run(CoreContainer.java:1153) 19) Thread[id=3D1353, name=3DOverseerStateUpdate-94514128404217859-127.0.= 0.1:7000_solr-n_0000000000, state=3DTIMED_WAITING, group=3DOverseer state u= pdater.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecu= tor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdE= xecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClie= nt.java:325) at org.apache.solr.cloud.DistributedQueue.fetchZkChildren(Distribut= edQueue.java:311) at org.apache.solr.cloud.DistributedQueue.firstChild(DistributedQue= ue.java:290) at org.apache.solr.cloud.DistributedQueue.firstElement(DistributedQ= ueue.java:359) at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.jav= a:166) at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.jav= a:144) at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.= java:193) at java.lang.Thread.run(Thread.java:745) 20) Thread[id=3D1328, name=3DzkCallback-189-thread-1, state=3DTIMED_WAITI= NG, group=3DTGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.jav= a:226) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill= (SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(Syn= chronousQueue.java:359) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java= :942) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecut= or.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec= utor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:615) at java.lang.Thread.run(Thread.java:745) =09at __randomizedtesting.SeedInfo.seed([B5F14C2F15BA983A]:0) FAILED: junit.framework.TestSuite.org.apache.solr.cloud.LeaderElectionInte= grationTest Error Message: There are still zombie threads that couldn't be terminated: 1) Thread[id= =3D1335, name=3DzkCallback-189-thread-4, state=3DTIMED_WAITING, group=3DTGR= P-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Met= hod) at java.util.concurrent.locks.LockSupport.parkNanos(LockSuppor= t.java:226) at java.util.concurrent.SynchronousQueue$TransferStack.= awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.Syn= chronousQueue$TransferStack.transfer(SynchronousQueue.java:359) at = java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942) = at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.ja= va:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(Threa= dPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor= $Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Th= read.java:745) 2) Thread[id=3D1328, name=3DzkCallback-189-thread-1, stat= e=3DTIMED_WAITING, group=3DTGRP-LeaderElectionIntegrationTest] at s= un.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.Lo= ckSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.S= ynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) = at java.util.concurrent.SynchronousQueue$TransferStack.transfer(Synchron= ousQueue.java:359) at java.util.concurrent.SynchronousQueue.poll(Sy= nchronousQueue.java:942) at java.util.concurrent.ThreadPoolExecutor= .getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.Thre= adPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util= .concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) = at java.lang.Thread.run(Thread.java:745) 3) Thread[id=3D1332, name= =3DThread-447, state=3DWAITING, group=3DTGRP-LeaderElectionIntegrationTest]= at java.lang.Object.wait(Native Method) at java.lang.Objec= t.wait(Object.java:503) at org.apache.solr.core.CloserThread.run(Co= reContainer.java:1153) 4) Thread[id=3D1357, name=3DzkCallback-194-thread= -2, state=3DTIMED_WAITING, group=3DTGRP-LeaderElectionIntegrationTest] = at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.= locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.conc= urrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:46= 0) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(= SynchronousQueue.java:359) at java.util.concurrent.SynchronousQueue= .poll(SynchronousQueue.java:942) at java.util.concurrent.ThreadPool= Executor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurr= ent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at j= ava.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:6= 15) at java.lang.Thread.run(Thread.java:745) 5) Thread[id=3D1356= , name=3DThread-449, state=3DWAITING, group=3DTGRP-LeaderElectionIntegratio= nTest] at java.lang.Object.wait(Native Method) at java.lang= .Object.wait(Object.java:503) at org.apache.solr.core.CloserThread.= run(CoreContainer.java:1153) 6) Thread[id=3D1358, name=3DzkCallback-194-= thread-3, state=3DTIMED_WAITING, group=3DTGRP-LeaderElectionIntegrationTest= ] at sun.misc.Unsafe.park(Native Method) at java.util.concu= rrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.uti= l.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.j= ava:460) at java.util.concurrent.SynchronousQueue$TransferStack.tra= nsfer(SynchronousQueue.java:359) at java.util.concurrent.Synchronou= sQueue.poll(SynchronousQueue.java:942) at java.util.concurrent.Thre= adPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.c= oncurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) = at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.= java:615) at java.lang.Thread.run(Thread.java:745) 7) Thread[id= =3D1326, name=3DTEST-LeaderElectionIntegrationTest.testLeaderElectionAfterC= lientTimeout-seed#[B5F14C2F15BA983A]-SendThread(127.0.0.1:53473), state=3DT= IMED_WAITING, group=3DTGRP-LeaderElectionIntegrationTest] at java.l= ang.Thread.sleep(Native Method) at org.apache.zookeeper.client.Stat= icHostProvider.next(StaticHostProvider.java:101) at org.apache.zook= eeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940) at or= g.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003) 8) Th= read[id=3D1352, name=3DzkCallback-194-thread-1, state=3DTIMED_WAITING, grou= p=3DTGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Nat= ive Method) at java.util.concurrent.locks.LockSupport.parkNanos(Loc= kSupport.java:226) at java.util.concurrent.SynchronousQueue$Transfe= rStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurr= ent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359) = at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942= ) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExec= utor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorke= r(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolE= xecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread= .run(Thread.java:745) 9) Thread[id=3D1355, name=3DOverseerHdfsCoreFailov= erThread-94514128404217859-127.0.0.1:7000_solr-n_0000000000, state=3DTIMED_= WAITING, group=3DOverseer Hdfs SolrCore Failover Thread.] at java.l= ang.Thread.sleep(Native Method) at org.apache.solr.cloud.OverseerAu= toReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139) = at java.lang.Thread.run(Thread.java:745) 10) Thread[id=3D1334, name= =3DzkCallback-189-thread-3, state=3DTIMED_WAITING, group=3DTGRP-LeaderElect= ionIntegrationTest] at sun.misc.Unsafe.park(Native Method) = at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) = at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(= SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue= $TransferStack.transfer(SynchronousQueue.java:359) at java.util.con= current.SynchronousQueue.poll(SynchronousQueue.java:942) at java.ut= il.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) = at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor= .java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(T= hreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745= ) 11) Thread[id=3D1359, name=3DzkCallback-194-thread-4, state=3DTIMED_WAI= TING, group=3DTGRP-LeaderElectionIntegrationTest] at sun.misc.Unsaf= e.park(Native Method) at java.util.concurrent.locks.LockSupport.par= kNanos(LockSupport.java:226) at java.util.concurrent.SynchronousQue= ue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.ut= il.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java= :359) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueu= e.java:942) at java.util.concurrent.ThreadPoolExecutor.getTask(Thre= adPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecuto= r.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.T= hreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.l= ang.Thread.run(Thread.java:745) 12) Thread[id=3D1350, name=3DTEST-LeaderE= lectionIntegrationTest.testSimpleSliceLeaderElection-seed#[B5F14C2F15BA983A= ]-SendThread(127.0.0.1:53484), state=3DTIMED_WAITING, group=3DTGRP-LeaderEl= ectionIntegrationTest] at java.lang.Thread.sleep(Native Method) = at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvi= der.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startCo= nnect(ClientCnxn.java:940) at org.apache.zookeeper.ClientCnxn$SendT= hread.run(ClientCnxn.java:1003) 13) Thread[id=3D1333, name=3DzkCallback-1= 89-thread-2, state=3DTIMED_WAITING, group=3DTGRP-LeaderElectionIntegrationT= est] at sun.misc.Unsafe.park(Native Method) at java.util.co= ncurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.= util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueu= e.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.= transfer(SynchronousQueue.java:359) at java.util.concurrent.Synchro= nousQueue.poll(SynchronousQueue.java:942) at java.util.concurrent.T= hreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.uti= l.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) = at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecut= or.java:615) at java.lang.Thread.run(Thread.java:745) 14) Thread[= id=3D1331, name=3DOverseerHdfsCoreFailoverThread-94514128225763331-127.0.0.= 1:7000_solr-n_0000000000, state=3DTIMED_WAITING, group=3DOverseer Hdfs Solr= Core Failover Thread.] at java.lang.Thread.sleep(Native Method) = at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(Oversee= rAutoReplicaFailoverThread.java:139) at java.lang.Thread.run(Thread= .java:745) Stack Trace: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie = threads that couldn't be terminated: 1) Thread[id=3D1335, name=3DzkCallback-189-thread-4, state=3DTIMED_WAITI= NG, group=3DTGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.jav= a:226) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill= (SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(Syn= chronousQueue.java:359) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java= :942) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecut= or.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec= utor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:615) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=3D1328, name=3DzkCallback-189-thread-1, state=3DTIMED_WAITI= NG, group=3DTGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.jav= a:226) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill= (SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(Syn= chronousQueue.java:359) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java= :942) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecut= or.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec= utor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:615) at java.lang.Thread.run(Thread.java:745) 3) Thread[id=3D1332, name=3DThread-447, state=3DWAITING, group=3DTGRP-Le= aderElectionIntegrationTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:503) at org.apache.solr.core.CloserThread.run(CoreContainer.java:1153) 4) Thread[id=3D1357, name=3DzkCallback-194-thread-2, state=3DTIMED_WAITI= NG, group=3DTGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.jav= a:226) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill= (SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(Syn= chronousQueue.java:359) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java= :942) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecut= or.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec= utor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:615) at java.lang.Thread.run(Thread.java:745) 5) Thread[id=3D1356, name=3DThread-449, state=3DWAITING, group=3DTGRP-Le= aderElectionIntegrationTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:503) at org.apache.solr.core.CloserThread.run(CoreContainer.java:1153) 6) Thread[id=3D1358, name=3DzkCallback-194-thread-3, state=3DTIMED_WAITI= NG, group=3DTGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.jav= a:226) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill= (SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(Syn= chronousQueue.java:359) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java= :942) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecut= or.java:1068 [...truncated too long message...] est-seed#[B5F14C2F15BA983A]-SendThread(127.0.0.1:54326), state=3DTIMED_WAIT= ING, group=3DTGRP-RecoveryZkTest] [junit4] > at java.lang.Thread.sleep(Native Method) [junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(= ClientCnxn.java:994) [junit4] > 15) Thread[id=3D6315, name=3DOverseerHdfsCoreFailoverThr= ead-94514178735538180-127.0.0.1:54329_m_se%2Fi-n_0000000000, state=3DTIMED_= WAITING, group=3DOverseer Hdfs SolrCore Failover Thread.] [junit4] > at java.lang.Thread.sleep(Native Method) [junit4] > at org.apache.solr.cloud.OverseerAutoReplicaFailov= erThread.run(OverseerAutoReplicaFailoverThread.java:139) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] > 16) Thread[id=3D6317, name=3DThread-2692, state=3DWAITIN= G, group=3DTGRP-RecoveryZkTest] [junit4] > at java.lang.Object.wait(Native Method) [junit4] > at java.lang.Object.wait(Object.java:503) [junit4] > at org.apache.solr.core.CloserThread.run(CoreConta= iner.java:1153) [junit4] > 17) Thread[id=3D6319, name=3DcoreContainerWorkExecutor-2= 468-thread-1, state=3DTIMED_WAITING, group=3DTGRP-RecoveryZkTest] [junit4] > at sun.misc.Unsafe.park(Native Method) [junit4] > at java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:226) [junit4] > at java.util.concurrent.SynchronousQueue$TransferS= tack.awaitFulfill(SynchronousQueue.java:460) [junit4] > at java.util.concurrent.SynchronousQueue$TransferS= tack.transfer(SynchronousQueue.java:359) [junit4] > at java.util.concurrent.SynchronousQueue.poll(Sync= hronousQueue.java:942) [junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask= (ThreadPoolExecutor.java:1068) [junit4] > at java.util.concurrent.ThreadPoolExecutor.runWork= er(ThreadPoolExecutor.java:1130) [junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.= run(ThreadPoolExecutor.java:615) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] > 18) Thread[id=3D6294, name=3Dqtp1819843047-6294-selector= -ServerConnectorManager@2595e45c/0, state=3DRUNNABLE, group=3DTGRP-Recovery= ZkTest] [junit4] > at sun.nio.ch.IOUtil.drain(Native Method) [junit4] > at sun.nio.ch.KQueueSelectorImpl.updateSelectedKey= s(KQueueSelectorImpl.java:167) [junit4] > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSe= lectorImpl.java:108) [junit4] > at sun.nio.ch.SelectorImpl.lockAndDoSelect(Selecto= rImpl.java:87) [junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.jav= a:98) [junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.jav= a:102) [junit4] > at org.eclipse.jetty.io.SelectorManager$ManagedSel= ector.select(SelectorManager.java:600) [junit4] > at org.eclipse.jetty.io.SelectorManager$ManagedSel= ector.run(SelectorManager.java:549) [junit4] > at org.eclipse.jetty.util.thread.NonBlockingThread= .run(NonBlockingThread.java:52) [junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.= runJob(QueuedThreadPool.java:635) [junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$= 3.run(QueuedThreadPool.java:555) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] > 19) Thread[id=3D6343, name=3DTEST-RecoveryZkTest.test-se= ed#[B5F14C2F15BA983A]-SendThread(127.0.0.1:54326), state=3DTIMED_WAITING, g= roup=3DTGRP-RecoveryZkTest] [junit4] > at java.lang.Thread.sleep(Native Method) [junit4] > at org.apache.zookeeper.client.StaticHostProvider.= next(StaticHostProvider.java:101) [junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.star= tConnect(ClientCnxn.java:940) [junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(= ClientCnxn.java:1003) [junit4] > 20) Thread[id=3D6351, name=3Dqtp591589711-6351-selector-= ServerConnectorManager@1b5badf2/0, state=3DRUNNABLE, group=3DTGRP-RecoveryZ= kTest] [junit4] > at sun.nio.ch.KQueueArrayWrapper.interrupt(Native = Method) [junit4] > at sun.nio.ch.KQueueArrayWrapper.interrupt(KQueueA= rrayWrapper.java:205) [junit4] > at sun.nio.ch.KQueueSelectorImpl.wakeup(KQueueSele= ctorImpl.java:243) [junit4] > at java.nio.channels.spi.AbstractSelector$1.interr= upt(AbstractSelector.java:210) [junit4] > at java.nio.channels.spi.AbstractSelector.begin(Ab= stractSelector.java:216) [junit4] > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSe= lectorImpl.java:102) [junit4] > at sun.nio.ch.SelectorImpl.lockAndDoSelect(Selecto= rImpl.java:87) [junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.jav= a:98) [junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.jav= a:102) [junit4] > at org.eclipse.jetty.io.SelectorManager$ManagedSel= ector.select(SelectorManager.java:600) [junit4] > at org.eclipse.jetty.io.SelectorManager$ManagedSel= ector.run(SelectorManager.java:549) [junit4] > at org.eclipse.jetty.util.thread.NonBlockingThread= .run(NonBlockingThread.java:52) [junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.= runJob(QueuedThreadPool.java:635) [junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$= 3.run(QueuedThreadPool.java:555) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] > 21) Thread[id=3D6335, name=3DScheduler-1340997918, state= =3DTIMED_WAITING, group=3DTGRP-RecoveryZkTest] [junit4] > at sun.misc.Unsafe.park(Native Method) [junit4] > at java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:226) [junit4] > at java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) [junit4] > at java.util.concurrent.ScheduledThreadPoolExecuto= r$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090) [junit4] > at java.util.concurrent.ScheduledThreadPoolExecuto= r$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807) [junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask= (ThreadPoolExecutor.java:1068) [junit4] > at java.util.concurrent.ThreadPoolExecutor.runWork= er(ThreadPoolExecutor.java:1130) [junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.= run(ThreadPoolExecutor.java:615) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] > 22) Thread[id=3D6371, name=3DThread-2714, state=3DWAITIN= G, group=3DTGRP-RecoveryZkTest] [junit4] > at java.lang.Object.wait(Native Method) [junit4] > at java.lang.Object.wait(Object.java:503) [junit4] > at org.apache.solr.core.CloserThread.run(CoreConta= iner.java:1153) [junit4] > 23) Thread[id=3D6360, name=3Dorg.eclipse.jetty.server.se= ssion.HashSessionManager@1500b267Timer, state=3DTIMED_WAITING, group=3DTGRP= -RecoveryZkTest] [junit4] > at sun.misc.Unsafe.park(Native Method) [junit4] > at java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:226) [junit4] > at java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) [junit4] > at java.util.concurrent.ScheduledThreadPoolExecuto= r$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090) [junit4] > at java.util.concurrent.ScheduledThreadPoolExecuto= r$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807) [junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask= (ThreadPoolExecutor.java:1068) [junit4] > at java.util.concurrent.ThreadPoolExecutor.runWork= er(ThreadPoolExecutor.java:1130) [junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.= run(ThreadPoolExecutor.java:615) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] > 24) Thread[id=3D6320, name=3DTEST-RecoveryZkTest.test-se= ed#[B5F14C2F15BA983A]-SendThread(127.0.0.1:54326), state=3DTIMED_WAITING, g= roup=3DTGRP-RecoveryZkTest] [junit4] > at java.lang.Thread.sleep(Native Method) [junit4] > at org.apache.zookeeper.client.StaticHostProvider.= next(StaticHostProvider.java:101) [junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.star= tConnect(ClientCnxn.java:940) [junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(= ClientCnxn.java:1003) [junit4] > =09at __randomizedtesting.SeedInfo.seed([B5F14C2F15BA983A]= :0) [junit4] Completed [511/538] on J0 in 41.31s, 1 test, 3 errors <<< FAILU= RES! [...truncated 102 lines...] BUILD FAILED /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/build.xml:785: The followin= g error occurred while executing this line: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/build.xml:729: The followin= g error occurred while executing this line: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/build.xml:59: The following= error occurred while executing this line: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build.xml:233: The fol= lowing error occurred while executing this line: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/common-build.xml:524: = The following error occurred while executing this line: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/lucene/common-build.xml:145= 2: The following error occurred while executing this line: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/lucene/common-build.xml:100= 6: There were test failures: 538 suites, 2127 tests, 4 suite-level errors, = 21 errors, 2 failures, 1527 ignored (22 assumptions) Total time: 40 minutes 40 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts [WARNINGS] Skipping publisher since build result is FAILURE Recording test results Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ------=_Part_22_1432817535.1442171986639 Content-Type: text/plain; charset=us-ascii --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org ------=_Part_22_1432817535.1442171986639--