Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 340A4200D50 for ; Mon, 4 Dec 2017 13:15:05 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 324CA160C05; Mon, 4 Dec 2017 12:15:05 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 5CBB2160BF9 for ; Mon, 4 Dec 2017 13:15:02 +0100 (CET) Received: (qmail 76761 invoked by uid 500); 4 Dec 2017 12:15:01 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 76751 invoked by uid 99); 4 Dec 2017 12:15:00 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Dec 2017 12:15:00 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id DC4841A0E52 for ; Mon, 4 Dec 2017 12:14:59 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.999 X-Spam-Level: X-Spam-Status: No, score=0.999 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RP_MATCHES_RCVD=-0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id MqSNfNG2Agtp for ; Mon, 4 Dec 2017 12:14:42 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 6FF515FB52 for ; Mon, 4 Dec 2017 12:14:40 +0000 (UTC) Received: from jenkins-master.apache.org (unknown [62.210.60.235]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 28F20E0162 for ; Mon, 4 Dec 2017 12:14:39 +0000 (UTC) Received: from jenkins-master.apache.org (localhost [127.0.0.1]) by jenkins-master.apache.org (ASF Mail Server at jenkins-master.apache.org) with ESMTP id 4753EA0035 for ; Mon, 4 Dec 2017 12:14:35 +0000 (UTC) Date: Mon, 4 Dec 2017 12:13:19 +0000 (UTC) From: Apache Jenkins Server To: dev@lucene.apache.org Message-ID: <369928509.1610.1512389676293.JavaMail.jenkins@jenkins-master.apache.org> In-Reply-To: <2103814279.1184.1512194092934.JavaMail.jenkins@jenkins-master.apache.org> References: <2103814279.1184.1512194092934.JavaMail.jenkins@jenkins-master.apache.org> Subject: [JENKINS] Lucene-Solr-NightlyTests-master - Build # 1432 - Failure MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_1609_1751305922.1512389674512" X-Jenkins-Job: Lucene-Solr-NightlyTests-master X-Jenkins-Result: FAILURE archived-at: Mon, 04 Dec 2017 12:15:05 -0000 ------=_Part_1609_1751305922.1512389674512 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1432/ 15 tests failed. FAILED: org.apache.solr.cloud.MultiThreadedOCPTest.test Error Message: Stack Trace: java.lang.AssertionError =09at __randomizedtesting.SeedInfo.seed([8370C462587B74F5:B24FBB8F687190D]:= 0) =09at org.junit.Assert.fail(Assert.java:92) =09at org.junit.Assert.assertTrue(Assert.java:43) =09at org.junit.Assert.assertTrue(Assert.java:54) =09at org.apache.solr.cloud.MultiThreadedOCPTest.testFillWorkQueue(MultiThr= eadedOCPTest.java:112) =09at org.apache.solr.cloud.MultiThreadedOCPTest.test(MultiThreadedOCPTest.= java:67) =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.= java:62) =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces= sorImpl.java:43) =09at java.lang.reflect.Method.invoke(Method.java:498) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1737) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Random= izedRunner.java:934) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(Random= izedRunner.java:970) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(Rando= mizedRunner.java:984) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= FixedStatement.callStatement(BaseDistributedSearchTestCase.java:993) =09at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$Shards= Statement.evaluate(BaseDistributedSearchTestCase.java:968) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:49) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:368) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:817) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:468) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:943) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:829) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Random= izedRunner.java:879) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:890) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:41) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:53) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:54) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:368) =09at java.lang.Thread.run(Thread.java:748) FAILED: org.apache.solr.uninverting.TestDocTermOrds.testTriggerUnInvertLim= it Error Message: this IndexWriter is closed Stack Trace: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed =09at __randomizedtesting.SeedInfo.seed([8370C462587B74F5:B0C2ECA655CCAE42]= :0) =09at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:896) =09at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:910) =09at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1= 711) =09at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1460= ) =09at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWrit= er.java:171) =09at org.apache.solr.uninverting.TestDocTermOrds.testTriggerUnInvertLimit(= TestDocTermOrds.java:167) =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.= java:62) =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces= sorImpl.java:43) =09at java.lang.reflect.Method.invoke(Method.java:498) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1737) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Random= izedRunner.java:934) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(Random= izedRunner.java:970) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(Rando= mizedRunner.java:984) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:49) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:368) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:817) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:468) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:943) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:829) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Random= izedRunner.java:879) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:890) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:41) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:53) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:54) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:368) =09at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.OutOfMemoryError: Java heap space =09at org.apache.lucene.codecs.lucene50.Lucene50PostingsWriter.newTermState= (Lucene50PostingsWriter.java:174) =09at org.apache.lucene.codecs.lucene50.Lucene50PostingsWriter.newTermState= (Lucene50PostingsWriter.java:57) =09at org.apache.lucene.codecs.PushPostingsWriterBase.writeTerm(PushPosting= sWriterBase.java:166) =09at org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter$TermsWriter.w= rite(BlockTreeTermsWriter.java:864) =09at org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter.write(BlockTr= eeTermsWriter.java:343) =09at org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105= ) =09at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter= .merge(PerFieldPostingsFormat.java:164) =09at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:2= 30) =09at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:115) =09at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4415= ) =09at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4055) =09at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMe= rgeScheduler.java:624) =09at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(Conc= urrentMergeScheduler.java:661) FAILED: org.apache.solr.uninverting.TestDocTermOrds.testEmptyIndex Error Message: Captured an uncaught exception in thread: Thread[id=3D205, name=3DLucene Me= rge Thread #7, state=3DRUNNABLE, group=3DTGRP-TestDocTermOrds] Stack Trace: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an unca= ught exception in thread: Thread[id=3D205, name=3DLucene Merge Thread #7, s= tate=3DRUNNABLE, group=3DTGRP-TestDocTermOrds] Caused by: org.apache.lucene.index.MergePolicy$MergeException: java.lang.Ou= tOfMemoryError: Java heap space =09at __randomizedtesting.SeedInfo.seed([8370C462587B74F5]:0) =09at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException= (ConcurrentMergeScheduler.java:703) =09at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(Conc= urrentMergeScheduler.java:683) Caused by: java.lang.OutOfMemoryError: Java heap space =09at org.apache.lucene.codecs.memory.DirectPostingsFormat$DirectField.(DirectPostingsFormat.java:465) =09at org.apache.lucene.codecs.memory.DirectPostingsFormat$DirectFields.(DirectPostingsFormat.java:129) =09at org.apache.lucene.codecs.memory.DirectPostingsFormat.fieldsProducer(D= irectPostingsFormat.java:113) =09at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader= .(PerFieldPostingsFormat.java:292) =09at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat.fieldsProduc= er(PerFieldPostingsFormat.java:372) =09at org.apache.lucene.index.SegmentCoreReaders.(SegmentCoreReaders.= java:112) =09at org.apache.lucene.index.SegmentReader.(SegmentReader.java:78) =09at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates= .java:208) =09at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4560= ) =09at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4055) =09at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMe= rgeScheduler.java:624) =09at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(Conc= urrentMergeScheduler.java:661) FAILED: junit.framework.TestSuite.org.apache.solr.uninverting.TestDocTermO= rds Error Message: Captured an uncaught exception in thread: Thread[id=3D206, name=3DLucene Me= rge Thread #8, state=3DRUNNABLE, group=3DTGRP-TestDocTermOrds] Stack Trace: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an unca= ught exception in thread: Thread[id=3D206, name=3DLucene Merge Thread #8, s= tate=3DRUNNABLE, group=3DTGRP-TestDocTermOrds] Caused by: org.apache.lucene.index.MergePolicy$MergeException: java.lang.Ou= tOfMemoryError: Java heap space =09at __randomizedtesting.SeedInfo.seed([8370C462587B74F5]:0) =09at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException= (ConcurrentMergeScheduler.java:703) =09at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(Conc= urrentMergeScheduler.java:683) Caused by: java.lang.OutOfMemoryError: Java heap space =09at org.apache.lucene.codecs.lucene50.Lucene50PostingsWriter.newTermState= (Lucene50PostingsWriter.java:174) =09at org.apache.lucene.codecs.lucene50.Lucene50PostingsWriter.newTermState= (Lucene50PostingsWriter.java:57) =09at org.apache.lucene.codecs.PushPostingsWriterBase.writeTerm(PushPosting= sWriterBase.java:166) =09at org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter$TermsWriter.w= rite(BlockTreeTermsWriter.java:864) =09at org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter.write(BlockTr= eeTermsWriter.java:343) =09at org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105= ) =09at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter= .merge(PerFieldPostingsFormat.java:164) =09at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:2= 30) =09at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:115) =09at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4415= ) =09at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4055) =09at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMe= rgeScheduler.java:624) =09at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(Conc= urrentMergeScheduler.java:661) FAILED: junit.framework.TestSuite.org.apache.solr.update.TestInPlaceUpdate= sDistrib Error Message: ObjectTracker found 17 object(s) that were not released!!! [TransactionLog,= TransactionLog, TransactionLog, TransactionLog, InternalHttpClient, Transa= ctionLog, TransactionLog, TransactionLog, MockDirectoryWrapper, MDCAwareThr= eadPoolExecutor, SolrIndexSearcher, TransactionLog, InternalHttpClient, Tra= nsactionLog, SolrCore, MockDirectoryWrapper, MockDirectoryWrapper] org.apac= he.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache= .solr.update.TransactionLog at org.apache.solr.common.util.ObjectReleaseTr= acker.track(ObjectReleaseTracker.java:42) at org.apache.solr.update.Transa= ctionLog.(TransactionLog.java:190) at org.apache.solr.update.UpdateL= og.newTransactionLog(UpdateLog.java:448) at org.apache.solr.update.UpdateL= og.ensureLog(UpdateLog.java:1261) at org.apache.solr.update.UpdateLog.dele= teByQuery(UpdateLog.java:621) at org.apache.solr.update.UpdateLog.copyOver= OldUpdates(UpdateLog.java:1232) at org.apache.solr.update.UpdateLog.copyAn= dSwitchToNewTlog(UpdateLog.java:1168) at org.apache.solr.update.UpdateLog.= copyOverOldUpdates(UpdateLog.java:1155) at org.apache.solr.cloud.Replicate= FromLeader.lambda$startReplication$0(ReplicateFromLeader.java:100) at org.= apache.solr.handler.ReplicationHandler.lambda$setupPolling$12(ReplicationHa= ndler.java:1160) at java.util.concurrent.Executors$RunnableAdapter.call(Ex= ecutors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTas= k.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledF= utureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.co= ncurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThrea= dPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWork= er(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecuto= r$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.j= ava:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerExc= eption: org.apache.solr.update.TransactionLog at org.apache.solr.common.ut= il.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.= solr.update.TransactionLog.(TransactionLog.java:190) at org.apache.s= olr.update.UpdateLog.newTransactionLog(UpdateLog.java:448) at org.apache.s= olr.update.UpdateLog.ensureLog(UpdateLog.java:1261) at org.apache.solr.upd= ate.UpdateLog.deleteByQuery(UpdateLog.java:621) at org.apache.solr.update.= UpdateLog.copyOverOldUpdates(UpdateLog.java:1232) at org.apache.solr.updat= e.UpdateLog.copyAndSwitchToNewTlog(UpdateLog.java:1168) at org.apache.solr= .update.UpdateLog.copyOverOldUpdates(UpdateLog.java:1155) at org.apache.so= lr.cloud.ReplicateFromLeader.lambda$startReplication$0(ReplicateFromLeader.= java:100) at org.apache.solr.handler.ReplicationHandler.lambda$setupPollin= g$12(ReplicationHandler.java:1160) at java.util.concurrent.Executors$Runna= bleAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run= AndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolE= xecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180= ) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPo= olExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent= .ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.T= hread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracke= r$ObjectTrackerException: org.apache.solr.update.TransactionLog at org.apa= che.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:4= 2) at org.apache.solr.update.TransactionLog.(TransactionLog.java:190= ) at org.apache.solr.update.UpdateLog.newTransactionLog(UpdateLog.java:448= ) at org.apache.solr.update.UpdateLog.ensureLog(UpdateLog.java:1261) at o= rg.apache.solr.update.UpdateLog.deleteByQuery(UpdateLog.java:621) at org.a= pache.solr.update.UpdateLog.copyOverOldUpdates(UpdateLog.java:1232) at org= .apache.solr.update.UpdateLog.copyAndSwitchToNewTlog(UpdateLog.java:1168) = at org.apache.solr.update.UpdateLog.copyOverOldUpdates(UpdateLog.java:1155)= at org.apache.solr.cloud.ReplicateFromLeader.lambda$startReplication$0(Re= plicateFromLeader.java:100) at org.apache.solr.handler.ReplicationHandler.= lambda$setupPolling$12(ReplicationHandler.java:1160) at java.util.concurre= nt.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurr= ent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.Sc= heduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoo= lExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$Sc= heduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.c= oncurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at ja= va.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:62= 4) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.O= bjectReleaseTracker$ObjectTrackerException: org.apache.solr.update.Transact= ionLog at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectRel= easeTracker.java:42) at org.apache.solr.update.TransactionLog.(Trans= actionLog.java:190) at org.apache.solr.update.UpdateLog.newTransactionLog(= UpdateLog.java:448) at org.apache.solr.update.UpdateLog.ensureLog(UpdateLo= g.java:1261) at org.apache.solr.update.UpdateLog.deleteByQuery(UpdateLog.j= ava:621) at org.apache.solr.update.UpdateLog.copyOverOldUpdates(UpdateLog.= java:1232) at org.apache.solr.update.UpdateLog.copyAndSwitchToNewTlog(Upda= teLog.java:1168) at org.apache.solr.update.UpdateLog.copyOverOldUpdates(Up= dateLog.java:1155) at org.apache.solr.cloud.ReplicateFromLeader.lambda$sta= rtReplication$0(ReplicateFromLeader.java:100) at org.apache.solr.handler.R= eplicationHandler.lambda$setupPolling$12(ReplicationHandler.java:1160) at = java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at= java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.= util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(= ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThr= eadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:29= 4) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor= .java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPo= olExecutor.java:624) at java.lang.Thread.run(Thread.java:748) org.apache.= solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.ht= tp.impl.client.InternalHttpClient at org.apache.solr.common.util.ObjectRel= easeTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.client.= solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289) at org.apa= che.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:= 298) at org.apache.solr.handler.IndexFetcher.createHttpClient(IndexFetcher= .java:224) at org.apache.solr.handler.IndexFetcher.(IndexFetcher.jav= a:266) at org.apache.solr.handler.ReplicationHandler.inform(ReplicationHan= dler.java:1190) at org.apache.solr.cloud.ReplicateFromLeader.startReplicat= ion(ReplicateFromLeader.java:106) at org.apache.solr.cloud.ZkController.st= artReplicationFromLeader(ZkController.java:1146) at org.apache.solr.cloud.= RecoveryStrategy.doSyncOrReplicateRecovery(RecoveryStrategy.java:673) at o= rg.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:308)= at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:292) = at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.r= un(InstrumentedExecutorService.java:176) at java.util.concurrent.Executors= $RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTa= sk.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MD= CAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.u= til.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) = at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja= va:624) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.u= til.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.update.Tra= nsactionLog at org.apache.solr.common.util.ObjectReleaseTracker.track(Obje= ctReleaseTracker.java:42) at org.apache.solr.update.TransactionLog.(= TransactionLog.java:190) at org.apache.solr.update.UpdateLog.newTransactio= nLog(UpdateLog.java:448) at org.apache.solr.update.UpdateLog.ensureLog(Upd= ateLog.java:1261) at org.apache.solr.update.UpdateLog.deleteByQuery(Update= Log.java:621) at org.apache.solr.update.UpdateLog.copyOverOldUpdates(Updat= eLog.java:1232) at org.apache.solr.update.UpdateLog.copyAndSwitchToNewTlog= (UpdateLog.java:1168) at org.apache.solr.update.UpdateLog.copyOverOldUpdat= es(UpdateLog.java:1155) at org.apache.solr.cloud.ReplicateFromLeader.lambd= a$startReplication$0(ReplicateFromLeader.java:100) at org.apache.solr.hand= ler.ReplicationHandler.lambda$setupPolling$12(ReplicationHandler.java:1160)= at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511= ) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at = java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access= $301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.Schedul= edThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.ja= va:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExe= cutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Thr= eadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) org.ap= ache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apac= he.solr.update.TransactionLog at org.apache.solr.common.util.ObjectRelease= Tracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.update.Tran= sactionLog.(TransactionLog.java:190) at org.apache.solr.update.Updat= eLog.newTransactionLog(UpdateLog.java:448) at org.apache.solr.update.Updat= eLog.ensureLog(UpdateLog.java:1261) at org.apache.solr.update.UpdateLog.de= leteByQuery(UpdateLog.java:621) at org.apache.solr.update.UpdateLog.copyOv= erOldUpdates(UpdateLog.java:1232) at org.apache.solr.update.UpdateLog.copy= AndSwitchToNewTlog(UpdateLog.java:1168) at org.apache.solr.update.UpdateLo= g.copyOverOldUpdates(UpdateLog.java:1155) at org.apache.solr.cloud.Replica= teFromLeader.lambda$startReplication$0(ReplicateFromLeader.java:100) at or= g.apache.solr.handler.ReplicationHandler.lambda$setupPolling$12(Replication= Handler.java:1160) at java.util.concurrent.Executors$RunnableAdapter.call(= Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureT= ask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$Schedule= dFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.= concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThr= eadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWo= rker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecu= tor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread= .java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerE= xception: org.apache.solr.update.TransactionLog at org.apache.solr.common.= util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apach= e.solr.update.TransactionLog.(TransactionLog.java:190) at org.apache= .solr.update.UpdateLog.newTransactionLog(UpdateLog.java:448) at org.apache= .solr.update.UpdateLog.ensureLog(UpdateLog.java:1261) at org.apache.solr.u= pdate.UpdateLog.deleteByQuery(UpdateLog.java:621) at org.apache.solr.updat= e.UpdateLog.copyOverOldUpdates(UpdateLog.java:1232) at org.apache.solr.upd= ate.UpdateLog.copyAndSwitchToNewTlog(UpdateLog.java:1168) at org.apache.so= lr.update.UpdateLog.copyOverOldUpdates(UpdateLog.java:1155) at org.apache.= solr.cloud.ReplicateFromLeader.lambda$startReplication$0(ReplicateFromLeade= r.java:100) at org.apache.solr.handler.ReplicationHandler.lambda$setupPoll= ing$12(ReplicationHandler.java:1160) at java.util.concurrent.Executors$Run= nableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.r= unAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoo= lExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:1= 80) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTas= k.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.Thread= PoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurre= nt.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang= .Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTrac= ker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper a= t org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTrack= er.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDir= ectoryFactory.java:348) at org.apache.solr.handler.IndexFetcher.fetchLates= tIndex(IndexFetcher.java:501) at org.apache.solr.handler.IndexFetcher.fetc= hLatestIndex(IndexFetcher.java:345) at org.apache.solr.handler.Replication= Handler.doFetch(ReplicationHandler.java:420) at org.apache.solr.handler.Re= plicationHandler.lambda$setupPolling$12(ReplicationHandler.java:1159) at j= ava.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at = java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.u= til.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(S= cheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThre= adPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294= ) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.= java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoo= lExecutor.java:624) at java.lang.Thread.run(Thread.java:748) org.apache.s= olr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.sol= r.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor at org.apache.solr.c= ommon.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org= .apache.solr.core.SolrCore.(SolrCore.java:873) at org.apache.solr.co= re.SolrCore.(SolrCore.java:844) at org.apache.solr.core.CoreContaine= r.createFromDescriptor(CoreContainer.java:1041) at org.apache.solr.core.Co= reContainer.create(CoreContainer.java:952) at org.apache.solr.handler.admi= n.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91) at org.ap= ache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:= 384) at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreA= dminHandler.java:389) at org.apache.solr.handler.admin.CoreAdminHandler.ha= ndleRequestBody(CoreAdminHandler.java:174) at org.apache.solr.handler.Requ= estHandlerBase.handleRequest(RequestHandlerBase.java:177) at org.apache.so= lr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735) at org.apache.s= olr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716) at org.= apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497) at org.apache= .solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382) at = org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java= :326) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(Ser= vletHandler.java:1759) at org.apache.solr.client.solrj.embedded.JettySolrR= unner$DebugFilter.doFilter(JettySolrRunner.java:139) at org.eclipse.jetty.= servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at o= rg.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582) = at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.= java:224) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(Cont= extHandler.java:1180) at org.eclipse.jetty.servlet.ServletHandler.doScope(= ServletHandler.java:512) at org.eclipse.jetty.server.session.SessionHandle= r.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.Con= textHandler.doScope(ContextHandler.java:1112) at org.eclipse.jetty.server.= handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.= server.handler.gzip.GzipHandler.handle(GzipHandler.java:426) at org.eclips= e.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134) at o= rg.eclipse.jetty.server.Server.handle(Server.java:534) at org.eclipse.jett= y.server.HttpChannel.handle(HttpChannel.java:320) at org.eclipse.jetty.ser= ver.HttpConnection.onFillable(HttpConnection.java:251) at org.eclipse.jett= y.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)= at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) at = org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251) = at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractC= onnection.java:283) at org.eclipse.jetty.io.FillInterest.fillable(FillInte= rest.java:108) at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectC= hannelEndPoint.java:93) at org.eclipse.jetty.util.thread.strategy.ExecuteP= roduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303) at org= .eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(Ex= ecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.Ex= ecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jet= ty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.e= clipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) = at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.Obje= ctReleaseTracker$ObjectTrackerException: org.apache.solr.search.SolrIndexSe= archer at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectRel= easeTracker.java:42) at org.apache.solr.search.SolrIndexSearcher.(So= lrIndexSearcher.java:323) at org.apache.solr.core.SolrCore.openNewSearcher= (SolrCore.java:2023) at org.apache.solr.core.SolrCore.getSearcher(SolrCore= .java:2196) at org.apache.solr.handler.IndexFetcher.openNewSearcherAndUpda= teCommitPoint(IndexFetcher.java:892) at org.apache.solr.handler.IndexFetch= er.fetchLatestIndex(IndexFetcher.java:649) at org.apache.solr.handler.Inde= xFetcher.fetchLatestIndex(IndexFetcher.java:345) at org.apache.solr.handle= r.ReplicationHandler.doFetch(ReplicationHandler.java:420) at org.apache.so= lr.handler.ReplicationHandler.lambda$setupPolling$12(ReplicationHandler.jav= a:1159) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.j= ava:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:30= 8) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask= .access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.= ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExec= utor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(Thread= PoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.= run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) = org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: o= rg.apache.solr.update.TransactionLog at org.apache.solr.common.util.Object= ReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.upda= te.TransactionLog.(TransactionLog.java:190) at org.apache.solr.updat= e.UpdateLog.newTransactionLog(UpdateLog.java:448) at org.apache.solr.updat= e.UpdateLog.ensureLog(UpdateLog.java:1261) at org.apache.solr.update.Updat= eLog.deleteByQuery(UpdateLog.java:621) at org.apache.solr.update.UpdateLog= .copyOverOldUpdates(UpdateLog.java:1232) at org.apache.solr.update.UpdateL= og.copyAndSwitchToNewTlog(UpdateLog.java:1168) at org.apache.solr.update.U= pdateLog.copyOverOldUpdates(UpdateLog.java:1155) at org.apache.solr.cloud.= ReplicateFromLeader.lambda$startReplication$0(ReplicateFromLeader.java:100)= at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$12(Repl= icationHandler.java:1160) at java.util.concurrent.Executors$RunnableAdapte= r.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(= FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$S= cheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at jav= a.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Sched= uledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecuto= r.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPo= olExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run= (Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectT= rackerException: org.apache.http.impl.client.InternalHttpClient at org.apa= che.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:4= 2) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpCl= ientUtil.java:289) at org.apache.solr.client.solrj.impl.HttpClientUtil.cre= ateClient(HttpClientUtil.java:298) at org.apache.solr.handler.IndexFetcher= .createHttpClient(IndexFetcher.java:224) at org.apache.solr.handler.IndexF= etcher.(IndexFetcher.java:266) at org.apache.solr.handler.Replicatio= nHandler.doFetch(ReplicationHandler.java:416) at org.apache.solr.cloud.Rec= overyStrategy.replicate(RecoveryStrategy.java:225) at org.apache.solr.clou= d.RecoveryStrategy.doSyncOrReplicateRecovery(RecoveryStrategy.java:626) at= org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:30= 8) at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:292= ) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable= .run(InstrumentedExecutorService.java:176) at java.util.concurrent.Executo= rs$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.Future= Task.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$= MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java= .util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)= at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.= java:624) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common= .util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.update.T= ransactionLog at org.apache.solr.common.util.ObjectReleaseTracker.track(Ob= jectReleaseTracker.java:42) at org.apache.solr.update.TransactionLog.(TransactionLog.java:190) at org.apache.solr.update.UpdateLog.newTransact= ionLog(UpdateLog.java:448) at org.apache.solr.update.UpdateLog.ensureLog(U= pdateLog.java:1261) at org.apache.solr.update.UpdateLog.deleteByQuery(Upda= teLog.java:621) at org.apache.solr.update.UpdateLog.copyOverOldUpdates(Upd= ateLog.java:1232) at org.apache.solr.update.UpdateLog.copyAndSwitchToNewTl= og(UpdateLog.java:1168) at org.apache.solr.update.UpdateLog.copyOverOldUpd= ates(UpdateLog.java:1155) at org.apache.solr.cloud.ReplicateFromLeader.lam= bda$startReplication$0(ReplicateFromLeader.java:100) at org.apache.solr.ha= ndler.ReplicationHandler.lambda$setupPolling$12(ReplicationHandler.java:116= 0) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:5= 11) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) a= t java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.acce= ss$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.Sched= uledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.= java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolE= xecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(T= hreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) org.= apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.ap= ache.solr.core.SolrCore at org.apache.solr.common.util.ObjectReleaseTracke= r.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.SolrCore.(SolrCore.java:1020) at org.apache.solr.core.SolrCore.(SolrCore.j= ava:844) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreCo= ntainer.java:1041) at org.apache.solr.core.CoreContainer.create(CoreContai= ner.java:952) at org.apache.solr.handler.admin.CoreAdminOperation.lambda$s= tatic$0(CoreAdminOperation.java:91) at org.apache.solr.handler.admin.CoreA= dminOperation.execute(CoreAdminOperation.java:384) at org.apache.solr.hand= ler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389) at org= .apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHand= ler.java:174) at org.apache.solr.handler.RequestHandlerBase.handleRequest(= RequestHandlerBase.java:177) at org.apache.solr.servlet.HttpSolrCall.handl= eAdmin(HttpSolrCall.java:735) at org.apache.solr.servlet.HttpSolrCall.hand= leAdminRequest(HttpSolrCall.java:716) at org.apache.solr.servlet.HttpSolrC= all.call(HttpSolrCall.java:497) at org.apache.solr.servlet.SolrDispatchFil= ter.doFilter(SolrDispatchFilter.java:382) at org.apache.solr.servlet.SolrD= ispatchFilter.doFilter(SolrDispatchFilter.java:326) at org.eclipse.jetty.s= ervlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at or= g.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(Je= ttySolrRunner.java:139) at org.eclipse.jetty.servlet.ServletHandler$Cached= Chain.doFilter(ServletHandler.java:1759) at org.eclipse.jetty.servlet.Serv= letHandler.doHandle(ServletHandler.java:582) at org.eclipse.jetty.server.s= ession.SessionHandler.doHandle(SessionHandler.java:224) at org.eclipse.jet= ty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180) at org= .eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512) at = org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java= :185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHa= ndler.java:1112) at org.eclipse.jetty.server.handler.ScopedHandler.handle(= ScopedHandler.java:141) at org.eclipse.jetty.server.handler.gzip.GzipHandl= er.handle(GzipHandler.java:426) at org.eclipse.jetty.server.handler.Handle= rWrapper.handle(HandlerWrapper.java:134) at org.eclipse.jetty.server.Serve= r.handle(Server.java:534) at org.eclipse.jetty.server.HttpChannel.handle(H= ttpChannel.java:320) at org.eclipse.jetty.server.HttpConnection.onFillable= (HttpConnection.java:251) at org.eclipse.jetty.io.AbstractConnection$ReadC= allback.succeeded(AbstractConnection.java:283) at org.eclipse.jetty.io.Fil= lInterest.fillable(FillInterest.java:108) at org.eclipse.jetty.io.ssl.SslC= onnection.onFillable(SslConnection.java:251) at org.eclipse.jetty.io.Abstr= actConnection$ReadCallback.succeeded(AbstractConnection.java:283) at org.e= clipse.jetty.io.FillInterest.fillable(FillInterest.java:108) at org.eclips= e.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93) at o= rg.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceC= onsume(ExecuteProduceConsume.java:303) at org.eclipse.jetty.util.thread.st= rategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)= at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(Execu= teProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPo= ol.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.Queu= edThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thre= ad.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTracke= rException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.sol= r.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at = org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.ja= va:348) at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:350)= at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:710) at org.apa= che.solr.core.SolrCore.(SolrCore.java:935) at org.apache.solr.core.S= olrCore.(SolrCore.java:844) at org.apache.solr.core.CoreContainer.cr= eateFromDescriptor(CoreContainer.java:1041) at org.apache.solr.core.CoreCo= ntainer.create(CoreContainer.java:952) at org.apache.solr.handler.admin.Co= reAdminOperation.lambda$static$0(CoreAdminOperation.java:91) at org.apache= .solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)= at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdmin= Handler.java:389) at org.apache.solr.handler.admin.CoreAdminHandler.handle= RequestBody(CoreAdminHandler.java:174) at org.apache.solr.handler.RequestH= andlerBase.handleRequest(RequestHandlerBase.java:177) at org.apache.solr.s= ervlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735) at org.apache.solr.= servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716) at org.apac= he.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497) at org.apache.sol= r.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382) at org.= apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326= ) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(Servlet= Handler.java:1759) at org.apache.solr.client.solrj.embedded.JettySolrRunne= r$DebugFilter.doFilter(JettySolrRunner.java:139) at org.eclipse.jetty.serv= let.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at org.e= clipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582) at o= rg.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java= :224) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextH= andler.java:1180) at org.eclipse.jetty.servlet.ServletHandler.doScope(Serv= letHandler.java:512) at org.eclipse.jetty.server.session.SessionHandler.do= Scope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.Context= Handler.doScope(ContextHandler.java:1112) at org.eclipse.jetty.server.hand= ler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.serv= er.handler.gzip.GzipHandler.handle(GzipHandler.java:426) at org.eclipse.je= tty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134) at org.e= clipse.jetty.server.Server.handle(Server.java:534) at org.eclipse.jetty.se= rver.HttpChannel.handle(HttpChannel.java:320) at org.eclipse.jetty.server.= HttpConnection.onFillable(HttpConnection.java:251) at org.eclipse.jetty.io= .AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283) at= org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) at org.= eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251) at o= rg.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConne= ction.java:283) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest= .java:108) at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChann= elEndPoint.java:93) at org.eclipse.jetty.util.thread.strategy.ExecuteProdu= ceConsume.executeProduceConsume(ExecuteProduceConsume.java:303) at org.ecl= ipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(Execut= eProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.Execut= eProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.u= til.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclip= se.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at = java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectRe= leaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryW= rapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectRel= easeTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(C= achingDirectoryFactory.java:348) at org.apache.solr.core.SolrCore.initSnap= shotMetaDataManager(SolrCore.java:479) at org.apache.solr.core.SolrCore.(SolrCore.java:929) at org.apache.solr.core.SolrCore.(SolrCore.j= ava:844) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreCo= ntainer.java:1041) at org.apache.solr.core.CoreContainer.create(CoreContai= ner.java:952) at org.apache.solr.handler.admin.CoreAdminOperation.lambda$s= tatic$0(CoreAdminOperation.java:91) at org.apache.solr.handler.admin.CoreA= dminOperation.execute(CoreAdminOperation.java:384) at org.apache.solr.hand= ler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389) at org= .apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHand= ler.java:174) at org.apache.solr.handler.RequestHandlerBase.handleRequest(= RequestHandlerBase.java:177) at org.apache.solr.servlet.HttpSolrCall.handl= eAdmin(HttpSolrCall.java:735) at org.apache.solr.servlet.HttpSolrCall.hand= leAdminRequest(HttpSolrCall.java:716) at org.apache.solr.servlet.HttpSolrC= all.call(HttpSolrCall.java:497) at org.apache.solr.servlet.SolrDispatchFil= ter.doFilter(SolrDispatchFilter.java:382) at org.apache.solr.servlet.SolrD= ispatchFilter.doFilter(SolrDispatchFilter.java:326) at org.eclipse.jetty.s= ervlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at or= g.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(Je= ttySolrRunner.java:139) at org.eclipse.jetty.servlet.ServletHandler$Cached= Chain.doFilter(ServletHandler.java:1759) at org.eclipse.jetty.servlet.Serv= letHandler.doHandle(ServletHandler.java:582) at org.eclipse.jetty.server.s= ession.SessionHandler.doHandle(SessionHandler.java:224) at org.eclipse.jet= ty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180) at org= .eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512) at = org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java= :185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHa= ndler.java:1112) at org.eclipse.jetty.server.handler.ScopedHandler.handle(= ScopedHandler.java:141) at org.eclipse.jetty.server.handler.gzip.GzipHandl= er.handle(GzipHandler.java:426) at org.eclipse.jetty.server.handler.Handle= rWrapper.handle(HandlerWrapper.java:134) at org.eclipse.jetty.server.Serve= r.handle(Server.java:534) at org.eclipse.jetty.server.HttpChannel.handle(H= ttpChannel.java:320) at org.eclipse.jetty.server.HttpConnection.onFillable= (HttpConnection.java:251) at org.eclipse.jetty.io.AbstractConnection$ReadC= allback.succeeded(AbstractConnection.java:283) at org.eclipse.jetty.io.Fil= lInterest.fillable(FillInterest.java:108) at org.eclipse.jetty.io.ssl.SslC= onnection.onFillable(SslConnection.java:251) at org.eclipse.jetty.io.Abstr= actConnection$ReadCallback.succeeded(AbstractConnection.java:283) at org.e= clipse.jetty.io.FillInterest.fillable(FillInterest.java:108) at org.eclips= e.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93) at o= rg.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceC= onsume(ExecuteProduceConsume.java:303) at org.eclipse.jetty.util.thread.st= rategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)= at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(Execu= teProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPo= ol.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.Queu= edThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thre= ad.java:748) =20 Stack Trace: java.lang.AssertionError: ObjectTracker found 17 object(s) that were not re= leased!!! [TransactionLog, TransactionLog, TransactionLog, TransactionLog, = InternalHttpClient, TransactionLog, TransactionLog, TransactionLog, MockDir= ectoryWrapper, MDCAwareThreadPoolExecutor, SolrIndexSearcher, TransactionLo= g, InternalHttpClient, TransactionLog, SolrCore, MockDirectoryWrapper, Mock= DirectoryWrapper] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: or= g.apache.solr.update.TransactionLog =09at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseT= racker.java:42) =09at org.apache.solr.update.TransactionLog.(TransactionLog.java:190) =09at org.apache.solr.update.UpdateLog.newTransactionLog(UpdateLog.java:448= ) =09at org.apache.solr.update.UpdateLog.ensureLog(UpdateLog.java:1261) =09at org.apache.solr.update.UpdateLog.deleteByQuery(UpdateLog.java:621) =09at org.apache.solr.update.UpdateLog.copyOverOldUpdates(UpdateLog.java:12= 32) =09at org.apache.solr.update.UpdateLog.copyAndSwitchToNewTlog(UpdateLog.jav= a:1168) =09at org.apache.solr.update.UpdateLog.copyOverOldUpdates(UpdateLog.java:11= 55) =09at org.apache.solr.cloud.ReplicateFromLeader.lambda$startReplication$0(R= eplicateFromLeader.java:100) =09at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$12(Rep= licationHandler.java:1160) =09at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:51= 1) =09at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= access$301(ScheduledThreadPoolExecutor.java:180) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= run(ScheduledThreadPoolExecutor.java:294) =09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.= java:1149) =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor= .java:624) =09at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: or= g.apache.solr.update.TransactionLog =09at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseT= racker.java:42) =09at org.apache.solr.update.TransactionLog.(TransactionLog.java:190) =09at org.apache.solr.update.UpdateLog.newTransactionLog(UpdateLog.java:448= ) =09at org.apache.solr.update.UpdateLog.ensureLog(UpdateLog.java:1261) =09at org.apache.solr.update.UpdateLog.deleteByQuery(UpdateLog.java:621) =09at org.apache.solr.update.UpdateLog.copyOverOldUpdates(UpdateLog.java:12= 32) =09at org.apache.solr.update.UpdateLog.copyAndSwitchToNewTlog(UpdateLog.jav= a:1168) =09at org.apache.solr.update.UpdateLog.copyOverOldUpdates(UpdateLog.java:11= 55) =09at org.apache.solr.cloud.ReplicateFromLeader.lambda$startReplication$0(R= eplicateFromLeader.java:100) =09at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$12(Rep= licationHandler.java:1160) =09at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:51= 1) =09at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= access$301(ScheduledThreadPoolExecutor.java:180) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= run(ScheduledThreadPoolExecutor.java:294) =09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.= java:1149) =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor= .java:624) =09at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: or= g.apache.solr.update.TransactionLog =09at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseT= racker.java:42) =09at org.apache.solr.update.TransactionLog.(TransactionLog.java:190) =09at org.apache.solr.update.UpdateLog.newTransactionLog(UpdateLog.java:448= ) =09at org.apache.solr.update.UpdateLog.ensureLog(UpdateLog.java:1261) =09at org.apache.solr.update.UpdateLog.deleteByQuery(UpdateLog.java:621) =09at org.apache.solr.update.UpdateLog.copyOverOldUpdates(UpdateLog.java:12= 32) =09at org.apache.solr.update.UpdateLog.copyAndSwitchToNewTlog(UpdateLog.jav= a:1168) =09at org.apache.solr.update.UpdateLog.copyOverOldUpdates(UpdateLog.java:11= 55) =09at org.apache.solr.cloud.ReplicateFromLeader.lambda$startReplication$0(R= eplicateFromLeader.java:100) =09at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$12(Rep= licationHandler.java:1160) =09at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:51= 1) =09at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= access$301(ScheduledThreadPoolExecutor.java:180) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= run(ScheduledThreadPoolExecutor.java:294) =09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.= java:1149) =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor= .java:624) =09at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: or= g.apache.solr.update.TransactionLog =09at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseT= racker.java:42) =09at org.apache.solr.update.TransactionLog.(TransactionLog.java:190) =09at org.apache.solr.update.UpdateLog.newTransactionLog(UpdateLog.java:448= ) =09at org.apache.solr.update.UpdateLog.ensureLog(UpdateLog.java:1261) =09at org.apache.solr.update.UpdateLog.deleteByQuery(UpdateLog.java:621) =09at org.apache.solr.update.UpdateLog.copyOverOldUpdates(UpdateLog.java:12= 32) =09at org.apache.solr.update.UpdateLog.copyAndSwitchToNewTlog(UpdateLog.jav= a:1168) =09at org.apache.solr.update.UpdateLog.copyOverOldUpdates(UpdateLog.java:11= 55) =09at org.apache.solr.cloud.ReplicateFromLeader.lambda$startReplication$0(R= eplicateFromLeader.java:100) =09at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$12(Rep= licationHandler.java:1160) =09at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:51= 1) =09at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= access$301(ScheduledThreadPoolExecutor.java:180) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= run(ScheduledThreadPoolExecutor.java:294) =09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.= java:1149) =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor= .java:624) =09at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: or= g.apache.http.impl.client.InternalHttpClient =09at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseT= racker.java:42) =09at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpCli= entUtil.java:289) =09at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpCli= entUtil.java:298) =09at org.apache.solr.handler.IndexFetcher.createHttpClient(IndexFetcher.ja= va:224) =09at org.apache.solr.handler.IndexFetcher.(IndexFetcher.java:266) =09at org.apache.solr.handler.ReplicationHandler.inform(ReplicationHandler.= java:1190) =09at org.apache.solr.cloud.ReplicateFromLeader.startReplication(ReplicateF= romLeader.java:106) =09at org.apache.solr.cloud.ZkController.startReplicationFromLeader(ZkContr= oller.java:1146) =09at org.apache.solr.cloud.RecoveryStrategy.doSyncOrReplicateRecovery(Reco= veryStrategy.java:673) =09at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.ja= va:308) =09at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:292) =09at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable= .run(InstrumentedExecutorService.java:176) =09at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:51= 1) =09at java.util.concurrent.FutureTask.run(FutureTask.java:266) =09at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.l= ambda$execute$0(ExecutorUtil.java:188) =09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.= java:1149) =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor= .java:624) =09at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: or= g.apache.solr.update.TransactionLog =09at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseT= racker.java:42) =09at org.apache.solr.update.TransactionLog.(TransactionLog.java:190) =09at org.apache.solr.update.UpdateLog.newTransactionLog(UpdateLog.java:448= ) =09at org.apache.solr.update.UpdateLog.ensureLog(UpdateLog.java:1261) =09at org.apache.solr.update.UpdateLog.deleteByQuery(UpdateLog.java:621) =09at org.apache.solr.update.UpdateLog.copyOverOldUpdates(UpdateLog.java:12= 32) =09at org.apache.solr.update.UpdateLog.copyAndSwitchToNewTlog(UpdateLog.jav= a:1168) =09at org.apache.solr.update.UpdateLog.copyOverOldUpdates(UpdateLog.java:11= 55) =09at org.apache.solr.cloud.ReplicateFromLeader.lambda$startReplication$0(R= eplicateFromLeader.java:100) =09at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$12(Rep= licationHandler.java:1160) =09at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:51= 1) =09at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= access$301(ScheduledThreadPoolExecutor.java:180) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= run(ScheduledThreadPoolExecutor.java:294) =09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.= java:1149) =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor= .java:624) =09at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: or= g.apache.solr.update.TransactionLog =09at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseT= racker.java:42) =09at org.apache.solr.update.TransactionLog.(TransactionLog.java:190) =09at org.apache.solr.update.UpdateLog.newTransactionLog(UpdateLog.java:448= ) =09at org.apache.solr.update.UpdateLog.ensureLog(UpdateLog.java:1261) =09at org.apache.solr.update.UpdateLog.deleteByQuery(UpdateLog.java:621) =09at org.apache.solr.update.UpdateLog.copyOverOldUpdates(UpdateLog.java:12= 32) =09at org.apache.solr.update.UpdateLog.copyAndSwitchToNewTlog(UpdateLog.jav= a:1168) =09at org.apache.solr.update.UpdateLog.copyOverOldUpdates(UpdateLog.java:11= 55) =09at org.apache.solr.cloud.ReplicateFromLeader.lambda$startReplication$0(R= eplicateFromLeader.java:100) =09at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$12(Rep= licationHandler.java:1160) =09at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:51= 1) =09at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= access$301(ScheduledThreadPoolExecutor.java:180) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= run(ScheduledThreadPoolExecutor.java:294) =09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.= java:1149) =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor= .java:624) =09at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: or= g.apache.solr.update.TransactionLog =09at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseT= racker.java:42) =09at org.apache.solr.update.TransactionLog.(TransactionLog.java:190) =09at org.apache.solr.update.UpdateLog.newTransactionLog(UpdateLog.java:448= ) =09at org.apache.solr.update.UpdateLog.ensureLog(UpdateLog.java:1261) =09at org.apache.solr.update.UpdateLog.deleteByQuery(UpdateLog.java:621) =09at org.apache.solr.update.UpdateLog.copyOverOldUpdates(UpdateLog.java:12= 32) =09at org.apache.solr.update.UpdateLog.copyAndSwitchToNewTlog(UpdateLog.jav= a:1168) =09at org.apache.solr.update.UpdateLog.copyOverOldUpdates(UpdateLog.java:11= 55) =09at org.apache.solr.cloud.ReplicateFromLeader.lambda$startReplication$0(R= eplicateFromLeader.java:100) =09at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$12(Rep= licationHandler.java:1160) =09at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:51= 1) =09at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= access$301(ScheduledThreadPoolExecutor.java:180) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= run(ScheduledThreadPoolExecutor.java:294) =09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.= java:1149) =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor= .java:624) =09at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: or= g.apache.lucene.store.MockDirectoryWrapper =09at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseT= racker.java:42) =09at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFact= ory.java:348) =09at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.ja= va:501) =09at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.ja= va:345) =09at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler= .java:420) =09at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$12(Rep= licationHandler.java:1159) =09at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:51= 1) =09at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= access$301(ScheduledThreadPoolExecutor.java:180) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= run(ScheduledThreadPoolExecutor.java:294) =09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.= java:1149) =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor= .java:624) =09at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: or= g.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor =09at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseT= racker.java:42) =09at org.apache.solr.core.SolrCore.(SolrCore.java:873) =09at org.apache.solr.core.SolrCore.(SolrCore.java:844) =09at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer= .java:1041) =09at org.apache.solr.core.CoreContainer.create(CoreContainer.java:952) =09at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(Core= AdminOperation.java:91) =09at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOpe= ration.java:384) =09at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdmi= nHandler.java:389) =09at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(Core= AdminHandler.java:174) =09at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandl= erBase.java:177) =09at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:73= 5) =09at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.= java:716) =09at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497) =09at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilte= r.java:382) =09at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilte= r.java:326) =09at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(Servlet= Handler.java:1759) =09at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doF= ilter(JettySolrRunner.java:139) =09at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(Servlet= Handler.java:1759) =09at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java= :582) =09at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandl= er.java:224) =09at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandl= er.java:1180) =09at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:= 512) =09at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandle= r.java:185) =09at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandle= r.java:1112) =09at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.j= ava:141) =09at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.= java:426) =09at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper= .java:134) =09at org.eclipse.jetty.server.Server.handle(Server.java:534) =09at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320) =09at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.jav= a:251) =09at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(Abstra= ctConnection.java:283) =09at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) =09at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:= 251) =09at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(Abstra= ctConnection.java:283) =09at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) =09at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoin= t.java:93) =09at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeP= roduceConsume(ExecuteProduceConsume.java:303) =09at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceC= onsume(ExecuteProduceConsume.java:148) =09at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(Exec= uteProduceConsume.java:136) =09at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPoo= l.java:671) =09at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool= .java:589) =09at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: or= g.apache.solr.search.SolrIndexSearcher =09at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseT= racker.java:42) =09at org.apache.solr.search.SolrIndexSearcher.(SolrIndexSearcher.jav= a:323) =09at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2023) =09at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2196) =09at org.apache.solr.handler.IndexFetcher.openNewSearcherAndUpdateCommitPo= int(IndexFetcher.java:892) =09at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.ja= va:649) =09at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.ja= va:345) =09at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler= .java:420) =09at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$12(Rep= licationHandler.java:1159) =09at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:51= 1) =09at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= access$301(ScheduledThreadPoolExecutor.java:180) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= run(ScheduledThreadPoolExecutor.java:294) =09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.= java:1149) =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor= .java:624) =09at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: or= g.apache.solr.update.TransactionLog =09at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseT= racker.java:42) =09at org.apache.solr.update.TransactionLog.(TransactionLog.java:190) =09at org.apache.solr.update.UpdateLog.newTransactionLog(UpdateLog.java:448= ) =09at org.apache.solr.update.UpdateLog.ensureLog(UpdateLog.java:1261) =09at org.apache.solr.update.UpdateLog.deleteByQuery(UpdateLog.java:621) =09at org.apache.solr.update.UpdateLog.copyOverOldUpdates(UpdateLog.java:12= 32) =09at org.apache.solr.update.UpdateLog.copyAndSwitchToNewTlog(UpdateLog.jav= a:1168) =09at org.apache.solr.update.UpdateLog.copyOverOldUpdates(UpdateLog.java:11= 55) =09at org.apache.solr.cloud.ReplicateFromLeader.lambda$startReplication$0(R= eplicateFromLeader.java:100) =09at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$12(Rep= licationHandler.java:1160) =09at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:51= 1) =09at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= access$301(ScheduledThreadPoolExecutor.java:180) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= run(ScheduledThreadPoolExecutor.java:294) =09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.= java:1149) =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor= .java:624) =09at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: or= g.apache.http.impl.client.InternalHttpClient =09at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseT= racker.java:42) =09at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpCli= entUtil.java:289) =09at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpCli= entUtil.java:298) =09at org.apache.solr.handler.IndexFetcher.createHttpClient(IndexFetcher.ja= va:224) =09at org.apache.solr.handler.IndexFetcher.(IndexFetcher.java:266) =09at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler= .java:416) =09at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.jav= a:225) =09at org.apache.solr.cloud.RecoveryStrategy.doSyncOrReplicateRecovery(Reco= veryStrategy.java:626) =09at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.ja= va:308) =09at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:292) =09at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable= .run(InstrumentedExecutorService.java:176) =09at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:51= 1) =09at java.util.concurrent.FutureTask.run(FutureTask.java:266) =09at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.l= ambda$execute$0(ExecutorUtil.java:188) =09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.= java:1149) =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor= .java:624) =09at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: or= g.apache.solr.update.TransactionLog =09at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseT= racker.java:42) =09at org.apache.solr.update.TransactionLog.(TransactionLog.java:190) =09at org.apache.solr.update.UpdateLog.newTransactionLog(UpdateLog.java:448= ) =09at org.apache.solr.update.UpdateLog.ensureLog(UpdateLog.java:1261) =09at org.apache.solr.update.UpdateLog.deleteByQuery(UpdateLog.java:621) =09at org.apache.solr.update.UpdateLog.copyOverOldUpdates(UpdateLog.java:12= 32) =09at org.apache.solr.update.UpdateLog.copyAndSwitchToNewTlog(UpdateLog.jav= a:1168) =09at org.apache.solr.update.UpdateLog.copyOverOldUpdates(UpdateLog.java:11= 55) =09at org.apache.solr.cloud.ReplicateFromLeader.lambda$startReplication$0(R= eplicateFromLeader.java:100) =09at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$12(Rep= licationHandler.java:1160) =09at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:51= 1) =09at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= access$301(ScheduledThreadPoolExecutor.java:180) =09at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.= run(ScheduledThreadPoolExecutor.java:294) =09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.= java:1149) =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor= .java:624) =09at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: or= g.apache.solr.core.SolrCore =09at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseT= racker.java:42) =09at org.apache.solr.core.SolrCore.(SolrCore.java:1020) =09at org.apache.solr.core.SolrCore.(SolrCore.java:844) =09at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer= .java:1041) =09at org.apache.solr.core.CoreContainer.create(CoreContainer.java:952) =09at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(Core= AdminOperation.java:91) =09at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOpe= ration.java:384) =09at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdmi= nHandler.java:389) =09at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(Core= AdminHandler.java:174) =09at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandl= erBase.java:177) =09at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:73= 5) =09at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.= java:716) =09at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497) =09at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilte= r.java:382) =09at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilte= r.java:326) =09at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(Servlet= Handler.java:1759) =09at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doF= ilter(JettySolrRunner.java:139) =09at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(Servlet= Handler.java:1759) =09at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java= :582) =09at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandl= er.java:224) =09at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandl= er.java:1180) =09at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:= 512) =09at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandle= r.java:185) =09at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandle= r.java:1112) =09at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.j= ava:141) =09at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.= java:426) =09at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper= .java:134) =09at org.eclipse.jetty.server.Server.handle(Server.java:534) =09at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320) =09at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.jav= a:251) =09at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(Abstra= ctConnection.java:283) =09at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) =09at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:= 251) =09at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(Abstra= ctConnection.java:283) =09at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) =09at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoin= t.java:93) =09at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeP= roduceConsume(ExecuteProduceConsume.java:303) =09at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceC= onsume(ExecuteProduceConsume.java:148) =09at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(Exec= uteProduceConsume.java:136) =09at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPoo= l.java:671) =09at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool= .java:589) =09at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: or= g.apache.lucene.store.MockDirectoryWrapper =09at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseT= racker.java:42) =09at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFact= ory.java:348) =09at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:350) =09at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:710) =09at org.apache.solr.core.SolrCore.(SolrCore.java:935) =09at org.apache.solr.core.SolrCore.(SolrCore.java:844) =09at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer= .java:1041) =09at org.apache.solr.core.CoreContainer.create(CoreContainer.java:952) =09at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(Core= AdminOperation.java:91) =09at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOpe= ration.java:384) =09at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdmi= nHandler.java:389) =09at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(Core= AdminHandler.java:174) =09at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandl= erBase.java:177) =09at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:73= 5) =09at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.= java:716) =09at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497) =09at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilte= r.java:382) =09at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilte= r.java:326) =09at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(Servlet= Handler.java:1759) =09at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doF= ilter(JettySolrRunner.java:139) =09at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(Servlet= Handler.java:1759) =09at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java= :582) =09at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandl= er.java:224) =09at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandl= er.java:1180) =09at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:= 512) =09at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandle= r.java:185) =09at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandle= r.java:1112) =09at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.j= ava:141) =09at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.= java:426) =09at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper= .java:134) =09at org.eclipse.jetty.server.Server.handle(Server.java:534) =09at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320) =09at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.jav= a:251) =09at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(Abstra= ctConnection.java:283) =09at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) =09at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:= 251) =09at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(Abstra= ctConnection.java:283) =09at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) =09at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoin= t.java:93) =09at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeP= roduceConsume(ExecuteProduceConsume.java:303) =09at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceC= onsume(ExecuteProduceConsume.java:148) =09at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(Exec= uteProduceConsume.java:136) =09at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPoo= l.java:671) =09at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool= .java:589) =09at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: or= g.apache.lucene.store.MockDirectoryWrapper =09at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseT= racker.java:42) =09at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFact= ory.java:348) =09at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.ja= va:479) =09at org.apache.solr.core.SolrCore.(SolrCore.java:929) =09at org.apache.solr.core.SolrCore.(SolrCore.java:844) =09at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer= .java:1041) =09at org.apache.solr.core.CoreContainer.create(CoreContainer.java:952) =09at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(Core= AdminOperation.java:91) =09at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOpe= ration.java:384) =09at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdmi= nHandler.java:389) =09at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(Core= AdminHandler.java:174) =09at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandl= erBase.java:177) =09at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:73= 5) =09at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.= java:716) =09at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497) =09at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilte= r.java:382) =09at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilte= r.java:326) =09at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(Servlet= Handler.java:1759) =09at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doF= ilter(JettySolrRunner.java:139) =09at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(Servlet= Handler.java:1759) =09at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java= :582) =09at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandl= er.java:224) =09at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandl= er.java:1180) =09at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:= 512) =09at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandle= r.java:185) =09at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandle= r.java:1112) =09at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.j= ava:141) =09at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.= java:426) =09at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper= .java:134) =09at org.eclipse.jetty.server.Server.handle(Server.java:534) =09at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320) =09at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.jav= a:251) =09at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(Abstra= ctConnection.java:283) =09at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) =09at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:= 251) =09at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(Abstra= ctConnection.java:283) =09at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) =09at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoin= t.java:93) =09at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeP= roduceConsume(ExecuteProduceConsume.java:303) =09at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceC= onsume(ExecuteProduceConsume.java:148) =09at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(Exec= uteProduceConsume.java:136) =09at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPoo= l.java:671) =09at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool= .java:589) =09at java.lang.Thread.run(Thread.java:748) =09at __randomizedtesting.SeedInfo.seed([8370C462587B74F5]:0) =09at org.junit.Assert.fail(Assert.java:93) =09at org.junit.Assert.assertTrue(Assert.java:43) =09at org.junit.Assert.assertNull(Assert.java:551) =09at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:= 298) =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.= java:62) =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces= sorImpl.java:43) =09at java.lang.reflect.Method.invoke(Method.java:498) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1737) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:897) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:41) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:53) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:54) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:368) =09at java.lang.Thread.run(Thread.java:748) FAILED: junit.framework.TestSuite.org.apache.solr.update.TestInPlaceUpdate= sDistrib Error Message: 2 threads leaked from SUITE scope at org.apache.solr.update.TestInPlaceUpda= tesDistrib: 1) Thread[id=3D58175, name=3DsearcherExecutor-12025-thread-= 1, state=3DWAITING, group=3DTGRP-TestInPlaceUpdatesDistrib] at sun.= misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockS= upport.park(LockSupport.java:175) at java.util.concurrent.locks.Abs= tractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.ja= va:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlo= ckingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.get= Task(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPo= olExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.con= current.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) = at java.lang.Thread.run(Thread.java:748) 2) Thread[id=3D58183, name=3Din= dexFetcher-12031-thread-1, state=3DTIMED_WAITING, group=3DTGRP-TestInPlaceU= pdatesDistrib] at sun.misc.Unsafe.park(Native Method) at ja= va.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) = at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.= awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concu= rrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPool= Executor.java:1093) at java.util.concurrent.ScheduledThreadPoolExec= utor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at= java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:10= 74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPool= Executor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Work= er.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.= java:748) Stack Trace: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from S= UITE scope at org.apache.solr.update.TestInPlaceUpdatesDistrib:=20 1) Thread[id=3D58175, name=3DsearcherExecutor-12025-thread-1, state=3DWA= ITING, group=3DTGRP-TestInPlaceUpdatesDistrib] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175= ) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionO= bject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueu= e.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecut= or.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec= utor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:624) at java.lang.Thread.run(Thread.java:748) 2) Thread[id=3D58183, name=3DindexFetcher-12031-thread-1, state=3DTIMED_= WAITING, group=3DTGRP-TestInPlaceUpdatesDistrib] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.jav= a:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionO= bject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueu= e.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueu= e.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecut= or.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec= utor.java:1134) at java.util.concurre [...truncated too long message...] [junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(= ThreadPoolExecutor.java:1134) [junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.= run(ThreadPoolExecutor.java:624) [junit4] > at java.lang.Thread.run(Thread.java:748) [junit4] > 7) Thread[id=3D1219, name=3DzkCallback-385-thread-1-Sen= dThread(127.0.0.1:35631), state=3DTIMED_WAITING, group=3DTGRP-GraphExpressi= onTest] [junit4] > at java.lang.Thread.sleep(Native Method) [junit4] > at org.apache.zookeeper.client.StaticHostProvider.= next(StaticHostProvider.java:101) [junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.star= tConnect(ClientCnxn.java:997) [junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(= ClientCnxn.java:1060) [junit4] > 8) Thread[id=3D1200, name=3DzkCallback-385-thread-1, st= ate=3DTIMED_WAITING, group=3DTGRP-GraphExpressionTest] [junit4] > at sun.misc.Unsafe.park(Native Method) [junit4] > at java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:215) [junit4] > at java.util.concurrent.SynchronousQueue$TransferS= tack.awaitFulfill(SynchronousQueue.java:460) [junit4] > at java.util.concurrent.SynchronousQueue$TransferS= tack.transfer(SynchronousQueue.java:362) [junit4] > at java.util.concurrent.SynchronousQueue.poll(Sync= hronousQueue.java:941) [junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask= (ThreadPoolExecutor.java:1073) [junit4] > at java.util.concurrent.ThreadPoolExecutor.runWork= er(ThreadPoolExecutor.java:1134) [junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.= run(ThreadPoolExecutor.java:624) [junit4] > at java.lang.Thread.run(Thread.java:748) [junit4] > 9) Thread[id=3D1213, name=3DzkCallback-385-thread-2, st= ate=3DTIMED_WAITING, group=3DTGRP-GraphExpressionTest] [junit4] > at sun.misc.Unsafe.park(Native Method) [junit4] > at java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:215) [junit4] > at java.util.concurrent.SynchronousQueue$TransferS= tack.awaitFulfill(SynchronousQueue.java:460) [junit4] > at java.util.concurrent.SynchronousQueue$TransferS= tack.transfer(SynchronousQueue.java:362) [junit4] > at java.util.concurrent.SynchronousQueue.poll(Sync= hronousQueue.java:941) [junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask= (ThreadPoolExecutor.java:1073) [junit4] > at java.util.concurrent.ThreadPoolExecutor.runWork= er(ThreadPoolExecutor.java:1134) [junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.= run(ThreadPoolExecutor.java:624) [junit4] > at java.lang.Thread.run(Thread.java:748) [junit4] > 10) Thread[id=3D1220, name=3DzkCallback-385-thread-1-Eve= ntThread, state=3DWAITING, group=3DTGRP-GraphExpressionTest] [junit4] > at sun.misc.Unsafe.park(Native Method) [junit4] > at java.util.concurrent.locks.LockSupport.park(Loc= kSupport.java:175) [junit4] > at java.util.concurrent.locks.AbstractQueuedSynchr= onizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) [junit4] > at java.util.concurrent.LinkedBlockingQueue.take(L= inkedBlockingQueue.java:442) [junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run= (ClientCnxn.java:501) [junit4] > =09at __randomizedtesting.SeedInfo.seed([9EB5CC6CBA28B45B]= :0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There = are still zombie threads that couldn't be terminated: [junit4] > 1) Thread[id=3D1329, name=3DzkCallback-385-thread-5, st= ate=3DTIMED_WAITING, group=3DTGRP-GraphExpressionTest] [junit4] > at sun.misc.Unsafe.park(Native Method) [junit4] > at java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:215) [junit4] > at java.util.concurrent.SynchronousQueue$TransferS= tack.awaitFulfill(SynchronousQueue.java:460) [junit4] > at java.util.concurrent.SynchronousQueue$TransferS= tack.transfer(SynchronousQueue.java:362) [junit4] > at java.util.concurrent.SynchronousQueue.poll(Sync= hronousQueue.java:941) [junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask= (ThreadPoolExecutor.java:1073) [junit4] > at java.util.concurrent.ThreadPoolExecutor.runWork= er(ThreadPoolExecutor.java:1134) [junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.= run(ThreadPoolExecutor.java:624) [junit4] > at java.lang.Thread.run(Thread.java:748) [junit4] > 2) Thread[id=3D1218, name=3DzkCallback-385-thread-4, st= ate=3DTIMED_WAITING, group=3DTGRP-GraphExpressionTest] [junit4] > at sun.misc.Unsafe.park(Native Method) [junit4] > at java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:215) [junit4] > at java.util.concurrent.SynchronousQueue$TransferS= tack.awaitFulfill(SynchronousQueue.java:460) [junit4] > at java.util.concurrent.SynchronousQueue$TransferS= tack.transfer(SynchronousQueue.java:362) [junit4] > at java.util.concurrent.SynchronousQueue.poll(Sync= hronousQueue.java:941) [junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask= (ThreadPoolExecutor.java:1073) [junit4] > at java.util.concurrent.ThreadPoolExecutor.runWork= er(ThreadPoolExecutor.java:1134) [junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.= run(ThreadPoolExecutor.java:624) [junit4] > at java.lang.Thread.run(Thread.java:748) [junit4] > 3) Thread[id=3D1214, name=3DzkCallback-385-thread-3, st= ate=3DTIMED_WAITING, group=3DTGRP-GraphExpressionTest] [junit4] > at sun.misc.Unsafe.park(Native Method) [junit4] > at java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:215) [junit4] > at java.util.concurrent.SynchronousQueue$TransferS= tack.awaitFulfill(SynchronousQueue.java:460) [junit4] > at java.util.concurrent.SynchronousQueue$TransferS= tack.transfer(SynchronousQueue.java:362) [junit4] > at java.util.concurrent.SynchronousQueue.poll(Sync= hronousQueue.java:941) [junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask= (ThreadPoolExecutor.java:1073) [junit4] > at java.util.concurrent.ThreadPoolExecutor.runWork= er(ThreadPoolExecutor.java:1134) [junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.= run(ThreadPoolExecutor.java:624) [junit4] > at java.lang.Thread.run(Thread.java:748) [junit4] > 4) Thread[id=3D1219, name=3DzkCallback-385-thread-1-Sen= dThread(127.0.0.1:35631), state=3DTIMED_WAITING, group=3DTGRP-GraphExpressi= onTest] [junit4] > at java.lang.Thread.sleep(Native Method) [junit4] > at org.apache.zookeeper.client.StaticHostProvider.= next(StaticHostProvider.java:101) [junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.star= tConnect(ClientCnxn.java:997) [junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(= ClientCnxn.java:1060) [junit4] > 5) Thread[id=3D1200, name=3DzkCallback-385-thread-1, st= ate=3DTIMED_WAITING, group=3DTGRP-GraphExpressionTest] [junit4] > at sun.misc.Unsafe.park(Native Method) [junit4] > at java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:215) [junit4] > at java.util.concurrent.SynchronousQueue$TransferS= tack.awaitFulfill(SynchronousQueue.java:460) [junit4] > at java.util.concurrent.SynchronousQueue$TransferS= tack.transfer(SynchronousQueue.java:362) [junit4] > at java.util.concurrent.SynchronousQueue.poll(Sync= hronousQueue.java:941) [junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask= (ThreadPoolExecutor.java:1073) [junit4] > at java.util.concurrent.ThreadPoolExecutor.runWork= er(ThreadPoolExecutor.java:1134) [junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.= run(ThreadPoolExecutor.java:624) [junit4] > at java.lang.Thread.run(Thread.java:748) [junit4] > 6) Thread[id=3D1213, name=3DzkCallback-385-thread-2, st= ate=3DTIMED_WAITING, group=3DTGRP-GraphExpressionTest] [junit4] > at sun.misc.Unsafe.park(Native Method) [junit4] > at java.util.concurrent.locks.LockSupport.parkNano= s(LockSupport.java:215) [junit4] > at java.util.concurrent.SynchronousQueue$TransferS= tack.awaitFulfill(SynchronousQueue.java:460) [junit4] > at java.util.concurrent.SynchronousQueue$TransferS= tack.transfer(SynchronousQueue.java:362) [junit4] > at java.util.concurrent.SynchronousQueue.poll(Sync= hronousQueue.java:941) [junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask= (ThreadPoolExecutor.java:1073) [junit4] > at java.util.concurrent.ThreadPoolExecutor.runWork= er(ThreadPoolExecutor.java:1134) [junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.= run(ThreadPoolExecutor.java:624) [junit4] > at java.lang.Thread.run(Thread.java:748) [junit4] > =09at __randomizedtesting.SeedInfo.seed([9EB5CC6CBA28B45B]= :0) [junit4] Completed [98/146 (1!)] on J0 in 62.06s, 6 tests, 3 errors <<< = FAILURES! [...truncated 7711 lines...] BUILD FAILED /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/check= out/build.xml:843: The following error occurred while executing this line: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/check= out/build.xml:787: Some of the tests produced a heap dump, but did not fail= . Maybe a suppressed OutOfMemoryError? Dumps created: * java_pid30451.hprof Total time: 854 minutes 19 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts Recording test results Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ------=_Part_1609_1751305922.1512389674512 Content-Type: text/plain; charset=us-ascii --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org ------=_Part_1609_1751305922.1512389674512--