lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS-EA] Lucene-Solr-7.x-Linux (64bit/jdk-11-ea+5) - Build # 1846 - Unstable!
Date Fri, 04 May 2018 10:20:57 GMT
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1846/
Java: 64bit/jdk-11-ea+5 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

13 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.search.TestStressRecovery

Error Message:
7 threads leaked from SUITE scope at org.apache.solr.search.TestStressRecovery:     1) Thread[id=16049, name=WRITER1, state=WAITING, group=TGRP-TestStressRecovery]         at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)         at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)         at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)         at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)         at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)         at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)         at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)         at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)         at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)         at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)         at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)         at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)    2) Thread[id=16050, name=WRITER2, state=WAITING, group=TGRP-TestStressRecovery]         at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)         at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)         at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)         at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)         at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)         at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)         at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)         at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)         at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)         at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)         at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)         at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)    3) Thread[id=16048, name=WRITER0, state=WAITING, group=TGRP-TestStressRecovery]         at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)         at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)         at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)         at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)         at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)         at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)         at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)         at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)         at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)         at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)         at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)         at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)    4) Thread[id=16052, name=WRITER4, state=WAITING, group=TGRP-TestStressRecovery]         at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)         at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)         at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)         at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)         at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)         at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)         at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)         at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)         at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)         at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)         at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)         at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)    5) Thread[id=16051, name=WRITER3, state=WAITING, group=TGRP-TestStressRecovery]         at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)         at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)         at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)         at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)         at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)         at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)         at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)         at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)         at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)         at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)         at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)         at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)    6) Thread[id=16053, name=WRITER5, state=WAITING, group=TGRP-TestStressRecovery]         at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)         at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)         at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)         at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)         at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)         at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)         at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)         at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)         at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)         at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)         at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)         at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)    7) Thread[id=16054, name=WRITER6, state=WAITING, group=TGRP-TestStressRecovery]         at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)         at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)         at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)         at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)         at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)         at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)         at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)         at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)         at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)         at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)         at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)         at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 7 threads leaked from SUITE scope at org.apache.solr.search.TestStressRecovery: 
   1) Thread[id=16049, name=WRITER1, state=WAITING, group=TGRP-TestStressRecovery]
        at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)
        at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)
        at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)
        at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)
        at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)
        at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
        at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
        at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
        at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)
        at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)
        at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)
        at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)
        at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)
   2) Thread[id=16050, name=WRITER2, state=WAITING, group=TGRP-TestStressRecovery]
        at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)
        at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)
        at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)
        at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)
        at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)
        at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
        at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
        at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
        at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)
        at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)
        at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)
        at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)
        at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)
   3) Thread[id=16048, name=WRITER0, state=WAITING, group=TGRP-TestStressRecovery]
        at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)
        at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)
        at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)
        at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)
        at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)
        at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
        at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
        at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
        at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)
        at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)
        at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)
        at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)
        at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)
   4) Thread[id=16052, name=WRITER4, state=WAITING, group=TGRP-TestStressRecovery]
        at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)
        at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)
        at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)
        at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)
        at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)
        at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
        at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
        at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
        at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)
        at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)
        at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)
        at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)
        at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)
   5) Thread[id=16051, name=WRITER3, state=WAITING, group=TGRP-TestStressRecovery]
        at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)
        at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)
        at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)
        at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)
        at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)
        at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
        at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
        at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
        at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)
        at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)
        at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)
        at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)
        at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)
   6) Thread[id=16053, name=WRITER5, state=WAITING, group=TGRP-TestStressRecovery]
        at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)
        at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)
        at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)
        at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)
        at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)
        at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
        at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
        at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
        at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)
        at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)
        at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)
        at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)
        at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)
   7) Thread[id=16054, name=WRITER6, state=WAITING, group=TGRP-TestStressRecovery]
        at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)
        at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)
        at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)
        at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)
        at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)
        at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
        at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
        at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
        at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)
        at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)
        at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)
        at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)
        at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)
	at __randomizedtesting.SeedInfo.seed([574A613DDBAAAD99]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.TestStressRecovery

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=16049, name=WRITER1, state=WAITING, group=TGRP-TestStressRecovery]         at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)         at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)         at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)         at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)         at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)         at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)         at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)         at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)         at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)         at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)         at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)         at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)    2) Thread[id=16050, name=WRITER2, state=WAITING, group=TGRP-TestStressRecovery]         at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)         at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)         at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)         at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)         at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)         at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)         at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)         at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)         at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)         at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)         at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)         at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)    3) Thread[id=16048, name=WRITER0, state=WAITING, group=TGRP-TestStressRecovery]         at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)         at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)         at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)         at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)         at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)         at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)         at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)         at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)         at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)         at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)         at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)         at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)    4) Thread[id=16052, name=WRITER4, state=WAITING, group=TGRP-TestStressRecovery]         at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)         at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)         at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)         at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)         at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)         at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)         at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)         at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)         at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)         at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)         at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)         at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)    5) Thread[id=16051, name=WRITER3, state=WAITING, group=TGRP-TestStressRecovery]         at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)         at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)         at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)         at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)         at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)         at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)         at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)         at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)         at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)         at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)         at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)         at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)    6) Thread[id=16053, name=WRITER5, state=WAITING, group=TGRP-TestStressRecovery]         at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)         at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)         at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)         at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)         at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)         at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)         at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)         at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)         at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)         at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)         at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)         at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)    7) Thread[id=16054, name=WRITER6, state=WAITING, group=TGRP-TestStressRecovery]         at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)         at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)         at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)         at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)         at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)         at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)         at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)         at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)         at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)         at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)         at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)         at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)         at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)         at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)         at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=16049, name=WRITER1, state=WAITING, group=TGRP-TestStressRecovery]
        at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)
        at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)
        at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)
        at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)
        at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)
        at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
        at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
        at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
        at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)
        at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)
        at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)
        at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)
        at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)
   2) Thread[id=16050, name=WRITER2, state=WAITING, group=TGRP-TestStressRecovery]
        at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)
        at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)
        at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)
        at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)
        at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)
        at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
        at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
        at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
        at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)
        at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)
        at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)
        at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)
        at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)
   3) Thread[id=16048, name=WRITER0, state=WAITING, group=TGRP-TestStressRecovery]
        at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)
        at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)
        at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)
        at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)
        at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)
        at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
        at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
        at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
        at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)
        at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)
        at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)
        at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)
        at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)
   4) Thread[id=16052, name=WRITER4, state=WAITING, group=TGRP-TestStressRecovery]
        at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)
        at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)
        at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)
        at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)
        at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)
        at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
        at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
        at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
        at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)
        at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)
        at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)
        at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)
        at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)
   5) Thread[id=16051, name=WRITER3, state=WAITING, group=TGRP-TestStressRecovery]
        at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)
        at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)
        at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)
        at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)
        at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)
        at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
        at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
        at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
        at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)
        at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)
        at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)
        at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)
        at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)
   6) Thread[id=16053, name=WRITER5, state=WAITING, group=TGRP-TestStressRecovery]
        at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)
        at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)
        at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)
        at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)
        at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)
        at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
        at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
        at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
        at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)
        at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)
        at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)
        at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)
        at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)
   7) Thread[id=16054, name=WRITER6, state=WAITING, group=TGRP-TestStressRecovery]
        at java.base@11-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)
        at java.base@11-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)
        at java.base@11-ea/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)
        at app//org.apache.solr.update.VersionInfo.lockForUpdate(VersionInfo.java:111)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1772)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteById(DistributedUpdateProcessor.java:1381)
        at app//org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1359)
        at app//org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteMap(JsonLoader.java:394)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleDeleteCommand(JsonLoader.java:311)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:171)
        at app//org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)
        at app//org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)
        at app//org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
        at app//org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
        at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
        at app//org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)
        at app//org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)
        at app//org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)
        at app//org.apache.solr.SolrTestCaseJ4.deleteAndGetVersion(SolrTestCaseJ4.java:1464)
        at app//org.apache.solr.search.TestStressRecovery$1.run(TestStressRecovery.java:190)
	at __randomizedtesting.SeedInfo.seed([574A613DDBAAAD99]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.TestStressRecovery

Error Message:
Captured an uncaught exception in thread: Thread[id=16060, name=READER5, state=RUNNABLE, group=TGRP-TestStressRecovery]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=16060, name=READER5, state=RUNNABLE, group=TGRP-TestStressRecovery]
Caused by: java.lang.RuntimeException: java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([574A613DDBAAAD99]:0)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:332)
Caused by: java.lang.NullPointerException
	at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:307)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.TestStressRecovery

Error Message:
Captured an uncaught exception in thread: Thread[id=16062, name=READER7, state=RUNNABLE, group=TGRP-TestStressRecovery]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=16062, name=READER7, state=RUNNABLE, group=TGRP-TestStressRecovery]
Caused by: java.lang.RuntimeException: java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([574A613DDBAAAD99]:0)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:332)
Caused by: java.lang.NullPointerException
	at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:307)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.TestStressRecovery

Error Message:
Captured an uncaught exception in thread: Thread[id=16059, name=READER4, state=RUNNABLE, group=TGRP-TestStressRecovery]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=16059, name=READER4, state=RUNNABLE, group=TGRP-TestStressRecovery]
Caused by: java.lang.RuntimeException: java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([574A613DDBAAAD99]:0)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:332)
Caused by: java.lang.NullPointerException
	at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:307)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.TestStressRecovery

Error Message:
Captured an uncaught exception in thread: Thread[id=16055, name=READER0, state=RUNNABLE, group=TGRP-TestStressRecovery]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=16055, name=READER0, state=RUNNABLE, group=TGRP-TestStressRecovery]
Caused by: java.lang.RuntimeException: java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([574A613DDBAAAD99]:0)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:332)
Caused by: java.lang.NullPointerException
	at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:307)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.TestStressRecovery

Error Message:
Captured an uncaught exception in thread: Thread[id=16058, name=READER3, state=RUNNABLE, group=TGRP-TestStressRecovery]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=16058, name=READER3, state=RUNNABLE, group=TGRP-TestStressRecovery]
Caused by: java.lang.RuntimeException: java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([574A613DDBAAAD99]:0)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:332)
Caused by: java.lang.NullPointerException
	at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:307)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.TestStressRecovery

Error Message:
Captured an uncaught exception in thread: Thread[id=16063, name=READER8, state=RUNNABLE, group=TGRP-TestStressRecovery]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=16063, name=READER8, state=RUNNABLE, group=TGRP-TestStressRecovery]
Caused by: java.lang.RuntimeException: java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([574A613DDBAAAD99]:0)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:332)
Caused by: java.lang.NullPointerException
	at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:307)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.TestStressRecovery

Error Message:
Captured an uncaught exception in thread: Thread[id=16057, name=READER2, state=RUNNABLE, group=TGRP-TestStressRecovery]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=16057, name=READER2, state=RUNNABLE, group=TGRP-TestStressRecovery]
Caused by: java.lang.RuntimeException: java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([574A613DDBAAAD99]:0)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:332)
Caused by: java.lang.NullPointerException
	at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:307)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.TestStressRecovery

Error Message:
Captured an uncaught exception in thread: Thread[id=16061, name=READER6, state=RUNNABLE, group=TGRP-TestStressRecovery]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=16061, name=READER6, state=RUNNABLE, group=TGRP-TestStressRecovery]
Caused by: java.lang.RuntimeException: java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([574A613DDBAAAD99]:0)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:332)
Caused by: java.lang.NullPointerException
	at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:307)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.TestStressRecovery

Error Message:
Captured an uncaught exception in thread: Thread[id=16064, name=READER9, state=RUNNABLE, group=TGRP-TestStressRecovery]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=16064, name=READER9, state=RUNNABLE, group=TGRP-TestStressRecovery]
Caused by: java.lang.RuntimeException: java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([574A613DDBAAAD99]:0)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:332)
Caused by: java.lang.NullPointerException
	at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:307)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.TestStressRecovery

Error Message:
Captured an uncaught exception in thread: Thread[id=16056, name=READER1, state=RUNNABLE, group=TGRP-TestStressRecovery]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=16056, name=READER1, state=RUNNABLE, group=TGRP-TestStressRecovery]
Caused by: java.lang.RuntimeException: java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([574A613DDBAAAD99]:0)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:332)
Caused by: java.lang.NullPointerException
	at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:307)


FAILED:  org.apache.solr.search.TestStressRecovery.testStressRecovery

Error Message:
java.lang.NullPointerException

Stack Trace:
java.util.concurrent.ExecutionException: java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([574A613DDBAAAD99:ED70086044421297]:0)
	at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:205)
	at org.apache.solr.search.TestStressRecovery.testStressRecovery(TestStressRecovery.java:371)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:841)
Caused by: java.lang.NullPointerException
	at org.apache.solr.update.TransactionLog$FSReverseReader.<init>(TransactionLog.java:808)
	at org.apache.solr.update.TransactionLog.getReverseReader(TransactionLog.java:646)
	at org.apache.solr.update.UpdateLog$RecentUpdates.update(UpdateLog.java:1408)
	at org.apache.solr.update.UpdateLog$RecentUpdates.<init>(UpdateLog.j

[...truncated too long message...]

101132_20614602959042967146031.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J1-20180504_101132_20618073274129231126722.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 567 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J1-20180504_101159_05810143225639296504778.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J2-20180504_101159_0584308963140825074635.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J0-20180504_101159_0588813132017587376442.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 576 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J2-20180504_101213_7145805151170764280167.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J1-20180504_101213_7142550350133308430948.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J0-20180504_101213_71410130057779731082168.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 680 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J0-20180504_101224_21313517981984597616143.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J1-20180504_101224_2134225711619446120161.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J2-20180504_101224_2133210143095984527918.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 567 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-prometheus-exporter/test/temp/junit4-J1-20180504_101256_15212059762253633760557.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-prometheus-exporter/test/temp/junit4-J0-20180504_101256_1522027126737862779894.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 606 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J1-20180504_101318_2689538202565116534253.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J0-20180504_101318_26810606924533171064882.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 557 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-velocity/test/temp/junit4-J0-20180504_101331_5175569997379065496466.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 34325 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1846/consoleText

[repro] Revision: 0e45b39476f287fe56ec4734c5c8695a99f8cb5d

[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseConcMarkSweepGC"
[repro] Repro line:  ant test  -Dtestcase=TestStressRecovery -Dtests.method=testStressRecovery -Dtests.seed=574A613DDBAAAD99 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=yi -Dtests.timezone=ART -Dtests.asserts=true -Dtests.file.encoding=US-ASCII

[repro] Repro line:  ant test  -Dtestcase=TestStressRecovery -Dtests.seed=574A613DDBAAAD99 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=yi -Dtests.timezone=ART -Dtests.asserts=true -Dtests.file.encoding=US-ASCII

[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       TestStressRecovery
[repro] ant compile-test

[...truncated 3321 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestStressRecovery" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseConcMarkSweepGC" -Dtests.seed=574A613DDBAAAD99 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=yi -Dtests.timezone=ART -Dtests.asserts=true -Dtests.file.encoding=US-ASCII

[...truncated 45 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/temp/junit4-J2-20180504_101701_9073479669514288774920.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 4 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/temp/junit4-J1-20180504_101701_90616954192306554472572.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 4 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/temp/junit4-J0-20180504_101701_90614419371337248993497.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 23 lines...]
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.search.TestStressRecovery
[repro] Exiting with code 0

[...truncated 40 lines...]

Mime
View raw message