lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 683 - Still Failing
Date Fri, 14 Nov 2014 00:20:25 GMT
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/683/

3 tests failed.
REGRESSION:  org.apache.solr.TestDistributedMissingSort.testDistribSearch

Error Message:
Captured an uncaught exception in thread: Thread[id=10863, name=Thread-7393, state=RUNNABLE, group=TGRP-TestDistributedMissingSort]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=10863, name=Thread-7393, state=RUNNABLE, group=TGRP-TestDistributedMissingSort]
	at __randomizedtesting.SeedInfo.seed([61FB14DDBC377AC2:E01D9AC5CB681AFE]:0)
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: https://127.0.0.1:30876
	at __randomizedtesting.SeedInfo.seed([61FB14DDBC377AC2]:0)
	at org.apache.solr.BaseDistributedSearchTestCase$5.run(BaseDistributedSearchTestCase.java:580)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: https://127.0.0.1:30876
	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:579)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.BaseDistributedSearchTestCase$5.run(BaseDistributedSearchTestCase.java:575)
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.read(SocketInputStream.java:152)
	at java.net.SocketInputStream.read(SocketInputStream.java:122)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:442)
	at sun.security.ssl.InputRecord.read(InputRecord.java:480)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:927)
	at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:884)
	at sun.security.ssl.AppInputStream.read(AppInputStream.java:102)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:465)
	... 5 more


REGRESSION:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
java.lang.NullPointerException 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: java.lang.NullPointerException

	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:569)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:583)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:205)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler

Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=734124, name=coreLoadExecutor-1668-thread-1, state=RUNNABLE, group=TGRP-TestReplicationHandler], registration stack trace below.

Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=734124, name=coreLoadExecutor-1668-thread-1, state=RUNNABLE, group=TGRP-TestReplicationHandler], registration stack trace below.
	at __randomizedtesting.SeedInfo.seed([61FB14DDBC377AC2]:0)
	at java.lang.Thread.getStackTrace(Thread.java:1589)
	at com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:166)
	at org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:732)
	at org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:1331)
	at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1209)
	at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1201)
	at org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:47)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:350)
	at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:277)
	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:489)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:797)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:653)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:510)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:274)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:268)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: Directory not closed: MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-61FB14DDBC377AC2-001/index-MMapDirectory-049 lockFactory=org.apache.lucene.store.NativeFSLockFactory@114ec234)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:699)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:696)
	at com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:183)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:712)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	... 1 more




Build Log:
[...truncated 11857 lines...]
   [junit4] Suite: org.apache.solr.TestDistributedMissingSort
   [junit4]   2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/init-core-data-001
   [junit4]   2> 1020173 T8069 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
   [junit4]   2> 1020173 T8069 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 1020177 T8069 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 1020180 T8069 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1020186 T8069 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1020189 T8069 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:29411
   [junit4]   2> 1020192 T8069 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1020193 T8069 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1020193 T8069 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr
   [junit4]   2> 1020194 T8069 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/'
   [junit4]   2> 1020252 T8069 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/solr.xml
   [junit4]   2> 1020338 T8069 oasc.CoreContainer.<init> New CoreContainer 2121972292
   [junit4]   2> 1020338 T8069 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/]
   [junit4]   2> 1020340 T8069 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1020341 T8069 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: https
   [junit4]   2> 1020341 T8069 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1020342 T8069 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1020342 T8069 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 1020343 T8069 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1020343 T8069 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1020344 T8069 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1020344 T8069 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1020345 T8069 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1020350 T8069 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1020353 T8069 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1020354 T8069 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1020354 T8069 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1020363 T8079 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 1020366 T8079 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 1020367 T8079 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 1020367 T8079 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 1020444 T8079 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1020513 T8079 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1020514 T8079 oass.IndexSchema.readSchema Reading Solr Schema from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema-distributed-missing-sort.xml
   [junit4]   2> 1020521 T8079 oass.IndexSchema.readSchema [collection1] Schema name=test-distributed-missing-sort
   [junit4]   2> 1020582 T8079 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1020584 T8079 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/
   [junit4]   2> 1020584 T8079 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1020584 T8079 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/tempDir-001/control/data/
   [junit4]   2> 1020584 T8079 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@36ae3790
   [junit4]   2> 1020585 T8079 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/tempDir-001/control/data
   [junit4]   2> 1020585 T8079 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/tempDir-001/control/data/index/
   [junit4]   2> 1020586 T8079 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1020587 T8079 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/tempDir-001/control/data/index
   [junit4]   2> 1020588 T8079 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=32, maxMergeAtOnceExplicit=20, maxMergedSegmentMB=1.595703125, floorSegmentMB=0.798828125, forceMergeDeletesPctAllowed=9.216499889132203, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1020596 T8079 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(NIOFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/index-NIOFSDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7830fced)),segFN=segments_1,generation=1}
   [junit4]   2> 1020596 T8079 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1020597 T8079 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
   [junit4]   2> 1020601 T8079 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1020602 T8079 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1020602 T8079 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 1020602 T8079 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 1020603 T8079 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1020603 T8079 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1020603 T8079 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 1020603 T8079 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 1020604 T8079 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1020604 T8079 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1020605 T8079 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1020605 T8079 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1020606 T8079 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 1020606 T8079 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1020607 T8079 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1020608 T8079 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1020608 T8079 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1020608 T8079 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1020609 T8079 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1020610 T8079 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1020611 T8079 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
   [junit4]   2> 1020611 T8079 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
   [junit4]   2> 1020612 T8079 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1020612 T8079 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1020613 T8079 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1020613 T8079 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 1020613 T8079 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 1020614 T8079 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 1020614 T8079 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1020614 T8079 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1020615 T8079 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1020615 T8079 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1020616 T8079 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1020616 T8079 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1020617 T8079 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1020617 T8079 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1020617 T8079 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1020618 T8079 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
   [junit4]   2> 1020618 T8079 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
   [junit4]   2> 1020637 T8079 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1020639 T8079 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1020641 T8079 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1020643 T8079 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1020645 T8079 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
   [junit4]   2> 1020647 T8079 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1020647 T8079 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1020648 T8079 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@163fa1d9
   [junit4]   2> 1020650 T8079 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(NIOFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/index-NIOFSDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7830fced)),segFN=segments_1,generation=1}
   [junit4]   2> 1020651 T8079 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1020651 T8079 oass.SolrIndexSearcher.<init> Opening Searcher@44a80708[collection1] main
   [junit4]   2> 1020651 T8079 oasr.RestManager.init Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
   [junit4]   2> 1020652 T8079 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 1020652 T8079 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 1020652 T8079 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
   [junit4]   2> 1020652 T8079 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1020653 T8079 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 1020664 T8079 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 1020711 T8080 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@44a80708[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1020718 T8079 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1020719 T8069 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3
   [junit4]   2> 1020720 T8069 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1020725 T8069 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1020730 T8069 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1020731 T8069 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:29412
   [junit4]   2> 1020734 T8069 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1020735 T8069 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1020735 T8069 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr
   [junit4]   2> 1020735 T8069 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/'
   [junit4]   2> 1020781 T8069 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/solr.xml
   [junit4]   2> 1020865 T8069 oasc.CoreContainer.<init> New CoreContainer 1638172289
   [junit4]   2> 1020865 T8069 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/]
   [junit4]   2> 1020867 T8069 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1020867 T8069 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: https
   [junit4]   2> 1020867 T8069 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1020868 T8069 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1020868 T8069 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 1020868 T8069 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1020869 T8069 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1020869 T8069 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1020869 T8069 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1020870 T8069 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1020873 T8069 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1020875 T8069 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1020875 T8069 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1020876 T8069 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1020881 T8091 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 1020882 T8091 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 1020883 T8091 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 1020884 T8091 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 1020972 T8091 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1021044 T8091 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1021046 T8091 oass.IndexSchema.readSchema Reading Solr Schema from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema-distributed-missing-sort.xml
   [junit4]   2> 1021054 T8091 oass.IndexSchema.readSchema [collection1] Schema name=test-distributed-missing-sort
   [junit4]   2> 1021128 T8091 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1021130 T8091 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/
   [junit4]   2> 1021130 T8091 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1021131 T8091 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/tempDir-001/shard0/data/
   [junit4]   2> 1021131 T8091 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@36ae3790
   [junit4]   2> 1021132 T8091 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/tempDir-001/shard0/data
   [junit4]   2> 1021132 T8091 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/tempDir-001/shard0/data/index/
   [junit4]   2> 1021132 T8091 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/tempDir-001/shard0/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1021135 T8091 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/tempDir-001/shard0/data/index
   [junit4]   2> 1021135 T8091 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=32, maxMergeAtOnceExplicit=20, maxMergedSegmentMB=1.595703125, floorSegmentMB=0.798828125, forceMergeDeletesPctAllowed=9.216499889132203, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1021140 T8091 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(NIOFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/index-NIOFSDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7830fced)),segFN=segments_1,generation=1}
   [junit4]   2> 1021141 T8091 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1021142 T8091 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
   [junit4]   2> 1021147 T8091 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1021148 T8091 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1021148 T8091 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 1021148 T8091 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 1021149 T8091 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1021149 T8091 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1021149 T8091 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 1021149 T8091 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 1021150 T8091 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1021150 T8091 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1021151 T8091 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1021151 T8091 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1021151 T8091 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 1021152 T8091 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1021153 T8091 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1021153 T8091 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1021153 T8091 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1021154 T8091 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1021154 T8091 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1021155 T8091 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1021155 T8091 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
   [junit4]   2> 1021156 T8091 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
   [junit4]   2> 1021156 T8091 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1021157 T8091 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1021157 T8091 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1021158 T8091 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 1021158 T8091 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 1021159 T8091 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 1021159 T8091 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1021160 T8091 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1021161 T8091 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1021161 T8091 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1021162 T8091 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1021162 T8091 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1021163 T8091 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1021163 T8091 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1021164 T8091 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1021164 T8091 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
   [junit4]   2> 1021165 T8091 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
   [junit4]   2> 1021185 T8091 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1021187 T8091 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1021189 T8091 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1021191 T8091 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1021193 T8091 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
   [junit4]   2> 1021195 T8091 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1021195 T8091 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1021196 T8091 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@7b7d607b
   [junit4]   2> 1021199 T8091 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(NIOFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/index-NIOFSDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7830fced)),segFN=segments_1,generation=1}
   [junit4]   2> 1021199 T8091 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1021200 T8091 oass.SolrIndexSearcher.<init> Opening Searcher@70b212ec[collection1] main
   [junit4]   2> 1021200 T8091 oasr.RestManager.init Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
   [junit4]   2> 1021200 T8091 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 1021201 T8091 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 1021201 T8091 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
   [junit4]   2> 1021201 T8091 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1021201 T8091 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 1021212 T8091 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 1021265 T8092 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@70b212ec[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1021273 T8091 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1021274 T8069 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3
   [junit4]   2> 1021274 T8069 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> ASYNC  NEW_CORE C475 name=collection1 org.apache.solr.core.SolrCore@3cf3e27a
   [junit4]   2> 1021410 T8072 C475 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 1021411 T8072 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 1
   [junit4]   2> ASYNC  NEW_CORE C476 name=collection1 org.apache.solr.core.SolrCore@b9195ba
   [junit4]   2> 1021539 T8084 C476 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 1021540 T8084 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 1
   [junit4]   2> 1021550 T8073 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1]} 0 5
   [junit4]   2> 1021559 T8085 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1]} 0 4
   [junit4]   2> 1021565 T8074 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2]} 0 1
   [junit4]   2> 1021570 T8086 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2]} 0 1
   [junit4]   2> 1021575 T8075 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3]} 0 1
   [junit4]   2> 1021580 T8087 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3]} 0 1
   [junit4]   2> 1021585 T8076 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4]} 0 1
   [junit4]   2> 1021589 T8088 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4]} 0 0
   [junit4]   2> 1021594 T8077 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5]} 0 1
   [junit4]   2> 1021599 T8089 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5]} 0 1
   [junit4]   2> 1021603 T8078 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6]} 0 0
   [junit4]   2> 1021608 T8090 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6]} 0 1
   [junit4]   2> 1021613 T8108 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7]} 0 1
   [junit4]   2> 1021618 T8110 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7]} 0 1
   [junit4]   2> 1021623 T8112 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8]} 0 1
   [junit4]   2> 1021628 T8114 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8]} 0 1
   [junit4]   2> 1021633 T8116 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9]} 0 1
   [junit4]   2> 1021637 T8118 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9]} 0 0
   [junit4]   2> 1021642 T8120 C475 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1021724 T8120 C475 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(NIOFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/index-NIOFSDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7830fced)),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(NIOFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/index-NIOFSDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7830fced)),segFN=segments_2,generation=2}
   [junit4]   2> 1021725 T8120 C475 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 1021734 T8120 C475 oass.SolrIndexSearcher.<init> Opening Searcher@7167bddd[collection1] main
   [junit4]   2> 1021735 T8120 C475 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 1021737 T8080 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7167bddd[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C9)))}
   [junit4]   2> 1021738 T8120 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&softCommit=false&version=2&waitSearcher=true&commit=true} {commit=} 0 96
   [junit4]   2> 1021743 T8122 C476 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1021821 T8122 C476 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(NIOFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/index-NIOFSDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7830fced)),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(NIOFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/index-NIOFSDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7830fced)),segFN=segments_2,generation=2}
   [junit4]   2> 1021822 T8122 C476 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 1021832 T8122 C476 oass.SolrIndexSearcher.<init> Opening Searcher@20a21a83[collection1] main
   [junit4]   2> 1021832 T8122 C476 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 1021834 T8092 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@20a21a83[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C9)))}
   [junit4]   2> 1021835 T8122 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&softCommit=false&version=2&waitSearcher=true&commit=true} {commit=} 0 92
   [junit4]   2> 1021844 T8124 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10]} 0 4
   [junit4]   2> 1021853 T8126 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10]} 0 4
   [junit4]   2> 1021858 T8128 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11]} 0 1
   [junit4]   2> 1021863 T8130 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11]} 0 1
   [junit4]   2> 1021868 T8132 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12]} 0 0
   [junit4]   2> 1021873 T8134 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12]} 0 1
   [junit4]   2> 1021878 T8136 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13]} 0 0
   [junit4]   2> 1021883 T8138 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13]} 0 0
   [junit4]   2> 1021889 T8140 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14]} 0 1
   [junit4]   2> 1021894 T8142 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14]} 0 1
   [junit4]   2> 1021899 T8144 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15]} 0 1
   [junit4]   2> 1021904 T8146 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15]} 0 0
   [junit4]   2> 1021910 T8148 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16]} 0 1
   [junit4]   2> 1021915 T8150 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16]} 0 1
   [junit4]   2> 1021922 T8152 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17]} 0 2
   [junit4]   2> 1021929 T8154 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17]} 0 1
   [junit4]   2> 1021935 T8156 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[100]} 0 1
   [junit4]   2> 1021940 T8158 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[100]} 0 1
   [junit4]   2> 1021946 T8160 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[101]} 0 1
   [junit4]   2> 1021951 T8162 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[101]} 0 0
   [junit4]   2> 1021956 T8164 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[102]} 0 0
   [junit4]   2> 1021961 T8166 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[102]} 0 0
   [junit4]   2> 1021966 T8168 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[103]} 0 0
   [junit4]   2> 1021971 T8170 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[103]} 0 0
   [junit4]   2> 1021976 T8172 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[104]} 0 0
   [junit4]   2> 1021981 T8174 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[104]} 0 1
   [junit4]   2> 1021986 T8176 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[105]} 0 1
   [junit4]   2> 1021991 T8178 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[105]} 0 1
   [junit4]   2> 1021995 T8180 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[106]} 0 0
   [junit4]   2> 1022000 T8182 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[106]} 0 1
   [junit4]   2> 1022005 T8184 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[107]} 0 1
   [junit4]   2> 1022009 T8186 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[107]} 0 0
   [junit4]   2> 1022014 T8188 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[108]} 0 0
   [junit4]   2> 1022019 T8190 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[108]} 0 0
   [junit4]   2> 1022024 T8192 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[109]} 0 1
   [junit4]   2> 1022029 T8194 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[109]} 0 0
   [junit4]   2> 1022034 T8196 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[110]} 0 1
   [junit4]   2> 1022039 T8198 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[110]} 0 1
   [junit4]   2> 1022044 T8200 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[111]} 0 0
   [junit4]   2> 1022049 T8202 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[111]} 0 0
   [junit4]   2> 1022054 T8204 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[112]} 0 0
   [junit4]   2> 1022059 T8206 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[112]} 0 0
   [junit4]   2> 1022064 T8208 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[113]} 0 0
   [junit4]   2> 1022069 T8210 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[113]} 0 0
   [junit4]   2> 1022074 T8212 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[114]} 0 0
   [junit4]   2> 1022079 T8214 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[114]} 0 0
   [junit4]   2> 1022084 T8216 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[115]} 0 1
   [junit4]   2> 1022088 T8218 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[115]} 0 0
   [junit4]   2> 1022093 T8220 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[116]} 0 0
   [junit4]   2> 1022098 T8222 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[116]} 0 1
   [junit4]   2> 1022102 T8224 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[117]} 0 0
   [junit4]   2> 1022107 T8226 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[117]} 0 1
   [junit4]   2> 1022111 T8228 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[118]} 0 0
   [junit4]   2> 1022116 T8230 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[118]} 0 1
   [junit4]   2> 1022121 T8232 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[119]} 0 1
   [junit4]   2> 1022125 T8234 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[119]} 0 0
   [junit4]   2> 1022130 T8236 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[120]} 0 0
   [junit4]   2> 1022135 T8238 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[120]} 0 0
   [junit4]   2> 1022140 T8240 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[121]} 0 0
   [junit4]   2> 1022145 T8242 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[121]} 0 1
   [junit4]   2> 1022149 T8244 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[122]} 0 0
   [junit4]   2> 1022154 T8246 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[122]} 0 0
   [junit4]   2> 1022159 T8248 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[123]} 0 1
   [junit4]   2> 1022164 T8250 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[123]} 0 1
   [junit4]   2> 1022169 T8252 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[124]} 0 1
   [junit4]   2> 1022174 T8254 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[124]} 0 1
   [junit4]   2> 1022179 T8256 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[125]} 0 0
   [junit4]   2> 1022184 T8258 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[125]} 0 0
   [junit4]   2> 1022189 T8260 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[126]} 0 0
   [junit4]   2> 1022194 T8262 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[126]} 0 1
   [junit4]   2> 1022199 T8264 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[127]} 0 1
   [junit4]   2> 1022203 T8266 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[127]} 0 0
   [junit4]   2> 1022208 T8268 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[128]} 0 0
   [junit4]   2> 1022213 T8270 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[128]} 0 1
   [junit4]   2> 1022217 T8272 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[129]} 0 0
   [junit4]   2> 1022222 T8274 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[129]} 0 1
   [junit4]   2> 1022227 T8276 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[130]} 0 1
   [junit4]   2> 1022232 T8278 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[130]} 0 1
   [junit4]   2> 1022236 T8280 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[131]} 0 0
   [junit4]   2> 1022241 T8282 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[131]} 0 0
   [junit4]   2> 1022246 T8284 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[132]} 0 1
   [junit4]   2> 1022251 T8286 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[132]} 0 0
   [junit4]   2> 1022255 T8288 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[133]} 0 0
   [junit4]   2> 1022271 T8290 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[133]} 0 1
   [junit4]   2> 1022277 T8292 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[134]} 0 1
   [junit4]   2> 1022281 T8294 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[134]} 0 0
   [junit4]   2> 1022286 T8296 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[135]} 0 0
   [junit4]   2> 1022291 T8298 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[135]} 0 1
   [junit4]   2> 1022296 T8300 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[136]} 0 1
   [junit4]   2> 1022300 T8302 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[136]} 0 0
   [junit4]   2> 1022305 T8304 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[137]} 0 0
   [junit4]   2> 1022310 T8306 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[137]} 0 0
   [junit4]   2> 1022316 T8308 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[138]} 0 1
   [junit4]   2> 1022321 T8310 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[138]} 0 1
   [junit4]   2> 1022326 T8312 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[139]} 0 1
   [junit4]   2> 1022331 T8314 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[139]} 0 0
   [junit4]   2> 1022336 T8316 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[140]} 0 0
   [junit4]   2> 1022342 T8318 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[140]} 0 1
   [junit4]   2> 1022347 T8320 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[141]} 0 1
   [junit4]   2> 1022351 T8322 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[141]} 0 0
   [junit4]   2> 1022356 T8324 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[142]} 0 0
   [junit4]   2> 1022361 T8326 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[142]} 0 1
   [junit4]   2> 1022366 T8328 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[143]} 0 1
   [junit4]   2> 1022370 T8330 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[143]} 0 0
   [junit4]   2> 1022376 T8332 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[144]} 0 0
   [junit4]   2> 1022383 T8334 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[144]} 0 1
   [junit4]   2> 1022388 T8336 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[145]} 0 1
   [junit4]   2> 1022393 T8338 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[145]} 0 1
   [junit4]   2> 1022398 T8340 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[146]} 0 1
   [junit4]   2> 1022402 T8342 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[146]} 0 0
   [junit4]   2> 1022407 T8344 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[147]} 0 0
   [junit4]   2> 1022413 T8346 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[147]} 0 1
   [junit4]   2> 1022418 T8348 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[148]} 0 1
   [junit4]   2> 1022423 T8350 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[148]} 0 1
   [junit4]   2> 1022427 T8352 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[149]} 0 0
   [junit4]   2> 1022432 T8354 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[149]} 0 1
   [junit4]   2> 1022436 T8356 C475 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1022479 T8356 C475 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(NIOFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/index-NIOFSDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7830fced)),segFN=segments_2,generation=2}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(NIOFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/index-NIOFSDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7830fced)),segFN=segments_3,generation=3}
   [junit4]   2> 1022479 T8356 C475 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
   [junit4]   2> 1022491 T8356 C475 oass.SolrIndexSearcher.<init> Opening Searcher@dc7d23[collection1] main
   [junit4]   2> 1022491 T8356 C475 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 1022493 T8080 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@dc7d23[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C9) Uninverting(_1(6.0.0):C58)))}
   [junit4]   2> 1022494 T8356 C475 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&softCommit=false&version=2&waitSearcher=true&commit=true} {commit=} 0 58
   [junit4]   2> 1022499 T8358 C476 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1022537 T8358 C476 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(NIOFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/index-NIOFSDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7830fced)),segFN=segments_2,generation=2}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(NIOFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.TestDistributedMissingSort-61FB14DDBC377AC2-001/index-NIOFSDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7830fced)),segFN=segments_3,generation=3}
   [junit4]   2> 1022537 T8358 C476 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
   [junit4]   2> 1022548 T8358 C476 oass.SolrIndexSearcher.<init> Opening Searcher@44ea502d[collection1] main
   [junit4]   2> 1022549 T8358 C476 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 1022551 T8092 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@44ea502d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C9) Uninverting(_1(6.0.0):C58)))}
   [junit4]   2> 1022551 T8358 C476 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&softCommit=false&version=2&waitSearcher=true&commit=true} {commit=} 0 52
   [junit4]   2> 1022557 T8360 C475 oasc.SolrCore.execute [collection1] webapp= path=/select params={sort=one_i1_ml+desc&q=*:*&wt=javabin&rows=13&version=2&distrib=false} hits=67 status=0 QTime=1 
   [junit4]   2> 1022829 T8366 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&sort=one_i1_ml+desc&wt=javabin&isShard=true&shard.url=[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/|[ff01::213]:33332/&rows=13&fl=id&fsv=true&version=2&NOW=1415919606519&distrib=false&start=0} hits=67 status=0 QTime=1 
   [junit4]   2> 1022836 T8368 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&wt=javabin&isShard=true&shard.url=[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/|[ff01::213]:33332/&rows=13&ids=8,2,5,7,6,11,10,9,4,13,1,12,3&version=2&NOW=1415919606519&distrib=false} status=0 QTime=1 
   [junit4]   2> 1022840 T8362 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={sort=one_i1_ml+desc&q=*:*&wt=javabin&rows=13&version=2&shards=[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/|[ff01::213]:33332/} hits=67 status=0 QTime=277 
   [junit4]   2> 1022841 T8069 oas.BaseDistributedSearchTestCase.query starting stress...
   [junit4]   2> 1022853 T8380 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&sort=one_i1_ml+desc&wt=javabin&isShard=true&shard.url=[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/|[ff01::213]:33332/&rows=13&fl=id&fsv=true&version=2&NOW=1415919606803&distrib=false&start=0} hits=67 status=0 QTime=1 
   [junit4]   2> 1022853 T8382 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&sort=one_i1_ml+desc&wt=javabin&isShard=true&shard.url=[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/|[ff01::213]:33332/&rows=13&fl=id&fsv=true&version=2&NOW=1415919606804&distrib=false&start=0} hits=67 status=0 QTime=0 
   [junit4]   2> 1022854 T8383 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&sort=one_i1_ml+desc&wt=javabin&isShard=true&shard.url=[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/|[ff01::213]:33332/&rows=13&fl=id&fsv=true&version=2&NOW=1415919606804&distrib=false&start=0} hits=67 status=0 QTime=0 
   [junit4]   2> 1022858 T8387 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&wt=javabin&isShard=true&shard.url=[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/|[ff01::213]:33332/&rows=13&ids=8,2,5,7,6,11,10,9,4,13,1,12,3&version=2&NOW=1415919606803&distrib=false} status=0 QTime=0 
   [junit4]   2> 1022859 T8388 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&wt=javabin&isShard=true&shard.url=[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/|[ff01::213]:33332/&rows=13&ids=8,2,5,7,6,11,10,9,4,13,1,12,3&version=2&NOW=1415919606804&distrib=false} status=0 QTime=0 
   [junit4]   2> 1022859 T8373 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={sort=one_i1_ml+desc&q=*:*&wt=javabin&rows=13&version=2&shards=[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/|[ff01::213]:33332/} hits=67 status=0 QTime=12 
   [junit4]   2> 1022860 T8389 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&wt=javabin&isShard=true&shard.url=[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/|[ff01::213]:33332/&rows=13&ids=8,2,5,7,6,11,10,9,4,13,1,12,3&version=2&NOW=1415919606804&distrib=false} status=0 QTime=1 
   [junit4]   2> 1022860 T8374 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={sort=one_i1_ml+desc&q=*:*&wt=javabin&rows=13&version=2&shards=[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/|[ff01::213]:33332/} hits=67 status=0 QTime=12 
   [junit4]   2> 1022861 T8375 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={sort=one_i1_ml+desc&q=*:*&wt=javabin&rows=13&version=2&shards=[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/|[ff01::213]:33332/} hits=67 status=0 QTime=13 
   [junit4]   2> 1022869 T8399 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&sort=one_i1_ml+desc&wt=javabin&isShard=true&shard.url=[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/|[ff01::213]:33332/&rows=13&fl=id&fsv=true&version=2&NOW=1415919606821&distrib=false&start=0} hits=67 status=0 QTime=1 
   [junit4]   2> 1022870 T8400 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&sort=one_i1_ml+desc&wt=javabin&isShard=true&shard.url=[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/|[ff01::213]:33332/&rows=13&fl=id&fsv=true&version=2&NOW=1415919606821&distrib=false&start=0} hits=67 status=0 QTime=0 
   [junit4]   2> 1022870 T8401 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&sort=one_i1_ml+desc&wt=javabin&isShard=true&shard.url=[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/|[ff01::213]:33332/&rows=13&fl=id&fsv=true&version=2&NOW=1415919606822&distrib=false&start=0} hits=67 status=0 QTime=0 
   [junit4]   2> 1022874 T8405 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&wt=javabin&isShard=true&shard.url=[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/|[ff01::213]:33332/&rows=13&ids=8,2,5,7,6,11,10,9,4,13,1,12,3&version=2&NOW=1415919606821&distrib=false} status=0 QTime=1 
   [junit4]   2> 1022875 T8393 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={sort=one_i1_ml+desc&q=*:*&wt=javabin&rows=13&version=2&shards=[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/|[ff01::213]:33332/} hits=67 status=0 QTime=10 
   [junit4]   2> 1022875 T8406 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&wt=javabin&isShard=true&shard.url=[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/|[ff01::213]:33332/&rows=13&ids=8,2,5,7,6,11,10,9,4,13,1,12,3&version=2&NOW=1415919606821&distrib=false} status=0 QTime=0 
   [junit4]   2> 1022876 T8407 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&wt=javabin&isShard=true&shard.url=[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/|[ff01::213]:33332/&rows=13&ids=8,2,5,7,6,11,10,9,4,13,1,12,3&version=2&NOW=1415919606822&distrib=false} status=0 QTime=1 
   [junit4]   2> 1022876 T8394 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={sort=one_i1_ml+desc&q=*:*&wt=javabin&rows=13&version=2&shards=[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/|[ff01::213]:33332/} hits=67 status=0 QTime=11 
   [junit4]   2> 1022877 T8395 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={sort=one_i1_ml+desc&q=*:*&wt=javabin&rows=13&version=2&shards=[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/|[ff01::213]:33332/} hits=67 status=0 QTime=11 
   [junit4]   2> 1022882 T8411 C475 oasc.SolrCore.execute [collection1] webapp= path=/select params={sort=one_i1_ml+asc&q=*:*&wt=javabin&rows=13&version=2&distrib=false} hits=67 status=0 QTime=0 
   [junit4]   2> 1022891 T8415 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&sort=one_i1_ml+asc&wt=javabin&isShard=true&shard.url=https://127.0.0.1:29412/|[ff01::213]:33332/&rows=13&fl=id&fsv=true&version=2&NOW=1415919606843&distrib=false&start=0} hits=67 status=0 QTime=0 
   [junit4]   2> 1022896 T8417 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&wt=javabin&isShard=true&shard.url=https://127.0.0.1:29412/|[ff01::213]:33332/&rows=13&ids=2,8,5,6,7,11,10,4,9,13,1,3,12&version=2&NOW=1415919606843&distrib=false} status=0 QTime=1 
   [junit4]   2> 1022897 T8413 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={sort=one_i1_ml+asc&q=*:*&wt=javabin&rows=13&version=2&shards=https://127.0.0.1:29412/|[ff01::213]:33332/} hits=67 status=0 QTime=10 
   [junit4]   2> 1022898 T8069 oas.BaseDistributedSearchTestCase.query starting stress...
   [junit4]   2> 1022906 T8428 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&sort=one_i1_ml+asc&wt=javabin&isShard=true&shard.url=https://127.0.0.1:29412/|[ff01::213]:33332/&rows=13&fl=id&fsv=true&version=2&NOW=1415919606858&distrib=false&start=0} hits=67 status=0 QTime=0 
   [junit4]   2> 1022908 T8429 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&sort=one_i1_ml+asc&wt=javabin&isShard=true&shard.url=https://127.0.0.1:29412/|[ff01::213]:33332/&rows=13&fl=id&fsv=true&version=2&NOW=1415919606859&distrib=false&start=0} hits=67 status=0 QTime=1 
   [junit4]   2> 1022908 T8430 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&sort=one_i1_ml+asc&wt=javabin&isShard=true&shard.url=https://127.0.0.1:29412/|[ff01::213]:33332/&rows=13&fl=id&fsv=true&version=2&NOW=1415919606860&distrib=false&start=0} hits=67 status=0 QTime=0 
   [junit4]   2> 1022911 T8434 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&wt=javabin&isShard=true&shard.url=https://127.0.0.1:29412/|[ff01::213]:33332/&rows=13&ids=2,8,5,6,7,11,10,4,9,13,1,3,12&version=2&NOW=1415919606858&distrib=false} status=0 QTime=0 
   [junit4]   2> 1022913 T8422 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={sort=one_i1_ml+asc&q=*:*&wt=javabin&rows=13&version=2&shards=https://127.0.0.1:29412/|[ff01::213]:33332/} hits=67 status=0 QTime=11 
   [junit4]   2> 1022913 T8368 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&wt=javabin&isShard=true&shard.url=https://127.0.0.1:29412/|[ff01::213]:33332/&rows=13&ids=2,8,5,6,7,11,10,4,9,13,1,3,12&version=2&NOW=1415919606859&distrib=false} status=0 QTime=1 
   [junit4]   2> 1022913 T8435 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&wt=javabin&isShard=true&shard.url=https://127.0.0.1:29412/|[ff01::213]:33332/&rows=13&ids=2,8,5,6,7,11,10,4,9,13,1,3,12&version=2&NOW=1415919606860&distrib=false} status=0 QTime=0 
   [junit4]   2> 1022914 T8423 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={sort=one_i1_ml+asc&q=*:*&wt=javabin&rows=13&version=2&shards=https://127.0.0.1:29412/|[ff01::213]:33332/} hits=67 status=0 QTime=11 
   [junit4]   2> 1022915 T8424 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={sort=one_i1_ml+asc&q=*:*&wt=javabin&rows=13&version=2&shards=https://127.0.0.1:29412/|[ff01::213]:33332/} hits=67 status=0 QTime=11 
   [junit4]   2> 1022922 T8380 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&sort=one_i1_ml+asc&wt=javabin&isShard=true&shard.url=https://127.0.0.1:29412/|[ff01::213]:33332/&rows=13&fl=id&fsv=true&version=2&NOW=1415919606874&distrib=false&start=0} hits=67 status=0 QTime=0 
   [junit4]   2> 1022923 T8382 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&sort=one_i1_ml+asc&wt=javabin&isShard=true&shard.url=https://127.0.0.1:29412/|[ff01::213]:33332/&rows=13&fl=id&fsv=true&version=2&NOW=1415919606875&distrib=false&start=0} hits=67 status=0 QTime=0 
   [junit4]   2> 1022924 T8383 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&sort=one_i1_ml+asc&wt=javabin&isShard=true&shard.url=https://127.0.0.1:29412/|[ff01::213]:33332/&rows=13&fl=id&fsv=true&version=2&NOW=1415919606876&distrib=false&start=0} hits=67 status=0 QTime=0 
   [junit4]   2> 1022927 T8387 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&wt=javabin&isShard=true&shard.url=https://127.0.0.1:29412/|[ff01::213]:33332/&rows=13&ids=2,8,5,6,7,11,10,4,9,13,1,3,12&version=2&NOW=1415919606874&distrib=false} status=0 QTime=1 
   [junit4]   2> 1022928 T8439 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={sort=one_i1_ml+asc&q=*:*&wt=javabin&rows=13&version=2&shards=https://127.0.0.1:29412/|[ff01::213]:33332/} hits=67 status=0 QTime=10 
   [junit4]   2> 1022928 T8388 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&wt=javabin&isShard=true&shard.url=https://127.0.0.1:29412/|[ff01::213]:33332/&rows=13&ids=2,8,5,6,7,11,10,4,9,13,1,3,12&version=2&NOW=1415919606875&distrib=false} status=0 QTime=0 
   [junit4]   2> 1022929 T8389 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&wt=javabin&isShard=true&shard.url=https://127.0.0.1:29412/|[ff01::213]:33332/&rows=13&ids=2,8,5,6,7,11,10,4,9,13,1,3,12&version=2&NOW=1415919606876&distrib=false} status=0 QTime=0 
   [junit4]   2> 1022929 T8440 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={sort=one_i1_ml+asc&q=*:*&wt=javabin&rows=13&version=2&shards=https://127.0.0.1:29412/|[ff01::213]:33332/} hits=67 status=0 QTime=10 
   [junit4]   2> 1022930 T8442 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={sort=one_i1_ml+asc&q=*:*&wt=javabin&rows=13&version=2&shards=https://127.0.0.1:29412/|[ff01::213]:33332/} hits=67 status=0 QTime=10 
   [junit4]   2> 1022936 T8451 C475 oasc.SolrCore.execute [collection1] webapp= path=/select params={sort=one_i1_ml+desc,id+asc&q=*:*&wt=javabin&rows=200&version=2&distrib=false} hits=67 status=0 QTime=1 
   [junit4]   2> 1022953 T8399 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&sort=one_i1_ml+desc,id+asc&wt=javabin&isShard=true&shard.url=[ff01::213]:33332/|[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/&rows=200&fl=id&fsv=true&version=2&NOW=1415919606904&distrib=false&start=0} hits=67 status=0 QTime=1 
   [junit4]   2> 1022966 T8400 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&wt=javabin&isShard=true&shard.url=[ff01::213]:33332/|[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/&rows=200&ids=5,109,129,120,114,14,103,133,144,119,140,113,124,117,138,141,106,4,135,123,9,107,1,148,110,100,149,102,121,146,142,17,118,134,127,8,139,115,7,126,130,147,12,3,116,112,6,11,15,111,105,10,145,137,108,16,131,136,125,2,143,128,101,104,132,122,13&version=2&NOW=1415919606904&distrib=false} status=0 QTime=1 
   [junit4]   2> 1022979 T8453 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={sort=one_i1_ml+desc,id+asc&q=*:*&wt=javabin&rows=200&version=2&shards=[ff01::213]:33332/|[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/} hits=67 status=0 QTime=31 
   [junit4]   2> 1022981 T8069 oas.BaseDistributedSearchTestCase.query starting stress...
   [junit4]   2> 1022990 T8401 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&sort=one_i1_ml+desc,id+asc&wt=javabin&isShard=true&shard.url=[ff01::213]:33332/|[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/&rows=200&fl=id&fsv=true&version=2&NOW=1415919606942&distrib=false&start=0} hits=67 status=0 QTime=0 
   [junit4]   2> 1022991 T8405 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&sort=one_i1_ml+desc,id+asc&wt=javabin&isShard=true&shard.url=[ff01::213]:33332/|[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/&rows=200&fl=id&fsv=true&version=2&NOW=1415919606942&distrib=false&start=0} hits=67 status=0 QTime=1 
   [junit4]   2> 1022992 T8406 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&sort=one_i1_ml+desc,id+asc&wt=javabin&isShard=true&shard.url=[ff01::213]:33332/|[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/&rows=200&fl=id&fsv=true&version=2&NOW=1415919606943&distrib=false&start=0} hits=67 status=0 QTime=1 
   [junit4]   2> 1022997 T8407 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&wt=javabin&isShard=true&shard.url=[ff01::213]:33332/|[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/&rows=200&ids=5,109,129,120,114,14,103,133,144,119,140,113,124,117,138,141,106,4,135,123,9,107,1,148,110,100,149,102,121,146,142,17,118,134,127,8,139,115,7,126,130,147,12,3,116,112,6,11,15,111,105,10,145,137,108,16,131,136,125,2,143,128,101,104,132,122,13&version=2&NOW=1415919606942&distrib=false} status=0 QTime=1 
   [junit4]   2> 1022998 T8415 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&wt=javabin&isShard=true&shard.url=[ff01::213]:33332/|[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/&rows=200&ids=5,109,129,120,114,14,103,133,144,119,140,113,124,117,138,141,106,4,135,123,9,107,1,148,110,100,149,102,121,146,142,17,118,134,127,8,139,115,7,126,130,147,12,3,116,112,6,11,15,111,105,10,145,137,108,16,131,136,125,2,143,128,101,104,132,122,13&version=2&NOW=1415919606942&distrib=false} status=0 QTime=1 
   [junit4]   2> 1022999 T8417 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&wt=javabin&isShard=true&shard.url=[ff01::213]:33332/|[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/&rows=200&ids=5,109,129,120,114,14,103,133,144,119,140,113,124,117,138,141,106,4,135,123,9,107,1,148,110,100,149,102,121,146,142,17,118,134,127,8,139,115,7,126,130,147,12,3,116,112,6,11,15,111,105,10,145,137,108,16,131,136,125,2,143,128,101,104,132,122,13&version=2&NOW=1415919606943&distrib=false} status=0 QTime=2 
   [junit4]   2> 1023000 T8460 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={sort=one_i1_ml+desc,id+asc&q=*:*&wt=javabin&rows=200&version=2&shards=[ff01::213]:33332/|[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/} hits=67 status=0 QTime=14 
   [junit4]   2> 1023001 T8461 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={sort=one_i1_ml+desc,id+asc&q=*:*&wt=javabin&rows=200&version=2&shards=[ff01::213]:33332/|[ff01::114]:33332/|https://127.0.0.1:29412/|[ff01::083]:33332/} hits=67 status=0 QTime=15 
   [junit4]   2> 1023001 T8462 C476 oasc.SolrCore.execute [collection1] webapp= path=/select params={sort=one_i

[...truncated too long message...]

 with IndexWriterCloser
   [junit4]   2> 3145653 T733362 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 3145653 T733362 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 3145654 T733362 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-61FB14DDBC377AC2-001/solr-instance-002/collection1/data/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-61FB14DDBC377AC2-001/solr-instance-002/collection1/data/index;done=false>>]
   [junit4]   2> 3145654 T733362 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-61FB14DDBC377AC2-001/solr-instance-002/collection1/data/index
   [junit4]   2> 3145654 T733362 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-61FB14DDBC377AC2-001/solr-instance-002/collection1/data [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-61FB14DDBC377AC2-001/solr-instance-002/collection1/data;done=false>>]
   [junit4]   2> 3145655 T733362 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-61FB14DDBC377AC2-001/solr-instance-002/collection1/data
   [junit4]   2> 3145655 T733362 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 3150663 T733362 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 1448269 T733361 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> 3155646 T734302 oash.SnapPuller.fetchLatestIndex ERROR Master at: http://127.0.0.1:16893/solr is not available. Index fetch failed. Exception: IOException occured when talking to server at: http://127.0.0.1:16893/solr
   [junit4]   2> 3155646 T734302 oash.SnapPuller.fetchLatestIndex ERROR caught org.apache.lucene.store.AlreadyClosedException: Already closed
   [junit4]   2> 	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:340)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.loadReplicationProperties(ReplicationHandler.java:823)
   [junit4]   2> 	at org.apache.solr.handler.SnapPuller.logReplicationTimeAndConfFiles(SnapPuller.java:573)
   [junit4]   2> 	at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:512)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:338)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler$1.run(ReplicationHandler.java:228)
   [junit4]   2> 
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {newname=PostingsFormat(name=Direct), id=PostingsFormat(name=Direct), name=PostingsFormat(name=Direct)}, docValues:{}, sim=DefaultSimilarity, locale=en_US, timezone=America/Indianapolis
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=1,free=137406968,total=434110464
   [junit4]   2> NOTE: All tests run in this JVM: [TestLFUCache, TestDefaultSearchFieldResource, PrimitiveFieldTypeTest, OpenCloseCoreStressTest, AddBlockUpdateTest, SampleTest, SuggesterFSTTest, DirectUpdateHandlerTest, ZkControllerTest, TestQuerySenderNoQuery, TestExceedMaxTermLength, InfoHandlerTest, TestSolrConfigHandlerConcurrent, PathHierarchyTokenizerFactoryTest, DirectUpdateHandlerOptimizeTest, DirectSolrSpellCheckerTest, SolrIndexConfigTest, TestDocumentBuilder, DateFieldTest, TestFieldTypeCollectionResource, TestCloudSchemaless, TestStandardQParsers, ChangedSchemaMergeTest, TestCollationField, ClusterStateTest, TestCustomSort, NotRequiredUniqueKeyTest, TestGroupingSearch, SolrCoreTest, DebugComponentTest, ConnectionManagerTest, HdfsBasicDistributedZkTest, BlockDirectoryTest, SolrXmlInZkTest, TestCodecSupport, CachingDirectoryFactoryTest, LukeRequestHandlerTest, SpatialFilterTest, AsyncMigrateRouteKeyTest, BasicZkTest, TestNoOpRegenerator, TestInitQParser, TestDistribDocBasedVersion, CursorMarkTest, SortByFunctionTest, DisMaxRequestHandlerTest, MigrateRouteKeyTest, TestZkChroot, TestSimpleQParserPlugin, DistributedFacetPivotSmallTest, TestLMDirichletSimilarityFactory, SimpleCollectionCreateDeleteTest, CoreAdminCreateDiscoverTest, UpdateParamsTest, OverseerTest, RecoveryZkTest, TestReplicationHandler]
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestReplicationHandler -Dtests.seed=61FB14DDBC377AC2 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=en_US -Dtests.timezone=America/Indianapolis -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J1 | TestReplicationHandler (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=734124, name=coreLoadExecutor-1668-thread-1, state=RUNNABLE, group=TGRP-TestReplicationHandler], registration stack trace below.
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([61FB14DDBC377AC2]:0)
   [junit4]    > 	at java.lang.Thread.getStackTrace(Thread.java:1589)
   [junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:166)
   [junit4]    > 	at org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:732)
   [junit4]    > 	at org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:1331)
   [junit4]    > 	at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1209)
   [junit4]    > 	at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1201)
   [junit4]    > 	at org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:47)
   [junit4]    > 	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:350)
   [junit4]    > 	at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:277)
   [junit4]    > 	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:489)
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:797)
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:653)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:510)
   [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:274)
   [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:268)
   [junit4]    > 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: java.lang.AssertionError: Directory not closed: MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-61FB14DDBC377AC2-001/index-MMapDirectory-049 lockFactory=org.apache.lucene.store.NativeFSLockFactory@114ec234)
   [junit4]    > 	at org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
   [junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:183)
   [junit4]    > 	... 1 more
   [junit4] Completed on J1 in 1453.14s, 14 tests, 1 error <<< FAILURES!

[...truncated 335 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:532: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:473: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:61: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:186: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:508: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1358: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:965: There were test failures: 447 suites, 1820 tests, 1 suite-level error, 2 errors, 55 ignored (9 assumptions)

Total time: 234 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-trunk #679
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 751706041 bytes
Compression is 0.0%
Took 2 min 14 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message