lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark Miller <markrmil...@gmail.com>
Subject Re: [JENKINS] Lucene-Solr-tests-only-trunk - Build # 14934 - Still Failing
Date Tue, 24 Jul 2012 19:45:00 GMT
I know a searcher doesn't get closed somewhere...they are not used in the test and I've seen this in other testing as well - I just have not yet been able to figure out where/how a Searcher is not closed - I did verify a week or so ago that there are no SolrCore's left open - so I'm pretty sure it's a searcher, and possibly the realtime searcher plays a role - but so far I only have guesses and have found nothing.

On Jul 24, 2012, at 3:25 PM, Apache Jenkins Server wrote:

> Build: https://builds.apache.org/job/Lucene-Solr-tests-only-trunk/14934/
> 
> 2 tests failed.
> FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.SyncSliceTest
> 
> Error Message:
> ERROR: SolrIndexSearcher opens=28 closes=27
> 
> Stack Trace:
> java.lang.AssertionError: ERROR: SolrIndexSearcher opens=28 closes=27
> 	at __randomizedtesting.SeedInfo.seed([45F3FDD6D64EE45A]:0)
> 	at org.junit.Assert.fail(Assert.java:93)
> 	at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
> 	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
> 	at sun.reflect.GeneratedMethodAccessor22.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:616)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
> 	at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> 	at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
> 	at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
> 
> 
> FAILED:  org.apache.solr.cloud.FullSolrCloudTest.testDistribSearch
> 
> Error Message:
> Timeout occured while waiting response from server at: http://localhost:24931/solr/collection1
> 
> Stack Trace:
> org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://localhost:24931/solr/collection1
> 	at __randomizedtesting.SeedInfo.seed([45F3FDD6D64EE45A:C41573CEA1118466]:0)
> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:410)
> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182)
> 	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
> 	at org.apache.solr.cloud.FullSolrCloudTest.index_specific(FullSolrCloudTest.java:503)
> 	at org.apache.solr.cloud.FullSolrCloudTest.brindDownShardIndexSomeDocsAndRecover(FullSolrCloudTest.java:739)
> 	at org.apache.solr.cloud.FullSolrCloudTest.doTest(FullSolrCloudTest.java:562)
> 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:679)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:616)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:818)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:877)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:891)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> 	at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:825)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:671)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:697)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:736)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:747)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
> 	at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> 	at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
> 	at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
> Caused by: java.net.SocketTimeoutException: Read timed out
> 	at java.net.SocketInputStream.socketRead0(Native Method)
> 	at java.net.SocketInputStream.read(SocketInputStream.java:146)
> 	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:149)
> 	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:111)
> 	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:264)
> 	at org.apache.http.impl.conn.DefaultResponseParser.parseHead(DefaultResponseParser.java:98)
> 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:252)
> 	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:282)
> 	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:247)
> 	at org.apache.http.impl.conn.AbstractClientConnAdapter.receiveResponseHeader(AbstractClientConnAdapter.java:216)
> 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:298)
> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
> 	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:647)
> 	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:464)
> 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
> 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
> 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
> 	... 45 more
> 
> 
> 
> 
> Build Log:
> [...truncated 11681 lines...]
> [junit4:junit4]   2> 139837 T794 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
> [junit4:junit4]   2> 139889 T794 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 24931
> [junit4:junit4]   2> 139889 T794 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=892754876
> [junit4:junit4]   2> 139889 T794 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:24931_solr_collection1
> [junit4:junit4]   2> 141436 T864 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:64696
> [junit4:junit4]   2> 151937 T865 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 151937 T794 oaz.ZooKeeper.close Session: 0x138ba670b7e0006 closed
> [junit4:junit4]   2> 151938 T794 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
> [junit4:junit4]   2> 151988 T863 C80 P24931 REQ /update {wt=javabin&version=2} status=503 QTime=56671 
> [junit4:junit4]   2> 151989 T863 C80 P24931 oasc.SolrException.log SEVERE null:org.eclipse.jetty.io.EofException
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:154)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:101)
> [junit4:junit4]   2> 		at org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:185)
> [junit4:junit4]   2> 		at org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:94)
> [junit4:junit4]   2> 		at org.apache.solr.response.BinaryResponseWriter.write(BinaryResponseWriter.java:49)
> [junit4:junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:403)
> [junit4:junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:288)
> [junit4:junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1337)
> [junit4:junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:484)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:267)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1067)
> [junit4:junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.Server.handle(Server.java:351)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:47)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954)
> [junit4:junit4]   2> 		at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:952)
> [junit4:junit4]   2> 		at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:66)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:254)
> [junit4:junit4]   2> 		at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
> [junit4:junit4]   2> 		at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
> [junit4:junit4]   2> 		at java.lang.Thread.run(Thread.java:679)
> [junit4:junit4]   2> 	
> [junit4:junit4]   2> 151991 T863 C80 P24931 oasc.SolrException.log SEVERE null:org.eclipse.jetty.io.EofException
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:154)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:101)
> [junit4:junit4]   2> 		at org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:185)
> [junit4:junit4]   2> 		at org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:94)
> [junit4:junit4]   2> 		at org.apache.solr.response.BinaryResponseWriter.write(BinaryResponseWriter.java:49)
> [junit4:junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:403)
> [junit4:junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:288)
> [junit4:junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1337)
> [junit4:junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:484)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:267)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1067)
> [junit4:junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.Server.handle(Server.java:351)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:47)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954)
> [junit4:junit4]   2> 		at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:952)
> [junit4:junit4]   2> 		at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:66)
> [junit4:junit4]   2> 		at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:254)
> [junit4:junit4]   2> 		at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
> [junit4:junit4]   2> 		at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
> [junit4:junit4]   2> 		at java.lang.Thread.run(Thread.java:679)
> [junit4:junit4]   2> 	
> [junit4:junit4]   2> 151995 T863 C80 P24931 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@2afccfa7
> [junit4:junit4]   2> 151999 T863 C80 P24931 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
> [junit4:junit4]   2> 152001 T863 C80 P24931 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=7,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=36,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
> [junit4:junit4]   2> 152002 T863 C80 P24931 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:24931_solr_collection1
> [junit4:junit4]   2> 152101 T794 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
> [junit4:junit4]   1>      /solr/collections/control_collection/leader_elect/control_shard (1)
> [junit4:junit4]   1>       /solr/collections/control_collection/leader_elect/control_shard/election (1)
> [junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/control_shard/election/88025144470929410-127.0.0.1:48410_solr_collection1-n_0000000000 (0)
> [junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
> [junit4:junit4]   1>      /solr/collections/control_collection/leaders/control_shard (0)
> [junit4:junit4]   1>      DATA:
> [junit4:junit4]   1>          {
> [junit4:junit4]   1>            "core":"collection1",
> [junit4:junit4]   1>            "node_name":"127.0.0.1:48410_solr",
> [junit4:junit4]   1>            "base_url":"http://127.0.0.1:48410/solr"}
> [junit4:junit4]   1>   /solr/clusterstate.json (0)
> [junit4:junit4]   1>   DATA:
> [junit4:junit4]   1>       {
> [junit4:junit4]   1>         "collection1":{
> [junit4:junit4]   1>           "shard1":{
> [junit4:junit4]   1>             "127.0.0.1:58033_solr_collection1":{
> [junit4:junit4]   1>               "shard":"shard1",
> [junit4:junit4]   1>               "leader":"true",
> [junit4:junit4]   1>               "roles":null,
> [junit4:junit4]   1>               "state":"active",
> [junit4:junit4]   1>               "core":"collection1",
> [junit4:junit4]   1>               "collection":"collection1",
> [junit4:junit4]   1>               "node_name":"127.0.0.1:58033_solr",
> [junit4:junit4]   1>               "base_url":"http://127.0.0.1:58033/solr"},
> [junit4:junit4]   1>             "127.0.0.1:28674_solr_collection1":{
> [junit4:junit4]   1>               "shard":"shard1",
> [junit4:junit4]   1>               "roles":null,
> [junit4:junit4]   1>               "state":"active",
> [junit4:junit4]   1>               "core":"collection1",
> [junit4:junit4]   1>               "collection":"collection1",
> [junit4:junit4]   1>               "node_name":"127.0.0.1:28674_solr",
> [junit4:junit4]   1>               "base_url":"http://127.0.0.1:28674/solr"}},
> [junit4:junit4]   1>           "shard2":{
> [junit4:junit4]   1>             "127.0.0.1:18183_solr_collection1":{
> [junit4:junit4]   1>               "shard":"shard2",
> [junit4:junit4]   1>               "roles":null,
> [junit4:junit4]   1>               "state":"active",
> [junit4:junit4]   1>               "core":"collection1",
> [junit4:junit4]   1>               "collection":"collection1",
> [junit4:junit4]   1>               "node_name":"127.0.0.1:18183_solr",
> [junit4:junit4]   1>               "base_url":"http://127.0.0.1:18183/solr"},
> [junit4:junit4]   1>             "127.0.0.1:24931_solr_collection1":{
> [junit4:junit4]   1>               "shard":"shard2",
> [junit4:junit4]   1>               "leader":"true",
> [junit4:junit4]   1>               "roles":null,
> [junit4:junit4]   1>               "state":"active",
> [junit4:junit4]   1>               "core":"collection1",
> [junit4:junit4]   1>               "collection":"collection1",
> [junit4:junit4]   1>               "node_name":"127.0.0.1:24931_solr",
> [junit4:junit4]   1>               "base_url":"http://127.0.0.1:24931/solr"}}},
> [junit4:junit4]   1>         "control_collection":{"control_shard":{"127.0.0.1:48410_solr_collection1":{
> [junit4:junit4]   1>               "shard":"control_shard",
> [junit4:junit4]   1>               "leader":"true",
> [junit4:junit4]   1>               "roles":null,
> [junit4:junit4]   1>               "state":"active",
> [junit4:junit4]   1>               "core":"collection1",
> [junit4:junit4]   1>               "collection":"control_collection",
> [junit4:junit4]   1>               "node_name":"127.0.0.1:48410_solr",
> [junit4:junit4]   1>               "base_url":"http://127.0.0.1:48410/solr"}}}}
> [junit4:junit4]   1>  /zookeeper (1)
> [junit4:junit4]   1>  DATA:
> [junit4:junit4]   1>      
> [junit4:junit4]   1> 
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=FullSolrCloudTest -Dtests.method=testDistribSearch -Dtests.seed=45F3FDD6D64EE45A -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=de_CH -Dtests.timezone=America/Metlakatla -Dtests.file.encoding=US-ASCII
> [junit4:junit4]   1> 
> [junit4:junit4]   2>
> [junit4:junit4]    > (@AfterClass output)
> [junit4:junit4]   2> 152141 T794 oas.SolrTestCaseJ4.deleteCore ###deleteCore
> [junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {n_f1=PostingsFormat(name=Memory doPackFST= true), foo_b=PostingsFormat(name=SimpleText), foo_d=PostingsFormat(name=Memory doPackFST= false), foo_f=PostingsFormat(name=SimpleText), n_tl1=PostingsFormat(name=Memory doPackFST= true), n_d1=PostingsFormat(name=MockSep), rnd_b=PostingsFormat(name=Memory doPackFST= false), intDefault=PostingsFormat(name=Memory doPackFST= true), n_td1=PostingsFormat(name=Memory doPackFST= true), id=PostingsFormat(name=Memory doPackFST= false), timestamp=PostingsFormat(name=MockSep), range_facet_sl=PostingsFormat(name=Memory doPackFST= false), range_facet_si=PostingsFormat(name=MockSep), oddField_s=PostingsFormat(name=Memory doPackFST= false), multiDefault=PostingsFormat(name=MockSep), n_tf1=PostingsFormat(name=MockSep), n_dt1=PostingsFormat(name=Memory doPackFST= true), n_ti1=PostingsFormat(name=Memory doPackFST= false), range_facet_l=PostingsFormat(name=MockSep), text=PostingsFormat(name=SimpleText), _version_=PostingsFormat(name=Memory doPackFST= true), SubjectTerms_mfacet=PostingsFormat(name=Memory doPackFST= true), a_t=PostingsFormat(name=MockSep), n_tdt1=PostingsFormat(name=Memory doPackFST= true), other_tl1=PostingsFormat(name=Memory doPackFST= true), n_l1=PostingsFormat(name=MockSep), a_si=PostingsFormat(name=Memory doPackFST= true)}, sim=RandomSimilarityProvider(queryNorm=false,coord=false): {}, locale=de_CH, timezone=America/Metlakatla
> [junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=3,free=75487888,total=164757504
> [junit4:junit4]   2> NOTE: All tests run in this JVM: [LengthFilterTest, TestXIncludeConfig, MultiTermTest, ResourceLoaderTest, TestJmxMonitoredMap, TestLRUCache, QueryParsingTest, PeerSyncTest, ZkCLITest, TestWikipediaTokenizerFactory, TestShingleFilterFactory, CommonGramsFilterFactoryTest, CloudStateUpdateTest, TestEnglishMinimalStemFilterFactory, TestRecovery, PrimUtilsTest, PolyFieldTest, SearchHandlerTest, TestPatternReplaceFilterFactory, UUIDFieldTest, TestSolrXMLSerializer, DocumentAnalysisRequestHandlerTest, TestGermanMinimalStemFilterFactory, TestKeepFilterFactory, CSVRequestHandlerTest, TestTrie, IndexSchemaRuntimeFieldTest, BadIndexSchemaTest, TestStressLucene, SortByFunctionTest, TestGermanNormalizationFilterFactory, SpellCheckComponentTest, TestGalicianMinimalStemFilterFactory, TestSuggestSpellingConverter, TestWriterPerf, TestRemoteStreaming, TestDefaultSimilarityFactory, SpellPossibilityIteratorTest, TestRussianLightStemFilterFactory, OverseerTest, TestCSVResponseWriter, TestMultiWordSynonyms, JsonLoaderTest, TestSystemIdResolver, WordBreakSolrSpellCheckerTest, TestPersianNormalizationFilterFactory, DocumentBuilderTest, TestSolrDeletionPolicy1, TestIndonesianStemFilterFactory, TestJapaneseTokenizerFactory, TestPropInjectDefaults, TestReverseStringFilterFactory, TimeZoneUtilsTest, TestCoreContainer, TestFastLRUCache, TestReload, SignatureUpdateProcessorFactoryTest, TestGreekStemFilterFactory, TestUtils, DebugComponentTest, TestCJKBigramFilterFactory, SuggesterFSTTest, TestGroupingSearch, TestOmitPositions, TestSort, NotRequiredUniqueKeyTest, FullSolrCloudTest]
> [junit4:junit4]   2> 
> [junit4:junit4] Completed on J1 in 152.17s, 1 test, 1 error <<< FAILURES!
> [...truncated 647 lines...]
> [junit4:junit4]   2> 
> [junit4:junit4]   2> 39249 T6493 oasc.Overseer$CloudStateUpdater.amILeader According to ZK I (id=88025185329872901-127.0.0.1:10194_solr-n_0000000003) am no longer a leader.
> [junit4:junit4]   2> 39633 T6417 oasc.Overseer$CloudStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
> [junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
> [junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
> [junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
> [junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:289)
> [junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:286)
> [junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
> [junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:286)
> [junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$CloudStateUpdater.amILeader(Overseer.java:187)
> [junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$CloudStateUpdater.run(Overseer.java:113)
> [junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:679)
> [junit4:junit4]   2> 
> [junit4:junit4]   2> 39633 T6417 oasc.Overseer$CloudStateUpdater.amILeader According to ZK I (id=88025185329872898-127.0.0.1:64152_solr-n_0000000000) am no longer a leader.
> [junit4:junit4]   2> 41874 T6399 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
> [junit4:junit4]   2> 49359 T6442 oasc.SyncStrategy.syncToMe Sync failed - asking replica to recover.
> [junit4:junit4]   2> 49359 T6442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 94366 T6442 oasc.SyncStrategy.syncToMe Could not tell a replica to recover org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:10190/solr/collection1
> [junit4:junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414)
> [junit4:junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182)
> [junit4:junit4]   2> 	at org.apache.solr.cloud.SyncStrategy.syncToMe(SyncStrategy.java:237)
> [junit4:junit4]   2> 	at org.apache.solr.cloud.SyncStrategy.syncReplicas(SyncStrategy.java:119)
> [junit4:junit4]   2> 	at org.apache.solr.cloud.SyncStrategy.sync(SyncStrategy.java:82)
> [junit4:junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:158)
> [junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
> [junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
> [junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
> [junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
> [junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
> [junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
> [junit4:junit4]   2> Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to 127.0.0.1:10190 timed out
> [junit4:junit4]   2> 	at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:125)
> [junit4:junit4]   2> 	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148)
> [junit4:junit4]   2> 	at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150)
> [junit4:junit4]   2> 	at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121)
> [junit4:junit4]   2> 	at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575)
> [junit4:junit4]   2> 	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425)
> [junit4:junit4]   2> 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
> [junit4:junit4]   2> 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
> [junit4:junit4]   2> 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
> [junit4:junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
> [junit4:junit4]   2> 	... 11 more
> [junit4:junit4]   2> 
> [junit4:junit4]   2> 94367 T6442 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:10192_solr_collection1
> [junit4:junit4]   2> 94368 T6442 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-
> [junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
> [junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
> [junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:643)
> [junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:244)
> [junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:241)
> [junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
> [junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:241)
> [junit4:junit4]   2> 	at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:236)
> [junit4:junit4]   2> 	at org.apache.solr.cloud.ZkController.publish(ZkController.java:734)
> [junit4:junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:168)
> [junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
> [junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
> [junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
> [junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
> [junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
> [junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
> [junit4:junit4]   2> 
> [junit4:junit4]   2> 94368 T6442 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
> [junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
> [junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
> [junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
> [junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
> [junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
> [junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
> [junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
> [junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
> [junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
> [junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
> [junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
> [junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
> [junit4:junit4]   2> 
> [junit4:junit4]   2> 94369 T6442 oascc.ZkStateReader$3.process Updating live nodes
> [junit4:junit4]   2> 94369 T6442 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
> [junit4:junit4]   2> 94369 T6442 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 94519 T6434 C109 P10192 oasc.SolrException.log SEVERE shard update error StdNode: http://127.0.0.1:10190/solr/collection1/:org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:10190/solr/collection1
> [junit4:junit4]   2> 		at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:407)
> [junit4:junit4]   2> 		at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182)
> [junit4:junit4]   2> 		at org.apache.solr.update.SolrCmdDistributor$1.call(SolrCmdDistributor.java:336)
> [junit4:junit4]   2> 		at org.apache.solr.update.SolrCmdDistributor$1.call(SolrCmdDistributor.java:317)
> [junit4:junit4]   2> 		at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> [junit4:junit4]   2> 		at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> [junit4:junit4]   2> 		at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> [junit4:junit4]   2> 		at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> [junit4:junit4]   2> 		at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> [junit4:junit4]   2> 		at org.apache.solr.update.SolrCmdDistributor$BoundedExecutor$1.run(SolrCmdDistributor.java:538)
> [junit4:junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> [junit4:junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> [junit4:junit4]   2> 		at java.lang.Thread.run(Thread.java:679)
> [junit4:junit4]   2> 	Caused by: org.apache.http.conn.HttpHostConnectException: Connection to http://127.0.0.1:10190 refused
> [junit4:junit4]   2> 		at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:158)
> [junit4:junit4]   2> 		at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150)
> [junit4:junit4]   2> 		at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121)
> [junit4:junit4]   2> 		at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575)
> [junit4:junit4]   2> 		at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425)
> [junit4:junit4]   2> 		at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
> [junit4:junit4]   2> 		at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
> [junit4:junit4]   2> 		at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
> [junit4:junit4]   2> 		at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
> [junit4:junit4]   2> 		... 12 more
> [junit4:junit4]   2> 	Caused by: java.net.ConnectException: Operation timed out
> [junit4:junit4]   2> 		at java.net.PlainSocketImpl.socketConnect(Native Method)
> [junit4:junit4]   2> 		at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:327)
> [junit4:junit4]   2> 		at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:193)
> [junit4:junit4]   2> 		at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:180)
> [junit4:junit4]   2> 		at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
> [junit4:junit4]   2> 		at java.net.Socket.connect(Socket.java:546)
> [junit4:junit4]   2> 		at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:123)
> [junit4:junit4]   2> 		at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148)
> [junit4:junit4]   2> 		... 20 more
> [junit4:junit4]   2> 	
> [junit4:junit4]   2> 160271 T6396 oas.SolrTestCaseJ4.endTrackingSearchers SEVERE ERROR: SolrIndexSearcher opens=28 closes=27
> [junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {range_facet_l=PostingsFormat(name=Memory doPackFST= false), text=PostingsFormat(name=NestedPulsing), _version_=PostingsFormat(name=Memory doPackFST= false), rnd_b=Lucene40(minBlockSize=63 maxBlockSize=210), intDefault=PostingsFormat(name=Memory doPackFST= false), id=Lucene40(minBlockSize=63 maxBlockSize=210), timestamp=PostingsFormat(name=Memory doPackFST= false), a_t=PostingsFormat(name=Memory doPackFST= false), range_facet_sl=PostingsFormat(name=NestedPulsing), range_facet_si=Pulsing40(freqCutoff=10 minBlockSize=63 maxBlockSize=210), other_tl1=PostingsFormat(name=Memory doPackFST= false), multiDefault=Pulsing40(freqCutoff=10 minBlockSize=63 maxBlockSize=210), a_si=Pulsing40(freqCutoff=10 minBlockSize=63 maxBlockSize=210)}, sim=RandomSimilarityProvider(queryNorm=false,coord=false): {}, locale=tr_TR, timezone=Africa/Casablanca
> [junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=6,free=222993728,total=290848768
> [junit4:junit4]   2> NOTE: All tests run in this JVM: [AutoCommitTest, TestPatternReplaceCharFilterFactory, StatelessScriptUpdateProcessorFactoryTest, TestJapaneseBaseFormFilterFactory, TestFrenchLightStemFilterFactory, TestPhoneticFilterFactory, TestDFRSimilarityFactory, JSONWriterTest, SolrCmdDistributorTest, TestFiltering, TestSwedishLightStemFilterFactory, CoreAdminHandlerTest, SuggesterTSTTest, TestSpanishLightStemFilterFactory, DateMathParserTest, TestTypeTokenFilterFactory, TestLatvianStemFilterFactory, TestPatternTokenizerFactory, UpdateRequestProcessorFactoryTest, TestStressRecovery, CacheHeaderTest, TestFaceting, PreAnalyzedFieldTest, TestCSVLoader, FastVectorHighlighterTest, TestTrimFilterFactory, TestSolrCoreProperties, TestPortugueseMinimalStemFilterFactory, TestPortugueseStemFilterFactory, SuggesterTest, TestRandomFaceting, TestMappingCharFilterFactory, CopyFieldTest, TestKStemFilterFactory, TestDistributedSearch, TestArabicFilters, LegacyHTMLStripCharFilterTest, BasicFunctionalityTest, RecoveryZkTest, TestCharFilters, EchoParamsTest, DirectSolrSpellCheckerTest, TestBinaryField, TestQueryUtils, TestReversedWildcardFilterFactory, TestIrishLowerCaseFilterFactory, XmlUpdateRequestHandlerTest, SuggesterWFSTTest, TestDelimitedPayloadTokenFilterFactory, TestStressVersions, SimpleFacetsTest, TestCapitalizationFilterFactory, TestWordDelimiterFilterFactory, DistributedSpellCheckComponentTest, TestFrenchMinimalStemFilterFactory, PluginInfoTest, ConvertedLegacyTest, DisMaxRequestHandlerTest, MinimalSchemaTest, TestJoin, IndexBasedSpellCheckerTest, SolrCoreCheckLockOnStartupTest, BinaryUpdateRequestHandlerTest, SystemInfoHandlerTest, TestRemoveDuplicatesTokenFilterFactory, MoreLikeThisHandlerTest, TestBrazilianStemFilterFactory, TestPerFieldSimilarity, CurrencyFieldTest, TestSolrJ, TestReplicationHandler, TestRealTimeGet, ZkSolrClientTest, TestHashPartitioner, StatsComponentTest, TestRangeQuery, DirectSolrConnectionTest, SpatialFilterTest, DistributedQueryElevationComponentTest, TermsComponentTest, SolrInfoMBeanTest, StandardRequestHandlerTest, FieldAnalysisRequestHandlerTest, TermVectorComponentTest, DirectUpdateHandlerOptimizeTest, SolrPluginUtilsTest, ReturnFieldsTest, RequiredFieldsTest, TestArbitraryIndexDir, UniqFieldsUpdateProcessorFactoryTest, ShowFileRequestHandlerTest, TestFoldingMultitermQuery, TestIndexingPerformance, PrimitiveFieldTypeTest, BadComponentTest, TestUpdate, HighlighterConfigTest, SOLR749Test, DefaultValueUpdateProcessorTest, TestDocSet, TestQuerySenderListener, SolrIndexConfigTest, IndexReaderFactoryTest, OutputWriterTest, TestJapaneseKatakanaStemFilterFactory, TestBM25SimilarityFactory, TestPhraseSuggestions, TestPluginEnable, TestHyphenationCompoundWordTokenFilterFactory, TestIBSimilarityFactory, TestHTMLStripCharFilterFactory, TestThaiWordFilterFactory, TestGreekLowerCaseFilterFactory, DoubleMetaphoneFilterFactoryTest, TestGalicianStemFilterFactory, FileUtilsTest, CloudStateTest, TestGermanLightStemFilterFactory, TestJapanesePartOfSpeechStopFilterFactory, TestStopFilterFactory, DOMUtilTest, TestElisionFilterFactory, TestHindiFilters, TestHungarianLightStemFilterFactory, CommonGramsQueryFilterFactoryTest, RAMDirectoryFactoryTest, TestGermanStemFilterFactory, TestItalianLightStemFilterFactory, TestPorterStemFilterFactory, ZkNodePropsTest, TestBulgarianStemFilterFactory, TestNorwegianMinimalStemFilterFactory, TestTurkishLowerCaseFilterFactory, TestFinnishLightStemFilterFactory, TestDocumentBuilder, SyncSliceTest]
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.seed=45F3FDD6D64EE45A -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=tr_TR -Dtests.timezone=Africa/Casablanca -Dtests.file.encoding=US-ASCII
> [junit4:junit4]   2> 
> [junit4:junit4] ERROR   0.00s J0 | SyncSliceTest (suite)
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=28 closes=27
> [junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([45F3FDD6D64EE45A]:0)
> [junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
> [junit4:junit4]    > 	at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
> [junit4:junit4]    > 	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
> [junit4:junit4]    > 	at sun.reflect.GeneratedMethodAccessor22.invoke(Unknown Source)
> [junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:616)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> [junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
> [junit4:junit4]    >
> [junit4:junit4] Completed on J0 in 160.32s, 1 test, 1 failure <<< FAILURES!
> [...truncated 21 lines...]
> 
> [...truncated 12651 lines...]
> 
> [...truncated 12651 lines...]
> 
> [...truncated 12651 lines...]
> 
> [...truncated 12651 lines...]
> 
> [...truncated 12595 lines...]
> [junit4:junit4]   2> 160271 T6396 oas.SolrTestCaseJ4.endTrackingSearchers SEVERE ERROR: SolrIndexSearcher opens=28 closes=27
> [junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {range_facet_l=PostingsFormat(name=Memory doPackFST= false), text=PostingsFormat(name=NestedPulsing), _version_=PostingsFormat(name=Memory doPackFST= false), rnd_b=Lucene40(minBlockSize=63 maxBlockSize=210), intDefault=PostingsFormat(name=Memory doPackFST= false), id=Lucene40(minBlockSize=63 maxBlockSize=210), timestamp=PostingsFormat(name=Memory doPackFST= false), a_t=PostingsFormat(name=Memory doPackFST= false), range_facet_sl=PostingsFormat(name=NestedPulsing), range_facet_si=Pulsing40(freqCutoff=10 minBlockSize=63 maxBlockSize=210), other_tl1=PostingsFormat(name=Memory doPackFST= false), multiDefault=Pulsing40(freqCutoff=10 minBlockSize=63 maxBlockSize=210), a_si=Pulsing40(freqCutoff=10 minBlockSize=63 maxBlockSize=210)}, sim=RandomSimilarityProvider(queryNorm=false,coord=false): {}, locale=tr_TR, timezone=Africa/Casablanca
> [junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=6,free=222993728,total=290848768
> [junit4:junit4]   2> NOTE: All tests run in this JVM: [AutoCommitTest, TestPatternReplaceCharFilterFactory, StatelessScriptUpdateProcessorFactoryTest, TestJapaneseBaseFormFilterFactory, TestFrenchLightStemFilterFactory, TestPhoneticFilterFactory, TestDFRSimilarityFactory, JSONWriterTest, SolrCmdDistributorTest, TestFiltering, TestSwedishLightStemFilterFactory, CoreAdminHandlerTest, SuggesterTSTTest, TestSpanishLightStemFilterFactory, DateMathParserTest, TestTypeTokenFilterFactory, TestLatvianStemFilterFactory, TestPatternTokenizerFactory, UpdateRequestProcessorFactoryTest, TestStressRecovery, CacheHeaderTest, TestFaceting, PreAnalyzedFieldTest, TestCSVLoader, FastVectorHighlighterTest, TestTrimFilterFactory, TestSolrCoreProperties, TestPortugueseMinimalStemFilterFactory, TestPortugueseStemFilterFactory, SuggesterTest, TestRandomFaceting, TestMappingCharFilterFactory, CopyFieldTest, TestKStemFilterFactory, TestDistributedSearch, TestArabicFilters, LegacyHTMLStripCharFilterTest, BasicFunctionalityTest, RecoveryZkTest, TestCharFilters, EchoParamsTest, DirectSolrSpellCheckerTest, TestBinaryField, TestQueryUtils, TestReversedWildcardFilterFactory, TestIrishLowerCaseFilterFactory, XmlUpdateRequestHandlerTest, SuggesterWFSTTest, TestDelimitedPayloadTokenFilterFactory, TestStressVersions, SimpleFacetsTest, TestCapitalizationFilterFactory, TestWordDelimiterFilterFactory, DistributedSpellCheckComponentTest, TestFrenchMinimalStemFilterFactory, PluginInfoTest, ConvertedLegacyTest, DisMaxRequestHandlerTest, MinimalSchemaTest, TestJoin, IndexBasedSpellCheckerTest, SolrCoreCheckLockOnStartupTest, BinaryUpdateRequestHandlerTest, SystemInfoHandlerTest, TestRemoveDuplicatesTokenFilterFactory, MoreLikeThisHandlerTest, TestBrazilianStemFilterFactory, TestPerFieldSimilarity, CurrencyFieldTest, TestSolrJ, TestReplicationHandler, TestRealTimeGet, ZkSolrClientTest, TestHashPartitioner, StatsComponentTest, TestRangeQuery, DirectSolrConnectionTest, SpatialFilterTest, DistributedQueryElevationComponentTest, TermsComponentTest, SolrInfoMBeanTest, StandardRequestHandlerTest, FieldAnalysisRequestHandlerTest, TermVectorComponentTest, DirectUpdateHandlerOptimizeTest, SolrPluginUtilsTest, ReturnFieldsTest, RequiredFieldsTest, TestArbitraryIndexDir, UniqFieldsUpdateProcessorFactoryTest, ShowFileRequestHandlerTest, TestFoldingMultitermQuery, TestIndexingPerformance, PrimitiveFieldTypeTest, BadComponentTest, TestUpdate, HighlighterConfigTest, SOLR749Test, DefaultValueUpdateProcessorTest, TestDocSet, TestQuerySenderListener, SolrIndexConfigTest, IndexReaderFactoryTest, OutputWriterTest, TestJapaneseKatakanaStemFilterFactory, TestBM25SimilarityFactory, TestPhraseSuggestions, TestPluginEnable, TestHyphenationCompoundWordTokenFilterFactory, TestIBSimilarityFactory, TestHTMLStripCharFilterFactory, TestThaiWordFilterFactory, TestGreekLowerCaseFilterFactory, DoubleMetaphoneFilterFactoryTest, TestGalicianStemFilterFactory, FileUtilsTest, CloudStateTest, TestGermanLightStemFilterFactory, TestJapanesePartOfSpeechStopFilterFactory, TestStopFilterFactory, DOMUtilTest, TestElisionFilterFactory, TestHindiFilters, TestHungarianLightStemFilterFactory, CommonGramsQueryFilterFactoryTest, RAMDirectoryFactoryTest, TestGermanStemFilterFactory, TestItalianLightStemFilterFactory, TestPorterStemFilterFactory, ZkNodePropsTest, TestBulgarianStemFilterFactory, TestNorwegianMinimalStemFilterFactory, TestTurkishLowerCaseFilterFactory, TestFinnishLightStemFilterFactory, TestDocumentBuilder, SyncSliceTest]
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.seed=45F3FDD6D64EE45A -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=tr_TR -Dtests.timezone=Africa/Casablanca -Dtests.file.encoding=US-ASCII
> [junit4:junit4]   2> 
> [junit4:junit4] ERROR   0.00s J0 | SyncSliceTest (suite)
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=28 closes=27
> [junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([45F3FDD6D64EE45A]:0)
> [junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
> [junit4:junit4]    > 	at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
> [junit4:junit4]    > 	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
> [junit4:junit4]    > 	at sun.reflect.GeneratedMethodAccessor22.invoke(Unknown Source)
> [junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:616)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> [junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
> [junit4:junit4]    >
> [junit4:junit4] Completed on J0 in 160.32s, 1 test, 1 failure <<< FAILURES!
> [junit4:junit4]  
> [junit4:junit4] JVM J0:     1.00 ..   915.62 =   914.62s
> [junit4:junit4] JVM J1:     1.00 ..   824.77 =   823.77s
> [junit4:junit4] Execution time total: 15 minutes 15 seconds
> [junit4:junit4] Tests summary: 297 suites, 1054 tests, 1 suite-level error, 1 error, 5 ignored
> 
> BUILD FAILED
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/build.xml:29: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build.xml:144: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/module-build.xml:62: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/common-build.xml:1094: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/common-build.xml:789: There were test failures: 297 suites, 1054 tests, 1 suite-level error, 1 error, 5 ignored
> 
> Total time: 34 minutes 52 seconds
> Build step 'Execute shell' marked build as failure
> Archiving artifacts
> Recording test results
> Publishing Clover coverage report...
> No Clover report will be published due to a Build Failure
> Email was triggered for: Failure
> Sending email for trigger: Failure
> 
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org

- Mark Miller
lucidimagination.com












---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message