Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 81655200B8E for ; Sun, 11 Sep 2016 19:26:24 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 7FF7B160AC7; Sun, 11 Sep 2016 17:26:24 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 0425E160AB6 for ; Sun, 11 Sep 2016 19:26:22 +0200 (CEST) Received: (qmail 11947 invoked by uid 500); 11 Sep 2016 17:26:21 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 11935 invoked by uid 99); 11 Sep 2016 17:26:21 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 11 Sep 2016 17:26:21 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id A3F272C1B79 for ; Sun, 11 Sep 2016 17:26:21 +0000 (UTC) Date: Sun, 11 Sep 2016 17:26:21 +0000 (UTC) From: "Michael McCandless (JIRA)" To: dev@lucene.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Resolved] (LUCENE-7445) TestSearcherManager failure: Document contains at least one immense term in field="body" MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Sun, 11 Sep 2016 17:26:24 -0000 [ https://issues.apache.org/jira/browse/LUCENE-7445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless resolved LUCENE-7445. ---------------------------------------- Resolution: Fixed Fix Version/s: 6.3 master (7.0) OK this newish test case was failing to explicitly trim too-large terms. I pushed a test fix. > TestSearcherManager failure: Document contains at least one immense term in field="body" > ---------------------------------------------------------------------------------------- > > Key: LUCENE-7445 > URL: https://issues.apache.org/jira/browse/LUCENE-7445 > Project: Lucene - Core > Issue Type: Bug > Reporter: Steve Rowe > Fix For: master (7.0), 6.3 > > > My Jenkins found a reproducing branch_6x seed: > {noformat} > [junit4] Suite: org.apache.lucene.search.TestSearcherManager > [junit4] 2> ruj 10, 2016 8:08:20 AM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException > [junit4] 2> WARNING: Uncaught exception in thread: Thread[Thread-673,5,TGRP-TestSearcherManager] > [junit4] 2> java.lang.IllegalArgumentException: Document contains at least one immense term in field="body" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped. Please correct the analyzer to not produce such terms. The prefix of the first immense term is: '[125, 125, 123, 123, 123, 123, 123, 115, 117, 98, 115, 116, 99, 124, 125, 125, 125, 123, 123, 123, 49, 125, 125, 125, 124, 123, 123, 123, 112, 49]...', original message: bytes can be at most 32766 in length; got 94384 > [junit4] 2> at __randomizedtesting.SeedInfo.seed([22BFCB6CA5A80CA]:0) > [junit4] 2> at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:772) > [junit4] 2> at org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:417) > [junit4] 2> at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:373) > [junit4] 2> at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:231) > [junit4] 2> at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478) > [junit4] 2> at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1562) > [junit4] 2> at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1307) > [junit4] 2> at org.apache.lucene.search.TestSearcherManager$8.run(TestSearcherManager.java:557) > [junit4] 2> Suppressed: java.lang.IllegalStateException: close() called in wrong state: INCREMENT > [junit4] 2> at org.apache.lucene.analysis.MockTokenizer.fail(MockTokenizer.java:125) > [junit4] 2> at org.apache.lucene.analysis.MockTokenizer.close(MockTokenizer.java:292) > [junit4] 2> at org.apache.lucene.analysis.TokenFilter.close(TokenFilter.java:58) > [junit4] 2> at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:788) > [junit4] 2> ... 7 more > [junit4] 2> Caused by: org.apache.lucene.util.BytesRefHash$MaxBytesLengthExceededException: bytes can be at most 32766 in length; got 94384 > [junit4] 2> at org.apache.lucene.util.BytesRefHash.add(BytesRefHash.java:263) > [junit4] 2> at org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:149) > [junit4] 2> at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:762) > [junit4] 2> ... 7 more > [junit4] 2> > [junit4] 2> ruj 10, 2016 8:38:00 AM com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate > [junit4] 2> WARNING: Suite execution timed out: org.apache.lucene.search.TestSearcherManager > [junit4] 2> ==== jstack at approximately timeout time ==== > [junit4] 2> "Thread-676" ID=802 RUNNABLE > [junit4] 2> at java.lang.Thread.holdsLock(Native Method) > [junit4] 2> at org.apache.lucene.index.IndexFileDeleter.locked(IndexFileDeleter.java:117) > [junit4] 2> at org.apache.lucene.index.IndexFileDeleter.incRef(IndexFileDeleter.java:565) > [junit4] 2> at org.apache.lucene.index.IndexFileDeleter.incRef(IndexFileDeleter.java:553) > [junit4] 2> at org.apache.lucene.index.IndexWriter.incRefDeleter(IndexWriter.java:4963) > [junit4] 2> - locked org.apache.lucene.index.IndexWriter@7fc295c2 > [junit4] 2> at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:117) > [junit4] 2> at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:460) > [junit4] 2> - locked org.apache.lucene.index.IndexWriter@7fc295c2 > [junit4] 2> - locked java.lang.Object@c3599a3 > [junit4] 2> at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:103) > [junit4] 2> at org.apache.lucene.search.SearcherManager.(SearcherManager.java:108) > [junit4] 2> at org.apache.lucene.search.SearcherManager.(SearcherManager.java:76) > [junit4] 2> at org.apache.lucene.search.TestSearcherManager$11.run(TestSearcherManager.java:647) > [junit4] 2> > [junit4] 2> "Thread-675" ID=801 RUNNABLE > [junit4] 2> at java.lang.Throwable.fillInStackTrace(Native Method) > [junit4] 2> at java.lang.Throwable.fillInStackTrace(Throwable.java:783) > [junit4] 2> - locked org.apache.lucene.store.AlreadyClosedException@4e77cf8b > [junit4] 2> at java.lang.Throwable.(Throwable.java:265) > [junit4] 2> at java.lang.Exception.(Exception.java:66) > [junit4] 2> at java.lang.RuntimeException.(RuntimeException.java:62) > [junit4] 2> at java.lang.IllegalStateException.(IllegalStateException.java:55) > [junit4] 2> at org.apache.lucene.store.AlreadyClosedException.(AlreadyClosedException.java:26) > [junit4] 2> at org.apache.lucene.search.ReferenceManager.ensureOpen(ReferenceManager.java:54) > [junit4] 2> at org.apache.lucene.search.ReferenceManager.maybeRefreshBlocking(ReferenceManager.java:248) > [junit4] 2> at org.apache.lucene.search.TestSearcherManager$10.run(TestSearcherManager.java:617) > [junit4] 2> > [junit4] 2> "Thread-674" ID=800 RUNNABLE > [junit4] 2> at java.lang.Throwable.fillInStackTrace(Native Method) > [junit4] 2> at java.lang.Throwable.fillInStackTrace(Throwable.java:783) > [junit4] 2> - locked org.apache.lucene.store.AlreadyClosedException@746a9d47 > [junit4] 2> at java.lang.Throwable.(Throwable.java:265) > [junit4] 2> at java.lang.Exception.(Exception.java:66) > [junit4] 2> at java.lang.RuntimeException.(RuntimeException.java:62) > [junit4] 2> at java.lang.IllegalStateException.(IllegalStateException.java:55) > [junit4] 2> at org.apache.lucene.store.AlreadyClosedException.(AlreadyClosedException.java:26) > [junit4] 2> at org.apache.lucene.search.ReferenceManager.acquire(ReferenceManager.java:98) > [junit4] 2> at org.apache.lucene.search.TestSearcherManager$9.run(TestSearcherManager.java:588) > [junit4] 2> > [junit4] 2> "TEST-TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh-seed#[22BFCB6CA5A80CA]" ID=797 WAITING on org.apache.lucene.search.TestSearcherManager$9@1fed6a8d > [junit4] 2> at java.lang.Object.wait(Native Method) > [junit4] 2> - waiting on org.apache.lucene.search.TestSearcherManager$9@1fed6a8d > [junit4] 2> at java.lang.Thread.join(Thread.java:1245) > [junit4] 2> at java.lang.Thread.join(Thread.java:1319) > [junit4] 2> at org.apache.lucene.search.TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh(TestSearcherManager.java:670) > [junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > [junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > [junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > [junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498) > [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764) > [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871) > [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907) > [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921) > [junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) > [junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) > [junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) > [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) > [junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) > [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367) > [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809) > [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460) > [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880) > [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781) > [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816) > [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827) > [junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) > [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > [junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) > [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) > [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) > [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > [junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) > [junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) > [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) > [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) > [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367) > [junit4] 2> at java.lang.Thread.run(Thread.java:745) > [junit4] 2> > [junit4] 2> "SUITE-TestSearcherManager-seed#[22BFCB6CA5A80CA]" ID=796 RUNNABLE > [junit4] 2> at sun.management.ThreadImpl.dumpThreads0(Native Method) > [junit4] 2> at sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:454) > [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:673) > [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:64) > [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:414) > [junit4] 2> - locked java.lang.Object@3fb51052 > [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:681) > [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:140) > [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:591) > [junit4] 2> > [junit4] 2> "JUnit4-serializer-daemon" ID=18 TIMED_WAITING > [junit4] 2> at java.lang.Thread.sleep(Native Method) > [junit4] 2> at com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:47) > [junit4] 2> > [junit4] 2> "Signal Dispatcher" ID=4 RUNNABLE > [junit4] 2> > [junit4] 2> "Finalizer" ID=3 WAITING on java.lang.ref.ReferenceQueue$Lock@4f4e9bb8 > [junit4] 2> at java.lang.Object.wait(Native Method) > [junit4] 2> - waiting on java.lang.ref.ReferenceQueue$Lock@4f4e9bb8 > [junit4] 2> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143) > [junit4] 2> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164) > [junit4] 2> at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209) > [junit4] 2> > [junit4] 2> "Reference Handler" ID=2 WAITING on java.lang.ref.Reference$Lock@6f6eb7b3 > [junit4] 2> at java.lang.Object.wait(Native Method) > [junit4] 2> - waiting on java.lang.ref.Reference$Lock@6f6eb7b3 > [junit4] 2> at java.lang.Object.wait(Object.java:502) > [junit4] 2> at java.lang.ref.Reference.tryHandlePending(Reference.java:191) > [junit4] 2> at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153) > [junit4] 2> > [junit4] 2> "main" ID=1 WAITING on com.carrotsearch.randomizedtesting.RandomizedRunner$2@3eff9ff9 > [junit4] 2> at java.lang.Object.wait(Native Method) > [junit4] 2> - waiting on com.carrotsearch.randomizedtesting.RandomizedRunner$2@3eff9ff9 > [junit4] 2> at java.lang.Thread.join(Thread.java:1245) > [junit4] 2> at java.lang.Thread.join(Thread.java:1319) > [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:601) > [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:450) > [junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:243) > [junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:354) > [junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:10) > [junit4] 2> > [junit4] 2> ^^============================================== > [junit4] 2> > [junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory. > [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestSearcherManager -Dtests.method=testConcurrentIndexCloseSearchAndRefresh -Dtests.seed=22BFCB6CA5A80CA -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=hr -Dtests.timezone=America/Port-au-Prince -Dtests.asserts=true -Dtests.file.encoding=US-ASCII > [junit4] ERROR 1800s J8 | TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh <<< > [junit4] > Throwable #1: java.lang.Exception: Test abandoned because suite timeout was reached. > [junit4] > at __randomizedtesting.SeedInfo.seed([22BFCB6CA5A80CA]:0) > [junit4] 2> ruj 10, 2016 8:38:00 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks > [junit4] 2> WARNING: Will linger awaiting termination of 4 leaked thread(s). > [junit4] 2> ruj 10, 2016 8:38:20 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks > [junit4] 2> SEVERE: 4 threads leaked from SUITE scope at org.apache.lucene.search.TestSearcherManager: > [junit4] 2> 1) Thread[id=800, name=Thread-674, state=RUNNABLE, group=TGRP-TestSearcherManager] > [junit4] 2> at java.lang.Throwable.fillInStackTrace(Native Method) > [junit4] 2> at java.lang.Throwable.fillInStackTrace(Throwable.java:783) > [junit4] 2> at java.lang.Throwable.(Throwable.java:265) > [junit4] 2> at java.lang.Exception.(Exception.java:66) > [junit4] 2> at java.lang.RuntimeException.(RuntimeException.java:62) > [junit4] 2> at java.lang.IllegalStateException.(IllegalStateException.java:55) > [junit4] 2> at org.apache.lucene.store.AlreadyClosedException.(AlreadyClosedException.java:26) > [junit4] 2> at org.apache.lucene.search.ReferenceManager.acquire(ReferenceManager.java:98) > [junit4] 2> at org.apache.lucene.search.TestSearcherManager$9.run(TestSearcherManager.java:588) > [junit4] 2> 2) Thread[id=802, name=Thread-676, state=RUNNABLE, group=TGRP-TestSearcherManager] > [junit4] 2> at java.lang.Thread.holdsLock(Native Method) > [junit4] 2> at org.apache.lucene.index.IndexFileDeleter.locked(IndexFileDeleter.java:117) > [junit4] 2> at org.apache.lucene.index.IndexFileDeleter.decRef(IndexFileDeleter.java:577) > [junit4] 2> at org.apache.lucene.index.IndexFileDeleter.decRef(IndexFileDeleter.java:647) > [junit4] 2> at org.apache.lucene.index.IndexWriter.decRefDeleter(IndexWriter.java:4975) > [junit4] 2> at org.apache.lucene.index.StandardDirectoryReader.doClose(StandardDirectoryReader.java:381) > [junit4] 2> at org.apache.lucene.index.IndexReader.decRef(IndexReader.java:251) > [junit4] 2> at org.apache.lucene.search.SearcherManager.decRef(SearcherManager.java:149) > [junit4] 2> at org.apache.lucene.search.SearcherManager.decRef(SearcherManager.java:58) > [junit4] 2> at org.apache.lucene.search.ReferenceManager.release(ReferenceManager.java:274) > [junit4] 2> at org.apache.lucene.search.ReferenceManager.swapReference(ReferenceManager.java:62) > [junit4] 2> at org.apache.lucene.search.ReferenceManager.close(ReferenceManager.java:146) > [junit4] 2> at org.apache.lucene.search.TestSearcherManager$11.run(TestSearcherManager.java:643) > [junit4] 2> 3) Thread[id=797, name=TEST-TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh-seed#[22BFCB6CA5A80CA], state=WAITING, group=TGRP-TestSearcherManager] > [junit4] 2> at java.lang.Object.wait(Native Method) > [junit4] 2> at java.lang.Thread.join(Thread.java:1245) > [junit4] 2> at java.lang.Thread.join(Thread.java:1319) > [junit4] 2> at org.apache.lucene.search.TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh(TestSearcherManager.java:670) > [junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > [junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > [junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > [junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498) > [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764) > [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871) > [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907) > [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921) > [junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) > [junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) > [junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) > [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) > [junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) > [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367) > [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809) > [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460) > [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880) > [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781) > [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816) > [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827) > [junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) > [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > [junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) > [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) > [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) > [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > [junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) > [junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) > [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) > [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) > [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367) > [junit4] 2> at java.lang.Thread.run(Thread.java:745) > [junit4] 2> 4) Thread[id=801, name=Thread-675, state=RUNNABLE, group=TGRP-TestSearcherManager] > [junit4] 2> at java.lang.Throwable.fillInStackTrace(Native Method) > [junit4] 2> at java.lang.Throwable.fillInStackTrace(Throwable.java:783) > [junit4] 2> at java.lang.Throwable.(Throwable.java:265) > [junit4] 2> at java.lang.Exception.(Exception.java:66) > [junit4] 2> at java.lang.RuntimeException.(RuntimeException.java:62) > [junit4] 2> at java.lang.IllegalStateException.(IllegalStateException.java:55) > [junit4] 2> at org.apache.lucene.store.AlreadyClosedException.(AlreadyClosedException.java:26) > [junit4] 2> at org.apache.lucene.search.ReferenceManager.ensureOpen(ReferenceManager.java:54) > [junit4] 2> at org.apache.lucene.search.ReferenceManager.maybeRefreshBlocking(ReferenceManager.java:248) > [junit4] 2> at org.apache.lucene.search.TestSearcherManager$10.run(TestSearcherManager.java:617) > [junit4] 2> ruj 10, 2016 8:38:20 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll > [junit4] 2> INFO: Starting to interrupt leaked threads: > [junit4] 2> 1) Thread[id=800, name=Thread-674, state=RUNNABLE, group=TGRP-TestSearcherManager] > [junit4] 2> 2) Thread[id=802, name=Thread-676, state=BLOCKED, group=TGRP-TestSearcherManager] > [junit4] 2> 3) Thread[id=797, name=TEST-TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh-seed#[22BFCB6CA5A80CA], state=WAITING, group=TGRP-TestSearcherManager] > [junit4] 2> 4) Thread[id=801, name=Thread-675, state=RUNNABLE, group=TGRP-TestSearcherManager] > [junit4] 2> NOTE: leaving temporary files on disk at: /var/lib/jenkins/jobs/Lucene-Solr-Nightly-6.x/workspace/lucene/build/core/test/J8/temp/lucene.search.TestSearcherManager_22BFCB6CA5A80CA-001 > [junit4] 2> Sep 10, 2016 8:38:23 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll > [junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated: > [junit4] 2> 1) Thread[id=800, name=Thread-674, state=RUNNABLE, group=TGRP-TestSearcherManager] > [junit4] 2> at java.lang.Throwable.fillInStackTrace(Native Method) > [junit4] 2> at java.lang.Throwable.fillInStackTrace(Throwable.java:783) > [junit4] 2> at java.lang.Throwable.(Throwable.java:265) > [junit4] 2> at java.lang.Exception.(Exception.java:66) > [junit4] 2> at java.lang.RuntimeException.(RuntimeException.java:62) > [junit4] 2> at java.lang.IllegalStateException.(IllegalStateException.java:55) > [junit4] 2> at org.apache.lucene.store.AlreadyClosedException.(AlreadyClosedException.java:26) > [junit4] 2> at org.apache.lucene.search.ReferenceManager.acquire(ReferenceManager.java:98) > [junit4] 2> at org.apache.lucene.search.TestSearcherManager$9.run(TestSearcherManager.java:588) > [junit4] 2> 2) Thread[id=802, name=Thread-676, state=RUNNABLE, group=TGRP-TestSearcherManager] > [junit4] 2> at java.lang.Thread.holdsLock(Native Method) > [junit4] 2> at org.apache.lucene.index.IndexWriter.holdsFullFlushLock(IndexWriter.java:3306) > [junit4] 2> at org.apache.lucene.index.DocumentsWriter.finishFullFlush(DocumentsWriter.java:676) > [junit4] 2> at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:468) > [junit4] 2> at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:103) > [junit4] 2> at org.apache.lucene.search.SearcherManager.(SearcherManager.java:108) > [junit4] 2> at org.apache.lucene.search.SearcherManager.(SearcherManager.java:76) > [junit4] 2> at org.apache.lucene.search.TestSearcherManager$11.run(TestSearcherManager.java:647) > [junit4] 2> 3) Thread[id=801, name=Thread-675, state=RUNNABLE, group=TGRP-TestSearcherManager] > [junit4] 2> at java.lang.Throwable.fillInStackTrace(Native Method) > [junit4] 2> at java.lang.Throwable.fillInStackTrace(Throwable.java:783) > [junit4] 2> at java.lang.Throwable.(Throwable.java:265) > [junit4] 2> at java.lang.Exception.(Exception.java:66) > [junit4] 2> at java.lang.RuntimeException.(RuntimeException.java:62) > [junit4] 2> at java.lang.IllegalStateException.(IllegalStateException.java:55) > [junit4] 2> at org.apache.lucene.store.AlreadyClosedException.(AlreadyClosedException.java:26) > [junit4] 2> at org.apache.lucene.search.ReferenceManager.ensureOpen(ReferenceManager.java:54) > [junit4] 2> at org.apache.lucene.search.ReferenceManager.maybeRefreshBlocking(ReferenceManager.java:248) > [junit4] 2> at org.apache.lucene.search.TestSearcherManager$10.run(TestSearcherManager.java:617) > [junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {date=BlockTreeOrds(blocksize=128), docid=PostingsFormat(name=Asserting), titleTokenized=PostingsFormat(name=LuceneFixedGap), body=BlockTreeOrds(blocksize=128), title=PostingsFormat(name=MockRandom)}, docValues:{docid_intDV=DocValuesFormat(name=Lucene54), titleDV=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=1354, maxMBSortInHeap=5.736770517965361, sim=RandomSimilarity(queryNorm=false,coord=yes): {titleTokenized=IB SPL-D3(800.0), body=ClassicSimilarity}, locale=hr, timezone=America/Port-au-Prince > [junit4] 2> NOTE: Linux 4.1.0-custom2-amd64 amd64/Oracle Corporation 1.8.0_77 (64-bit)/cpus=16,threads=4,free=246890576,total=341311488 > [junit4] 2> NOTE: All tests run in this JVM: [TestIndexWriterDelete, TestBooleanQuery, TestInPlaceMergeSorter, TestReaderWrapperDVTypeCheck, FuzzyTermOnShortTermsTest, TestParallelLeafReader, TestConjunctions, TestUTF32ToUTF8, TestPolygon2D, TestCharsRef, TestSimpleFSLockFactory, TestIndexWriterWithThreads, TestSpanOrQuery, TestShardSearching, TestEarlyTermination, TestTimeLimitingCollector, TestIndexWriterNRTIsCurrent, TestSetOnce, TestIndexWriterOnDiskFull, TestSegmentMerger, TestScorerPerf, TestIndexableField, TestSearcherManager] > [junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory. > [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestSearcherManager -Dtests.seed=22BFCB6CA5A80CA -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=hr -Dtests.timezone=America/Port-au-Prince -Dtests.asserts=true -Dtests.file.encoding=US-ASCII > [junit4] ERROR 0.00s J8 | TestSearcherManager (suite) <<< > [junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 1800000 msec). > [junit4] > at __randomizedtesting.SeedInfo.seed([22BFCB6CA5A80CA]:0)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=799, name=Thread-673, state=RUNNABLE, group=TGRP-TestSearcherManager] > [junit4] > Caused by: java.lang.IllegalArgumentException: Document contains at least one immense term in field="body" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped. Please correct the analyzer to not produce such terms. The prefix of the first immense term is: '[125, 125, 123, 123, 123, 123, 123, 115, 117, 98, 115, 116, 99, 124, 125, 125, 125, 123, 123, 123, 49, 125, 125, 125, 124, 123, 123, 123, 112, 49]...', original message: bytes can be at most 32766 in length; got 94384 > [junit4] > at __randomizedtesting.SeedInfo.seed([22BFCB6CA5A80CA]:0) > [junit4] > at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:772) > [junit4] > at org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:417) > [junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:373) > [junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:231) > [junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478) > [junit4] > at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1562) > [junit4] > at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1307) > [junit4] > at org.apache.lucene.search.TestSearcherManager$8.run(TestSearcherManager.java:557) > [junit4] > Suppressed: java.lang.IllegalStateException: close() called in wrong state: INCREMENT > [junit4] > at org.apache.lucene.analysis.MockTokenizer.fail(MockTokenizer.java:125) > [junit4] > at org.apache.lucene.analysis.MockTokenizer.close(MockTokenizer.java:292) > [junit4] > at org.apache.lucene.analysis.TokenFilter.close(TokenFilter.java:58) > [junit4] > at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:788) > [junit4] > ... 7 more > [junit4] > Caused by: org.apache.lucene.util.BytesRefHash$MaxBytesLengthExceededException: bytes can be at most 32766 in length; got 94384 > [junit4] > at org.apache.lucene.util.BytesRefHash.add(BytesRefHash.java:263) > [junit4] > at org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:149) > [junit4] > at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:762) > [junit4] > ... 7 more > [junit4] Completed [438/438 (1!)] on J8 in 1823.24s, 3 tests, 3 errors <<< FAILURES! > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org