lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael McCandless (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (LUCENE-7445) TestSearcherManager failure: Document contains at least one immense term in field="body"
Date Sun, 11 Sep 2016 17:26:21 GMT

     [ https://issues.apache.org/jira/browse/LUCENE-7445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Michael McCandless resolved LUCENE-7445.
----------------------------------------
       Resolution: Fixed
    Fix Version/s: 6.3
                   master (7.0)

OK this newish test case was failing to explicitly trim too-large terms.  I pushed a test
fix.

> TestSearcherManager failure: Document contains at least one immense term in field="body"
> ----------------------------------------------------------------------------------------
>
>                 Key: LUCENE-7445
>                 URL: https://issues.apache.org/jira/browse/LUCENE-7445
>             Project: Lucene - Core
>          Issue Type: Bug
>            Reporter: Steve Rowe
>             Fix For: master (7.0), 6.3
>
>
> My Jenkins found a reproducing branch_6x seed:
> {noformat}
>    [junit4] Suite: org.apache.lucene.search.TestSearcherManager
>    [junit4]   2> ruj 10, 2016 8:08:20 AM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler
uncaughtException
>    [junit4]   2> WARNING: Uncaught exception in thread: Thread[Thread-673,5,TGRP-TestSearcherManager]
>    [junit4]   2> java.lang.IllegalArgumentException: Document contains at least one
immense term in field="body" (whose UTF8 encoding is longer than the max length 32766), all
of which were skipped.  Please correct the analyzer to not produce such terms.  The prefix
of the first immense term is: '[125, 125, 123, 123, 123, 123, 123, 115, 117, 98, 115, 116,
99, 124, 125, 125, 125, 123, 123, 123, 49, 125, 125, 125, 124, 123, 123, 123, 112, 49]...',
original message: bytes can be at most 32766 in length; got 94384
>    [junit4]   2> 	at __randomizedtesting.SeedInfo.seed([22BFCB6CA5A80CA]:0)
>    [junit4]   2> 	at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:772)
>    [junit4]   2> 	at org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:417)
>    [junit4]   2> 	at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:373)
>    [junit4]   2> 	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:231)
>    [junit4]   2> 	at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
>    [junit4]   2> 	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1562)
>    [junit4]   2> 	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1307)
>    [junit4]   2> 	at org.apache.lucene.search.TestSearcherManager$8.run(TestSearcherManager.java:557)
>    [junit4]   2> 	Suppressed: java.lang.IllegalStateException: close() called in wrong
state: INCREMENT
>    [junit4]   2> 		at org.apache.lucene.analysis.MockTokenizer.fail(MockTokenizer.java:125)
>    [junit4]   2> 		at org.apache.lucene.analysis.MockTokenizer.close(MockTokenizer.java:292)
>    [junit4]   2> 		at org.apache.lucene.analysis.TokenFilter.close(TokenFilter.java:58)
>    [junit4]   2> 		at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:788)
>    [junit4]   2> 		... 7 more
>    [junit4]   2> Caused by: org.apache.lucene.util.BytesRefHash$MaxBytesLengthExceededException:
bytes can be at most 32766 in length; got 94384
>    [junit4]   2> 	at org.apache.lucene.util.BytesRefHash.add(BytesRefHash.java:263)
>    [junit4]   2> 	at org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:149)
>    [junit4]   2> 	at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:762)
>    [junit4]   2> 	... 7 more
>    [junit4]   2> 
>    [junit4]   2> ruj 10, 2016 8:38:00 AM com.carrotsearch.randomizedtesting.ThreadLeakControl$2
evaluate
>    [junit4]   2> WARNING: Suite execution timed out: org.apache.lucene.search.TestSearcherManager
>    [junit4]   2> ==== jstack at approximately timeout time ====
>    [junit4]   2> "Thread-676" ID=802 RUNNABLE
>    [junit4]   2> 	at java.lang.Thread.holdsLock(Native Method)
>    [junit4]   2> 	at org.apache.lucene.index.IndexFileDeleter.locked(IndexFileDeleter.java:117)
>    [junit4]   2> 	at org.apache.lucene.index.IndexFileDeleter.incRef(IndexFileDeleter.java:565)
>    [junit4]   2> 	at org.apache.lucene.index.IndexFileDeleter.incRef(IndexFileDeleter.java:553)
>    [junit4]   2> 	at org.apache.lucene.index.IndexWriter.incRefDeleter(IndexWriter.java:4963)
>    [junit4]   2> 	- locked org.apache.lucene.index.IndexWriter@7fc295c2
>    [junit4]   2> 	at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:117)
>    [junit4]   2> 	at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:460)
>    [junit4]   2> 	- locked org.apache.lucene.index.IndexWriter@7fc295c2
>    [junit4]   2> 	- locked java.lang.Object@c3599a3
>    [junit4]   2> 	at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:103)
>    [junit4]   2> 	at org.apache.lucene.search.SearcherManager.<init>(SearcherManager.java:108)
>    [junit4]   2> 	at org.apache.lucene.search.SearcherManager.<init>(SearcherManager.java:76)
>    [junit4]   2> 	at org.apache.lucene.search.TestSearcherManager$11.run(TestSearcherManager.java:647)
>    [junit4]   2> 
>    [junit4]   2> "Thread-675" ID=801 RUNNABLE
>    [junit4]   2> 	at java.lang.Throwable.fillInStackTrace(Native Method)
>    [junit4]   2> 	at java.lang.Throwable.fillInStackTrace(Throwable.java:783)
>    [junit4]   2> 	- locked org.apache.lucene.store.AlreadyClosedException@4e77cf8b
>    [junit4]   2> 	at java.lang.Throwable.<init>(Throwable.java:265)
>    [junit4]   2> 	at java.lang.Exception.<init>(Exception.java:66)
>    [junit4]   2> 	at java.lang.RuntimeException.<init>(RuntimeException.java:62)
>    [junit4]   2> 	at java.lang.IllegalStateException.<init>(IllegalStateException.java:55)
>    [junit4]   2> 	at org.apache.lucene.store.AlreadyClosedException.<init>(AlreadyClosedException.java:26)
>    [junit4]   2> 	at org.apache.lucene.search.ReferenceManager.ensureOpen(ReferenceManager.java:54)
>    [junit4]   2> 	at org.apache.lucene.search.ReferenceManager.maybeRefreshBlocking(ReferenceManager.java:248)
>    [junit4]   2> 	at org.apache.lucene.search.TestSearcherManager$10.run(TestSearcherManager.java:617)
>    [junit4]   2> 
>    [junit4]   2> "Thread-674" ID=800 RUNNABLE
>    [junit4]   2> 	at java.lang.Throwable.fillInStackTrace(Native Method)
>    [junit4]   2> 	at java.lang.Throwable.fillInStackTrace(Throwable.java:783)
>    [junit4]   2> 	- locked org.apache.lucene.store.AlreadyClosedException@746a9d47
>    [junit4]   2> 	at java.lang.Throwable.<init>(Throwable.java:265)
>    [junit4]   2> 	at java.lang.Exception.<init>(Exception.java:66)
>    [junit4]   2> 	at java.lang.RuntimeException.<init>(RuntimeException.java:62)
>    [junit4]   2> 	at java.lang.IllegalStateException.<init>(IllegalStateException.java:55)
>    [junit4]   2> 	at org.apache.lucene.store.AlreadyClosedException.<init>(AlreadyClosedException.java:26)
>    [junit4]   2> 	at org.apache.lucene.search.ReferenceManager.acquire(ReferenceManager.java:98)
>    [junit4]   2> 	at org.apache.lucene.search.TestSearcherManager$9.run(TestSearcherManager.java:588)
>    [junit4]   2> 
>    [junit4]   2> "TEST-TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh-seed#[22BFCB6CA5A80CA]"
ID=797 WAITING on org.apache.lucene.search.TestSearcherManager$9@1fed6a8d
>    [junit4]   2> 	at java.lang.Object.wait(Native Method)
>    [junit4]   2> 	- waiting on org.apache.lucene.search.TestSearcherManager$9@1fed6a8d
>    [junit4]   2> 	at java.lang.Thread.join(Thread.java:1245)
>    [junit4]   2> 	at java.lang.Thread.join(Thread.java:1319)
>    [junit4]   2> 	at org.apache.lucene.search.TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh(TestSearcherManager.java:670)
>    [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>    [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>    [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>    [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:498)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
>    [junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
>    [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>    [junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>    [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>    [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
>    [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>    [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>    [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
>    [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>    [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>    [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
>    [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
>    [junit4]   2> 
>    [junit4]   2> "SUITE-TestSearcherManager-seed#[22BFCB6CA5A80CA]" ID=796 RUNNABLE
>    [junit4]   2> 	at sun.management.ThreadImpl.dumpThreads0(Native Method)
>    [junit4]   2> 	at sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:454)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:673)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:64)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:414)
>    [junit4]   2> 	- locked java.lang.Object@3fb51052
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:681)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:140)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:591)
>    [junit4]   2> 
>    [junit4]   2> "JUnit4-serializer-daemon" ID=18 TIMED_WAITING
>    [junit4]   2> 	at java.lang.Thread.sleep(Native Method)
>    [junit4]   2> 	at com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:47)
>    [junit4]   2> 
>    [junit4]   2> "Signal Dispatcher" ID=4 RUNNABLE
>    [junit4]   2> 
>    [junit4]   2> "Finalizer" ID=3 WAITING on java.lang.ref.ReferenceQueue$Lock@4f4e9bb8
>    [junit4]   2> 	at java.lang.Object.wait(Native Method)
>    [junit4]   2> 	- waiting on java.lang.ref.ReferenceQueue$Lock@4f4e9bb8
>    [junit4]   2> 	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
>    [junit4]   2> 	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
>    [junit4]   2> 	at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
>    [junit4]   2> 
>    [junit4]   2> "Reference Handler" ID=2 WAITING on java.lang.ref.Reference$Lock@6f6eb7b3
>    [junit4]   2> 	at java.lang.Object.wait(Native Method)
>    [junit4]   2> 	- waiting on java.lang.ref.Reference$Lock@6f6eb7b3
>    [junit4]   2> 	at java.lang.Object.wait(Object.java:502)
>    [junit4]   2> 	at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
>    [junit4]   2> 	at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
>    [junit4]   2> 
>    [junit4]   2> "main" ID=1 WAITING on com.carrotsearch.randomizedtesting.RandomizedRunner$2@3eff9ff9
>    [junit4]   2> 	at java.lang.Object.wait(Native Method)
>    [junit4]   2> 	- waiting on com.carrotsearch.randomizedtesting.RandomizedRunner$2@3eff9ff9
>    [junit4]   2> 	at java.lang.Thread.join(Thread.java:1245)
>    [junit4]   2> 	at java.lang.Thread.join(Thread.java:1319)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:601)
>    [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:450)
>    [junit4]   2> 	at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:243)
>    [junit4]   2> 	at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:354)
>    [junit4]   2> 	at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:10)
>    [junit4]   2> 
>    [junit4]   2> ^^==============================================
>    [junit4]   2> 
>    [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs'
in the lucene directory.
>    [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSearcherManager -Dtests.method=testConcurrentIndexCloseSearchAndRefresh
-Dtests.seed=22BFCB6CA5A80CA -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt
-Dtests.locale=hr -Dtests.timezone=America/Port-au-Prince -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
>    [junit4] ERROR   1800s J8  | TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh
<<<
>    [junit4]    > Throwable #1: java.lang.Exception: Test abandoned because suite timeout
was reached.
>    [junit4]    > 	at __randomizedtesting.SeedInfo.seed([22BFCB6CA5A80CA]:0)
>    [junit4]   2> ruj 10, 2016 8:38:00 AM com.carrotsearch.randomizedtesting.ThreadLeakControl
checkThreadLeaks
>    [junit4]   2> WARNING: Will linger awaiting termination of 4 leaked thread(s).
>    [junit4]   2> ruj 10, 2016 8:38:20 AM com.carrotsearch.randomizedtesting.ThreadLeakControl
checkThreadLeaks
>    [junit4]   2> SEVERE: 4 threads leaked from SUITE scope at org.apache.lucene.search.TestSearcherManager:

>    [junit4]   2>    1) Thread[id=800, name=Thread-674, state=RUNNABLE, group=TGRP-TestSearcherManager]
>    [junit4]   2>         at java.lang.Throwable.fillInStackTrace(Native Method)
>    [junit4]   2>         at java.lang.Throwable.fillInStackTrace(Throwable.java:783)
>    [junit4]   2>         at java.lang.Throwable.<init>(Throwable.java:265)
>    [junit4]   2>         at java.lang.Exception.<init>(Exception.java:66)
>    [junit4]   2>         at java.lang.RuntimeException.<init>(RuntimeException.java:62)
>    [junit4]   2>         at java.lang.IllegalStateException.<init>(IllegalStateException.java:55)
>    [junit4]   2>         at org.apache.lucene.store.AlreadyClosedException.<init>(AlreadyClosedException.java:26)
>    [junit4]   2>         at org.apache.lucene.search.ReferenceManager.acquire(ReferenceManager.java:98)
>    [junit4]   2>         at org.apache.lucene.search.TestSearcherManager$9.run(TestSearcherManager.java:588)
>    [junit4]   2>    2) Thread[id=802, name=Thread-676, state=RUNNABLE, group=TGRP-TestSearcherManager]
>    [junit4]   2>         at java.lang.Thread.holdsLock(Native Method)
>    [junit4]   2>         at org.apache.lucene.index.IndexFileDeleter.locked(IndexFileDeleter.java:117)
>    [junit4]   2>         at org.apache.lucene.index.IndexFileDeleter.decRef(IndexFileDeleter.java:577)
>    [junit4]   2>         at org.apache.lucene.index.IndexFileDeleter.decRef(IndexFileDeleter.java:647)
>    [junit4]   2>         at org.apache.lucene.index.IndexWriter.decRefDeleter(IndexWriter.java:4975)
>    [junit4]   2>         at org.apache.lucene.index.StandardDirectoryReader.doClose(StandardDirectoryReader.java:381)
>    [junit4]   2>         at org.apache.lucene.index.IndexReader.decRef(IndexReader.java:251)
>    [junit4]   2>         at org.apache.lucene.search.SearcherManager.decRef(SearcherManager.java:149)
>    [junit4]   2>         at org.apache.lucene.search.SearcherManager.decRef(SearcherManager.java:58)
>    [junit4]   2>         at org.apache.lucene.search.ReferenceManager.release(ReferenceManager.java:274)
>    [junit4]   2>         at org.apache.lucene.search.ReferenceManager.swapReference(ReferenceManager.java:62)
>    [junit4]   2>         at org.apache.lucene.search.ReferenceManager.close(ReferenceManager.java:146)
>    [junit4]   2>         at org.apache.lucene.search.TestSearcherManager$11.run(TestSearcherManager.java:643)
>    [junit4]   2>    3) Thread[id=797, name=TEST-TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh-seed#[22BFCB6CA5A80CA],
state=WAITING, group=TGRP-TestSearcherManager]
>    [junit4]   2>         at java.lang.Object.wait(Native Method)
>    [junit4]   2>         at java.lang.Thread.join(Thread.java:1245)
>    [junit4]   2>         at java.lang.Thread.join(Thread.java:1319)
>    [junit4]   2>         at org.apache.lucene.search.TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh(TestSearcherManager.java:670)
>    [junit4]   2>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>    [junit4]   2>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>    [junit4]   2>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>    [junit4]   2>         at java.lang.reflect.Method.invoke(Method.java:498)
>    [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
>    [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
>    [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
>    [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
>    [junit4]   2>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
>    [junit4]   2>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>    [junit4]   2>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>    [junit4]   2>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>    [junit4]   2>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>    [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>    [junit4]   2>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
>    [junit4]   2>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
>    [junit4]   2>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
>    [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
>    [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
>    [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
>    [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
>    [junit4]   2>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>    [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>    [junit4]   2>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
>    [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>    [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>    [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>    [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>    [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>    [junit4]   2>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
>    [junit4]   2>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>    [junit4]   2>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>    [junit4]   2>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
>    [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>    [junit4]   2>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
>    [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
>    [junit4]   2>    4) Thread[id=801, name=Thread-675, state=RUNNABLE, group=TGRP-TestSearcherManager]
>    [junit4]   2>         at java.lang.Throwable.fillInStackTrace(Native Method)
>    [junit4]   2>         at java.lang.Throwable.fillInStackTrace(Throwable.java:783)
>    [junit4]   2>         at java.lang.Throwable.<init>(Throwable.java:265)
>    [junit4]   2>         at java.lang.Exception.<init>(Exception.java:66)
>    [junit4]   2>         at java.lang.RuntimeException.<init>(RuntimeException.java:62)
>    [junit4]   2>         at java.lang.IllegalStateException.<init>(IllegalStateException.java:55)
>    [junit4]   2>         at org.apache.lucene.store.AlreadyClosedException.<init>(AlreadyClosedException.java:26)
>    [junit4]   2>         at org.apache.lucene.search.ReferenceManager.ensureOpen(ReferenceManager.java:54)
>    [junit4]   2>         at org.apache.lucene.search.ReferenceManager.maybeRefreshBlocking(ReferenceManager.java:248)
>    [junit4]   2>         at org.apache.lucene.search.TestSearcherManager$10.run(TestSearcherManager.java:617)
>    [junit4]   2> ruj 10, 2016 8:38:20 AM com.carrotsearch.randomizedtesting.ThreadLeakControl
tryToInterruptAll
>    [junit4]   2> INFO: Starting to interrupt leaked threads:
>    [junit4]   2>    1) Thread[id=800, name=Thread-674, state=RUNNABLE, group=TGRP-TestSearcherManager]
>    [junit4]   2>    2) Thread[id=802, name=Thread-676, state=BLOCKED, group=TGRP-TestSearcherManager]
>    [junit4]   2>    3) Thread[id=797, name=TEST-TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh-seed#[22BFCB6CA5A80CA],
state=WAITING, group=TGRP-TestSearcherManager]
>    [junit4]   2>    4) Thread[id=801, name=Thread-675, state=RUNNABLE, group=TGRP-TestSearcherManager]
>    [junit4]   2> NOTE: leaving temporary files on disk at: /var/lib/jenkins/jobs/Lucene-Solr-Nightly-6.x/workspace/lucene/build/core/test/J8/temp/lucene.search.TestSearcherManager_22BFCB6CA5A80CA-001
>    [junit4]   2> Sep 10, 2016 8:38:23 AM com.carrotsearch.randomizedtesting.ThreadLeakControl
tryToInterruptAll
>    [junit4]   2> SEVERE: There are still zombie threads that couldn't be terminated:
>    [junit4]   2>    1) Thread[id=800, name=Thread-674, state=RUNNABLE, group=TGRP-TestSearcherManager]
>    [junit4]   2>         at java.lang.Throwable.fillInStackTrace(Native Method)
>    [junit4]   2>         at java.lang.Throwable.fillInStackTrace(Throwable.java:783)
>    [junit4]   2>         at java.lang.Throwable.<init>(Throwable.java:265)
>    [junit4]   2>         at java.lang.Exception.<init>(Exception.java:66)
>    [junit4]   2>         at java.lang.RuntimeException.<init>(RuntimeException.java:62)
>    [junit4]   2>         at java.lang.IllegalStateException.<init>(IllegalStateException.java:55)
>    [junit4]   2>         at org.apache.lucene.store.AlreadyClosedException.<init>(AlreadyClosedException.java:26)
>    [junit4]   2>         at org.apache.lucene.search.ReferenceManager.acquire(ReferenceManager.java:98)
>    [junit4]   2>         at org.apache.lucene.search.TestSearcherManager$9.run(TestSearcherManager.java:588)
>    [junit4]   2>    2) Thread[id=802, name=Thread-676, state=RUNNABLE, group=TGRP-TestSearcherManager]
>    [junit4]   2>         at java.lang.Thread.holdsLock(Native Method)
>    [junit4]   2>         at org.apache.lucene.index.IndexWriter.holdsFullFlushLock(IndexWriter.java:3306)
>    [junit4]   2>         at org.apache.lucene.index.DocumentsWriter.finishFullFlush(DocumentsWriter.java:676)
>    [junit4]   2>         at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:468)
>    [junit4]   2>         at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:103)
>    [junit4]   2>         at org.apache.lucene.search.SearcherManager.<init>(SearcherManager.java:108)
>    [junit4]   2>         at org.apache.lucene.search.SearcherManager.<init>(SearcherManager.java:76)
>    [junit4]   2>         at org.apache.lucene.search.TestSearcherManager$11.run(TestSearcherManager.java:647)
>    [junit4]   2>    3) Thread[id=801, name=Thread-675, state=RUNNABLE, group=TGRP-TestSearcherManager]
>    [junit4]   2>         at java.lang.Throwable.fillInStackTrace(Native Method)
>    [junit4]   2>         at java.lang.Throwable.fillInStackTrace(Throwable.java:783)
>    [junit4]   2>         at java.lang.Throwable.<init>(Throwable.java:265)
>    [junit4]   2>         at java.lang.Exception.<init>(Exception.java:66)
>    [junit4]   2>         at java.lang.RuntimeException.<init>(RuntimeException.java:62)
>    [junit4]   2>         at java.lang.IllegalStateException.<init>(IllegalStateException.java:55)
>    [junit4]   2>         at org.apache.lucene.store.AlreadyClosedException.<init>(AlreadyClosedException.java:26)
>    [junit4]   2>         at org.apache.lucene.search.ReferenceManager.ensureOpen(ReferenceManager.java:54)
>    [junit4]   2>         at org.apache.lucene.search.ReferenceManager.maybeRefreshBlocking(ReferenceManager.java:248)
>    [junit4]   2>         at org.apache.lucene.search.TestSearcherManager$10.run(TestSearcherManager.java:617)
>    [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): {date=BlockTreeOrds(blocksize=128),
docid=PostingsFormat(name=Asserting), titleTokenized=PostingsFormat(name=LuceneFixedGap),
body=BlockTreeOrds(blocksize=128), title=PostingsFormat(name=MockRandom)}, docValues:{docid_intDV=DocValuesFormat(name=Lucene54),
titleDV=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=1354, maxMBSortInHeap=5.736770517965361,
sim=RandomSimilarity(queryNorm=false,coord=yes): {titleTokenized=IB SPL-D3(800.0), body=ClassicSimilarity},
locale=hr, timezone=America/Port-au-Prince
>    [junit4]   2> NOTE: Linux 4.1.0-custom2-amd64 amd64/Oracle Corporation 1.8.0_77
(64-bit)/cpus=16,threads=4,free=246890576,total=341311488
>    [junit4]   2> NOTE: All tests run in this JVM: [TestIndexWriterDelete, TestBooleanQuery,
TestInPlaceMergeSorter, TestReaderWrapperDVTypeCheck, FuzzyTermOnShortTermsTest, TestParallelLeafReader,
TestConjunctions, TestUTF32ToUTF8, TestPolygon2D, TestCharsRef, TestSimpleFSLockFactory, TestIndexWriterWithThreads,
TestSpanOrQuery, TestShardSearching, TestEarlyTermination, TestTimeLimitingCollector, TestIndexWriterNRTIsCurrent,
TestSetOnce, TestIndexWriterOnDiskFull, TestSegmentMerger, TestScorerPerf, TestIndexableField,
TestSearcherManager]
>    [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs'
in the lucene directory.
>    [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSearcherManager -Dtests.seed=22BFCB6CA5A80CA
-Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt
-Dtests.locale=hr -Dtests.timezone=America/Port-au-Prince -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
>    [junit4] ERROR   0.00s J8  | TestSearcherManager (suite) <<<
>    [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>=
1800000 msec).
>    [junit4]    > 	at __randomizedtesting.SeedInfo.seed([22BFCB6CA5A80CA]:0)Throwable
#2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception
in thread: Thread[id=799, name=Thread-673, state=RUNNABLE, group=TGRP-TestSearcherManager]
>    [junit4]    > Caused by: java.lang.IllegalArgumentException: Document contains
at least one immense term in field="body" (whose UTF8 encoding is longer than the max length
32766), all of which were skipped.  Please correct the analyzer to not produce such terms.
 The prefix of the first immense term is: '[125, 125, 123, 123, 123, 123, 123, 115, 117, 98,
115, 116, 99, 124, 125, 125, 125, 123, 123, 123, 49, 125, 125, 125, 124, 123, 123, 123, 112,
49]...', original message: bytes can be at most 32766 in length; got 94384
>    [junit4]    > 	at __randomizedtesting.SeedInfo.seed([22BFCB6CA5A80CA]:0)
>    [junit4]    > 	at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:772)
>    [junit4]    > 	at org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:417)
>    [junit4]    > 	at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:373)
>    [junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:231)
>    [junit4]    > 	at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
>    [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1562)
>    [junit4]    > 	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1307)
>    [junit4]    > 	at org.apache.lucene.search.TestSearcherManager$8.run(TestSearcherManager.java:557)
>    [junit4]    > 	Suppressed: java.lang.IllegalStateException: close() called in wrong
state: INCREMENT
>    [junit4]    > 		at org.apache.lucene.analysis.MockTokenizer.fail(MockTokenizer.java:125)
>    [junit4]    > 		at org.apache.lucene.analysis.MockTokenizer.close(MockTokenizer.java:292)
>    [junit4]    > 		at org.apache.lucene.analysis.TokenFilter.close(TokenFilter.java:58)
>    [junit4]    > 		at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:788)
>    [junit4]    > 		... 7 more
>    [junit4]    > Caused by: org.apache.lucene.util.BytesRefHash$MaxBytesLengthExceededException:
bytes can be at most 32766 in length; got 94384
>    [junit4]    > 	at org.apache.lucene.util.BytesRefHash.add(BytesRefHash.java:263)
>    [junit4]    > 	at org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:149)
>    [junit4]    > 	at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:762)
>    [junit4]    > 	... 7 more
>    [junit4] Completed [438/438 (1!)] on J8 in 1823.24s, 3 tests, 3 errors <<<
FAILURES!
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message