lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Simon Willnauer <simon.willna...@googlemail.com>
Subject Re: regular but not individually reproducible failure: TestIndexWriterWithThreads.testRollbackAndCommitWithThreads
Date Fri, 29 Jun 2012 07:44:30 GMT
this seems like a windows / files issue. We can not obtain the write
lock quickly enough. Maybe we should do a retry loop in the test if we
are on windows?

simon

On Thu, Jun 28, 2012 at 6:25 PM, Steven A Rowe <sarowe@syr.edu> wrote:
> I see this roughly 50% of the time I run all Lucene core tests (Win7 64, Sun JDK 1.6.0_21
64-bit), but the seeds don't reproduce the error when it's run individually.
>
> The only unusual thing I'm doing on this machine is running some web crawls in a VirtualBox
Linux VM, hosted on and writing to a different physical drive than the one I ran Lucene tests
on.
>
> Here's the most recent failure:
>
> Suite: org.apache.lucene.index.TestIndexWriterWithThreads
> OK      0.04s J0 | TestIndexWriterWithThreads.testIOExceptionDuringAbortOnlyOnce
> OK      1.01s J0 | TestIndexWriterWithThreads.testOpenTwoIndexWritersOnDifferentThreads
> OK      0.97s J0 | TestIndexWriterWithThreads.testIOExceptionDuringAbortWithThreads
> ERROR   7.07s J0 | TestIndexWriterWithThreads.testRollbackAndCommitWithThreads
>   > Throwable #1: java.lang.AssertionError
>   >    at __randomizedtesting.SeedInfo.seed([299FEFE00B1E1931:5BC9FB3E94E8E02C]:0)
>   >    at org.junit.Assert.fail(Assert.java:92)
>   >    at org.junit.Assert.assertTrue(Assert.java:43)
>   >    at org.junit.Assert.assertTrue(Assert.java:54)
>   >    at org.apache.lucene.index.TestIndexWriterWithThreads.testRollbackAndCommitWithThreads(TestIndexWriterWithThreads.java:588)
>   >    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   >    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>   >    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>   >    at java.lang.reflect.Method.invoke(Method.java:597)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1969)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:814)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:875)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:889)
>   >    at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>   >    at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32)
>   >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>   >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>   >    at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
>   >    at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>   >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:821)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:669)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:695)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:734)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:745)
>   >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>   >    at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
>   >    at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
>   >    at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
>   >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>   >    at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
>   >    at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
>   >    at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
>   >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>   >    at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:56)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
>   > Throwable #2: java.lang.RuntimeException: Thread threw an uncaught exception,
thread: Thread[Thread-34,5,]
>   >    at com.carrotsearch.randomizedtesting.RunnerThreadGroup.processUncaught(RunnerThreadGroup.java:96)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:857)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:669)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:695)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:734)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:745)
>   >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>   >    at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
>   >    at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
>   >    at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
>   >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>   >    at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
>   >    at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
>   >    at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
>   >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>   >    at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:56)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
>   > Caused by: java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException:
this IndexWriter is closed
>   >    at __randomizedtesting.SeedInfo.seed([299FEFE00B1E1931]:0)
>   >    at org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:576)
>   > Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is
closed
>   >    at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:551)
>   >    at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:556)
>   >    at org.apache.lucene.index.IndexWriter.rollback(IndexWriter.java:1773)
>   >    at org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:532)
>   > Throwable #3: java.lang.RuntimeException: Thread threw an uncaught exception,
thread: Thread[Thread-35,5,]
>   >    at com.carrotsearch.randomizedtesting.RunnerThreadGroup.processUncaught(RunnerThreadGroup.java:96)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:857)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:669)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:695)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:734)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:745)
>   >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>   >    at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
>   >    at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
>   >    at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
>   >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>   >    at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
>   >    at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
>   >    at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
>   >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>   >    at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:56)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
>   > Caused by: java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException:
this IndexWriter is closed
>   >    at __randomizedtesting.SeedInfo.seed([299FEFE00B1E1931]:0)
>   >    at org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:576)
>   > Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is
closed
>   >    at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:551)
>   >    at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:556)
>   >    at org.apache.lucene.index.IndexWriter.rollback(IndexWriter.java:1773)
>   >    at org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:532)
>   > Throwable #4: java.lang.RuntimeException: Thread threw an uncaught exception,
thread: Thread[Thread-36,5,]
>   >    at com.carrotsearch.randomizedtesting.RunnerThreadGroup.processUncaught(RunnerThreadGroup.java:96)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:857)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:669)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:695)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:734)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:745)
>   >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>   >    at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
>   >    at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
>   >    at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
>   >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>   >    at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
>   >    at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
>   >    at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
>   >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>   >    at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:56)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
>   >    at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
>   > Caused by: java.lang.RuntimeException: org.apache.lucene.store.LockObtainFailedException:
Lock obtain timed out: org.apache.lucene.store.MockLockFactoryWrapper$MockLock@32846ede
>   >    at __randomizedtesting.SeedInfo.seed([299FEFE00B1E1931]:0)
>   >    at org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:576)
>   > Caused by: org.apache.lucene.store.LockObtainFailedException: Lock obtain timed
out: org.apache.lucene.store.MockLockFactoryWrapper$MockLock@32846ede
>   >    at org.apache.lucene.store.Lock.obtain(Lock.java:84)
>   >    at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:595)
>   >    at org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:536)
>   >
>  2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs'
in the lucene directory.
>  2> NOTE: reproduce with: ant test  -Dtestcase=TestIndexWriterWithThreads -Dtests.method=testRollbackAndCommitWithThreads
-Dtests.seed=299FEFE00B1E1931 -Dtests.linedocsfile=e:/Lucene_data/enwiki.random.lines.txt
-Dtests.locale=en_IN -Dtests.timezone=PST8PDT -Dargs="-Dfile.encoding=UTF-8"
>  2>
> OK      1.05s J0 | TestIndexWriterWithThreads.testCloseWithThreads
> OK      0.57s J0 | TestIndexWriterWithThreads.testIOExceptionDuringWriteSegmentWithThreads
> OK      0.74s J0 | TestIndexWriterWithThreads.testIOExceptionDuringAbortWithThreadsOnlyOnce
> OK      0.60s J0 | TestIndexWriterWithThreads.testIOExceptionDuringWriteSegmentWithThreadsOnlyOnce
> OK      0.38s J0 | TestIndexWriterWithThreads.testImmediateDiskFullWithThreads
> OK      0.05s J0 | TestIndexWriterWithThreads.testIOExceptionDuringWriteSegment
> OK      0.04s J0 | TestIndexWriterWithThreads.testIOExceptionDuringWriteSegmentOnlyOnce
> OK      0.02s J0 | TestIndexWriterWithThreads.testIOExceptionDuringAbort
>   > (@AfterClass output)
>  2> NOTE: test params are: codec=Lucene40: {field=Pulsing40(freqCutoff=16 minBlockSize=12
maxBlockSize=100), docid=Lucene40(minBlockSize=12 maxBlockSize=100), body=Pulsing40(freqCutoff=16
minBlockSize=12 maxBlockSize=100), title=PostingsFormat(name=MockRandom), titleTokenized=PostingsFormat(name=Memory
doPackFST= true), date=Pulsing40(freqCutoff=16 minBlockSize=12 maxBlockSize=100)}, sim=DefaultSimilarity,
locale=en_IN, timezone=PST8PDT
>  2> NOTE: Windows 7 6.1 amd64/Sun Microsystems Inc. 1.6.0_21 (64-bit)/cpus=8,threads=1,free=223919176,total=261357568
>  2> NOTE: All tests run in this JVM: [TestCharTermAttributeImpl, TestSearchForDuplicates,
TestPositionIncrement, TestNRTThreads, TestDeletionPolicy, TestWeakIdentityMap, TestAutomatonQueryUnicode,
TestOmitTf, TestBytesRefHash, NestedSetupChain, NestedTeardownChain, TestIndexWriterWithThreads]
>  2>
>
> Completed on J0 in 12.73s, 12 tests, 1 error <<< FAILURES!
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message