lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Muir (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (LUCENE-3027) TestOmitTf.testMixedMerge random seed failure
Date Thu, 14 Apr 2011 08:24:05 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-3027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019726#comment-13019726
] 

Robert Muir commented on LUCENE-3027:
-------------------------------------

Thanks for reporting this, I can reproduce on windows also, looks serious.

Might be triggered by the fact we recently started randomizing skipinterval?

Note, the test will NOT fail if you try the "repro" line!!!
You have to do 'ant test -Dtests.seed=-6595054217575280191:5576532348905930588'

I don't know if this causes a timing issue or what, but it works for me too:

{noformat}
    [junit] Testsuite: org.apache.lucene.index.TestOmitTf
    [junit] Testcase: testMixedMerge(org.apache.lucene.index.TestOmitTf):       Caused an
ERROR
    [junit] CheckIndex failed
    [junit] java.lang.RuntimeException: CheckIndex failed
    [junit]     at org.apache.lucene.util._TestUtil.checkIndex(_TestUtil.java:152)
    [junit]     at org.apache.lucene.util._TestUtil.checkIndex(_TestUtil.java:138)
    [junit]     at org.apache.lucene.index.TestOmitTf.testMixedMerge(TestOmitTf.java:155)
    [junit]     at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1232)
    [junit]     at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1160)
    [junit]
    [junit]
    [junit] Tests run: 5, Failures: 0, Errors: 1, Time elapsed: 0.284 sec
    [junit]
    [junit] ------------- Standard Output ---------------
    [junit] CheckIndex failed
    [junit] Segments file=segments_1 numSegments=1 version=FORMAT_4_0 [Lucene 4.0]
    [junit]   1 of 1: name=_12 docCount=60
    [junit]     codec=SegmentCodecs [codecs=[MockRandom, MockVariableIntBlock(baseBlockSize=112)],
provider=RandomCodecProvider: {f1=MockRandom, f2=MockVariable
IntBlock(baseBlockSize=112)}]
    [junit]     compound=false
    [junit]     hasProx=false
    [junit]     numFiles=16
    [junit]     size (MB)=0,01
    [junit]     diagnostics = {optimize=true, mergeFactor=2, os.version=6.0, os=Windows Vista,
lucene.version=4.0-SNAPSHOT, source=merge, os.arch=x86, java.vers
ion=1.6.0_23, java.vendor=Sun Microsystems Inc.}
    [junit]     no deletions
    [junit]     test: open reader.........OK
    [junit]     test: fields..............OK [2 fields]
    [junit]     test: field norms.........OK [2 fields]
    [junit]     test: terms, freq, prox...ERROR: java.io.IOException: Read past EOF
    [junit] java.io.IOException: Read past EOF
    [junit]     at org.apache.lucene.store.RAMInputStream.switchCurrentBuffer(RAMInputStream.java:90)
    [junit]     at org.apache.lucene.store.RAMInputStream.readByte(RAMInputStream.java:63)
    [junit]     at org.apache.lucene.store.MockIndexInputWrapper.readByte(MockIndexInputWrapper.java:105)
    [junit]     at org.apache.lucene.store.DataInput.readVInt(DataInput.java:94)
    [junit]     at org.apache.lucene.index.codecs.sep.SepSkipListReader.readSkipData(SepSkipListReader.java:188)
    [junit]     at org.apache.lucene.index.codecs.MultiLevelSkipListReader.loadNextSkip(MultiLevelSkipListReader.java:142)
    [junit]     at org.apache.lucene.index.codecs.MultiLevelSkipListReader.skipTo(MultiLevelSkipListReader.java:112)
    [junit]     at org.apache.lucene.index.codecs.sep.SepPostingsReaderImpl$SepDocsEnum.advance(SepPostingsReaderImpl.java:454)
    [junit]     at org.apache.lucene.index.CheckIndex.testTermIndex(CheckIndex.java:782)
{noformat}

> TestOmitTf.testMixedMerge random seed failure
> ---------------------------------------------
>
>                 Key: LUCENE-3027
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3027
>             Project: Lucene - Java
>          Issue Type: Bug
>            Reporter: selckin
>         Attachments: output.txt
>
>
> Version: trunk r1091638
> ant test -Dtests.seed=-6595054217575280191:5576532348905930588
>     [junit] ------------- Standard Error -----------------
>     [junit] WARNING: test method: 'testDeMorgan' left thread running: Thread[NRT search
threads-1691-thread-2,5,main]
>     [junit] RESOURCE LEAK: test method: 'testDeMorgan' left 1 thread(s) running
>     [junit] NOTE: reproduce with: ant test -Dtestcase=TestBooleanQuery -Dtestmethod=testDeMorgan
-Dtests.seed=-6595054217575280191:5576532348905930588
>     [junit] ------------- ---------------- ---------------
>     [junit] Testsuite: org.apache.lucene.index.TestNorms
>     [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 5.064 sec
>     [junit] 
>     [junit] Testsuite: org.apache.lucene.index.TestOmitTf
>     [junit] Testcase: testMixedMerge(org.apache.lucene.index.TestOmitTf):	Caused an ERROR
>     [junit] CheckIndex failed
>     [junit] java.lang.RuntimeException: CheckIndex failed
>     [junit] 	at org.apache.lucene.util._TestUtil.checkIndex(_TestUtil.java:152)
>     [junit] 	at org.apache.lucene.util._TestUtil.checkIndex(_TestUtil.java:138)
>     [junit] 	at org.apache.lucene.index.TestOmitTf.testMixedMerge(TestOmitTf.java:155)
>     [junit] 	at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1232)
>     [junit] 	at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1160)
>     [junit] 
>     [junit] 
>     [junit] Tests run: 5, Failures: 0, Errors: 1, Time elapsed: 0.851 sec
>     [junit] 
>     [junit] ------------- Standard Output ---------------
>     [junit] CheckIndex failed
>     [junit] Segments file=segments_1 numSegments=1 version=FORMAT_4_0 [Lucene 4.0]
>     [junit]   1 of 1: name=_12 docCount=60
>     [junit]     codec=SegmentCodecs [codecs=[MockRandom, MockVariableIntBlock(baseBlockSize=112)],
provider=RandomCodecProvider: {f1=MockRandom, f2=MockVariableIntBlock(baseBlockSize=112)}]
>     [junit]     compound=false
>     [junit]     hasProx=false
>     [junit]     numFiles=16
>     [junit]     size (MB)=0,01
>     [junit]     diagnostics = {optimize=true, mergeFactor=2, os.version=2.6.37-gentoo,
os=Linux, lucene.version=4.0-SNAPSHOT, source=merge, os.arch=amd64, java.version=1.6.0_24,
java.vendor=Sun Microsystems Inc.}
>     [junit]     no deletions
>     [junit]     test: open reader.........OK
>     [junit]     test: fields..............OK [2 fields]
>     [junit]     test: field norms.........OK [2 fields]
>     [junit]     test: terms, freq, prox...ERROR: java.io.IOException: Read past EOF
>     [junit] java.io.IOException: Read past EOF
>     [junit] 	at org.apache.lucene.store.RAMInputStream.switchCurrentBuffer(RAMInputStream.java:90)
>     [junit] 	at org.apache.lucene.store.RAMInputStream.readByte(RAMInputStream.java:63)
>     [junit] 	at org.apache.lucene.store.MockIndexInputWrapper.readByte(MockIndexInputWrapper.java:105)
>     [junit] 	at org.apache.lucene.store.DataInput.readVInt(DataInput.java:94)
>     [junit] 	at org.apache.lucene.index.codecs.sep.SepSkipListReader.readSkipData(SepSkipListReader.java:188)
>     [junit] 	at org.apache.lucene.index.codecs.MultiLevelSkipListReader.loadNextSkip(MultiLevelSkipListReader.java:142)
>     [junit] 	at org.apache.lucene.index.codecs.MultiLevelSkipListReader.skipTo(MultiLevelSkipListReader.java:112)
>     [junit] 	at org.apache.lucene.index.codecs.sep.SepPostingsReaderImpl$SepDocsEnum.advance(SepPostingsReaderImpl.java:454)
>     [junit] 	at org.apache.lucene.index.CheckIndex.testTermIndex(CheckIndex.java:782)
>     [junit] 	at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:495)
>     [junit] 	at org.apache.lucene.util._TestUtil.checkIndex(_TestUtil.java:148)
>     [junit] 	at org.apache.lucene.util._TestUtil.checkIndex(_TestUtil.java:138)
>     [junit] 	at org.apache.lucene.index.TestOmitTf.testMixedMerge(TestOmitTf.java:155)
>     [junit] 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     [junit] 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     [junit] 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     [junit] 	at java.lang.reflect.Method.invoke(Method.java:597)
>     [junit] 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)
>     [junit] 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
>     [junit] 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41)
>     [junit] 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
>     [junit] 	at org.junit.rules.TestWatchman$1.evaluate(TestWatchman.java:48)
>     [junit] 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
>     [junit] 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:31)
>     [junit] 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:76)
>     [junit] 	at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1232)
>     [junit] 	at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1160)
>     [junit] 	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:193)
>     [junit] 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:52)
>     [junit] 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:191)
>     [junit] 	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:42)
>     [junit] 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:184)
>     [junit] 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
>     [junit] 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:31)
>     [junit] 	at org.junit.runners.ParentRunner.run(ParentRunner.java:236)
>     [junit] 	at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:39)
>     [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:422)
>     [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:931)
>     [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:758)
>     [junit]     test: stored fields.......OK [60 total field count; avg 1 fields per
doc]
>     [junit]     test: term vectors........OK [120 total vector count; avg 2 term/freq
vector fields per doc]
>     [junit] FAILED
>     [junit]     WARNING: fixIndex() would remove reference to this segment; full exception:
>     [junit] java.lang.RuntimeException: Term Index test failed
>     [junit] 	at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:508)
>     [junit] 	at org.apache.lucene.util._TestUtil.checkIndex(_TestUtil.java:148)
>     [junit] 	at org.apache.lucene.util._TestUtil.checkIndex(_TestUtil.java:138)
>     [junit] 	at org.apache.lucene.index.TestOmitTf.testMixedMerge(TestOmitTf.java:155)
>     [junit] 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     [junit] 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     [junit] 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     [junit] 	at java.lang.reflect.Method.invoke(Method.java:597)
>     [junit] 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)
>     [junit] 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
>     [junit] 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41)
>     [junit] 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
>     [junit] 	at org.junit.rules.TestWatchman$1.evaluate(TestWatchman.java:48)
>     [junit] 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
>     [junit] 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:31)
>     [junit] 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:76)
>     [junit] 	at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1232)
>     [junit] 	at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1160)
>     [junit] 	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:193)
>     [junit] 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:52)
>     [junit] 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:191)
>     [junit] 	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:42)
>     [junit] 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:184)
>     [junit] 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
>     [junit] 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:31)
>     [junit] 	at org.junit.runners.ParentRunner.run(ParentRunner.java:236)
>     [junit] 	at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:39)
>     [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:422)
>     [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:931)
>     [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:758)
>     [junit] 
>     [junit] WARNING: 1 broken segments (containing 60 documents) detected
>     [junit] 
>     [junit] ------------- ---------------- ---------------
>     [junit] ------------- Standard Error -----------------
>     [junit] NOTE: reproduce with: ant test -Dtestcase=TestOmitTf -Dtestmethod=testMixedMerge
-Dtests.seed=-6595054217575280191:5576532348905930588
>     [junit] NOTE: test params are: codec=RandomCodecProvider: {noTf=MockSep, tf=Standard,
f1=MockRandom, f2=MockVariableIntBlock(baseBlockSize=112)}, locale=cs_CZ, timezone=Chile/Continental
>     [junit] NOTE: all tests run in this JVM:
>     [junit] [TestAssertions, TestCachingTokenFilter, TestDocument, TestDirectoryReader,
TestFlex, TestIndexWriterConfig, TestIndexWriterMerging, TestIndexWriterOnJRECrash, TestMultiReader,
TestNewestSegment, TestNorms, TestOmitTf]
>     [junit] NOTE: Linux 2.6.37-gentoo amd64/Sun Microsystems Inc. 1.6.0_24 (64-bit)/cpus=8,threads=1,free=94021800,total=126484480
>     [junit] ------------- ---------------- ---------------

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message