lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael McCandless (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (LUCENE-3027) TestOmitTf.testMixedMerge random seed failure
Date Thu, 14 Apr 2011 09:28:05 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-3027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019748#comment-13019748
] 

Michael McCandless commented on LUCENE-3027:
--------------------------------------------

I found the issue: it's because a FieldInfo got into a bad state where omitTF was true but
storesPayloads was also true.  Plus, that the sep codec's skip data reader was "tricked" by
this bad state.

StandardCodec is not affected, and 3.x is not affected.  Still, for 3.x I'll backport making
sure FieldInfo always clears storesPayloads if omitTF is true.

> TestOmitTf.testMixedMerge random seed failure
> ---------------------------------------------
>
>                 Key: LUCENE-3027
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3027
>             Project: Lucene - Java
>          Issue Type: Bug
>            Reporter: selckin
>         Attachments: output.txt
>
>
> Version: trunk r1091638
> ant test -Dtests.seed=-6595054217575280191:5576532348905930588
>     [junit] ------------- Standard Error -----------------
>     [junit] WARNING: test method: 'testDeMorgan' left thread running: Thread[NRT search
threads-1691-thread-2,5,main]
>     [junit] RESOURCE LEAK: test method: 'testDeMorgan' left 1 thread(s) running
>     [junit] NOTE: reproduce with: ant test -Dtestcase=TestBooleanQuery -Dtestmethod=testDeMorgan
-Dtests.seed=-6595054217575280191:5576532348905930588
>     [junit] ------------- ---------------- ---------------
>     [junit] Testsuite: org.apache.lucene.index.TestNorms
>     [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 5.064 sec
>     [junit] 
>     [junit] Testsuite: org.apache.lucene.index.TestOmitTf
>     [junit] Testcase: testMixedMerge(org.apache.lucene.index.TestOmitTf):	Caused an ERROR
>     [junit] CheckIndex failed
>     [junit] java.lang.RuntimeException: CheckIndex failed
>     [junit] 	at org.apache.lucene.util._TestUtil.checkIndex(_TestUtil.java:152)
>     [junit] 	at org.apache.lucene.util._TestUtil.checkIndex(_TestUtil.java:138)
>     [junit] 	at org.apache.lucene.index.TestOmitTf.testMixedMerge(TestOmitTf.java:155)
>     [junit] 	at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1232)
>     [junit] 	at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1160)
>     [junit] 
>     [junit] 
>     [junit] Tests run: 5, Failures: 0, Errors: 1, Time elapsed: 0.851 sec
>     [junit] 
>     [junit] ------------- Standard Output ---------------
>     [junit] CheckIndex failed
>     [junit] Segments file=segments_1 numSegments=1 version=FORMAT_4_0 [Lucene 4.0]
>     [junit]   1 of 1: name=_12 docCount=60
>     [junit]     codec=SegmentCodecs [codecs=[MockRandom, MockVariableIntBlock(baseBlockSize=112)],
provider=RandomCodecProvider: {f1=MockRandom, f2=MockVariableIntBlock(baseBlockSize=112)}]
>     [junit]     compound=false
>     [junit]     hasProx=false
>     [junit]     numFiles=16
>     [junit]     size (MB)=0,01
>     [junit]     diagnostics = {optimize=true, mergeFactor=2, os.version=2.6.37-gentoo,
os=Linux, lucene.version=4.0-SNAPSHOT, source=merge, os.arch=amd64, java.version=1.6.0_24,
java.vendor=Sun Microsystems Inc.}
>     [junit]     no deletions
>     [junit]     test: open reader.........OK
>     [junit]     test: fields..............OK [2 fields]
>     [junit]     test: field norms.........OK [2 fields]
>     [junit]     test: terms, freq, prox...ERROR: java.io.IOException: Read past EOF
>     [junit] java.io.IOException: Read past EOF
>     [junit] 	at org.apache.lucene.store.RAMInputStream.switchCurrentBuffer(RAMInputStream.java:90)
>     [junit] 	at org.apache.lucene.store.RAMInputStream.readByte(RAMInputStream.java:63)
>     [junit] 	at org.apache.lucene.store.MockIndexInputWrapper.readByte(MockIndexInputWrapper.java:105)
>     [junit] 	at org.apache.lucene.store.DataInput.readVInt(DataInput.java:94)
>     [junit] 	at org.apache.lucene.index.codecs.sep.SepSkipListReader.readSkipData(SepSkipListReader.java:188)
>     [junit] 	at org.apache.lucene.index.codecs.MultiLevelSkipListReader.loadNextSkip(MultiLevelSkipListReader.java:142)
>     [junit] 	at org.apache.lucene.index.codecs.MultiLevelSkipListReader.skipTo(MultiLevelSkipListReader.java:112)
>     [junit] 	at org.apache.lucene.index.codecs.sep.SepPostingsReaderImpl$SepDocsEnum.advance(SepPostingsReaderImpl.java:454)
>     [junit] 	at org.apache.lucene.index.CheckIndex.testTermIndex(CheckIndex.java:782)
>     [junit] 	at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:495)
>     [junit] 	at org.apache.lucene.util._TestUtil.checkIndex(_TestUtil.java:148)
>     [junit] 	at org.apache.lucene.util._TestUtil.checkIndex(_TestUtil.java:138)
>     [junit] 	at org.apache.lucene.index.TestOmitTf.testMixedMerge(TestOmitTf.java:155)
>     [junit] 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     [junit] 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     [junit] 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     [junit] 	at java.lang.reflect.Method.invoke(Method.java:597)
>     [junit] 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)
>     [junit] 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
>     [junit] 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41)
>     [junit] 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
>     [junit] 	at org.junit.rules.TestWatchman$1.evaluate(TestWatchman.java:48)
>     [junit] 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
>     [junit] 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:31)
>     [junit] 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:76)
>     [junit] 	at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1232)
>     [junit] 	at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1160)
>     [junit] 	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:193)
>     [junit] 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:52)
>     [junit] 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:191)
>     [junit] 	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:42)
>     [junit] 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:184)
>     [junit] 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
>     [junit] 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:31)
>     [junit] 	at org.junit.runners.ParentRunner.run(ParentRunner.java:236)
>     [junit] 	at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:39)
>     [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:422)
>     [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:931)
>     [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:758)
>     [junit]     test: stored fields.......OK [60 total field count; avg 1 fields per
doc]
>     [junit]     test: term vectors........OK [120 total vector count; avg 2 term/freq
vector fields per doc]
>     [junit] FAILED
>     [junit]     WARNING: fixIndex() would remove reference to this segment; full exception:
>     [junit] java.lang.RuntimeException: Term Index test failed
>     [junit] 	at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:508)
>     [junit] 	at org.apache.lucene.util._TestUtil.checkIndex(_TestUtil.java:148)
>     [junit] 	at org.apache.lucene.util._TestUtil.checkIndex(_TestUtil.java:138)
>     [junit] 	at org.apache.lucene.index.TestOmitTf.testMixedMerge(TestOmitTf.java:155)
>     [junit] 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     [junit] 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     [junit] 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     [junit] 	at java.lang.reflect.Method.invoke(Method.java:597)
>     [junit] 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)
>     [junit] 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
>     [junit] 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41)
>     [junit] 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
>     [junit] 	at org.junit.rules.TestWatchman$1.evaluate(TestWatchman.java:48)
>     [junit] 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
>     [junit] 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:31)
>     [junit] 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:76)
>     [junit] 	at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1232)
>     [junit] 	at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1160)
>     [junit] 	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:193)
>     [junit] 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:52)
>     [junit] 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:191)
>     [junit] 	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:42)
>     [junit] 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:184)
>     [junit] 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
>     [junit] 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:31)
>     [junit] 	at org.junit.runners.ParentRunner.run(ParentRunner.java:236)
>     [junit] 	at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:39)
>     [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:422)
>     [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:931)
>     [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:758)
>     [junit] 
>     [junit] WARNING: 1 broken segments (containing 60 documents) detected
>     [junit] 
>     [junit] ------------- ---------------- ---------------
>     [junit] ------------- Standard Error -----------------
>     [junit] NOTE: reproduce with: ant test -Dtestcase=TestOmitTf -Dtestmethod=testMixedMerge
-Dtests.seed=-6595054217575280191:5576532348905930588
>     [junit] NOTE: test params are: codec=RandomCodecProvider: {noTf=MockSep, tf=Standard,
f1=MockRandom, f2=MockVariableIntBlock(baseBlockSize=112)}, locale=cs_CZ, timezone=Chile/Continental
>     [junit] NOTE: all tests run in this JVM:
>     [junit] [TestAssertions, TestCachingTokenFilter, TestDocument, TestDirectoryReader,
TestFlex, TestIndexWriterConfig, TestIndexWriterMerging, TestIndexWriterOnJRECrash, TestMultiReader,
TestNewestSegment, TestNorms, TestOmitTf]
>     [junit] NOTE: Linux 2.6.37-gentoo amd64/Sun Microsystems Inc. 1.6.0_24 (64-bit)/cpus=8,threads=1,free=94021800,total=126484480
>     [junit] ------------- ---------------- ---------------

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message