lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael McCandless <luc...@mikemccandless.com>
Subject Re: TestIndexWriterDelete fails with OOM
Date Thu, 02 Aug 2012 17:39:33 GMT
Thanks Robert.

Mike McCandless

http://blog.mikemccandless.com

On Thu, Aug 2, 2012 at 1:35 PM, Robert Muir <rcmuir@gmail.com> wrote:
> this test method uses only one field, but disables simpletext and
> memory already. i think directPF was just an omission. I'll add it
> too.
>
> On Thu, Aug 2, 2012 at 11:07 AM, Simon Willnauer
> <simon.willnauer@gmail.com> wrote:
>> I see this on http://85.25.120.39/job/Lucene-trunk-Linux-Java6-64/162/console
>> should we disable the mem intensive codecs for this test?
>>
>> [junit4:junit4] Suite: org.apache.lucene.index.TestIndexWriterDelete
>> [junit4:junit4] ERROR   35.5s J1 |
>> TestIndexWriterDelete.testIndexingThenDeleting
>> [junit4:junit4]    > Throwable #1: java.lang.OutOfMemoryError: Java heap space
>> [junit4:junit4]    >    at
>> __randomizedtesting.SeedInfo.seed([F645C683FAA013CE:8FD749EA602CCB95]:0)
>> [junit4:junit4]    >    at
>> org.apache.lucene.codecs.memory.DirectPostingsFormat$DirectField.<init>(DirectPostingsFormat.java:385)
>> [junit4:junit4]    >    at
>> org.apache.lucene.codecs.memory.DirectPostingsFormat$DirectFields.<init>(DirectPostingsFormat.java:130)
>> [junit4:junit4]    >    at
>> org.apache.lucene.codecs.memory.DirectPostingsFormat.fieldsProducer(DirectPostingsFormat.java:112)
>> [junit4:junit4]    >    at
>> org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader.<init>(PerFieldPostingsFormat.java:186)
>> [junit4:junit4]    >    at
>> org.apache.lucene.codecs.perfield.PerFieldPostingsFormat.fieldsProducer(PerFieldPostingsFormat.java:250)
>> [junit4:junit4]    >    at
>> org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:107)
>> [junit4:junit4]    >    at
>> org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:55)
>> [junit4:junit4]    >    at
>> org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:62)
>> [junit4:junit4]    >    at
>> org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:638)
>> [junit4:junit4]    >    at
>> org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:52)
>> [junit4:junit4]    >    at
>> org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:62)
>> [junit4:junit4]    >    at
>> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:583)
>> [junit4:junit4]    >    at
>> org.apache.lucene.index.TestIndexWriterDelete.testIndexingThenDeleting(TestIndexWriterDelete.java:935)
>> [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> [junit4:junit4]    >    at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:597)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:818)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:877)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:891)
>> [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>> [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32)
>> [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>> [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
>> [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>> [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>> [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:825)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
>> [junit4:junit4]    >
>> [junit4:junit4]   2> NOTE: download the large Jenkins line-docs file
>> by running 'ant get-jenkins-line-docs' in the lucene directory.
>> [junit4:junit4]   2> NOTE: reproduce with: ant test
>> -Dtestcase=TestIndexWriterDelete
>> -Dtests.method=testIndexingThenDeleting -Dtests.seed=F645C683FAA013CE
>> -Dtests.multiplier=3 -Dtests.nightly=true -Dtests.slow=true
>> -Dtests.linedocsfile=/var/lib/jenkins/lucene-data/enwiki.random.lines.txt
>> -Dtests.locale=vi -Dtests.timezone=America/St_Barthelemy
>> -Dtests.file.encoding=UTF-8
>> [junit4:junit4]   2>
>> [junit4:junit4]    > (@AfterClass output)
>> [junit4:junit4]   2> NOTE: test params are: codec=Lucene40:
>> {content=PostingsFormat(name=Asserting),
>> id=MockVariableIntBlock(baseBlockSize=5),
>> field=PostingsFormat(name=Direct), body=PostingsFormat(name=Direct),
>> contents=PostingsFormat(name=Memory doPackFST= false),
>> value=PostingsFormat(name=Asserting),
>> city=MockVariableIntBlock(baseBlockSize=5)},
>> sim=RandomSimilarityProvider(queryNorm=true,coord=false): {content=IB
>> LL-D3(800.0), field=DFR GL3(800.0), body=DFR I(F)B3(800.0),
>> contents=LM Jelinek-Mercer(0.700000), city=DFR I(n)2}, locale=vi,
>> timezone=America/St_Barthelemy
>> [junit4:junit4]   2> NOTE: Linux 3.2.0-26-generic amd64/Sun
>> Microsystems Inc. 1.6.0_33
>> (64-bit)/cpus=8,threads=1,free=493230400,total=536870912
>> [junit4:junit4]   2> NOTE: All tests run in this JVM:
>> [TestSameTokenSamePosition, TestRecyclingByteBlockAllocator,
>> TestLucene40PostingsReader, TestBooleanQueryVisitSubscorers,
>> TestMultiValuedNumericRangeQuery, TestForTooMuchCloning,
>> TestTypePromotion, TestNRTManager, TestNumericRangeQuery32,
>> TestIsCurrent, TestMockAnalyzer, TestAutomatonQuery,
>> TestMultiLevelSkipList, TestForceMergeForever, TestCrash,
>> TestIndexInput, TestSegmentTermEnum, TestUnicodeUtil,
>> TestAttributeSource, TestDirectoryReader, TestSimpleAttributeImpl,
>> TestDuelingCodecs, TestParallelAtomicReader, TestTransactions,
>> TestConsistentFieldNumbers, TestDocCount, TestQueryWrapperFilter,
>> TestStressIndexing, TestComplexExplanationsOfNonMatches, TestBasics,
>> TestBitUtil, TestCollectionUtil, TestPayloadExplanations,
>> TestTopDocsMerge, TestNewestSegment, TestDocument,
>> TestCachingWrapperFilter, TestMatchAllDocsQuery, TestNoMergePolicy,
>> TestToken, TestDocIdSet, TestBytesRefHash, TestVirtualMethod,
>> TestReuseDocsEnum, Nested, TestDocsAndPositions, TestLock,
>> TestMultiTermQueryRewrites, TestThreadedForceMerge,
>> TestNRTCachingDirectory, TestBinaryDocument, TestDirectory,
>> TestRamUsageEstimatorOnWildAnimals, TestIdentityHashSet,
>> TestSentinelIntSet, TestWildcard, TestIndexWriterConfig,
>> TestDocumentsWriterStallControl, TestParallelTermEnum,
>> TestAutomatonQueryUnicode, TestLookaheadTokenFilter,
>> TestTermVectorsWriter, TestRegexpRandom2,
>> TestSpanMultiTermQueryWrapper, TestTermsEnum, TestSimpleExplanations,
>> TestNRTReaderWithThreads, TestNumericRangeQuery64, TestSubScorerFreqs,
>> TestOmitPositions, TestNumericTokenStream, TestIndexWriterMergePolicy,
>> TestUniqueTermCount, TestPersistentSnapshotDeletionPolicy,
>> TestPostingsFormat, TestSimilarity, TestNorms, TestByteSlices,
>> TestAtomicUpdate, TestTimeLimitingCollector, TestNeverDelete,
>> TestFlushByRamOrCountsPolicy, TestSort, TestIndexWriterDelete]
>> [junit4:junit4]   2>
>> [junit4:junit4] Completed on J1 in 70.73s, 19 tests, 1 error <<< FAILURES!
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
>
>
>
> --
> lucidimagination.com
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message