lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uwe Schindler" <...@thetaphi.de>
Subject RE: [JENKINS] Lucene-Solr-tests-only-4.x-java7 - Build # 228 - Still Failing
Date Tue, 31 Jul 2012 11:20:18 GMT
> Mike: Because heap dumps were disabled 2 weeks ago on Jenkins. I cannot
> reenable them, as it fills my disk, because currently some Lucene/Solr
test (not
> sure which) *always* produces a heap dump. So it looks like some test it
> forcefully OOM (maybe for test reasons), although all tests fail.

Ahm, they pass, but still produce heap dump.

> I can try with JRockit JVM, it has an -XX option to crash and thread-dump
JVM
> on OOM.
> 
> -----
> Uwe Schindler
> H.-H.-Meier-Allee 63, D-28213 Bremen
> http://www.thetaphi.de
> eMail: uwe@thetaphi.de
> 
> 
> > -----Original Message-----
> > From: Michael McCandless [mailto:lucene@mikemccandless.com]
> > Sent: Tuesday, July 31, 2012 12:48 PM
> > To: dev@lucene.apache.org
> > Subject: Re: [JENKINS] Lucene-Solr-tests-only-4.x-java7 - Build # 228
> > - Still Failing
> >
> > Thanks Robert, I'll dig.
> >
> > Separately: how come we didn't get a heap dump from the failure...?
> >
> > Mike McCandless
> >
> > http://blog.mikemccandless.com
> >
> > On Mon, Jul 30, 2012 at 10:15 PM, Robert Muir <rcmuir@gmail.com> wrote:
> > > This seed OOMs here too.
> > >
> > > I added these prints:
> > >     System.out.println(RamUsageEstimator.sizeOf(fields));
> > >     System.out.println(RamUsageEstimator.sizeOf(fieldsLive));
> > >
> > > I see:
> > > [junit4:junit4]   1> 367701000
> > > [junit4:junit4]   1> 222881224
> > >
> > > (I am sure they are likely sharing some ram). But this is a massive
> > > amount of ram for this test.
> > >
> > > I will temporarily disable the multiplier, until the test can be
> > > made more ram efficient. it grows linearly with the multiplier, i
> > > think because of all the lists within lists within maps etc :)
> > >
> > > [junit4:junit4]   1> 136660616
> > > [junit4:junit4]   1> 89595032
> > >
> > >
> > > On Mon, Jul 30, 2012 at 8:30 PM, Apache Jenkins Server
> > > <jenkins@builds.apache.org> wrote:
> > >> Build:
> > >> https://builds.apache.org/job/Lucene-Solr-tests-only-4.x-java7/228/
> > >>
> > >> 1 tests failed.
> > >> REGRESSION:  org.apache.lucene.index.TestPostingsFormat.test
> > >>
> > >> Error Message:
> > >> Java heap space
> > >>
> > >> Stack Trace:
> > >> java.lang.OutOfMemoryError: Java heap space
> > >>         at
> >
> __randomizedtesting.SeedInfo.seed([E8AAFF6FA7F41694:60FEC0B509087B6C]:
> > 0)
> > >>         at org.apache.lucene.util.BytesRef.<init>(BytesRef.java:75)
> > >>         at
> > org.apache.lucene.util.fst.ByteSequenceOutputs.read(ByteSequenceOutput
> > s.jav
> > a:124)
> > >>         at
> > org.apache.lucene.util.fst.ByteSequenceOutputs.read(ByteSequenceOutput
> > s.jav
> > a:33)
> > >>         at
org.apache.lucene.util.fst.FST.readNextRealArc(FST.java:960)
> > >>         at
org.apache.lucene.util.fst.NodeHash.hash(NodeHash.java:106)
> > >>         at org.apache.lucene.util.fst.NodeHash.add(NodeHash.java:124)
> > >>         at
org.apache.lucene.util.fst.Builder.compileNode(Builder.java:195)
> > >>         at
org.apache.lucene.util.fst.Builder.freezeTail(Builder.java:287)
> > >>         at org.apache.lucene.util.fst.Builder.add(Builder.java:392)
> > >>         at
> >
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finis
> > h
> > Term(MemoryPostingsFormat.java:257)
> > >>         at
> > org.apache.lucene.index.TestPostingsFormat.buildIndex(TestPostingsForm
> > at.jav
> > a:441)
> > >>         at
> > org.apache.lucene.index.TestPostingsFormat.test(TestPostingsFormat.jav
> > a:896)
> > >>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
> > >>         at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> > 57)
> > >>         at
> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess
> > orI
> > mpl.java:43)
> > >>         at java.lang.reflect.Method.invoke(Method.java:601)
> > >>         at
> >
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedR
> > u
> > nner.java:1995)
> > >>         at
> >
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(Random
> > izedRunner.java:132)
> > >>         at
> >
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Randomi
> > z
> > edRunner.java:818)
> > >>         at
> >
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Randomi
> > z
> > edRunner.java:877)
> > >>         at
> >
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Randomi
> > z
> > edRunner.java:891)
> > >>         at
> > org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRul
> > eSet
> > upTeardownChained.java:50)
> > >>         at
> > org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFie
> > ldCach
> > eSanity.java:32)
> > >>         at
> > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBefo
> > reAfte
> > rRule.java:45)
> > >>         at
> > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule
> > $1.ev
> > aluate(SystemPropertiesInvariantRule.java:55)
> > >>         at
> > org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(Tes
> > tRule
> > ReportUncaughtExceptions.java:68)
> > >>         at
> > org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> > rea
> > dAndTestName.java:48)
> > >>         at
> > org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestR
> > uleIgn
> > oreAfterMaxFailures.java:70)
> > >>         at
> > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFail
> > ure.ja
> > va:48)
> > >>         at
> > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Rand
> > o
> > mizedRunner.java:825)
> > >>         at
> >
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(Randomi
> > z
> > edRunner.java:132)
> > >>         at
> > >>
> > com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(Randomize
> > >> dRunner.java:671)
> > >>
> > >>
> > >>
> > >>
> > >> Build Log:
> > >> [...truncated 1197 lines...]
> > >> [junit4:junit4] Suite: org.apache.lucene.index.TestPostingsFormat
> > >> [junit4:junit4] ERROR   4.61s J0 | TestPostingsFormat.test
> > >> [junit4:junit4]    > Throwable #1: java.lang.OutOfMemoryError: Java
heap
> > space
> > >> [junit4:junit4]    >    at
> >
> __randomizedtesting.SeedInfo.seed([E8AAFF6FA7F41694:60FEC0B509087B6C]:
> > 0)
> > >> [junit4:junit4]    >    at
> > org.apache.lucene.util.BytesRef.<init>(BytesRef.java:75)
> > >> [junit4:junit4]    >    at
> > org.apache.lucene.util.fst.ByteSequenceOutputs.read(ByteSequenceOutput
> > s.jav
> > a:124)
> > >> [junit4:junit4]    >    at
> > org.apache.lucene.util.fst.ByteSequenceOutputs.read(ByteSequenceOutput
> > s.jav
> > a:33)
> > >> [junit4:junit4]    >    at
> > org.apache.lucene.util.fst.FST.readNextRealArc(FST.java:960)
> > >> [junit4:junit4]    >    at
> > org.apache.lucene.util.fst.NodeHash.hash(NodeHash.java:106)
> > >> [junit4:junit4]    >    at
> > org.apache.lucene.util.fst.NodeHash.add(NodeHash.java:124)
> > >> [junit4:junit4]    >    at
> > org.apache.lucene.util.fst.Builder.compileNode(Builder.java:195)
> > >> [junit4:junit4]    >    at
> > org.apache.lucene.util.fst.Builder.freezeTail(Builder.java:287)
> > >> [junit4:junit4]    >    at
> > org.apache.lucene.util.fst.Builder.add(Builder.java:392)
> > >> [junit4:junit4]    >    at
> >
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finis
> > h
> > Term(MemoryPostingsFormat.java:257)
> > >> [junit4:junit4]    >    at
> > org.apache.lucene.index.TestPostingsFormat.buildIndex(TestPostingsForm
> > at.jav
> > a:441)
> > >> [junit4:junit4]    >    at
> > org.apache.lucene.index.TestPostingsFormat.test(TestPostingsFormat.jav
> > a:896)
> > >> [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> > Method)
> > >> [junit4:junit4]    >    at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> > 57)
> > >> [junit4:junit4]    >    at
> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess
> > orI
> > mpl.java:43)
> > >> [junit4:junit4]    >    at
java.lang.reflect.Method.invoke(Method.java:601)
> > >> [junit4:junit4]    >    at
> >
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedR
> > u
> > nner.java:1995)
> > >> [junit4:junit4]    >    at
> >
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(Random
> > izedRunner.java:132)
> > >> [junit4:junit4]    >    at
> >
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Randomi
> > z
> > edRunner.java:818)
> > >> [junit4:junit4]    >    at
> >
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Randomi
> > z
> > edRunner.java:877)
> > >> [junit4:junit4]    >    at
> >
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Randomi
> > z
> > edRunner.java:891)
> > >> [junit4:junit4]    >    at
> > org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRul
> > eSet
> > upTeardownChained.java:50)
> > >> [junit4:junit4]    >    at
> > org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFie
> > ldCach
> > eSanity.java:32)
> > >> [junit4:junit4]    >    at
> > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBefo
> > reAfte
> > rRule.java:45)
> > >> [junit4:junit4]    >    at
> > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule
> > $1.ev
> > aluate(SystemPropertiesInvariantRule.java:55)
> > >> [junit4:junit4]    >    at
> > org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(Tes
> > tRule
> > ReportUncaughtExceptions.java:68)
> > >> [junit4:junit4]    >    at
> > org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> > rea
> > dAndTestName.java:48)
> > >> [junit4:junit4]    >    at
> > org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestR
> > uleIgn
> > oreAfterMaxFailures.java:70)
> > >> [junit4:junit4]    >    at
> > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFail
> > ure.ja
> > va:48)
> > >> [junit4:junit4]    >    at
> > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Rand
> > o
> > mizedRunner.java:825)
> > >> [junit4:junit4]    >    at
> >
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(Randomi
> > z
> > edRunner.java:132)
> > >> [junit4:junit4]    >    at
> >
> com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(Randomized
> > Runner.java:671)
> > >> [junit4:junit4]    >
> > >> [junit4:junit4]   2> NOTE: reproduce with: ant test  -
> > Dtestcase=TestPostingsFormat -Dtests.method=test -
> > Dtests.seed=E8AAFF6FA7F41694 -Dtests.multiplier=3 -Dtests.slow=true -
> > Dtests.locale=ja -Dtests.timezone=America/Fort_Wayne -
> > Dtests.file.encoding=US-ASCII
> > >> [junit4:junit4]   2>
> > >> [junit4:junit4]    > (@AfterClass output)
> > >> [junit4:junit4]   2> NOTE: test params are: codec=Lucene40:
> > {=PostingsFormat(name=MockSep), rl=Lucene40(minBlockSize=82
> > maxBlockSize=257), xgeplm=PostingsFormat(name=Memory doPackFST=
> > false), kojsjftf=PostingsFormat(name=NestedPulsing)},
> > sim=DefaultSimilarity, locale=ja, timezone=America/Fort_Wayne
> > >> [junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle
Corporation
> > 1.7.0_04 (64-bit)/cpus=16,threads=1,free=33223808,total=536870912
> > >> [junit4:junit4]   2> NOTE: All tests run in this JVM:
[TestSearchAfter,
> > TestDocValuesIndexing, TestWeakIdentityMap,
> > TestSimpleExplanationsOfNonMatches, TestFilteredQuery,
> > TestFieldCacheTermsFilter, Nested, Nested, Nested, Nested, Nested,
> > Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested,
> > Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested,
> > TestSpanExplanations, TestIndexWriterWithThreads,
> > TestMaxTermFrequency, TestStressIndexing2,
> > TestIndexableBinaryStringTools, TestCheckIndex, TestCharsRef,
> > TestTermdocPerf, TestDateSort, TestSetOnce, TestMixedCodecs,
> > TestSloppyPhraseQuery2, TestMultiFields, TestSnapshotDeletionPolicy,
> > TestTimeLimitingCollector, TestNoDeletionPolicy, TestLazyProxSkipping,
> > Test2BTerms, TestIndexWriterForceMerge, TestRollingUpdates,
> > TestTermVectorsReader, TestAssertions, TestSpecialOperations,
> > TestFilterAtomicReader, TestElevationComparator, TestMultiMMap,
> > TestByteSlices, TestPayloadTermQuery, TestDocumentWriter,
> > TestSizeBoundedForceMerge, TestFuzzyQuery, TestDeletionPolicy,
> > TestShardSearching, TestNumericUtils, TestSpanSearchEquivalence,
> > TestDisjunctionMaxQuery, TestByteArrayDataInput, TestMultiPhraseQuery,
> > TestTopDocsCollector, TestFixedBitSet, TestSearch,
> > TestTransactionRollback, TestTermVectors, TestIndexWriter,
> > TestDirectoryReaderReopen, TestOmitTf, TestCopyBytes, TestRegexpQuery,
> > TestSmallFloat, TestIndexWriterNRTIsCurrent, TestMockCharFilter,
> > TestPrefixCodedTerms, TestLevenshteinAutomata, Nested, Nested,
> > TestMultiTermConstantScore, TestIndexWriterReader, TestWindowsMMap,
> > TestDemo, TestParallelCompositeReader, TestScoreCachingWrappingScorer,
> > TestFileSwitchDirectory, TestArrayUtil, TestPagedBytes,
> > TestIndexWriterLockRelease, InBeforeClass, InAfterClass, InTestMethod,
> > NonStringProperties, TestBasicOperations,
> > TestSpanExplanationsOfNonMatches, TestSortedVIntList, TestScorerPerf,
> > TestPrefixInBooleanQuery, TestRegexpRandom, TestNorms,
> > TestIndexWriterExceptions, TestBasics, TestDuelingCodecs,
> > TestIndexWriterMergePolicy, TestNeverDelete,
> > TestFlushByRamOrCountsPolicy, TestTopDocsMerge, TestCollectionUtil,
> > TestCompoundFile, TestSimpleExplanations, TestCustomNorms,
> > TestStressIndexing, TestDeterminizeLexicon,
> > TestDocumentsWriterStallControl, TestRollingCharBuffer,
> > TestRegexpRandom2, TestConsistentFieldNumbers,
> > TestDoubleBarrelLRUCache, TestCrashCausesCorruptIndex, TestDocValues,
> > TestUTF32ToUTF8, TestTransactions, TestThreadedForceMerge,
> > TestSegmentReader, TestPerFieldPostingsFormat, TestFieldCache,
> > TestPayloadNearQuery, TestPrefixRandom, TestDocsAndPositions,
> > TestFlex, TestIndexableField, TestSimilarity2,
> > TestAllFilesHaveCodecHeader, TestMultiLevelSkipList,
> > TestExternalCodecs, Nested2, Nested3, Nested1, TestTermRangeQuery,
> > TestSpansAdvanced2, TestSpanMultiTermQueryWrapper,
> > TestComplexExplanationsOfNonMatches,
> > TestSumDocFreq, TestPerSegmentDeletes, TestParallelReaderEmptyIndex,
> > TestIndexFileDeleter, Before3, Before3, TestDocValuesScoring,
> > TestDocIdSet, TestFieldValueFilter, TestAppendingCodec,
> > TestSpansAdvanced, TestConstantScoreQuery, TestPositionIncrement,
> > Nested, TestReaderClosed, TestNot, TestAutomatonQueryUnicode,
> > TestIndexWriterOnJRECrash, TestBinaryDocument, TestSpanFirstQuery,
> > TestPriorityQueue, TestDocBoost, TestIntBlockCodec, TestIsCurrent,
> > MultiCollectorTest, TestPrefixFilter, TestVersion,
> > TestNoMergeScheduler, TestCachingTokenFilter, TestIOUtils,
> > TestCharFilter, TestPostingsFormat]
> > >> [junit4:junit4]   2>
> > >> [junit4:junit4] Completed on J0 in 13.67s, 1 test, 1 error <<<
FAILURES!
> > >>
> > >> [...truncated 5 lines...]
> > >> BUILD FAILED
> > >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-4.x-
> > java7/checkout/build.xml:29: The following error occurred while
> > executing this
> > line:
> > >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-4.x-
> > java7/checkout/lucene/build.xml:50: The following error occurred while
> > executing this line:
> > >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-4.x-
> > java7/checkout/lucene/common-build.xml:1095: The following error
> > occurred while executing this line:
> > >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-4.x-
> > >> ja
> > >> va7/checkout/lucene/common-build.xml:790: There were test failures:
> > >> 309 suites, 1736 tests, 1 error, 14 ignored (12 assumptions)
> > >>
> > >> Total time: 6 minutes 14 seconds
> > >> Build step 'Execute shell' marked build as failure Archiving
> > >> artifacts Recording test results Email was triggered for: Failure
> > >> Sending email for trigger: Failure
> > >>
> > >>
> > >>
> > >>
> > >> -------------------------------------------------------------------
> > >> -- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For
> > >> additional commands, e-mail: dev-help@lucene.apache.org
> > >
> > >
> > >
> > > --
> > > lucidimagination.com
> > >
> > > --------------------------------------------------------------------
> > > - To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For
> > > additional commands, e-mail: dev-help@lucene.apache.org
> > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For
> > additional commands, e-mail: dev-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message