lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael McCandless (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (LUCENE-4081) JVM outOfMemory when call IndexWriter.optimize() method
Date Tue, 29 May 2012 10:25:23 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-4081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13284708#comment-13284708
] 

Michael McCandless commented on LUCENE-4081:
--------------------------------------------

LUCENE-2357 would help here (that specific line that tripped the OOME would have allocated
less RAM)...
                
> JVM outOfMemory when call IndexWriter.optimize() method
> -------------------------------------------------------
>
>                 Key: LUCENE-4081
>                 URL: https://issues.apache.org/jira/browse/LUCENE-4081
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: core/index
>    Affects Versions: 2.1
>         Environment: jvm 2048, jdk1.5
>            Reporter: Zhenglin Sun
>
>     I have a luccen application,while the index file has 6.3G. When I update the indexes
every night, It can update successfully, but when i call the optimize() method, there is a
outOfMemory error. The error informations are listed as follows:
> Caused by: java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 122069080,
Num elements: 30517266
>         at org.apache.lucene.index.SegmentMergeInfo.getDocMap(SegmentMergeInfo.java:44)
>         at org.apache.lucene.index.SegmentMerger.appendPostings(SegmentMerger.java:343)
>         at org.apache.lucene.index.SegmentMerger.mergeTermInfo(SegmentMerger.java:315)
>         at org.apache.lucene.index.SegmentMerger.mergeTermInfos(SegmentMerger.java:289)
>         at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:253)
>         at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:96)
>         at org.apache.lucene.index.IndexWriter.mergeSegments(IndexWriter.java:1489)
>         at org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:900)
>         at com.papcic.epcis.epciscommon.intqry.biz.service.impl.AhsPolicyIndexGeneratorPojoService.generateIndexBatch(AhsPolicyIndexGeneratorPojoService.java:372)
>         at com.papcic.epcis.epciscommon.intqry.biz.service.impl.AhsPolicyIndexGeneratorPojoService.generateAHSPolicyIndex(AhsPolicyIndexGeneratorPojoService.java:196)
>         at com.papcic.epcis.epciscommon.intqry.biz.service.impl.PolicyIndexJobPojoService.generatePolicyIndex(PolicyIndexJobPojoService.java:68)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message