lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Earwin Burrfoot (JIRA)" <j...@apache.org>
Subject [jira] Commented: (LUCENE-2361) OutOfMemoryException while Indexing
Date Sat, 03 Apr 2010 00:22:27 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-2361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12853021#action_12853021
] 

Earwin Burrfoot commented on LUCENE-2361:
-----------------------------------------

Basically, my bet is you're using a truckload of unique field names. Lucene interns them for
speed, as it does quite a lot of field name comparisons, and the whole thing explodes.
Unless you fill up your PermGen in some other manner, and Lucene just happens to hit the consequences.

The strange thing is - last time I tested String.intern(), it failed to cause OOMs being bombarded
by random strings, like it did in java 1.4.something.

> OutOfMemoryException while Indexing
> -----------------------------------
>
>                 Key: LUCENE-2361
>                 URL: https://issues.apache.org/jira/browse/LUCENE-2361
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: Index
>    Affects Versions: 2.9.1
>         Environment: Windows
>            Reporter: Shivender Devarakonda
>
> Hi,
> We use lucene 2.9.1 version.
> We see the following OutOfMemory error in our environment, I think This is happening
at a significant high load. Have you observed this anytime? Please let me know your thoughts
on this.
> org.apache.lucene.index.MergePolicy$MergeException: java.lang.OutOfMemoryError: PermGen
space
> 	at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:351)
> 	at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:315)
> Caused by: java.lang.OutOfMemoryError: PermGen space
> 	at java.lang.String.$$YJP$$intern(Native Method)
> 	at java.lang.String.intern(Unknown Source)
> 	at org.apache.lucene.util.SimpleStringInterner.intern(SimpleStringInterner.java:74)
> 	at org.apache.lucene.util.StringHelper.intern(StringHelper.java:36)
> 	at org.apache.lucene.index.FieldInfos.read(FieldInfos.java:356)
> 	at org.apache.lucene.index.FieldInfos.<init>(FieldInfos.java:71)
> 	at org.apache.lucene.index.SegmentReader$CoreReaders.<init>(SegmentReader.java:116)
> 	at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:638)
> 	at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:608)
> 	at org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:686)
> 	at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4979)
> 	at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4614)
> 	at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:235)
> 	at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:291)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message