lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From <Fang...@emc.com>
Subject exception to open a large index Insufficient system resources exist
Date Tue, 01 Sep 2009 09:37:48 GMT
I met a problem to open an index bigger than 8GB and the following
exception was thrown. There is a segment which is bigger than 4GB
already. After searching internet, it is said that not using compound
index may solve the problem.

The same exception was thrown when merging with another index happens.
If the problem is caused by the big segment, we can adjust Lucene
parameters to control the segment size. 
Anyone knows what's the cause for this exception? As reproducing the
problem will take a long time, your idea will be save us a lot of
effort.

java.io.IOException: Insufficient system resources exist to complete the
requested service
	at java.io.RandomAccessFile.readBytes(Native Method)
	at java.io.RandomAccessFile.read(RandomAccessFile.java:315)
	at
org.apache.lucene.store.FSDirectory$FSIndexInput.readInternal(FSDirector
y.java:596)
	at
org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.jav
a:157)
	at
org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.j
ava:38)
	at
org.apache.lucene.store.IndexInput.readVInt(IndexInput.java:78)
	at
org.apache.lucene.index.CompoundFileReader.<init>(CompoundFileReader.jav
a:73)
	at
org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:321)
	at
org.apache.lucene.index.SegmentReader.get(SegmentReader.java:306)
	at
org.apache.lucene.index.SegmentReader.get(SegmentReader.java:228)
	at
org.apache.lucene.index.MultiSegmentReader.<init>(MultiSegmentReader.jav
a:55)
	at
org.apache.lucene.index.DirectoryIndexReader$1.doBody(DirectoryIndexRead
er.java:104)
	at
org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.j
ava:653)
	at
org.apache.lucene.index.DirectoryIndexReader.open(DirectoryIndexReader.j
ava:115)
	at
org.apache.lucene.index.IndexReader.open(IndexReader.java:316)
	at
org.apache.lucene.index.IndexReader.open(IndexReader.java:227)

Thanks,
-Li


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message