lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mordo, Aviran (EXP N-NANNATEK)" <aviran.mo...@lmco.com>
Subject RE: merging indexes together
Date Mon, 08 Aug 2005 17:54:25 GMT
Why don't you just add the new information directly to the main index ?
As long as you don't get a new IndexReader you should be able to access
the old information. Once your indexing and deletion is done just get a
new IndexReader instance to access the new documents.

Aviran
http://www.aviransplace.com

-----Original Message-----
From: Volodymyr Bychkoviak [mailto:vbychkoviak@i-hypergrid.com] 
Sent: Monday, August 08, 2005 1:50 PM
To: java-user@lucene.apache.org
Subject: merging indexes together

Hello All.

In my program I index new information to temporary dir and after then I
delete outdated information from main index and add new information by
calling indexWriter.addIndexes() method. This works fine when doc number
is relatively small but when index size grows, every call to addIndexes
can take very long. (NOTE: new information is ONLY part of all index)

The reason I'm using this approach is that I want old information to be
available during indexing new information and then switch as fast as I
can to new information.

current index 336Mb / 1100000 Docs. and growing...
current time to merge indexes is about 5min.

Any ideas how to optimize this?

--
regards,
Volodymyr Bychkoviak


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message