lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uwe Schindler" <...@thetaphi.de>
Subject RE: Lucene reorganizing indexes
Date Mon, 16 Jul 2012 20:47:26 GMT
You may want to read:
http://www.searchworkings.org/blog/-/blogs/simon-says%3A-optimize-is-bad-for
-you

-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de


> -----Original Message-----
> From: Scott Smith [mailto:ssmith@mainstreamdata.com]
> Sent: Monday, July 16, 2012 10:29 PM
> To: java-user@lucene.apache.org
> Subject: Lucene reorganizing indexes
> 
> We have an application that has to do "real time" indexing of a number of
> documents.  What it does is wake up about every 20 seconds and updates the
> index with any changes that have been queued since the last time it ran.
This
> involves adding and deleting several hundred documents.  This is all done
in a
> single thread.  There can be multiple threads doing searches simultaneous
with
> the update thread (the searches run in a different process).
> 
> Back in the days of 1.42, we would force an index optimization once each
day.
> However, my impression is that the later versions of Lucene (we are
currently
> using 3.5), Lucene will often do its own reorganization based on hitting
certain
> criteria.  I've been told that optimizing the index is, perhaps, no longer
> necessary.  Can someone describe what happens here?
> 
> The reason I'm asking about this is that we see our application
periodically
> using excessive amounts of kernel time (on Windows) which normally
indicates
> a lot of disk activity.  We are unable to align this with anything our
code is
> doing.  Obviously, we expect Lucene to be causing disk activity, it just
seems
> that the last release (we were at 3.02 before going to 3.5) severely
increased
> the disk activity which is interfering with other things running on the
boxes.
> 
> Does any of this make sense to anyone?  Is there an explanation?  Thoughts
> about what we might do about it?
> 
> Thanks in advance.
> 
> Scott


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message