lucene-solr-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <>
Subject [Solr Wiki] Update of "SolrPerformanceFactors" by RobertMuir
Date Thu, 03 Nov 2011 23:26:12 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Solr Wiki" for change notification.

The "SolrPerformanceFactors" page has been changed by RobertMuir:

die optimize die

     * Memory usage during indexing
     * Segment merge time
-    * Optimization times
     * Index size
  These impacts can be reduced by the use of `omitNorms="true"`
@@ -74, +73 @@

  === Explicit Warming of Sort Fields ===
  If you do a lot of field based sorting, it is advantageous to add explicitly warming queries
to the "newSearcher" and "firstSearcher" event listeners in your solrconfig which sort on
those fields, so the !FieldCache is populated prior to any queries being executed by your
- == Optimization Considerations ==
- You may want to optimize an index whenever practical -- ie: if you build your index once,
and then never modify it.
- If your index is receiving a steady stream of modifications, then consider the following
-    * As more segments are added to the index, query performace will degrade slightly.  Automatic
segment merging by Lucene will set an upper bound on the number of segments created though.
-    * Auto-warming time will grow since it's normally dependent on doing searches. 
-    * The first distribution after an optimization will take longer than subsequent ones.
See [[CollectionDistribution|Collection Distribution]] for more information.
-    * During optimization the file size of the index doubles, but returns to it's original
size or even slightly less.
-    * If you can, make sure that you do not have multiple concurrent producers of documents
calling commit(). Multiple concurrent commits will cause a large performance degradation.

- Since optimizing an index saves all the segments in an index (about 7 files per segment)
into a single segment, optimizing an index helps avoid the "too many open files" problem,
i.e. running out of file descriptors, which is mentioned in an [[|ONJava
  == Updates and Commit Frequency Tradeoffs ==

View raw message