lucene-solr-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Solr Wiki] Update of "SolrPerformanceFactors" by MikeKlaas
Date Wed, 29 Nov 2006 19:06:29 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Solr Wiki" for change notification.

The following page has been changed by MikeKlaas:
http://wiki.apache.org/solr/SolrPerformanceFactors

The comment on the change is:
added stored field performance considerations

------------------------------------------------------------------------------
  
  == Schema Design Considerations ==
  
+ === indexed fields ===
  The number of indexed fields greatly increases the following:
  
     * Memory usage during indexing
@@ -12, +13 @@

     * Index size
  
  These impacts can be reduced by the use of `omitNorms="true"`
+ 
+ === stored fields ===
+ 
+ Retrieving the stored fields of a query result can be a significant expense.  This cost
is affected largely by the number of bytes stored per document--the higher byte count, the
sparser the documents will be distributed on disk and hence more i/o is necessary to retrieve
the fields (usually this is a concern when storing large fields, like the entire contents
of a document).
+ 
+ Consider storing large fields outside of Solr.  If you feel inclined to do so regardless,
consider using compressed fields, which increase the CPU cost of storing and retrieving the
fields, but lowers the i/o burden and cpu usage.
+ 
+ If you aren't always using all the stored fields, then enabling lazy field loading can be
a huge boon, especially if compressed fields are used.
  
  == Configuration Considerations ==
  

Mime
View raw message