lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Hostetter <>
Subject Re: full-import cycle, period ?!
Date Thu, 06 May 2010 19:16:56 GMT

: is it really necessary to run an full import every night ? 

(these comments are not specific to DIH, they are general opinions)

In my experience if you have a really good "delta" importing strategy, 
then the only reason you need a full rebuild strategy is in the event of 
catestrophic failure, or in cases where you may want to modify the 
schema.xml and reindex.  If your delta importing mechanism is effecient 
enough it can *be* your full reindexing strategy by marking all records as 
modified.  likewise: if your full builds are lightning fast, then you can 
eliminate some complexity by not bothering with a delta import strategy, 
and just rebuild on a regular basis.

The key: have as much complexity as you need, but no more.


View raw message