lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steffen B." <>
Subject DIH full-import with clean=true fails and rollback empties index
Date Tue, 17 Feb 2009 11:12:26 GMT

Hi there,
I've got a pretty simple question regarding the DIH full-import command.
I have a SOLR server running that has a full index with lots of documents in
it. Once a day, a full-import is run, which uses the default parameters
(clean=true, because it's not an incremental index).
When I run a full-import, the first step is cleaning up the whole index:

Feb 7, 2009 2:12:01 AM org.apache.solr.update.DirectUpdateHandler2 deleteAll

After that, suppose the import suddenly fails for one reason or another (ie.
SQL error), which initiates a rollback:

Feb 7, 2009 2:12:02 AM org.apache.solr.handler.dataimport.DataImporter
SEVERE: Full Import failed
Feb 7, 2009 2:12:02 AM org.apache.solr.update.DirectUpdateHandler2 rollback
INFO: start rollback
Feb 7, 2009 2:12:02 AM org.apache.solr.update.DirectUpdateHandler2 rollback
INFO: end_rollback
Feb 7, 2009 2:12:02 AM org.apache.solr.update.DirectUpdateHandler2 commit
INFO: start commit(optimize=false,waitFlush=false,waitSearcher=true)

Unfortunately, this rollback does not "refill" the index with the old data,
and neither keeps the old index from being overwritten with the new,
erroneous index. Now my question is: is there anything I can do to keep Solr
from trashing my index on a full-import when there is a problem with the
Or should I use clean=false, even though 99% of the imported documents are
not incremental but the same documents that already were in the index, only
with new data?
Any tips will be greatly appreciated! :)
- Steffen
View this message in context:
Sent from the Solr - User mailing list archive at

View raw message