lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erick Erickson <erickerick...@gmail.com>
Subject Re: Starting optimize... Reading and rewriting the entire index! Use with care
Date Thu, 27 Dec 2018 16:01:18 GMT
1> Not sure. You can get stats after the fact if that would help.

2, 3, 4>  Well, optimize is a configuration parameter in DIH
that defaults to true so set it false and
you'll get rid of the optimize. See:
https://lucene.apache.org/solr/guide/6_6/uploading-structured-data-store-data-with-the-data-import-handler.html

On Wed, Dec 26, 2018 at 11:23 PM talhanather <talhanather@gmail.com> wrote:
>
> Hi Erick,
>
> My DIH is working perfectly, As I have done the full import of index from
> SQL Server after installation.
>
> I had 25000 records which was imported to Solr through Full import using DIH
> config only.
> But my additional requirement is to import the new records through delta
> import (through some automation job) whenever the new records are getting
> created in the database.
> But when I click on Delta Import,  Its not working for some reason and
> nothing is showing in logs.
>
> While verifying logs, I saw the below warning occurring recursively and
> could see that the new records are getting indexed without clicking on delta
> import.
>
> "2018-12-19 16:13:21.927 WARN  (qtp736709391-15) [   x:solrprod]
> o.a.s.u.DirectUpdateHandler2 Starting optimize... Reading and rewriting the
> entire index! Use with care."
>
> I have mentioned my queries below,  Kindly suggest.
>
> 1. Without clicking on delta import, How my new records are getting indexed
> ?
> 2. I didnt click on the optimize, Then how its continuously doing the same.
> 3. How to stop optimization ?
> 4. As per the requirement my new records are getting indexed (without delta
> import), whether it will stop import of index when i stop optimization.
>
> Thanks,
> Talha
>
>
>
>
>
>
>
> --
> Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Mime
View raw message