lucene-solr-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Abdul Chaudhry (JIRA)" <>
Subject [jira] Commented: (SOLR-1426) Allow delta-import to run continously until aborted
Date Thu, 01 Oct 2009 18:12:23 GMT


Abdul Chaudhry commented on SOLR-1426:

NOTE: the last_index_time is broken with the perpetual patch

I hacked around this by changing the data-config.xml file for the deltaQuery to do something
like this:-

WHERE updated_at > DATE_SUB('${dataimporter.last_index_time}',INTERVAL 10 SECOND)

This is because of the time discrepancy between the sleep and the writers last_index_time.

However, it looks like the delta-import is broken in the latest build of solr trunk revision
820731. It looks like the lastIndexTime in the DataImporter is not populated after a delta
and so if you used ${dataimporter.last_index_time} then the deltaQuery uses the wrong time.

I am going to wait until delta-import is fixed before I update a patch.

> Allow delta-import to run continously until aborted
> ---------------------------------------------------
>                 Key: SOLR-1426
>                 URL:
>             Project: Solr
>          Issue Type: Improvement
>          Components: contrib - DataImportHandler
>    Affects Versions: 1.4
>            Reporter: Abdul Chaudhry
>            Assignee: Noble Paul
>             Fix For: 1.5
>         Attachments: delta-import-perpetual.patch
> Modify the delta-import so that it takes a perpetual flag that makes it run continuously
until its aborted.
> http://localhost:8985/solr/select/?command=delta-import&clean=false&qt=/dataimport&commit=true&perpetual=true
> perpetual means the delta import will keep running and pause for a few seconds when running
> The only way to stop delta import will be to explicitly issue an abort like so:-
> http://localhost:8985/solr/tickets/select/?command=abort

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message