lucene-solr-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Abdul Chaudhry (JIRA)" <j...@apache.org>
Subject [jira] Commented: (SOLR-1426) Allow delta-import to run continously until aborted
Date Thu, 01 Oct 2009 18:12:23 GMT

    [ https://issues.apache.org/jira/browse/SOLR-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12761289#action_12761289
] 

Abdul Chaudhry commented on SOLR-1426:
--------------------------------------

NOTE: the last_index_time is broken with the perpetual patch

I hacked around this by changing the data-config.xml file for the deltaQuery to do something
like this:-

WHERE updated_at > DATE_SUB('${dataimporter.last_index_time}',INTERVAL 10 SECOND)

This is because of the time discrepancy between the sleep and the writers last_index_time.

However, it looks like the delta-import is broken in the latest build of solr trunk revision
820731. It looks like the lastIndexTime in the DataImporter is not populated after a delta
and so if you used ${dataimporter.last_index_time} then the deltaQuery uses the wrong time.


I am going to wait until delta-import is fixed before I update a patch.


> Allow delta-import to run continously until aborted
> ---------------------------------------------------
>
>                 Key: SOLR-1426
>                 URL: https://issues.apache.org/jira/browse/SOLR-1426
>             Project: Solr
>          Issue Type: Improvement
>          Components: contrib - DataImportHandler
>    Affects Versions: 1.4
>            Reporter: Abdul Chaudhry
>            Assignee: Noble Paul
>             Fix For: 1.5
>
>         Attachments: delta-import-perpetual.patch
>
>
> Modify the delta-import so that it takes a perpetual flag that makes it run continuously
until its aborted.
> http://localhost:8985/solr/select/?command=delta-import&clean=false&qt=/dataimport&commit=true&perpetual=true
> perpetual means the delta import will keep running and pause for a few seconds when running
queries.
> The only way to stop delta import will be to explicitly issue an abort like so:-
> http://localhost:8985/solr/tickets/select/?command=abort

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message