lucene-solr-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Noble Paul നോബിള്‍ नोब्ळ् <noble.p...@corp.aol.com>
Subject Re: [jira] Commented: (SOLR-1426) Allow delta-import to run continously until aborted
Date Thu, 01 Oct 2009 18:44:07 GMT
the lastIndexTime is removed from DataImporter because it is redundant.

On Thu, Oct 1, 2009 at 11:42 PM, Abdul Chaudhry (JIRA) <jira@apache.org> wrote:
>
>    [ https://issues.apache.org/jira/browse/SOLR-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12761289#action_12761289
]
>
> Abdul Chaudhry commented on SOLR-1426:
> --------------------------------------
>
> NOTE: the last_index_time is broken with the perpetual patch
>
> I hacked around this by changing the data-config.xml file for the deltaQuery to do something
like this:-
>
> WHERE updated_at > DATE_SUB('${dataimporter.last_index_time}',INTERVAL 10 SECOND)
>
> This is because of the time discrepancy between the sleep and the writers last_index_time.
>
> However, it looks like the delta-import is broken in the latest build of solr trunk revision
820731. It looks like the lastIndexTime in the DataImporter is not populated after a delta
and so if you used ${dataimporter.last_index_time} then the deltaQuery uses the wrong time.
>
> I am going to wait until delta-import is fixed before I update a patch.
>
>
>> Allow delta-import to run continously until aborted
>> ---------------------------------------------------
>>
>>                 Key: SOLR-1426
>>                 URL: https://issues.apache.org/jira/browse/SOLR-1426
>>             Project: Solr
>>          Issue Type: Improvement
>>          Components: contrib - DataImportHandler
>>    Affects Versions: 1.4
>>            Reporter: Abdul Chaudhry
>>            Assignee: Noble Paul
>>             Fix For: 1.5
>>
>>         Attachments: delta-import-perpetual.patch
>>
>>
>> Modify the delta-import so that it takes a perpetual flag that makes it run continuously
until its aborted.
>> http://localhost:8985/solr/select/?command=delta-import&clean=false&qt=/dataimport&commit=true&perpetual=true
>> perpetual means the delta import will keep running and pause for a few seconds when
running queries.
>> The only way to stop delta import will be to explicitly issue an abort like so:-
>> http://localhost:8985/solr/tickets/select/?command=abort
>
> --
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>
>



-- 
-----------------------------------------------------
Noble Paul | Principal Engineer| AOL | http://aol.com

Mime
View raw message