lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "James Dyer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SOLR-1920) Need generic placemarker for DIH delta-import
Date Tue, 13 Nov 2012 21:06:13 GMT

    [ https://issues.apache.org/jira/browse/SOLR-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496541#comment-13496541
] 

James Dyer commented on SOLR-1920:
----------------------------------

possibly, the fields/values from the last document added could be all stored in the properties
file.  This would mean you'd have to sort your documents by the autoincrement field so that
the highest one is guaranteed to be last.

Another possibility is to have it go out and execute a query to get the values from the database
in a special "get the properties" query.  This would be like SOLR-3365, where the user wants
to get "last_index_time" from the database rather than from the Solr server's clock as currently
done.  To implement SOLR-3365, I imagine letting the user specify a query like "select CURRENT_TIMESTAMP
as 'last_index_time' from dual" .  It would be just as easy to let any set of properties be
put in such a query, for instance, "select max(autoincrement_field) from mytable".  So maybe
something can be written that would solve both issues?
                
> Need generic placemarker for DIH delta-import
> ---------------------------------------------
>
>                 Key: SOLR-1920
>                 URL: https://issues.apache.org/jira/browse/SOLR-1920
>             Project: Solr
>          Issue Type: Improvement
>          Components: contrib - DataImportHandler
>            Reporter: Shawn Heisey
>            Priority: Minor
>             Fix For: 4.1
>
>
> The dataimporthandler currently is only capable of saving the index timestamp for later
use in delta-import commands.  It should be extended to allow any arbitrary data to be used
as a placemarker for the next import.
> It is possible to use externally supplied variables in data-config.xml and send values
in via the URL that starts the import, but if the config can support it natively, that is
better.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message