lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erick Erickson <erickerick...@gmail.com>
Subject Re: How to import a part of index from main Solr server(based on a query) to another Solr server and then do incremental import at intervals later(the updated index)?
Date Fri, 12 Oct 2012 22:20:15 GMT
Hmmm, not quite what you asked, but would it work to just
replicate from Solr1 to Solr2 when you want to synch? You
can trigger this via http, see:
http://wiki.apache.org/solr/SolrReplication#HTTP_API

If you're talking about individual documents, then the answer
is no. There's nothing as far as I know that moves just a single
document. If you've stored all the fields, you could fetch the doc
from solr1 and index it to solr2, but that's kinda kludgy...

Best
Erick

On Fri, Oct 12, 2012 at 4:44 PM, jefferyyuan <yuanyun.cn@gmail.com> wrote:
> I have a main solr server(solr1) which stores indexes of all docs, and want
> to implement the following function:
> 1. First make a full import of my doc updated/created recently(last 1 or 2
> weeks) from solr1.
> 2. Make delta import at intervals to copy the change of my doc from solr1 to
> solr2. - doc may be deleted, updated, created during this period.
>
> -- as the function supported by SqlEntityProcessor to import data from DB to
> Solr.
>
> http://wiki.apache.org/solr/DataImportHandler#SolrEntityProcessor
> SolrEntityProcessor can make a full-import from one Solr to another solr
> based on a query(using query parameter in config file), but seems can't do
> delta import later: no deltaImportQuery and deltaQuery configuration, which
> is supported in SqlEntityProcessor.
>
> I have a field last_modified which records the timestamp an doc is created
> or updated.
> Task1 can be easily implemented: <entity name="sep"
> processor="SolrEntityProcessor" query="+from:jeffery
> +last_modified:[${dataimporter.request.start_time} TO NOW]"
> url="mainsolr:8080/solr/"/>;
>
> But how can implement incremental import with SolrEntityProcessor? Seems
> SolrEntityProcessor doesn't support "command=delta-import".
>
> Thanks for any reply and help :)
>
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/How-to-import-a-part-of-index-from-main-Solr-server-based-on-a-query-to-another-Solr-server-and-then-tp4013479.html
> Sent from the Solr - User mailing list archive at Nabble.com.

Mime
View raw message