lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Blargy <zman...@hotmail.com>
Subject Re: Importing large datasets
Date Wed, 02 Jun 2010 16:58:29 GMT



> One thing that might help indexing speed - create a *single* SQL query  
> to grab all the data you need without using DIH's sub-entities, at  
> least the non-cached ones.
> 

Not sure how much that would help. As I mentioned that without the item
description import the full process takes 4 hours which is bearable. However
once I started to import the item description which is located on a separate
machine/database the import process exploded to over 24 hours.

-- 
View this message in context: http://lucene.472066.n3.nabble.com/Importing-large-datasets-tp863447p865324.html
Sent from the Solr - User mailing list archive at Nabble.com.

Mime
View raw message