lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sunnyfr <>
Subject Re: Solr1.3 / MySql / Tomcat55 multiple delta-import inside a big full-import
Date Fri, 31 Oct 2008 11:53:52 GMT

Sorry I wasn't clear,
The stack is not on solr database or index query, stack request are on our
main database MySql,
When I do a full import to create indexes for solr, MySql honnor it and
won't drive it OOM, but with a batchsize -1, it uses MySql memory which let
less memory for the rest of the request on the dabase like, insert, update,
delete ...

:) thanks for your answer,

Shalin Shekhar Mangar wrote:
> On Fri, Oct 31, 2008 at 3:27 PM, sunnyfr <> wrote:
>> I would like to know if it's very longer to make a limited full import
>> and
>> multi delta-import to index all the database.
>> If I fire a full-import without limit 4M in my request that will run me
>> OOM
>> because I've 8,5M of document.
>> If I fire a full-import without limit and a batchsize=-1 I will stock the
>> database just for me, and stack other request for 10hours, but it will
>> work.
> A full-import should not stack other requests though response time will be
> more because of the heavy processing.
> Most users have a dedicated Master instance used only for indexing and
> many
> slaves dedicated for serving search requests. Maybe you can try a
> master-slave architecture.
> -- 
> Regards,
> Shalin Shekhar Mangar.

View this message in context:
Sent from the Solr - User mailing list archive at

View raw message