lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marc Sturlese <marc.sturl...@gmail.com>
Subject Re: concurrency problem with delta-import (indexing various cores simultaniously)
Date Fri, 20 Feb 2009 18:08:09 GMT

I am working with 3 index of 1 gig each. I am using the standard setting of
the GC, haven't changed anything and using java version "1.6.0_07".
I don't know so much about GV configuration... just read this

http://marcus.net/blog/2007/11/10/solr-search-and-java-gc-tuning/

when a month ago I exeprienced another problem with Solr (at the end it was
not GV's fault). So, any advice about wich GC should I try or what should I
tune?

Thank you very much!



Shalin Shekhar Mangar wrote:
> 
> On Fri, Feb 20, 2009 at 11:23 PM, Marc Sturlese
> <marc.sturlese@gmail.com>wrote:
> 
>>
>> Yes,
>> Now it's almost tree days non-stop since I am running updates with the 3
>> cores with cron jobs. If there are updates of 10000 docs everything is
>> alrite. When I start doing updates of 300000 is when that core runs
>> really
>> slow. I have to abort the import in that core and keep updating with less
>> rows each time.
>> Another thing to point is that tomcat reaches the maximum memory I allow
>> (2Gig) and never goes down (but at least it doesn't run out of memory).
>> Is
>> that normal? Shouldn't the memory go down a lot after an update is
>> completed?
>>
> 
> I guess you are being hit by garbage collection. Memory utilization should
> go down once an import completes. Which GC are you using? There have been
> a
> few recent threads on GC settings. Perhaps you can try out a few of those
> settings. I don't know how big your documents/index are but if possible
> give
> it more memory.
> 
> -- 
> Regards,
> Shalin Shekhar Mangar.
> 
> 

-- 
View this message in context: http://www.nabble.com/concurrency-problem-with-delta-import-%28indexing-various-cores-simultaniously%29-tp22120430p22125716.html
Sent from the Solr - User mailing list archive at Nabble.com.


Mime
View raw message