lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Renee Sun (JIRA)" <j...@apache.org>
Subject [jira] Commented: (SOLR-2138) Solr 1.4 takes long time to load cores (memory leak?)
Date Tue, 05 Oct 2010 16:19:32 GMT

    [ https://issues.apache.org/jira/browse/SOLR-2138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12918050#action_12918050
] 

Renee Sun commented on SOLR-2138:
---------------------------------

yes, same JVM, jre1.6.0_21.

By the way, in solr_user blog, I added more information after more test... I have commented
out the newSearcher and firstSearcher in solrconfig.xml, after that it loaded up all 130 cores
in 1 minutes. It only took totally 1GB memory, whereas with Solr 1.3, with newSearcher and
firstSearcher, it took about 1 minute and 6.5GB on same core.

> Solr 1.4 takes long time to load cores (memory leak?)
> -----------------------------------------------------
>
>                 Key: SOLR-2138
>                 URL: https://issues.apache.org/jira/browse/SOLR-2138
>             Project: Solr
>          Issue Type: Bug
>    Affects Versions: 1.4
>         Environment: 8 processors Intel(R) Xeon(R) CPU           E5345  @ 2.33GHz
>            Reporter: Renee Sun
>
> 1. 32 GB total memory, with 16GB allocated to Solr server.
> 2. 130 cores, with most cores having 50,000 documents, and 2,3 cores having 1~2.4Million
documents (largest core takes about 11GB disk space)
> 3. in solr 1.3, there was no problem, it took 5,6 minutes to load up all cores.
> 4. just upgrade to solr 1.4, it takes about 45+ minutes to load all 130 cores.
> 5. no solrconfig or schema change
> 6. autowarmCount="0" for all caches
> I have monitored the memory with JConsole. The 'queryConverter' warning in catalina.out
file helped me figured out that when about 70 cores were loaded, the memory usage went from
300MB to 16GB, and stay at that level. Rest of the cores are loaded up extremely slow.
> I find Yonik's fix note for SOLR-1797: fix ConcurrentModificationException and potential
memory
>   leaks in ResourceLoader. (yonik)
> We are in process of upgrading to 1.4.1

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message