lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Luca Cavanna (JIRA)" <>
Subject [jira] [Created] (SOLR-3443) Optimize hunspell dictionary loading with multiple cores
Date Mon, 07 May 2012 12:36:51 GMT
Luca Cavanna created SOLR-3443:

             Summary: Optimize hunspell dictionary loading with multiple cores
                 Key: SOLR-3443
             Project: Solr
          Issue Type: Improvement
            Reporter: Luca Cavanna

The Hunspell dictionary is actually loaded into memory. Each core using hunspell loads its
own dictionary, no matter if all the cores are using the same dictionary files. As a result,
the same dictionary is loaded into memory multiple times, once for each core. I think we should
share those dictionaries between all cores in order to optimize the memory usage. In fact,
let's say a dictionary takes 20MB into memory (this is what I detected), if you have 20 cores
you are going to use 400MB only for dictionaries, which doesn't seem a good idea to me.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message