Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@lucene.apache.org
Date: Wed, 14 Dec 2011 02:52:30 +0000 (UTC)
From: "Maciej Lisiewski (Created) (JIRA)" <jira@apache.org>
To: dev@lucene.apache.org
Message-ID: 
 <1915115004.9272.1323831150526.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (SOLR-2968) Hunspell very high memory use when
 loading dictionary
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Hunspell very high memory use when loading dictionary
-----------------------------------------------------

                 Key: SOLR-2968
                 URL: https://issues.apache.org/jira/browse/SOLR-2968
             Project: Solr
          Issue Type: Bug
    Affects Versions: 3.5
            Reporter: Maciej Lisiewski
            Priority: Minor


Hunspell stemmer requires gigantic (for the task) amounts of memory to load dictionary/rules files. 
For example loading a 4.5 MB polish dictionary (with empty index!) will cause whole core to crash with various out of memory errors unless you set max heap size close to 2GB or more.
By comparison Stempel using the same dictionary file works just fine with 1/8 of that (and possibly lower values as well).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org