Return-Path: Delivered-To: apmail-lucene-solr-dev-archive@minotaur.apache.org Received: (qmail 58582 invoked from network); 15 Jun 2009 17:36:28 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 15 Jun 2009 17:36:28 -0000 Received: (qmail 17238 invoked by uid 500); 15 Jun 2009 17:36:39 -0000 Delivered-To: apmail-lucene-solr-dev-archive@lucene.apache.org Received: (qmail 17175 invoked by uid 500); 15 Jun 2009 17:36:39 -0000 Mailing-List: contact solr-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-dev@lucene.apache.org Delivered-To: mailing list solr-dev@lucene.apache.org Received: (qmail 17165 invoked by uid 99); 15 Jun 2009 17:36:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 15 Jun 2009 17:36:39 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 15 Jun 2009 17:36:28 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 68E3E234C045 for ; Mon, 15 Jun 2009 10:36:07 -0700 (PDT) Message-ID: <55508945.1245087367428.JavaMail.jira@brutus> Date: Mon, 15 Jun 2009 10:36:07 -0700 (PDT) From: "Mark Miller (JIRA)" To: solr-dev@lucene.apache.org Subject: [jira] Updated: (SOLR-1150) OutofMemoryError on enabling highlighting In-Reply-To: <1154525133.1241695170420.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/SOLR-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Miller updated SOLR-1150: ------------------------------ Attachment: SOLR-1150.patch > OutofMemoryError on enabling highlighting > ----------------------------------------- > > Key: SOLR-1150 > URL: https://issues.apache.org/jira/browse/SOLR-1150 > Project: Solr > Issue Type: Improvement > Components: highlighter > Affects Versions: 1.4 > Reporter: Siddharth Gargate > Assignee: Mark Miller > Fix For: 1.4 > > Attachments: SOLR-1150.patch, SOLR-1150.patch > > > Please refer to following mail thread > http://markmail.org/message/5nhkm5h3ongqlput > I am testing with 2MB document size and just 500 documents. Indexing is working fine even with 128MB heap size. But on searching Solr throws OOM error. This issue is observed only when we enable highlighting. While indexing I am storing 1 MB text. While searching Solr reads all the 500 documents in the memory. It also reads the complete 1 MB stored field in the memory for all 500 documents. Due to this 500 docs * 1 MB * 2 (2 bytes per char) = 1000 MB memory is required for searching. > This memory usage can be reduced by reading one document at a time. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.