Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of petercheng456@gmail.com
 designates 209.85.142.189 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=from:to:subject:date:message-id:mime-version:content-type
         :content-transfer-encoding:x-mailer:x-mimeole:thread-index;
        b=wN78dgzOQbXdGnHe5veZ0QSh3a9GuORIi6KrCbHC7tvsQiMf9fSGoBzQfAaxyKtBvH
         QfICO5g+k4d+0SA/DeqUQqWocPIKOt5aqKIr7otcYH6f3l/SZlgVB6OnBeiE/bAdJb+k
         BgLHaLw61KkVQIvBt1rHLpPzvbk9z2Xq3WYAI=
From: "Peter Cheng" <petercheng456@gmail.com>
To: <java-user@lucene.apache.org>
Subject: Memory eaten up by String, Term and TermInfo?
Date: Sun, 14 Sep 2008 21:58:24 +0800
Message-ID: <02dc01c91671$f813ea20$8c458c0a@gcheng>
MIME-Version: 1.0
Content-Type: text/plain;
	charset="utf-8"
Content-Transfer-Encoding: quoted-printable
Thread-Index: AckWcfR0rdumEV7YTsuUkZRVn/IDJQ==

Hi the community,

In a Tomcat application (a keyword-based search engine), I use Lucene =
2.3.2 to index 60 million documents, but each document is small-sized. =
The total index size is about 60GB.
After a successful running for a week, Tomcat was down due to =
OutOfMemory. Then I restarted Tomcat, and after three days, I used jmap =
and jhat to find out what had eaten up the memory. I found millions of =
instances of String, Term, and TermInfo. Why?

In my application, I use a single IndexSearcher object, which is shared =
by all the requests. It is opened initially, and will never be closed.

What could have eaten up the memory? What is referring to millions of =
instances of Term and TermInfo?

I can provide any snippets of codes if necessary.
Thank you so much!

Gong Cheng


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org