From java-user-return-24958-apmail-lucene-java-user-archive=lucene.apache.org@lucene.apache.org Tue Dec 12 04:27:54 2006 Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 26628 invoked from network); 12 Dec 2006 04:27:53 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 12 Dec 2006 04:27:53 -0000 Received: (qmail 72371 invoked by uid 500); 12 Dec 2006 04:27:54 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 72337 invoked by uid 500); 12 Dec 2006 04:27:54 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 72326 invoked by uid 99); 12 Dec 2006 04:27:54 -0000 Received: from herse.apache.org (HELO herse.apache.org) (140.211.11.133) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 Dec 2006 20:27:54 -0800 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (herse.apache.org: domain of yseeley@gmail.com designates 64.233.182.187 as permitted sender) Received: from [64.233.182.187] (HELO nf-out-0910.google.com) (64.233.182.187) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 Dec 2006 20:27:44 -0800 Received: by nf-out-0910.google.com with SMTP id n28so169256nfc for ; Mon, 11 Dec 2006 20:27:22 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:sender:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; b=Bj8sbv2YFSW1CCsm+DUfQWBvto9EMIhZImHXmpLvreaNcTKefIkcTkZpLxi8ukL6XAZq2ZLHRlP3gHMxvXgV+ULfSL9q7o4dCi8lYf4VvuIUHOdH0tT0ELQINWmI0M82sdY3Yx2e9kXoLXksRMqDoKMzsa8yRZbJ7QnXjFklUcE= Received: by 10.82.120.15 with SMTP id s15mr585077buc.1165897642454; Mon, 11 Dec 2006 20:27:22 -0800 (PST) Received: by 10.82.149.12 with HTTP; Mon, 11 Dec 2006 20:27:22 -0800 (PST) Message-ID: Date: Mon, 11 Dec 2006 23:27:22 -0500 From: "Yonik Seeley" Sender: yseeley@gmail.com To: java-user@lucene.apache.org Subject: Re: SegmentReader using too much memory? In-Reply-To: <457E2EF1.9080403@isb-sib.ch> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <457DE387.4090601@isb-sib.ch> <457E14F6.8050806@isb-sib.ch> <457E2EF1.9080403@isb-sib.ch> X-Google-Sender-Auth: 4dd26a3e7e93f887 X-Virus-Checked: Checked by ClamAV on apache.org On 12/11/06, Eric Jain wrote: > Yonik Seeley wrote: > > There is no real document boost at the index level... it is simply > > multiplied into the boost for every field of that document. So it > > comes down to what fields you want that index-time boost to take > > effect on (as well as length normalization). > > Come to think of it, I do have two large indexes that don't really need any > document boosting, could perhaps save some memory there... > > But what I still don't understand is why the amount of memory that is used > by SegmentReader.Norm.bytes keeps growing -- at first quite fast to about > 150mb, then slower. It's read on demand, per indexed field. So assuming your index is optimized (a single segment), then it increases by one byte[] each time you search on a new field. -Yonik http://incubator.apache.org/solr Solr, the open-source Lucene search server --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org