Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 75019 invoked from network); 18 Nov 2005 02:38:53 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 18 Nov 2005 02:38:53 -0000 Received: (qmail 49674 invoked by uid 500); 18 Nov 2005 02:38:47 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 49646 invoked by uid 500); 18 Nov 2005 02:38:47 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 49635 invoked by uid 99); 18 Nov 2005 02:38:46 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 Nov 2005 18:38:46 -0800 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received-SPF: pass (asf.osuosl.org: local policy) Received: from [210.50.55.251] (HELO file1.syd.nuix.com.au) (210.50.55.251) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 Nov 2005 18:40:19 -0800 Received: from [192.168.222.102] (host102.syd.nuix.com.au [192.168.222.102]) by file1.syd.nuix.com.au (Postfix) with ESMTP id D7101B7359 for ; Fri, 18 Nov 2005 13:38:21 +1100 (EST) Message-ID: <437D4021.2020104@nuix.com.au> Date: Fri, 18 Nov 2005 13:44:49 +1100 From: Daniel Noll Organization: NUIX Pty Limited User-Agent: Mozilla Thunderbird 1.0.7 (Windows/20050923) X-Accept-Language: en-us, en MIME-Version: 1.0 To: java-user@lucene.apache.org Subject: Re: Memory Usage References: <437298F1.40205@nuix.com.au> <4377F240.4090004@nuix.com.au> <5E565757-B7D3-4CC7-A92A-CE8A7A94E967@rectangular.com> <4378C708.2070909@apache.org> <437AB3DD.8060704@nuix.com.au> <437B9DB7.4010009@apache.org> <437BBC15.4090901@nuix.com.au> <437CB806.5080108@apache.org> <437D1D5C.80801@nuix.com.au> <437D1F81.2080801@apache.org> In-Reply-To: <437D1F81.2080801@apache.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N Doug Cutting wrote: > Daniel Noll wrote: > >> Doug Cutting wrote: >> >>> Daniel Noll wrote: >>> >>>> I actually did throw a lot of terms in, and eventually chose "one" >>>> for the tests because it was the slowest query to complete of them >>>> all (hence I figured it was already spending some fairly long time >>>> in I/O, and would be penalised the most.) Every other query was >>>> around 7ms before tweaking, and the tweak increased them all to >>>> somewhere around 10ms but that's still a lot faster than "one" was >>>> even at its fastest. >>> >>> >>> Different terms are affected differently by this tweak, so results >>> for a single term don't reveal much. >> >> >> >> Hence why I just said: "I actually did throw a lot of terms in". > > > I'm confused. I'm talking about the table of results you posted. You > measured only a single term in those, no? I don't think results for a > single term are representative. If it is term 127 then it will be > slower than average with an indexInterval of 128, and will be faster > than average with an indexInterval of 16k. So to get numbers that are > representative of an average term at multiple indexIntervals you need > to test with many terms. Am I missing something? "Every other query was around 7ms before tweaking, and the tweak increased them all to somewhere around 10ms but that's still a lot faster than "one" was even at its fastest. " In other words, I didn't publish the results for all the other ones, because all the fast ones were exactly the same as "test". "one" was the only interesting term. Daniel -- Daniel Noll NUIX Pty Ltd Level 8, 143 York Street, Sydney 2000 Phone: (02) 9283 9010 Fax: (02) 9283 9020 This message is intended only for the named recipient. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this message or attachment is strictly prohibited. --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org