Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 39297 invoked from network); 17 Jun 2009 20:02:20 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 17 Jun 2009 20:02:20 -0000 Received: (qmail 45463 invoked by uid 500); 17 Jun 2009 20:02:29 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 45415 invoked by uid 500); 17 Jun 2009 20:02:29 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 45405 invoked by uid 99); 17 Jun 2009 20:02:29 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 Jun 2009 20:02:29 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of peterlkeegan@gmail.com designates 74.125.78.27 as permitted sender) Received: from [74.125.78.27] (HELO ey-out-2122.google.com) (74.125.78.27) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 Jun 2009 20:02:19 +0000 Received: by ey-out-2122.google.com with SMTP id 25so94395eya.53 for ; Wed, 17 Jun 2009 13:01:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type; bh=CRzzNpX2EgZCkhHY4nh0o2ak106ktfvM39Lxb0zlbSQ=; b=WcmHWi+/Cv30eyEmSz3Cp+yxgWQyh2g/2qZC1PxkrhdGE7b50kYCv49RNo2VIAkFhk e3aoJxmX4tuJRSAAS2Ilk3Puq3if+gpNxrZS8mavKx/82mqFaLRuZrglsPgsqdynLSWU ++62NDLH4pm2O6ALSdQvul7Beca6mbFQJn6eU= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=CmTFleond4wuOa/szG6+DPwvJikPU+iShwRAMwq9lCrBr+VWI9JaPlrX36AEbGkdhc evTOqY0a3K9Z08u5Gf/mF9owJQEcvTjpWaSrA6miLsfWe5RZr66SqCZSieDAyvVfB76o GCxEMnX15cBttryQS8fvvEYu+AM4oiZCqfp74= MIME-Version: 1.0 Received: by 10.210.33.3 with SMTP id g3mr698987ebg.41.1245268917861; Wed, 17 Jun 2009 13:01:57 -0700 (PDT) In-Reply-To: References: <359a92830906170909w2d18d0c4g780e0064841a8249@mail.gmail.com> Date: Wed, 17 Jun 2009 16:01:57 -0400 Message-ID: Subject: Re: Lucene performance: is search time linear to the index size? From: Peter Keegan To: java-user@lucene.apache.org Content-Type: multipart/alternative; boundary=0015174c19827fbee0046c90c32f X-Virus-Checked: Checked by ClamAV on apache.org --0015174c19827fbee0046c90c32f Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit There is a similar discussion on this topic here: http://www.gossamer-threads.com/lists/lucene/java-user/42824?search_string=Lucene%20search%20performance%3A%20linear%3F;#42824 or: *http://tinyurl.com/lpp3hf* On Wed, Jun 17, 2009 at 1:18 PM, Teruhiko Kurosaka wrote: > Thank you, Ian and Erick, > > This is a stand-alone search application that runs a query > and exits, as opposed to the typical web-based search program. > > > The query is consists of combination of SpanQuery, TermQuery, > BooleanClause, SpanNearQuery, and SpanTermQuery. > I get the top 50 hits at most and no fancy assembly of output is done. > I'm measuring the time from the start to finish of this application, > and the profile result shows the most time is spent inside Lucene. > > > -kuro > > > -----Original Message----- > > From: Erick Erickson [mailto:erickerickson@gmail.com] > > Sent: Wednesday, June 17, 2009 9:09 AM > > To: java-user@lucene.apache.org > > Subject: Re: Lucene performance: is search time linear to the > > index size? > > > > Are you measuring search time *only* or are you measuring > > total response time including assembling whatever you > > assemble? If you're measuring total response time, everything > > from network latency to what you're doing with each hit may > > affect response time. > > > > This is especially true if you're iterating over a Hits object. > > > > It would be helpful if you showed us the snippet that you use > > to measure. > > > > Best > > Erick > > > > On Wed, Jun 17, 2009 at 4:47 PM, Teruhiko Kurosaka > > wrote: > > > > > I am seeing my Lucene application's search time grows pretty much > > > linearly to the number of Documents. > > > Is this how Lucene is supposed to work, or does it depend on the > > > nature of query? > > > > > > I am not using FuzzyQuery that was the subject of the recent > > > discussion by the way. > > > > > > -Kuro > > > > > > > > --------------------------------------------------------------------- > > > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org > > > For additional commands, e-mail: java-user-help@lucene.apache.org > > > > > > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org > For additional commands, e-mail: java-user-help@lucene.apache.org > > --0015174c19827fbee0046c90c32f--