lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Otis Gospodnetic <otis_gospodne...@yahoo.com>
Subject Re: MultiPhraseQuery slowing down over time in Lucene 3.1
Date Mon, 02 May 2011 17:19:10 GMT
Hi,

I think this describes what's going on:

10 load N stored queries
20 parse N stored queries, keep them in some List forever
30 for each incoming document create a new MemoryIndex instance "mi"
40 for query 1 to N do mi.search(query)

Over time this step 40 takes longer and longer and longer -- if some of the 
queries are MultiPhraseQueries.  This is even with with mergeSort being used in 
MultiPhraseQuery.

Otis
----
Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecosystem search :: http://search-lucene.com/



----- Original Message ----
> From: Michael McCandless <lucene@mikemccandless.com>
> To: java-user@lucene.apache.org
> Sent: Mon, May 2, 2011 12:15:40 PM
> Subject: Re: MultiPhraseQuery slowing down over time in Lucene 3.1
> 
> By "slowing down over time" do you mean you use the same index (no new
> docs  added) yet running the same MPQ over and over you see it taking
> longer to  execute over time?
> 
> Mike
> 
> http://blog.mikemccandless.com
> 
> On Mon, May 2, 2011 at  12:00 PM, Tomislav Poljak <tpoljak@gmail.com> wrote:
> >  Hi,
> > after running tests on both MemoryIndex and RAMDirectory based  index
> > in Lucene 3.1, seems MultiPhraseQueries are slowing down over  time
> > (each iteration of executing the same MultiPhraseQueries on the  same
> > doc, seems to require more and more execution time). Are there  any
> > existing/known issues related to the MultiPhraseQuery in Lucene  3.1
> > which could lead to this performance drop?
> >
> >  Tomislav
> >
> >  ---------------------------------------------------------------------
> > To  unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> >  For additional commands, e-mail: java-user-help@lucene.apache.org
> >
> >
> 
> ---------------------------------------------------------------------
> To  unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For  additional commands, e-mail: java-user-help@lucene.apache.org
> 
> 

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message