lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael McCandless <luc...@mikemccandless.com>
Subject Re: MultiPhraseQuery slowing down over time in Lucene 3.1
Date Tue, 03 May 2011 09:48:38 GMT
I feel like we are back to Basic ;)

If you keep running line 40 over and over on the same memory index, do
you see a slowdown?

Mike

http://blog.mikemccandless.com

On Mon, May 2, 2011 at 1:19 PM, Otis Gospodnetic
<otis_gospodnetic@yahoo.com> wrote:
> Hi,
>
> I think this describes what's going on:
>
> 10 load N stored queries
> 20 parse N stored queries, keep them in some List forever
> 30 for each incoming document create a new MemoryIndex instance "mi"
> 40 for query 1 to N do mi.search(query)
>
> Over time this step 40 takes longer and longer and longer -- if some of the
> queries are MultiPhraseQueries.  This is even with with mergeSort being used in
> MultiPhraseQuery.
>
> Otis
> ----
> Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
> Lucene ecosystem search :: http://search-lucene.com/
>
>
>
> ----- Original Message ----
>> From: Michael McCandless <lucene@mikemccandless.com>
>> To: java-user@lucene.apache.org
>> Sent: Mon, May 2, 2011 12:15:40 PM
>> Subject: Re: MultiPhraseQuery slowing down over time in Lucene 3.1
>>
>> By "slowing down over time" do you mean you use the same index (no new
>> docs  added) yet running the same MPQ over and over you see it taking
>> longer to  execute over time?
>>
>> Mike
>>
>> http://blog.mikemccandless.com
>>
>> On Mon, May 2, 2011 at  12:00 PM, Tomislav Poljak <tpoljak@gmail.com> wrote:
>> >  Hi,
>> > after running tests on both MemoryIndex and RAMDirectory based  index
>> > in Lucene 3.1, seems MultiPhraseQueries are slowing down over  time
>> > (each iteration of executing the same MultiPhraseQueries on the  same
>> > doc, seems to require more and more execution time). Are there  any
>> > existing/known issues related to the MultiPhraseQuery in Lucene  3.1
>> > which could lead to this performance drop?
>> >
>> >  Tomislav
>> >
>> >  ---------------------------------------------------------------------
>> > To  unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> >  For additional commands, e-mail: java-user-help@lucene.apache.org
>> >
>> >
>>
>> ---------------------------------------------------------------------
>> To  unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For  additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message