lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael McCandless <luc...@mikemccandless.com>
Subject Re: MultiPhraseQuery slowing down over time in Lucene 3.1
Date Wed, 04 May 2011 12:21:54 GMT
OK, phew :)  Thanks for bringing closure...

Mike

http://blog.mikemccandless.com

On Wed, May 4, 2011 at 6:52 AM, Tomislav Poljak <tpoljak@gmail.com> wrote:
> Hi,
> seems there is a custom impl of MultiPhraseQuery used in the system,
> which uses (and maybe misuses) Lucene's MultiPhraseQuery that could be
> the reason of slowdown. I've tried running sample Lucene's
> MultiPhraseQuery in an infinite while loop printing out times for
> every 1000 executions and couldn't reproduce slowdown.
>
> Thanks for provided assistance,
>
> Tomislav
>
>
> 2011/5/3 Michael McCandless <lucene@mikemccandless.com>:
>> On Tue, May 3, 2011 at 7:43 AM, Tomislav Poljak <tpoljak@gmail.com> wrote:
>>> Hi,
>>>
>>> 2011/5/3 Michael McCandless <lucene@mikemccandless.com>:
>>>> I feel like we are back to Basic ;)
>>>>
>>>> If you keep running line 40 over and over on the same memory index, do
>>>> you see a slowdown?
>>>
>>> Yes. I've tested running same query list (~3,5 k queries) on the same
>>> MemoryIndex instance and after a while iterations get slower and
>>> slower. Same thing happens when running queries on the same instance
>>> of RAMDir based index holding only one doc. But, if I remove
>>> MultiPhraseQuery type of queries from the query list then speed of
>>> execution is the same, meaning execution time for other queries is
>>> constant and it doesn't grow over time (as it would be expected).
>>>
>>> I've tried to run tests with the latest 3.1 branch as Uwe suggested
>>> (checkout and built today) and slowdown is still present when
>>> MultiPhraseQuery type of queries are included (not removed from the
>>> query list).
>>
>> Spooky!
>>
>> Can you boil this into a contained test case?
>>
>> Mike
>>
>> http://blog.mikemccandless.com
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message