Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
MIME-Version: 1.0
In-Reply-To: <BANLkTimh8E-eCfu00nqhDfJD06ZnEgQBdw@mail.gmail.com>
References: <BANLkTinX=wFsYDHtnQ5aiDVCpEXp3UfWJA@mail.gmail.com>
	<BANLkTi=cEthzMYQ8Vn4_oSNWd3fohs1RZg@mail.gmail.com>
	<347589.95733.qm@web130102.mail.mud.yahoo.com>
	<BANLkTikZgUcQuHRAVmFZeP0hEMLMoF2OVA@mail.gmail.com>
	<BANLkTincBCeZ-RDK71cVbwuH1Xv7_Wmwew@mail.gmail.com>
	<BANLkTins1T5V6+aKAtqX5BGhQrv9pT_9zA@mail.gmail.com>
	<BANLkTimh8E-eCfu00nqhDfJD06ZnEgQBdw@mail.gmail.com>
Date: Wed, 4 May 2011 08:21:54 -0400
Message-ID: <BANLkTimg03kB37btGAng3LUpNsG69pM5jw@mail.gmail.com>
Subject: Re: MultiPhraseQuery slowing down over time in Lucene 3.1
From: Michael McCandless <lucene@mikemccandless.com>
To: java-user@lucene.apache.org
Content-Type: text/plain; charset=ISO-8859-1

OK, phew :)  Thanks for bringing closure...

Mike

http://blog.mikemccandless.com

On Wed, May 4, 2011 at 6:52 AM, Tomislav Poljak <tpoljak@gmail.com> wrote:
> Hi,
> seems there is a custom impl of MultiPhraseQuery used in the system,
> which uses (and maybe misuses) Lucene's MultiPhraseQuery that could be
> the reason of slowdown. I've tried running sample Lucene's
> MultiPhraseQuery in an infinite while loop printing out times for
> every 1000 executions and couldn't reproduce slowdown.
>
> Thanks for provided assistance,
>
> Tomislav
>
>
> 2011/5/3 Michael McCandless <lucene@mikemccandless.com>:
>> On Tue, May 3, 2011 at 7:43 AM, Tomislav Poljak <tpoljak@gmail.com> wrote:
>>> Hi,
>>>
>>> 2011/5/3 Michael McCandless <lucene@mikemccandless.com>:
>>>> I feel like we are back to Basic ;)
>>>>
>>>> If you keep running line 40 over and over on the same memory index, do
>>>> you see a slowdown?
>>>
>>> Yes. I've tested running same query list (~3,5 k queries) on the same
>>> MemoryIndex instance and after a while iterations get slower and
>>> slower. Same thing happens when running queries on the same instance
>>> of RAMDir based index holding only one doc. But, if I remove
>>> MultiPhraseQuery type of queries from the query list then speed of
>>> execution is the same, meaning execution time for other queries is
>>> constant and it doesn't grow over time (as it would be expected).
>>>
>>> I've tried to run tests with the latest 3.1 branch as Uwe suggested
>>> (checkout and built today) and slowdown is still present when
>>> MultiPhraseQuery type of queries are included (not removed from the
>>> query list).
>>
>> Spooky!
>>
>> Can you boil this into a contained test case?
>>
>> Mike
>>
>> http://blog.mikemccandless.com
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org