lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sanne Grinovero <sanne.grinov...@gmail.com>
Subject Re: StressTest: Document not guaranteed to be found after write and commit
Date Wed, 25 Nov 2009 21:28:38 GMT
thanks a lot for looking into it.
It's opened: https://issues.apache.org/jira/browse/LUCENE-2095

Besides this being expected behavior after a commit(), I'm needing
this to be able to assert state consistency on the distributed
Directory under load: any suggestions for a temporary workaround?

I am thinking about a statistical assert, like considering it's fine
if (ratio error < some threshold), but that's my last resort.

Regards,
Sanne


2009/11/25 Michael McCandless <lucene@mikemccandless.com>:
> Indeed I see this test failing too!  On first look the test seems correct.
>
> Can you open an issue & attach this as a patch?  Thanks.
>
> Mike
>
> On Wed, Nov 25, 2009 at 12:30 PM, Sanne Grinovero
> <sanne.grinovero@gmail.com> wrote:
>> Hello,
>> I developed a stress test to assert that a new document containing a
>> specific term "X" is always found after a commit on the IndexWriter.
>> This works most of the time, but it fails under load in rare occasions.
>>
>> I'm testing with 40 Threads, both with a SerialMergeScheduler and a
>> ConcurrentMergeScheduler, all sharing a common IndexWriter.
>> Attached testcase is using a RAMDirectory only, but I verified a
>> FSDirectory behaves in the same way so I don't believe it's the
>> Directory implementation or the MergeScheduler.
>> This test is slow, so I don't consider it a functional or unit test.
>> It might give false positives: it doesn't always fail, sorry I
>> couldn't find out how to make it more likely to happen, besides
>> scheduling it to run for a longer time.
>>
>> Could someone please try it, and suggest if my test is wrong or if I
>> should open a new issue?
>> The patch applies to 2.9.1, I've experienced same behavior on 2.4.1.
>>
>> Best regards,
>> Sanne Grinovero
>>
>> P.S. congratulations with the release of 3.0.0 :-)
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-dev-help@lucene.apache.org
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-dev-help@lucene.apache.org
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message