lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mark Harwood (JIRA)" <>
Subject [jira] [Commented] (LUCENE-4275) Threaded tests with MockDirectoryWrapper delete active PostingFormat files
Date Tue, 31 Jul 2012 16:27:33 GMT


Mark Harwood commented on LUCENE-4275:

Thanks, Rob. This test requires a call to "ant clean" between each run before it will consistently
work. However, I don't consider that a fix and assume that we are still looking for a bug
here as there's an index consistency issue lurking somewhere here. I've tried adding the setting but the test still looks to have some "memory" between runs.

I added some logging of creates and deletes as you suggest and it looks like on a second,
un-cleansed run, my PF is being called to open a high-numbered segment which I suspect was
created by an earlier run as the logging doesn't show signs of the PF being asked to created
content for this (or any other) segment as part of the current run. At this point it fails
as there is no longer a copy of  the "foobar" file listed by the directory.
I have noticed in the logs from previous runs MDW is asked to delete the segment's "foobar"
file by IndexWriter as part of compaction into a compound CFS.

Hope this sheds some light as I'm finding this a complex one to debug.

> Threaded tests with MockDirectoryWrapper delete active PostingFormat files
> --------------------------------------------------------------------------
>                 Key: LUCENE-4275
>                 URL:
>             Project: Lucene - Core
>          Issue Type: Bug
>          Components: core/codecs, general/test
>    Affects Versions: 4.0-ALPHA
>         Environment: Win XP 64bit Sun JDK 1.6
>            Reporter: Mark Harwood
>             Fix For: 4.0
>         Attachments: Lucene-4275-TestClass.patch
> As part of testing Lucene-4069 I have encountered sporadic issues with files going missing.
I believe this is a bug in the test framework (multi-threading issues in MockDirectoryWrapper?)
so have raised a separate issue with simplified test PostingFormat class here.
> Using this test PF will fail due to a missing file roughly one in four times of executing
this test:
> ant test-core  -Dtestcase=TestIndexWriterCommit -Dtests.method=testCommitThreadSafety
-Dtests.seed=EA320250471B75AE -Dtests.slow=true -Dtests.postingsformat=TestNonCoreDummyPostingsFormat
-Dtests.locale=no -Dtests.timezone=Europe/Belfast -Dtests.file.encoding=UTF-8 

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message