lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dawid Weiss (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (LUCENE-3492) Extract a generic framework for running randomized tests.
Date Thu, 06 Oct 2011 11:08:30 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13121842#comment-13121842
] 

Dawid Weiss commented on LUCENE-3492:
-------------------------------------

I've implemented a runner that follows the basic algorithm given in LUCENE-3489. Basically
speaking, seeds for each test run are fixed derivations of a single master seed (used for
the runner and all class-level fixtures) and don't rely on the order of invocations or other
factors.

There's plenty of ways to tweak and tune by overriding class-level @Seed, method-level @Seed.
@Repeat gives you control on how many times a given test is executed and whether a seed is
reused (constant for each iteration) or randomized (predictably from the start seed).

Most of all, everything fits quite nicely in Eclipse (and I hope other GUIs... didn't check
Idea or Netbeans though) because each executed test run is nicely described in the runner
(full seed), so that you can either click on it and re-run a single test or write down the
seed and fix it at runtime.

Lots of TODOs in the code, will continue in the evening.
                
> Extract a generic framework for running randomized tests.
> ---------------------------------------------------------
>
>                 Key: LUCENE-3492
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3492
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: general/test
>            Reporter: Dawid Weiss
>            Assignee: Dawid Weiss
>            Priority: Minor
>             Fix For: 4.0
>
>         Attachments: Screen Shot 2011-10-06 at 12.58.02 PM.png
>
>
> I love the idea of randomized testing. Everyone (we at CarrotSearch, Lucene and Solr
folks) have their glue to make it possible. The question is if there's something to pull out
that others could share without having the need to import Lucene-specific classes.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message