lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Muir (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (LUCENE-4463) add support for running the same test method many times
Date Sat, 06 Oct 2012 07:38:02 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-4463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13470946#comment-13470946
] 

Robert Muir commented on LUCENE-4463:
-------------------------------------

And just to give a little more background, I mean the stuff we are dealing with is really
crazy in some sense.

You don't see the normal jenkins servers emitting failures: what happened is we realized we
weren't really testing XYZ
that we thought we were testing for months: I'm trying to help make up for lost time :(

So all these failures you have seen this week have been typically nasty-to-debug hard-to-reproduce
long-tail failures
that would normally take a ton of time to show up: Its just been Mike debugging and fixing
and me trying to figure
out more ways to provoke these failures in a more efficient way, like good-cop/bad-cop

                
> add support for running the same test method many times
> -------------------------------------------------------
>
>                 Key: LUCENE-4463
>                 URL: https://issues.apache.org/jira/browse/LUCENE-4463
>             Project: Lucene - Core
>          Issue Type: Wish
>          Components: general/build
>            Reporter: Robert Muir
>         Attachments: LUCENE-4463.patch
>
>
> I have a shell script for this, mike has a python script, its annoying :)
> I want to do something like this:
> ant beast -Dtestcase=XXXX -Dtestmethod=YYYY -Diterations=100
> I would be happy with a simple loop that just invokes 'test' somehow: getting a fresh
new JVM to each iteration is desirable anyway (so you get fresh codecs, etc). 
> the -Dtests.iters is not really useful for this because it does not allow -Dtestmethod
and it does not give a fresh jvm.
> bonus points if it can use multiple jvms at the same time though :)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message