lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hoss Man (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (LUCENE-4463) add support for running the same test method many times
Date Fri, 05 Oct 2012 22:44:02 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-4463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13470746#comment-13470746
] 

Hoss Man commented on LUCENE-4463:
----------------------------------

bq. I'll take the (hard to reproduce seed) from http://sierranevada.servebeer.com/job/lucene40-beaster/1327/consoleText,
and add -Dtests.iters=100 to it:

you said "because it does not allow -Dtestmethod" i said "-Dtests.iters definitely works with
-Dtestmethod." ... the reproduce line noted in the url you mentioned doesn't use "-Dtestmethod"
-- it uses "-Dtests.method" which is why you get the helpful error that you need to add a
"*" to that in order to use tests.iters (which is also what it said in the test-help output
i pasted)

if you can settle for reusing the same JVM, tests.iters combined with testmethod (or tests.method=...*)
will give you different _test_ seeds everytime -- only the global seed will be the same 

{noformat}
hossman@frisbee:~/lucene/dev/lucene/core$ ant test -Dtestcase=TestDemo -Dtestmethod=testDemo
-Dtests.iters=100
...
test:
    [mkdir] Created dir: /home/hossman/lucene/dev/lucene/build/core/test
[junit4:junit4] <JUnit4> says ¡Hola! Master seed: 22F7073C01E2726A
[junit4:junit4] Executing 1 suite with 1 JVM.
[junit4:junit4] 
[junit4:junit4] Suite: org.apache.lucene.TestDemo
[junit4:junit4] OK      0.26s | TestDemo.testDemo {#0 seed=[22F7073C01E2726A:5D5BBB89303F587A]}
[junit4:junit4] OK      0.02s | TestDemo.testDemo {#1 seed=[22F7073C01E2726A:E90D077504FD9356]}
[junit4:junit4] OK      0.02s | TestDemo.testDemo {#2 seed=[22F7073C01E2726A:67E491A95539DB9D]}
[junit4:junit4] OK      0.02s | TestDemo.testDemo {#3 seed=[22F7073C01E2726A:560A3A4C39C780B4]}
...
[junit4:junit4] OK      0.01s | TestDemo.testDemo {#97 seed=[22F7073C01E2726A:350464D9D520F10D]}
[junit4:junit4] OK      0.06s | TestDemo.testDemo {#98 seed=[22F7073C01E2726A:F13956B54576EE0E]}
[junit4:junit4] OK      0.01s | TestDemo.testDemo {#99 seed=[22F7073C01E2726A:3BAD13CC4232331D]}
[junit4:junit4] Completed in 3.28s, 100 tests
[junit4:junit4] 
[junit4:junit4] JVM J0:     0.49 ..     4.34 =     3.85s
[junit4:junit4] Execution time total: 4.34 sec.
[junit4:junit4] Tests summary: 1 suite, 100 tests
{noformat}
                
> add support for running the same test method many times
> -------------------------------------------------------
>
>                 Key: LUCENE-4463
>                 URL: https://issues.apache.org/jira/browse/LUCENE-4463
>             Project: Lucene - Core
>          Issue Type: Wish
>          Components: general/build
>            Reporter: Robert Muir
>         Attachments: LUCENE-4463.patch
>
>
> I have a shell script for this, mike has a python script, its annoying :)
> I want to do something like this:
> ant beast -Dtestcase=XXXX -Dtestmethod=YYYY -Diterations=100
> I would be happy with a simple loop that just invokes 'test' somehow: getting a fresh
new JVM to each iteration is desirable anyway (so you get fresh codecs, etc). 
> the -Dtests.iters is not really useful for this because it does not allow -Dtestmethod
and it does not give a fresh jvm.
> bonus points if it can use multiple jvms at the same time though :)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message