commons-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Luc Maisonobe (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MATH-520) Some unit tests fail in "CMAESOptimizerTest"
Date Sun, 20 Feb 2011 08:54:38 GMT

    [ https://issues.apache.org/jira/browse/MATH-520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12997112#comment-12997112
] 

Luc Maisonobe commented on MATH-520:
------------------------------------

Unit test should not fail "sometimes".
As long as they are used in automated tests, they should have deterministic behaviour. This
means that if they use some random drawings, the seed of the generator *must* be set to a
constant value in the unit tests.

Of course, for validation testing, this constraint should be removed to invastigate potential
problems.

I think we have already encountered this kind of problems a few times, in the statistics package
if I remember well.

> Some unit tests fail in "CMAESOptimizerTest"
> --------------------------------------------
>
>                 Key: MATH-520
>                 URL: https://issues.apache.org/jira/browse/MATH-520
>             Project: Commons Math
>          Issue Type: Task
>            Reporter: Gilles
>              Labels: test
>             Fix For: 3.0
>
>
> Out of 28 test runs, "CMAESOptimizerTest" failed 6 times. Those failures were sometimes
in "testMaximize" and sometimes in "testDiagonalRosen".
> Is there some way to reduce the failure ratio?
> Anyways, it would probably be useful to introduce comments for those methods that are
expected to fail sometimes.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message