lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dawid Weiss (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SOLR-3766) A test group and build plan for known unstable tests
Date Mon, 17 Sep 2012 21:41:08 GMT

    [ https://issues.apache.org/jira/browse/SOLR-3766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13457371#comment-13457371
] 

Dawid Weiss commented on SOLR-3766:
-----------------------------------

bq. These tests should not be excluded from the normal non-jenkins command line "ant test"

I think the point is to exclude known flaky tests from "ant test" runs so that people running
precommit tests or something don't have to re-run their tests because a known offender failed.
One can enable them on the build server (that's why I created a separate plan) where time
is of no crucial importance and which can either not send e-mails or send them tagged so that
people can ignore them (as I'm sure most of us already do, unfortunately).

Anyway, I give up on trying to improve this situation. There is a non-intersecting set of
strongly defended positions and I don't see a solution for this.

                
> A test group and build plan for known unstable tests
> ----------------------------------------------------
>
>                 Key: SOLR-3766
>                 URL: https://issues.apache.org/jira/browse/SOLR-3766
>             Project: Solr
>          Issue Type: Task
>            Reporter: Dawid Weiss
>            Assignee: Dawid Weiss
>            Priority: Minor
>
> As discussed on the mailing list and suggested by Hoss:
> {code}
>  1) slap a special "@UnstableTest" annotation on them
>  2) set up a new jenkins job that *only* runs these @UnstableTest jobs
>  3) configure this new jenkins job to not send any email
> {code}
> Point 1 is trivial, 2 I have filed an issue for in the runner --
> https://github.com/carrotsearch/randomizedtesting/issues/122
> that I will take care of shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message