lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dawid Weiss (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (LUCENE-4406) Print out where tests failed at the end of running the Test Suite
Date Tue, 18 Sep 2012 18:06:07 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13458008#comment-13458008
] 

Dawid Weiss commented on LUCENE-4406:
-------------------------------------

There are a few different ways to do it. I can also modify the default text report to include
such an information, or we could extract it from ANT test XMLs generated during the run (this
can be misleading if there are existing XMLs in the output directory and one runs just a subset
of tests). I wouldn't use "exec grep" because this isn't always available (windows machines).
There is a task for Ant that does it I'm sure (or it can be built).

I think the easiest way would be to include failed tests (or suites?) at the end via an attribute
on the text report in randomized testing. Let me know if you'd want it done this way.
                
> Print out where tests failed at the end of running the Test Suite
> -----------------------------------------------------------------
>
>                 Key: LUCENE-4406
>                 URL: https://issues.apache.org/jira/browse/LUCENE-4406
>             Project: Lucene - Core
>          Issue Type: Bug
>          Components: general/test
>            Reporter: Grant Ingersoll
>            Priority: Minor
>
> It would be nice if, at the end of running ant test, it spit out the names of which tests
failed so that one doesn't have to go scrolling up through the output or go run grep on the
test-reports as a separate step.
> For another project, I use:
> {code}
> <target name="test-summary">
>     <echo>Looking for summaries in: ${build.dir}/test-reports with basedir: ${basedir}</echo>
>     <echo>Errors:</echo>
>     <exec executable="grep">
>             <arg value="-r"/>
>             <arg value="-rl"/>
>             <arg value="errors=\&quot;[1-9]\&quot;"/>
>             <arg value="${build.dir}/test-reports"/>
>     </exec>
>     <echo>Failures:</echo>
>     <exec executable="grep">
>             <arg value="-r"/>
>             <arg value="-rl"/>
>             <arg value="failures=\&quot;[1-9]\&quot;"/>
>             <arg value="${build.dir}/test-reports"/>
>     </exec>
>   </target>
> {code} 
> which can likely be modified for Lucene.  I can do it, but wanted to see if others had
an opinion.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message