harmony-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vladimir Beliaev (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HARMONY-4807) [buildtest][eut] EUT summary reporter
Date Mon, 17 Sep 2007 13:38:56 GMT

    [ https://issues.apache.org/jira/browse/HARMONY-4807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12528061
] 

Vladimir Beliaev commented on HARMONY-4807:
-------------------------------------------

Also...

Right now the tests/eut/build.xml contains the sofisticate code which parses output.txt and
XML reports, does regexp-based filtering and generates report.txt file. 

The recommended Java-program should do this parsing and output the collected data in to form:

1. index.htm - html summary report with links to suites html reports.

2. report.txt - the text file contating failures/errors/crashes with issue output / messages
/ stack traces (filtered from output.txt).

Thanks
Vladimir Beliaev

> [buildtest][eut] EUT summary reporter
> -------------------------------------
>
>                 Key: HARMONY-4807
>                 URL: https://issues.apache.org/jira/browse/HARMONY-4807
>             Project: Harmony
>          Issue Type: New Feature
>          Components: build - test - ci
>         Environment: any
>            Reporter: Vladimir Beliaev
>
> For now EUT (both pure and w/ Harmony wrappers) does not generate HTML summary report.
> To get this resolved it is recommended to develop Java-program which includes a SAX-based
parser to process XML reports. This solution is preferable because: 
> 1. one checked that (in spite of EUT run produces xml/html reports for suites exist)
the junitreport tag does not actually "eat" these reports to produce the summary. 
> 2. there are specific case for EUT - suite crash - when XML report is not generated,
so no information to be put in summary report.
> 3. EUT does not operate with Exclude-list, instead one runs all of the EUT and then applies
the Excepted Failure List (EFL) to filter out expected failures/errors. Thus two summaries
are possible for EUT on Harmony - Relative Summary (which takes EFL into account) and Absolute
Summary (which just show the real status of EUT run).
> Thanks
> Vladimir Beliaev

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message