Mailing-List: contact commits-help@harmony.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@harmony.apache.org
Message-ID: <22204442.1190036336687.JavaMail.jira@brutus>
Date: Mon, 17 Sep 2007 06:38:56 -0700 (PDT)
From: "Vladimir Beliaev (JIRA)" <jira@apache.org>
To: commits@harmony.apache.org
Subject: [jira] Commented: (HARMONY-4807) [buildtest][eut] EUT summary
 reporter
In-Reply-To: <6028605.1190036096149.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HARMONY-4807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12528061 ] 

Vladimir Beliaev commented on HARMONY-4807:
-------------------------------------------

Also...

Right now the tests/eut/build.xml contains the sofisticate code which parses output.txt and XML reports, does regexp-based filtering and generates report.txt file. 

The recommended Java-program should do this parsing and output the collected data in to form:

1. index.htm - html summary report with links to suites html reports.

2. report.txt - the text file contating failures/errors/crashes with issue output / messages / stack traces (filtered from output.txt).

Thanks
Vladimir Beliaev

> [buildtest][eut] EUT summary reporter
> -------------------------------------
>
>                 Key: HARMONY-4807
>                 URL: https://issues.apache.org/jira/browse/HARMONY-4807
>             Project: Harmony
>          Issue Type: New Feature
>          Components: build - test - ci
>         Environment: any
>            Reporter: Vladimir Beliaev
>
> For now EUT (both pure and w/ Harmony wrappers) does not generate HTML summary report.
> To get this resolved it is recommended to develop Java-program which includes a SAX-based parser to process XML reports. This solution is preferable because: 
> 1. one checked that (in spite of EUT run produces xml/html reports for suites exist) the junitreport tag does not actually "eat" these reports to produce the summary. 
> 2. there are specific case for EUT - suite crash - when XML report is not generated, so no information to be put in summary report.
> 3. EUT does not operate with Exclude-list, instead one runs all of the EUT and then applies the Excepted Failure List (EFL) to filter out expected failures/errors. Thus two summaries are possible for EUT on Harmony - Relative Summary (which takes EFL into account) and Absolute Summary (which just show the real status of EUT run).
> Thanks
> Vladimir Beliaev

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.