harmony-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tim Ellison <t.p.elli...@gmail.com>
Subject [test] Mauve results (was: Re: [buildtest] A new adaptor to integrate junit's tests into BTI 2.0)
Date Fri, 31 Aug 2007 10:46:13 GMT
To make things easier to read, I uploaded your results attachments from
HARMONY-4701 to here
   http://people.apache.org/~tellison/mauve/

Regards,
Tim

Sean Qiu wrote:
> To run mauve test, build the mauve test according to its README [1] firstly.
> 
> We can run the tests and  get test report with the command:
> "harmony/jre/bin/java -cp <mauve test classpath>
> gnu.testlet.runner.Mauvelist-harmony"
> 
> To run the single test with debug detail, we can use the command:
> "java Harness -vm harmony/jre/bin/java -verbose -debug -hidecompilefails
> -noexceptions -showpasses  <testfile>"
> 
> Soon, i will supply the adaptor for mauve.
> 
> [1]http://sources.redhat.com/cgi-bin/cvsweb.cgi/~checkout~/mauve/README?rev=
> 1.29&content-type=text/plain&cvsroot=mauve
> 
> 2007/8/31, Sean Qiu <sean.xx.qiu@gmail.com>:
>> I have uploaded the test result [1] with harmony classslib and ibm j9 vm
>> ,since drlvm cannot generate the report.
>> I first find out a list that ri can pass all of the test. (Ri cannot pass
>> all the tests).
>> Then run this list with harmony jre.  The result is as followings [2]
>>
>> I have started to dive into the code to find out the problems.
>> It seems some tests of them are trivial and the reason of failure is due
>> to behavior difference.
>>
>> Later, i will try to run all the tests regardless of ri results.
>>
>> [1] https://issues.apache.org/jira/browse/HARMONY-4701
>> [2] test results
>> Package: Passed: Failed: Total:  java/awt 1946 127 2070     + color 38 0
>> 38     + datatransfer 9 6 14     + dnd 50 1 51     + geom 2650 66 2714
>>    + image 60747 168 60896  java/beans 283 17 297     + beancontext 130 1
>> 130  java/io 651 18 667  java/lang 2049 16 2064     + ref 10 0 10
>>    + reflect 340 1 341  java/math 379 8 387  java/net 834 78 910  java/nio
>> 2944 2 2946     + channels 9 0 9     + charset 34 1 35  java/rmi 20 0 20
>> java/security 160 0 160  java/text 793 39 829
>>    + AttributedCharacterIterator 3 0 3  java/util 6053 16 6068     + jar 5
>> 0 5     + logging 225 1 225     + regex 85 5 90     + zip 179 0 179
>> javax/accessibility 2 0 2  javax/crypto 28 0 28  javax/imageio/plugins 85
>> 0 85  javax/imageio/spi 10 26 15  javax/imageio/stream 8 0 8  javax/naming
>> 65 0 65     + directory 4 0 4  javax/net/ssl 0 3 2  javax/print 47 2 49
>>    + attribute 113 12 125     + attribute/standard 2 0 2
>> javax/security/auth 2 0 2  javax/swing 4169 274 4410     + JInternalFrame
>> 4 0 4     + JList 3 11 8     + JList/AccessibleJList 1 15 1
>>    + JRootPane 15 0 15     + JScrollPane 3 1 4     + JSpinner 49 0 49
>>    + JTable 1 1 1     + JTable/AccessibleJTable 2 2 2     + UIManager 4 0
>> 4     + border 105 7 112     + event 207 19 226     + filechooser 11 0 11
>>    + plaf 31 0 31     + plaf/basic 816 113 921
>>    + plaf/basic/BasicSplitPaneUI 4 0 4     + plaf/metal 345 152 494
>>    + plaf/metal/MetalBorders 24 6 30     + plaf/metal/MetalIconFactory 4 2
>> 6     + table 568 19 579     + table/JTableHeader 0 3 1
>>    + table/JTableHeader/AccessibleJTableHeader 0 13 0     + text 1432 216
>> 1640     + text/AbstractDocument 13 2 14     + text/DefaultStyledDocument
>> 583 4 586     + text/FlowView 0 1 0     + text/html 165 3 168
>>    + text/html/parser 1494 169 1663     + tree 1172 25 1195     + undo 178
>> 17 194  javax/xml 1 0 1     + parsers 1 0 1  org/omg/CORBA 88 7 90
>>    + portable 31 0 31     + 2_3 0 1 1  org/omg/DynamicAny 241 0 241
>> org/omg/IOP 0 1 0  org/omg/PortableServer 6 2 7
>>
>> 2007/8/27, Sean Qiu <sean.xx.qiu@gmail.com>:
>>> Of course, thanks for you help.
>>>
>>> 2007/8/24, Mikhail Loenko <mloenko@gmail.com>:
>>>> Hi Sean,
>>>>
>>>> would you like to try installing regular run of this suite against
>>>> snapshots?
>>>> If you make the results available by some URL, I'd updated the list
>>>> of source URL (@test_results_links in [1]) and results of the testing
>>>> would
>>>> automatically appear in the tables [2,3]
>>>>
>>>> Thanks,
>>>> Mikhail
>>>>
>>>> [1]
>>>> http://people.apache.org/~mloenko/snapshot_testing/script/snapshots.pl<http://people.apache.org/%7Emloenko/snapshot_testing/script/snapshots.pl>
>>>> [2] http://people.apache.org/~mloenko/snapshot_testing/script/snapshots_summary.html
>>>>
>>>> <http://people.apache.org/%7Emloenko/snapshot_testing/script/snapshots_summary.html>
>>>> [3] http://people.apache.org/~mloenko/snapshot_testing/script/r567890/index.html
>>>>
>>>> <http://people.apache.org/%7Emloenko/snapshot_testing/script/r567890/index.html>
>>>>
>>>> 2007/8/24, Sean Qiu < sean.xx.qiu@gmail.com>:
>>>>> 2007/8/23, Alexey Varlamov <alexey.v.varlamov@gmail.com>:
>>>>>
>>>>>> Sean,
>>>>>>
>>>>>> Nice work - I've integrated this JIRA into SVN. I'm curious what
>>>> is
>>>>>
>>>>> Thanks very much.
>>>>>
>>>>> next - TestNG, JMock, Mauve?
>>>>>
>>>>>
>>>>> I have got the test list that we can pass successfully.
>>>>> So i will try mauve first.
>>>>>
>>>>> BTW, the derby 10.3.1.4 finally release, and this one includes the
>>>> derby
>>>>> junit test now. I am trying derby too.
>>>>>
>>>>>
>>>>>> BTW, recalling the XMLReporter issue with Mauve, you can simply
>>>>>> contact their developers and ask for this feature or even provide
>>>>>> ready-to-commit patch. I think it is the best solution.
>>>>>> Good luck, and looking forward for the new adapters!
>>>>>
>>>>> Thanks again. I will try.
>>>>>
>>>>> 2007/8/22, Sean Qiu <sean.xx.qiu@gmail.com>:
>>>>>>> 2007/8/22, Tim Ellison < t.p.ellison@gmail.com>:
>>>>>>>> Sean Qiu wrote:
>>>>>>>>> Hi, guys
>>>>>>>>>
>>>>>>>>> I have wrote a new adaptor to integrate junit's tests
into
>>>> BTI 2.0.
>>>>>>>>> Could someone pls try this patch [1] ?  Thanks.
>>>>>>>>>
>>>>>>>>> [1] https://issues.apache.org/jira/browse/HARMONY-4637
>>>>>>>> I wouldn't know Sean, but hopefully the BTI gurus can
>>>> comment.  I took
>>>>>> a
>>>>>>>> look at the files and it seems remarkably simple to
>>>> incorporate
>>>>>> JUnit's
>>>>>>>> test suites if that is all that is required.
>>>>>>>
>>>>>>>  Yes , i am going to add some other test suites into our BTI.
>>>>>>> And this is the simplest one as a start.
>>>>>>>
>>>>>>> On a different topic, a while ago I suggested that we move the
>>>> 2.0
>>>>>>>> branch to HEAD -- any BTI maintainers still up for it?
>>>>>>>>
>>>>>>>> Regards,
>>>>>>>> Tim
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Sean Qiu
>>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Sean Qiu
>>>>>
>>>
>>>
>>> --
>>> Sean Qiu
>>
>>
>>
>> --
>> Sean Qiu
> 
> 
> 
> 

Mime
View raw message