harmony-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Qiu" <sean.xx....@gmail.com>
Subject Re: [buildtest] A new adaptor to integrate junit's tests into BTI 2.0
Date Fri, 31 Aug 2007 10:12:31 GMT
To run mauve test, build the mauve test according to its README [1] firstly.

We can run the tests and  get test report with the command:
"harmony/jre/bin/java -cp <mauve test classpath>
gnu.testlet.runner.Mauvelist-harmony"

To run the single test with debug detail, we can use the command:
"java Harness -vm harmony/jre/bin/java -verbose -debug -hidecompilefails
-noexceptions -showpasses  <testfile>"

Soon, i will supply the adaptor for mauve.

[1]http://sources.redhat.com/cgi-bin/cvsweb.cgi/~checkout~/mauve/README?rev=
1.29&content-type=text/plain&cvsroot=mauve

2007/8/31, Sean Qiu <sean.xx.qiu@gmail.com>:
>
> I have uploaded the test result [1] with harmony classslib and ibm j9 vm
> ,since drlvm cannot generate the report.
> I first find out a list that ri can pass all of the test. (Ri cannot pass
> all the tests).
> Then run this list with harmony jre.  The result is as followings [2]
>
> I have started to dive into the code to find out the problems.
> It seems some tests of them are trivial and the reason of failure is due
> to behavior difference.
>
> Later, i will try to run all the tests regardless of ri results.
>
> [1] https://issues.apache.org/jira/browse/HARMONY-4701
> [2] test results
> Package: Passed: Failed: Total:  java/awt 1946 127 2070     + color 38 0
> 38     + datatransfer 9 6 14     + dnd 50 1 51     + geom 2650 66 2714
>    + image 60747 168 60896  java/beans 283 17 297     + beancontext 130 1
> 130  java/io 651 18 667  java/lang 2049 16 2064     + ref 10 0 10
>    + reflect 340 1 341  java/math 379 8 387  java/net 834 78 910  java/nio
> 2944 2 2946     + channels 9 0 9     + charset 34 1 35  java/rmi 20 0 20
> java/security 160 0 160  java/text 793 39 829
>    + AttributedCharacterIterator 3 0 3  java/util 6053 16 6068     + jar 5
> 0 5     + logging 225 1 225     + regex 85 5 90     + zip 179 0 179
> javax/accessibility 2 0 2  javax/crypto 28 0 28  javax/imageio/plugins 85
> 0 85  javax/imageio/spi 10 26 15  javax/imageio/stream 8 0 8  javax/naming
> 65 0 65     + directory 4 0 4  javax/net/ssl 0 3 2  javax/print 47 2 49
>    + attribute 113 12 125     + attribute/standard 2 0 2
> javax/security/auth 2 0 2  javax/swing 4169 274 4410     + JInternalFrame
> 4 0 4     + JList 3 11 8     + JList/AccessibleJList 1 15 1
>    + JRootPane 15 0 15     + JScrollPane 3 1 4     + JSpinner 49 0 49
>    + JTable 1 1 1     + JTable/AccessibleJTable 2 2 2     + UIManager 4 0
> 4     + border 105 7 112     + event 207 19 226     + filechooser 11 0 11
>    + plaf 31 0 31     + plaf/basic 816 113 921
>    + plaf/basic/BasicSplitPaneUI 4 0 4     + plaf/metal 345 152 494
>    + plaf/metal/MetalBorders 24 6 30     + plaf/metal/MetalIconFactory 4 2
> 6     + table 568 19 579     + table/JTableHeader 0 3 1
>    + table/JTableHeader/AccessibleJTableHeader 0 13 0     + text 1432 216
> 1640     + text/AbstractDocument 13 2 14     + text/DefaultStyledDocument
> 583 4 586     + text/FlowView 0 1 0     + text/html 165 3 168
>    + text/html/parser 1494 169 1663     + tree 1172 25 1195     + undo 178
> 17 194  javax/xml 1 0 1     + parsers 1 0 1  org/omg/CORBA 88 7 90
>    + portable 31 0 31     + 2_3 0 1 1  org/omg/DynamicAny 241 0 241
> org/omg/IOP 0 1 0  org/omg/PortableServer 6 2 7
>
> 2007/8/27, Sean Qiu <sean.xx.qiu@gmail.com>:
> >
> > Of course, thanks for you help.
> >
> > 2007/8/24, Mikhail Loenko <mloenko@gmail.com>:
> > >
> > > Hi Sean,
> > >
> > > would you like to try installing regular run of this suite against
> > > snapshots?
> > > If you make the results available by some URL, I'd updated the list
> > > of source URL (@test_results_links in [1]) and results of the testing
> > > would
> > > automatically appear in the tables [2,3]
> > >
> > > Thanks,
> > > Mikhail
> > >
> > > [1]
> > > http://people.apache.org/~mloenko/snapshot_testing/script/snapshots.pl<http://people.apache.org/%7Emloenko/snapshot_testing/script/snapshots.pl>
> > > [2] http://people.apache.org/~mloenko/snapshot_testing/script/snapshots_summary.html
> > >
> > > <http://people.apache.org/%7Emloenko/snapshot_testing/script/snapshots_summary.html>
> > > [3] http://people.apache.org/~mloenko/snapshot_testing/script/r567890/index.html
> > >
> > > <http://people.apache.org/%7Emloenko/snapshot_testing/script/r567890/index.html>
> > >
> > > 2007/8/24, Sean Qiu < sean.xx.qiu@gmail.com>:
> > > > 2007/8/23, Alexey Varlamov <alexey.v.varlamov@gmail.com>:
> > > >
> > > > > Sean,
> > > > >
> > > > > Nice work - I've integrated this JIRA into SVN. I'm curious what
> > > is
> > > >
> > > >
> > > > Thanks very much.
> > > >
> > > > next - TestNG, JMock, Mauve?
> > > >
> > > >
> > > > I have got the test list that we can pass successfully.
> > > > So i will try mauve first.
> > > >
> > > > BTW, the derby 10.3.1.4 finally release, and this one includes the
> > > derby
> > > > junit test now. I am trying derby too.
> > > >
> > > >
> > > > > BTW, recalling the XMLReporter issue with Mauve, you can simply
> > > > > contact their developers and ask for this feature or even provide
> > > > > ready-to-commit patch. I think it is the best solution.
> > > > > Good luck, and looking forward for the new adapters!
> > > >
> > > >
> > > > Thanks again. I will try.
> > > >
> > > > 2007/8/22, Sean Qiu <sean.xx.qiu@gmail.com>:
> > > > > > 2007/8/22, Tim Ellison < t.p.ellison@gmail.com>:
> > > > > > >
> > > > > > > Sean Qiu wrote:
> > > > > > > > Hi, guys
> > > > > > > >
> > > > > > > > I have wrote a new adaptor to integrate junit's tests
into
> > > BTI 2.0.
> > > > > > > > Could someone pls try this patch [1] ?  Thanks.
> > > > > > > >
> > > > > > > > [1] https://issues.apache.org/jira/browse/HARMONY-4637
> > > > > > >
> > > > > > > I wouldn't know Sean, but hopefully the BTI gurus can
> > > comment.  I took
> > > > > a
> > > > > > > look at the files and it seems remarkably simple to
> > > incorporate
> > > > > JUnit's
> > > > > > > test suites if that is all that is required.
> > > > > >
> > > > > >
> > > > > >  Yes , i am going to add some other test suites into our BTI.
> > > > > > And this is the simplest one as a start.
> > > > > >
> > > > > > On a different topic, a while ago I suggested that we move the
> > > 2.0
> > > > > > > branch to HEAD -- any BTI maintainers still up for it?
> > > > > > >
> > > > > > > Regards,
> > > > > > > Tim
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Sean Qiu
> > > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Sean Qiu
> > > >
> > >
> >
> >
> >
> > --
> > Sean Qiu
>
>
>
>
> --
> Sean Qiu




-- 
Sean Qiu

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message