harmony-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Qiu" <sean.xx....@gmail.com>
Subject Re: [test] Mauve results
Date Tue, 18 Sep 2007 08:04:51 GMT
I have upload the mave test report within the latest snapshot at r575777.
https://issues.apache.org/jira/browse/HARMONY-4701


2007/9/18, Sean Qiu <sean.xx.qiu@gmail.com>:
>
> I am tring to add it to our BTI.
> But i encountered a problem.
> To get the html report, if the test list is too large, the test will hang
> there for some reasons.
> But if i divide it into some smaller parts, it run successfully.
>
> I am try to find out a solution. Before that, i will update a new run
> results based on HEAD.
>
>
> 2007/9/18, Tim Ellison <t.p.ellison@gmail.com>:
> >
> > Sean,
> >
> > Any chance you can update the Mauve run results based on HEAD?  If you
> > upload the results to JIRA I'll put them on the website again (until we
> > get into the habit of running them through the BTI).
> >
> > Thanks,
> > Tim
> >
> > Sean Qiu wrote:
> > > Thanks very much.
> > >
> > > 2007/8/31, Tim Ellison <t.p.ellison@gmail.com >:
> > >> To make things easier to read, I uploaded your results attachments
> > from
> > >> HARMONY-4701 to here
> > >>   http://people.apache.org/~tellison/mauve/
> > >>
> > >> Regards,
> > >> Tim
> > >>
> > >> Sean Qiu wrote:
> > >>> To run mauve test, build the mauve test according to its README [1]
> > >> firstly.
> > >>> We can run the tests and  get test report with the command:
> > >>> "harmony/jre/bin/java -cp <mauve test classpath>
> > >>> gnu.testlet.runner.Mauvelist-harmony"
> > >>>
> > >>> To run the single test with debug detail, we can use the command:
> > >>> "java Harness -vm harmony/jre/bin/java -verbose -debug
> > -hidecompilefails
> > >>> -noexceptions -showpasses  <testfile>"
> > >>>
> > >>> Soon, i will supply the adaptor for mauve.
> > >>>
> > >>>
> > >>
> > [1]http://sources.redhat.com/cgi-bin/cvsweb.cgi/~checkout~/mauve/README?rev=
> > >>> 1.29&content-type=text/plain&cvsroot=mauve
> > >>>
> > >>> 2007/8/31, Sean Qiu < sean.xx.qiu@gmail.com>:
> > >>>> I have uploaded the test result [1] with harmony classslib and
ibm
> > j9
> > >> vm
> > >>>> ,since drlvm cannot generate the report.
> > >>>> I first find out a list that ri can pass all of the test. (Ri
> > cannot
> > >> pass
> > >>>> all the tests).
> > >>>> Then run this list with harmony jre.  The result is as followings
> > [2]
> > >>>>
> > >>>> I have started to dive into the code to find out the problems.
> > >>>> It seems some tests of them are trivial and the reason of failure
> > is
> > >> due
> > >>>> to behavior difference.
> > >>>>
> > >>>> Later, i will try to run all the tests regardless of ri results.
> > >>>>
> > >>>> [1] https://issues.apache.org/jira/browse/HARMONY-4701
> > >>>> [2] test results
> > >>>> Package: Passed: Failed: Total:  java/awt 1946 127 2070     + color
> > 38
> > >> 0
> > >>>> 38     + datatransfer 9 6 14     + dnd 50 1 51     + geom 2650
66
> > 2714
> > >>>>    + image 60747 168 60896  java/beans 283 17 297     + beancontext
> > 130
> > >> 1
> > >>>> 130  java/io 651 18 667  java/lang 2049 16 2064     + ref 10 0
10
> > >>>>    + reflect 340 1 341  java/math 379 8 387  java/net 834 78
> > >> 910  java/nio
> > >>>> 2944 2 2946     + channels 9 0 9     + charset 34 1 35  java/rmi
20
> > 0
> > >> 20
> > >>>> java/security 160 0 160  java/text 793 39 829
> > >>>>    + AttributedCharacterIterator 3 0 3  java/util 6053 16 6068
> > +
> > >> jar 5
> > >>>> 0 5     + logging 225 1 225     + regex 85 5 90     + zip 179 0
179
> > >>>> javax/accessibility 2 0 2  javax/crypto 28 0
> > 28  javax/imageio/plugins
> > >> 85
> > >>>> 0 85  javax/imageio/spi 10 26 15  javax/imageio/stream 8 0
> > >> 8  javax/naming
> > >>>> 65 0 65     + directory 4 0 4  javax/net/ssl 0 3 2  javax/print
47
> > 2 49
> > >>>>    + attribute 113 12 125     + attribute/standard 2 0 2
> > >>>> javax/security/auth 2 0 2  javax/swing 4169 274 4410     +
> > >> JInternalFrame
> > >>>> 4 0 4     + JList 3 11 8     + JList/AccessibleJList 1 15 1
> > >>>>    + JRootPane 15 0 15     + JScrollPane 3 1 4     + JSpinner 49
0
> > 49
> > >>>>    + JTable 1 1 1     + JTable/AccessibleJTable 2 2 2     +
> > UIManager 4
> > >> 0
> > >>>> 4     + border 105 7 112     + event 207 19 226     + filechooser
> > 11 0
> > >> 11
> > >>>>    + plaf 31 0 31     + plaf/basic 816 113 921
> > >>>>    + plaf/basic/BasicSplitPaneUI 4 0 4     + plaf/metal 345 152
494
> >
> > >>>>    + plaf/metal/MetalBorders 24 6 30     +
> > plaf/metal/MetalIconFactory
> > >> 4 2
> > >>>> 6     + table 568 19 579     + table/JTableHeader 0 3 1
> > >>>>    + table/JTableHeader/AccessibleJTableHeader 0 13 0     + text
> > 1432
> > >> 216
> > >>>> 1640     + text/AbstractDocument 13 2 14     +
> > >> text/DefaultStyledDocument
> > >>>> 583 4 586     + text/FlowView 0 1 0     + text/html 165 3 168
> > >>>>    + text/html/parser 1494 169 1663     + tree 1172 25 1195   
 +
> > undo
> > >> 178
> > >>>> 17 194  javax/xml 1 0 1     + parsers 1 0 1  org/omg/CORBA 88 7
90
> > >>>>    + portable 31 0 31     + 2_3 0 1 1  org/omg/DynamicAny 241 0
241
> > >>>> org/omg/IOP 0 1 0  org/omg/PortableServer 6 2 7
> > >>>>
> > >>>> 2007/8/27, Sean Qiu <sean.xx.qiu@gmail.com>:
> > >>>>> Of course, thanks for you help.
> > >>>>>
> > >>>>> 2007/8/24, Mikhail Loenko < mloenko@gmail.com>:
> > >>>>>> Hi Sean,
> > >>>>>>
> > >>>>>> would you like to try installing regular run of this suite
> > against
> > >>>>>> snapshots?
> > >>>>>> If you make the results available by some URL, I'd updated
the
> > list
> > >>>>>> of source URL (@test_results_links in [1]) and results
of the
> > testing
> > >>>>>> would
> > >>>>>> automatically appear in the tables [2,3]
> > >>>>>>
> > >>>>>> Thanks,
> > >>>>>> Mikhail
> > >>>>>>
> > >>>>>> [1]
> > >>>>>>
> > >> http://people.apache.org/~mloenko/snapshot_testing/script/snapshots.pl
> > <
> > >>
> > http://people.apache.org/%7Emloenko/snapshot_testing/script/snapshots.pl
> > >
> > >>>>>> [2]
> > >>
> > http://people.apache.org/~mloenko/snapshot_testing/script/snapshots_summary.html
> > >>>>>> <
> > >>
> > http://people.apache.org/%7Emloenko/snapshot_testing/script/snapshots_summary.html
> > >>>>>> [3]
> > >>
> > http://people.apache.org/~mloenko/snapshot_testing/script/r567890/index.html
> > >>>>>> <
> > >>
> > http://people.apache.org/%7Emloenko/snapshot_testing/script/r567890/index.html
> > >>>>>> 2007/8/24, Sean Qiu < sean.xx.qiu@gmail.com>:
> > >>>>>>> 2007/8/23, Alexey Varlamov < alexey.v.varlamov@gmail.com>:
> > >>>>>>>
> > >>>>>>>> Sean,
> > >>>>>>>>
> > >>>>>>>> Nice work - I've integrated this JIRA into SVN.
I'm curious
> > what
> > >>>>>> is
> > >>>>>>> Thanks very much.
> > >>>>>>>
> > >>>>>>> next - TestNG, JMock, Mauve?
> > >>>>>>>
> > >>>>>>>
> > >>>>>>> I have got the test list that we can pass successfully.
> > >>>>>>> So i will try mauve first.
> > >>>>>>>
> > >>>>>>> BTW, the derby 10.3.1.4 finally release, and this one
includes
> > the
> > >>>>>> derby
> > >>>>>>> junit test now. I am trying derby too.
> > >>>>>>>
> > >>>>>>>
> > >>>>>>>> BTW, recalling the XMLReporter issue with Mauve,
you can simply
> > >>>>>>>> contact their developers and ask for this feature
or even
> > provide
> > >>>>>>>> ready-to-commit patch. I think it is the best solution.
> > >>>>>>>> Good luck, and looking forward for the new adapters!
> > >>>>>>> Thanks again. I will try.
> > >>>>>>>
> > >>>>>>> 2007/8/22, Sean Qiu <sean.xx.qiu@gmail.com>:
> > >>>>>>>>> 2007/8/22, Tim Ellison < t.p.ellison@gmail.com>:
> > >>>>>>>>>> Sean Qiu wrote:
> > >>>>>>>>>>> Hi, guys
> > >>>>>>>>>>>
> > >>>>>>>>>>> I have wrote a new adaptor to integrate
junit's tests into
> > >>>>>> BTI 2.0.
> > >>>>>>>>>>> Could someone pls try this patch [1]
?  Thanks.
> > >>>>>>>>>>>
> > >>>>>>>>>>> [1] https://issues.apache.org/jira/browse/HARMONY-4637
> > >>>>>>>>>> I wouldn't know Sean, but hopefully the
BTI gurus can
> > >>>>>> comment.  I took
> > >>>>>>>> a
> > >>>>>>>>>> look at the files and it seems remarkably
simple to
> > >>>>>> incorporate
> > >>>>>>>> JUnit's
> > >>>>>>>>>> test suites if that is all that is required.
> > >>>>>>>>>  Yes , i am going to add some other test suites
into our BTI.
> > >>>>>>>>> And this is the simplest one as a start.
> > >>>>>>>>>
> > >>>>>>>>> On a different topic, a while ago I suggested
that we move the
> >
> > >>>>>> 2.0
> > >>>>>>>>>> branch to HEAD -- any BTI maintainers still
up for it?
> > >>>>>>>>>>
> > >>>>>>>>>> Regards,
> > >>>>>>>>>> Tim
> > >>>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> --
> > >>>>>>>>> Sean Qiu
> > >>>>>>>>>
> > >>>>>>>
> > >>>>>>> --
> > >>>>>>> Sean Qiu
> > >>>>>>>
> > >>>>>
> > >>>>> --
> > >>>>> Sean Qiu
> > >>>>
> > >>>>
> > >>>> --
> > >>>> Sean Qiu
> > >>>
> > >>>
> > >>>
> > >
> > >
> > >
> >
>
>
>
> --
> Sean Qiu
> China Software Development Lab, IBM




-- 
Sean Qiu
China Software Development Lab, IBM

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message