harmony-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Qiu" <sean.xx....@gmail.com>
Subject Re: [test] Mauve results
Date Tue, 18 Sep 2007 02:50:01 GMT
I am tring to add it to our BTI.
But i encountered a problem.
To get the html report, if the test list is too large, the test will hang
there for some reasons.
But if i divide it into some smaller parts, it run successfully.

I am try to find out a solution. Before that, i will update a new run
results based on HEAD.


2007/9/18, Tim Ellison <t.p.ellison@gmail.com>:
>
> Sean,
>
> Any chance you can update the Mauve run results based on HEAD?  If you
> upload the results to JIRA I'll put them on the website again (until we
> get into the habit of running them through the BTI).
>
> Thanks,
> Tim
>
> Sean Qiu wrote:
> > Thanks very much.
> >
> > 2007/8/31, Tim Ellison <t.p.ellison@gmail.com>:
> >> To make things easier to read, I uploaded your results attachments from
> >> HARMONY-4701 to here
> >>   http://people.apache.org/~tellison/mauve/
> >>
> >> Regards,
> >> Tim
> >>
> >> Sean Qiu wrote:
> >>> To run mauve test, build the mauve test according to its README [1]
> >> firstly.
> >>> We can run the tests and  get test report with the command:
> >>> "harmony/jre/bin/java -cp <mauve test classpath>
> >>> gnu.testlet.runner.Mauvelist-harmony"
> >>>
> >>> To run the single test with debug detail, we can use the command:
> >>> "java Harness -vm harmony/jre/bin/java -verbose -debug
> -hidecompilefails
> >>> -noexceptions -showpasses  <testfile>"
> >>>
> >>> Soon, i will supply the adaptor for mauve.
> >>>
> >>>
> >>
> [1]http://sources.redhat.com/cgi-bin/cvsweb.cgi/~checkout~/mauve/README?rev=
> >>> 1.29&content-type=text/plain&cvsroot=mauve
> >>>
> >>> 2007/8/31, Sean Qiu <sean.xx.qiu@gmail.com>:
> >>>> I have uploaded the test result [1] with harmony classslib and ibm j9
> >> vm
> >>>> ,since drlvm cannot generate the report.
> >>>> I first find out a list that ri can pass all of the test. (Ri cannot
> >> pass
> >>>> all the tests).
> >>>> Then run this list with harmony jre.  The result is as followings [2]
> >>>>
> >>>> I have started to dive into the code to find out the problems.
> >>>> It seems some tests of them are trivial and the reason of failure is
> >> due
> >>>> to behavior difference.
> >>>>
> >>>> Later, i will try to run all the tests regardless of ri results.
> >>>>
> >>>> [1] https://issues.apache.org/jira/browse/HARMONY-4701
> >>>> [2] test results
> >>>> Package: Passed: Failed: Total:  java/awt 1946 127 2070     + color
> 38
> >> 0
> >>>> 38     + datatransfer 9 6 14     + dnd 50 1 51     + geom 2650 66
> 2714
> >>>>    + image 60747 168 60896  java/beans 283 17 297     + beancontext
> 130
> >> 1
> >>>> 130  java/io 651 18 667  java/lang 2049 16 2064     + ref 10 0 10
> >>>>    + reflect 340 1 341  java/math 379 8 387  java/net 834 78
> >> 910  java/nio
> >>>> 2944 2 2946     + channels 9 0 9     + charset 34 1 35  java/rmi 20
0
> >> 20
> >>>> java/security 160 0 160  java/text 793 39 829
> >>>>    + AttributedCharacterIterator 3 0 3  java/util 6053 16 6068     +
> >> jar 5
> >>>> 0 5     + logging 225 1 225     + regex 85 5 90     + zip 179 0 179
> >>>> javax/accessibility 2 0 2  javax/crypto 28 0
> 28  javax/imageio/plugins
> >> 85
> >>>> 0 85  javax/imageio/spi 10 26 15  javax/imageio/stream 8 0
> >> 8  javax/naming
> >>>> 65 0 65     + directory 4 0 4  javax/net/ssl 0 3 2  javax/print 47 2
> 49
> >>>>    + attribute 113 12 125     + attribute/standard 2 0 2
> >>>> javax/security/auth 2 0 2  javax/swing 4169 274 4410     +
> >> JInternalFrame
> >>>> 4 0 4     + JList 3 11 8     + JList/AccessibleJList 1 15 1
> >>>>    + JRootPane 15 0 15     + JScrollPane 3 1 4     + JSpinner 49 0 49
> >>>>    + JTable 1 1 1     + JTable/AccessibleJTable 2 2 2     + UIManager
> 4
> >> 0
> >>>> 4     + border 105 7 112     + event 207 19 226     + filechooser 11
> 0
> >> 11
> >>>>    + plaf 31 0 31     + plaf/basic 816 113 921
> >>>>    + plaf/basic/BasicSplitPaneUI 4 0 4     + plaf/metal 345 152 494
> >>>>    + plaf/metal/MetalBorders 24 6 30     +
> plaf/metal/MetalIconFactory
> >> 4 2
> >>>> 6     + table 568 19 579     + table/JTableHeader 0 3 1
> >>>>    + table/JTableHeader/AccessibleJTableHeader 0 13 0     + text 1432
> >> 216
> >>>> 1640     + text/AbstractDocument 13 2 14     +
> >> text/DefaultStyledDocument
> >>>> 583 4 586     + text/FlowView 0 1 0     + text/html 165 3 168
> >>>>    + text/html/parser 1494 169 1663     + tree 1172 25 1195     +
> undo
> >> 178
> >>>> 17 194  javax/xml 1 0 1     + parsers 1 0 1  org/omg/CORBA 88 7 90
> >>>>    + portable 31 0 31     + 2_3 0 1 1  org/omg/DynamicAny 241 0 241
> >>>> org/omg/IOP 0 1 0  org/omg/PortableServer 6 2 7
> >>>>
> >>>> 2007/8/27, Sean Qiu <sean.xx.qiu@gmail.com>:
> >>>>> Of course, thanks for you help.
> >>>>>
> >>>>> 2007/8/24, Mikhail Loenko <mloenko@gmail.com>:
> >>>>>> Hi Sean,
> >>>>>>
> >>>>>> would you like to try installing regular run of this suite against
> >>>>>> snapshots?
> >>>>>> If you make the results available by some URL, I'd updated the
list
> >>>>>> of source URL (@test_results_links in [1]) and results of the
> testing
> >>>>>> would
> >>>>>> automatically appear in the tables [2,3]
> >>>>>>
> >>>>>> Thanks,
> >>>>>> Mikhail
> >>>>>>
> >>>>>> [1]
> >>>>>>
> >> http://people.apache.org/~mloenko/snapshot_testing/script/snapshots.pl<
> >>
> http://people.apache.org/%7Emloenko/snapshot_testing/script/snapshots.pl>
> >>>>>> [2]
> >>
> http://people.apache.org/~mloenko/snapshot_testing/script/snapshots_summary.html
> >>>>>> <
> >>
> http://people.apache.org/%7Emloenko/snapshot_testing/script/snapshots_summary.html
> >>>>>> [3]
> >>
> http://people.apache.org/~mloenko/snapshot_testing/script/r567890/index.html
> >>>>>> <
> >>
> http://people.apache.org/%7Emloenko/snapshot_testing/script/r567890/index.html
> >>>>>> 2007/8/24, Sean Qiu < sean.xx.qiu@gmail.com>:
> >>>>>>> 2007/8/23, Alexey Varlamov <alexey.v.varlamov@gmail.com>:
> >>>>>>>
> >>>>>>>> Sean,
> >>>>>>>>
> >>>>>>>> Nice work - I've integrated this JIRA into SVN. I'm
curious what
> >>>>>> is
> >>>>>>> Thanks very much.
> >>>>>>>
> >>>>>>> next - TestNG, JMock, Mauve?
> >>>>>>>
> >>>>>>>
> >>>>>>> I have got the test list that we can pass successfully.
> >>>>>>> So i will try mauve first.
> >>>>>>>
> >>>>>>> BTW, the derby 10.3.1.4 finally release, and this one includes
the
> >>>>>> derby
> >>>>>>> junit test now. I am trying derby too.
> >>>>>>>
> >>>>>>>
> >>>>>>>> BTW, recalling the XMLReporter issue with Mauve, you
can simply
> >>>>>>>> contact their developers and ask for this feature or
even provide
> >>>>>>>> ready-to-commit patch. I think it is the best solution.
> >>>>>>>> Good luck, and looking forward for the new adapters!
> >>>>>>> Thanks again. I will try.
> >>>>>>>
> >>>>>>> 2007/8/22, Sean Qiu <sean.xx.qiu@gmail.com>:
> >>>>>>>>> 2007/8/22, Tim Ellison < t.p.ellison@gmail.com>:
> >>>>>>>>>> Sean Qiu wrote:
> >>>>>>>>>>> Hi, guys
> >>>>>>>>>>>
> >>>>>>>>>>> I have wrote a new adaptor to integrate
junit's tests into
> >>>>>> BTI 2.0.
> >>>>>>>>>>> Could someone pls try this patch [1] ? 
Thanks.
> >>>>>>>>>>>
> >>>>>>>>>>> [1] https://issues.apache.org/jira/browse/HARMONY-4637
> >>>>>>>>>> I wouldn't know Sean, but hopefully the BTI
gurus can
> >>>>>> comment.  I took
> >>>>>>>> a
> >>>>>>>>>> look at the files and it seems remarkably simple
to
> >>>>>> incorporate
> >>>>>>>> JUnit's
> >>>>>>>>>> test suites if that is all that is required.
> >>>>>>>>>  Yes , i am going to add some other test suites
into our BTI.
> >>>>>>>>> And this is the simplest one as a start.
> >>>>>>>>>
> >>>>>>>>> On a different topic, a while ago I suggested that
we move the
> >>>>>> 2.0
> >>>>>>>>>> branch to HEAD -- any BTI maintainers still
up for it?
> >>>>>>>>>>
> >>>>>>>>>> Regards,
> >>>>>>>>>> Tim
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --
> >>>>>>>>> Sean Qiu
> >>>>>>>>>
> >>>>>>>
> >>>>>>> --
> >>>>>>> Sean Qiu
> >>>>>>>
> >>>>>
> >>>>> --
> >>>>> Sean Qiu
> >>>>
> >>>>
> >>>> --
> >>>> Sean Qiu
> >>>
> >>>
> >>>
> >
> >
> >
>



-- 
Sean Qiu
China Software Development Lab, IBM

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message