Mailing-List: contact harmony-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: harmony-dev@incubator.apache.org
Received-SPF: pass (asf.osuosl.org: domain of gcjhd-harmony-dev@m.gmane.org
 designates 80.91.229.2 as permitted sender)
To: harmony-dev@incubator.apache.org
From: Stuart Ballard <stuart.a.ballard@gmail.com>
Subject: API coverage results for Harmony?
Date: Sat, 11 Feb 2006 16:01:25 +0000 (UTC)
Lines: 51
Message-ID: <loom.20060211T163420-484@post.gmane.org>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
User-Agent: Loom/3.14 (http://gmane.org/)
Sender: news <news@sea.gmane.org>

(please keep me cc'd as I'm not subscribed to this list)

First off, I'd like to admit up front that I haven't been following the Harmony
project very closely and so I'm pretty ignorant about the state of your
progress, so please forgive any stupid misconceptions I may have.

I maintain a set of programs called japitools
(http://www.kaffe.org/~stuart/japi/ - not part of the kaffe project as such,
they just generously offered to host the homepage) which can be used to produce
(among other things) reports of how well a particular J2SE implementation covers
the API defined by Sun's reference implementation. In collaboration with the
Classpath developers I've been producing nightly results of Classpath's coverage
of each JDK release, as seen for example here (and others linked from the
homepage):

http://www.kaffe.org/~stuart/japi/htmlout/h-jdk14-classpath
http://www.kaffe.org/~stuart/japi/htmlout/h-jdk15-classpath-generics

I also send out emails to the classpath-testresults mailing list with reports on
the differences, if any, between each night's results, which is a handy way to
catch any API coverage regressions that might be introduced, as well as a nice
concrete way to see progress being made.

My understanding is that the Harmony project has made pretty significant
progress on its own class library implementation and I thought you might be
interested in producing similar nightly reports for Harmony. If you are
interested, there are a couple of ways we could go about it.

My machine doesn't have the resources to build a J2SE implementation itself so
for each project I report on I rely on their own nightly build infrastructure.
(I don't know if Harmony has such a thing set up already; alternatively a
developer could set up nightly build scripts on their own machine). Ideally (and
to match what other projects do) the script would also check out the latest
japitools source code, build it, and run the "Japize" tool to produce a
"harmony.japi.gz" file, and then make that file available for download
somewhere. I'd then configure my scripts to download that file and produce the
comparisons you see (I can also provide those scripts and the JDK japi files so
if you want to run them yourselves you can - there's nothing secret about them
;) ).

If running Japize yourselves is a problem for any reason, if you instead made
your equivalent(s) of rt.jar (and jce.jar and jsse.jar if you have them)
available for download, I could do the Japize as part of my script too.

Is there any interest in something like this?

If you want nightly difference reports sent to some mailing list, please also
let me know which list :)

Thanks,
Stuart.