Mailing-List: contact harmony-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: harmony-dev@incubator.apache.org
Received-SPF: pass (herse.apache.org: domain of ivavladimir@gmail.com
 designates 66.249.92.169 as permitted sender)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
        s=beta; d=gmail.com;
        h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:references;
        b=fcOn3l+nH7O9FeKB7ZDgLOUvMWHZmsKgyxHc6ckW3liqcJRORDXysqhFEYHeGjcJ6JcDdRjmO2320AFDVO07ZvqdxGch8LxB/rEeIHhv15lzKfGVd1v4HsjQDzMcnEU51tgyh4PGY3v+CRddZt0BCVRjV8c7vmvTOvTR+gq+z7M=
Message-ID: <7273946b0610260509h3d10321che178f027a1163fee@mail.gmail.com>
Date: Thu, 26 Oct 2006 19:09:48 +0700
From: "Vladimir Ivanov" <ivavladimir@gmail.com>
To: harmony-dev@incubator.apache.org
Subject: Re: Harmony passes 94% on derby tests.
In-Reply-To: <e66844de0610260439v5a2285e0v5d2d0c4301787ebf@mail.gmail.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_31756_12812861.1161864588970"
References: <e66844de0610230026t6c02e553h44941bd128e26f82@mail.gmail.com>
	 <453EFCDD.6080200@pobox.com>
	 <7273946b0610250436t4b28e4f0g101b11194c19fe94@mail.gmail.com>
	 <e66844de0610260439v5a2285e0v5d2d0c4301787ebf@mail.gmail.com>

------=_Part_31756_12812861.1161864588970
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

On 10/26/06, Leo Li <liyilei1979@gmail.com> wrote:
>
> Hi, Vladimir:
>     Sorry for the delay.
>     I am willing to share my script. It will be great if we can use real
> application as a supplement for our testcase.
>    But...actually, I am not quite sure about what the script is.:)


>From my point of view (other people can have other point :) ) it is ant
based script that:

 - download application (if needed);

 - download tests (if needed);

 - do some 'standard' modification (if needed);

 - run application tests over the harmony runtime.


Also it may prepare results for wiki or something else :)


 thanks, Vladimir

Note, you can look at
*HARMONY-995*<http://issues.apache.org/jira/browse/HARMONY-995>,
file cc.zip to see a preliminary structure of 'buildtest' module


> On 10/25/06, Vladimir Ivanov <ivavladimir@gmail.com> wrote:
> >
> > Excellent!
> >
> >
> >
> > I have one more idea: we already have buildtest module. Some time ago we
> > agreed to extends it by coverage and japi scripts (I hope it happens
> > soon:)
> > ). May be we extend it one more time and store here some scripts for
> > automatic run of other-projects unit tests? Seems, in this case we can
> > easily reproduce tests run and enable new platforms.
> >
> > Of cause, we can not cover all application but we can define some list
> of
> > 'most important application'.
> >
> > Is it OK?
> >
> > Leo, could you share your script for Derby?
> >
> > Tony, could you share your scripts for ant and log4j?
> >
> >
> >
> > thanks, Vladimir
> >
> >
> > PS. The directory structure may be something like that:
> > builtest
> >    - trunk
> >        - cc
> >        - coverage
> >        - japi
> >        - application_test
> >            - derby
> >            - ant
> >            - etc
> >        - misc (some other scripts)
> > On 10/25/06, Geir Magnusson Jr. <geir@pobox.com> wrote:
> > >
> > > Nice work!
> > >
> > > More inline..
> > >
> > > Leo Li wrote:
> > > > 467 Tests Run
> > > > 94% Pass (443 tests passed)
> > > > 6% Fail (24 tests failed)
> > > > 5 Suites skipped
> > > >
> > > > The main progress focuses here:
> > > > 1. Harmony classlib fails to load class when user-defined security
> > > policy
> > > > exists. It is due to the sequence of library loading of VM, which
> has
> > > been
> > > > resolved now.
> > > > 2. A new workround for derby tests which allow useprocess to run
> test
> > or
> > > > else several testcases might fail due to derby lack these tests when
> > > > useprocess = false.
> > > > 3. Derby source code uses the version and the name of java vm to
> > decide
> > > > what
> > > > to do, while current IBM VM has the version of "1.4.2" and the name
> of
> > > > "j9",
> > > > which has different output on the screen from that of standard RI
> 1.5.
> > > At
> > > > the same time Derby test compares the output of the iteractive test
> > > scripts
> > > > to that of expected. I have made some slight modification in its
> > source
> > > > code, but I have not throughly change this odd behavior, ...,too
> > much:(
> > >
> > > Have you approached the derby community with the changes?
> > >
> > > >
> > > > Besides, some testcase fails even on RI. I exclude
> > > > a "derbynetclientmats" test suit since it will hang both RI and
> > Harmony.
> > > > Currently all the failure is irrelevant to Harmony. Hope I can find
> > > > something in the left.
> > > >
> > > > I have updated the wiki of derby on Hamony:
> > > > http://wiki.apache.org/harmony/Apache_Derby.
> > > >
> > >
> >
> >
>
>
> --
> Leo Li
> China Software Development Lab, IBM
>
>

------=_Part_31756_12812861.1161864588970--