harmony-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rana Dasgupta" <rdasg...@gmail.com>
Subject Re: [drlvm][smoke tests] Enabling smoke tests
Date Wed, 06 Dec 2006 22:30:57 GMT
This sounds quite acceptable, we should turn these tests on.

On 12/6/06, Geir Magnusson Jr. <geir@pobox.com> wrote:
>
> Yes!
>
> Elena Semukhina wrote:
> > On 12/5/06, Rana Dasgupta <rdasgupt@gmail.com> wrote:
> >>
> >> How much total additional time would be needed to run the tests that
> are
> >> excluded for "slowness" only?
> >
> >
> > There are 11 tests marked as slow. They run about 30 sec in JIT mode.
> Only
> > one of them is rather slow: gc.Mark (~15 sec).
> >
> > I compared the whole run duration on linux (JIT + interpreter).
> > Currently 26
> > tests run for about 3 min 30 sec. Adding 42 tests from exclude list
> > increases duration up to 11 minutes (1 min 40 sec for JIT).
> >
> > Is this time acceptable?
> >
> > Thanks,
> > Elena
> >
> > Thanks,
> >> Rana
> >>
> >>
> >> On 12/5/06, Elena Semukhina <elena.semukhina@gmail.com> wrote:
> >> >
> >> > We currently have more than 40 smoke tests in the exclude list.
> >> > I tried to run all of them on linux/Windows and found out that most
> of
> >> > them
> >> > stably pass.
> >> > Those of them which have been marked with the "slow" keyword don't
> >> > actually
> >> > run slow. They are not slower than an average smoke test. Only few of
> >> them
> >> > work about 10 seconds (comparing to 1-4 seconds duration of any other
> >> > test).
> >> >
> >> > Only 3 tests stably fail and about 5 tests fail intermittently. I've
> >> added
> >> > the details to the
> >> http://wiki.apache.org/harmony/DRLVMInternalTestspage.
> >> > I plan to file JIRA issues about failing tests and to gather more
> >> > statictics
> >> > on intermittent failures.
> >> >
> >> > Does anybody object to removing most tests from exclude lists and
> bring
> >> > them
> >> > back to runs?
> >> >
> >> > --
> >> > Thanks,
> >> > Elena
> >> >
> >> >
> >>
> >>
> >
> >
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message