Mailing-List: contact dev-help@harmony.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@harmony.apache.org
Received-SPF: pass (herse.apache.org: domain of elena.semukhina@gmail.com
 designates 72.14.204.234 as permitted sender)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
        s=beta; d=gmail.com;
        h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:references;
        b=nbuo3g2dPOJKOWG0XUN6ipvR/PzVKd+mnU4kDStHydbNppcHMuv0wcDXKXmmSkYXx/xwP591Y6QF7YjdAYCoX3S1MrqShoGwQiGgT9kzD1pLo7vrue4k87xeiGhE1vvud51coH+Ql95kG7Y6N2tK796VqW778lLGa7IN4AbjnH8=
Message-ID: <e79e5b390612120457g22c9127an9fc51ea66846c539@mail.gmail.com>
Date: Tue, 12 Dec 2006 18:57:47 +0600
From: "Elena Semukhina" <elena.semukhina@gmail.com>
To: dev@harmony.apache.org, geir@pobox.com
Subject: Re: [drlvm][smoke tests] Enabling smoke tests
In-Reply-To: <457D6BDF.9030905@pobox.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_134687_30762638.1165928267976"
References: <e79e5b390612050539v3995b50cv9fcec00fff33206b@mail.gmail.com>
	 <51d555c70612050703i130fb3bbh82392b1f096f7d35@mail.gmail.com>
	 <e79e5b390612060219o2e106fa5gd5402fc7e1607a51@mail.gmail.com>
	 <f944d83d0612062147w7a0d4211jc09a7d24d8cfedd1@mail.gmail.com>
	 <e79e5b390612070119n6c35e1c3u54ee7dac48396e29@mail.gmail.com>
	 <e79e5b390612080554t2947f1b5k3dd874f003e9c80d@mail.gmail.com>
	 <4579A2FB.3070205@pobox.com>
	 <e79e5b390612110627w1f59493eg3f8d2b002c0aa833@mail.gmail.com>
	 <457D6BDF.9030905@pobox.com>

------=_Part_134687_30762638.1165928267976
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

On 12/11/06, Geir Magnusson Jr. <geir@pobox.com> wrote:
>
>
>
> Elena Semukhina wrote:
> > On 12/8/06, Geir Magnusson Jr. <geir@pobox.com> wrote:
> >>
> >> Nice work - I'm testing it now and will commit.  If someone can test
> >> today on x86_64, that would be great, or I will do it tomorrow
> >
> >
> > At last I managed to start the tests on x86_64 and they passed.
> > They still print something like
> >
> > test exception.FinalizeStackTest is skipped due to X_em64t
>
> I thought I fixed those.  Oh!  I may not have committed.
>
> >
> > I'll verify if this is still valid tomorrow.
>
> I found a bunch of tests breaking on x86_64.  Let me double check to see
> if I have all checked in.


Smoke tests look rather unstable today on SUSE 9 x86_64. They pass and fail
alternately.
I observed a number of failures (io.Integers, jni.LoadLibrary, gc.List,
gc.Free) with the same error message:

Assertion failed: 0
LIL INTERNAL ERROR: Not enough temporary registers
java:
/nfs/ins/proj/drl/coreapi/esemukhi/em64/drlvm/trunk/vm/port/src/lil/em64t/pim/lil_code_generator_em64t.cpp:204:
LcgEM64TCodeGen::Tmp_GR_Opnd::Tmp_GR_Opnd(LcgEM64TContext&,
LilInstructionContext*): Assertion `0' failed.
log4cxx: No appender could be found for logger (port.old).
log4cxx: Please initialize the log4cxx system properly.

Elena

geir
>
> >
> >
> > Elena
> >
> > geir
> >>
> >>
> >> Elena Semukhina wrote:
> >> > After a few days of runs I can conclude that almost 40 tests are
> valid
> >> and
> >> > should be removed from the exclude lists. I've prepared a patch to
> >> smoke
> >> > tests: https://issues.apache.org/jira/browse/HARMONY-2543
> >> >
> >> > After it is applied we'll have 3 stable issues:
> >> > 1) gc.Mark craches on Windows
> >> > 2) - 3)  stress.Stack and io.Integers will pass only on linux/JIT and
> >> fail
> >> > on other configurations because of StackOverflowError. Is it a known
> >> issue?
> >> >
> >> > We'll also have four tests failing intermittently. I plan to play
> with
> >> them
> >> > to get more details.
> >> >
> >> > All the above tests remain excluded.
> >> >
> >> > I prepared the update for ia32 platforms only because I don't have
> >> > access to
> >> > x86_64 machines for now. Hope to get it soon.
> >> >
> >> > I updated the http://wiki.apache.org/harmony/DRLVMInternalTests with
> >> new
> >> > details.
> >> >
> >> > Thanks,
> >> > Elena
> >> >
> >> >
> >> > On 12/7/06, Elena Semukhina <elena.semukhina@gmail.com> wrote:
> >> >>
> >> >>
> >> >>
> >> >> On 12/7/06, Alexey Varlamov <alexey.v.varlamov@gmail.com> wrote:
> >> >> >
> >> >> > 2006/12/6, Elena Semukhina <elena.semukhina@gmail.com>:
> >> >> > > On 12/5/06, Rana Dasgupta <rdasgupt@gmail.com> wrote:
> >> >> > > >
> >> >> > > > How much total additional time would be needed to run the
> tests
> >> >> that
> >> >> > are
> >> >> > > > excluded for "slowness" only?
> >> >> > >
> >> >> > >
> >> >> > > There are 11 tests marked as slow. They run about 30 sec in JIT
> >> mode.
> >> >> > Only
> >> >> > > one of them is rather slow: gc.Mark (~15 sec).
> >> >> > >
> >> >> > > I compared the whole run duration on linux (JIT + interpreter).
> >> >> > Currently 26
> >> >> > > tests run for about 3 min 30 sec. Adding 42 tests from exclude
> >> list
> >> >> > > increases duration up to 11 minutes (1 min 40 sec for JIT).
> >> >> > >
> >> >> > > Is this time acceptable?
> >> >> >
> >> >> > Probably yes.Exact timings depend on hardware used; I guess the
> >> >> > figures above are on a laptop?
> >> >>
> >> >>
> >> >> No, 11 minutes are for multiprocessor machines (Windows/linux). On a
> >> >> single processor desktop the tests run for 24 minutes :(  Most
> >> >> annoying is
> >> >> the interpreter mode. We can agree later that some slow tests
> >> should be
> >> >> excluded for interpreter.
> >> >>
> >> >> Anyway I need a couple of days to run the tests intensively to
> reveal
> >> all
> >> >> unstable issues.
> >> >>
> >> >> Elena
> >> >>
> >> >>
> >> >> Anyway let's try them over! Later if someone analyzed coverage, we
> can
> >> >> > re-balance pre-commit and CI tests.
> >> >> >
> >> >> > >
> >> >> > > Thanks,
> >> >> > > Elena
> >> >> > >
> >> >> > > Thanks,
> >> >> > > > Rana
> >> >> > > >
> >> >> > > >
> >> >> > > > On 12/5/06, Elena Semukhina <elena.semukhina@gmail.com >
> wrote:
> >> >> > > > >
> >> >> > > > > We currently have more than 40 smoke tests in the exclude
> >> list.
> >> >> > > > > I tried to run all of them on linux/Windows and found out
> that
> >> >> > most of
> >> >> > > > > them
> >> >> > > > > stably pass.
> >> >> > > > > Those of them which have been marked with the "slow" keyword
> >> >> don't
> >> >> > > > > actually
> >> >> > > > > run slow. They are not slower than an average smoke test.
> Only
> >> >> few
> >> >> > of
> >> >> > > > them
> >> >> > > > > work about 10 seconds (comparing to 1-4 seconds duration of
> >> any
> >> >> > other
> >> >> > > > > test).
> >> >> > > > >
> >> >> > > > > Only 3 tests stably fail and about 5 tests fail
> >> intermittently.
> >> >> > I've
> >> >> > > > added
> >> >> > > > > the details to the
> >> >> > > > http://wiki.apache.org/harmony/DRLVMInternalTestspage.
> >> >> > > > > I plan to file JIRA issues about failing tests and to gather
> >> more
> >> >> > > > > statictics
> >> >> > > > > on intermittent failures.
> >> >> > > > >
> >> >> > > > > Does anybody object to removing most tests from exclude
> lists
> >> and
> >> >> > bring
> >> >> > > > > them
> >> >> > > > > back to runs?
> >> >> > > > >
> >> >> > > > > --
> >> >> > > > > Thanks,
> >> >> > > > > Elena
> >> >> > > > >
> >> >> > > > >
> >> >> > > >
> >> >> > > >
> >> >> > >
> >> >> > >
> >> >> > > --
> >> >> > > Thanks,
> >> >> > > Elena
> >> >> > >
> >> >> > >
> >> >> >
> >> >>
> >> >>
> >> >>
> >> >> --
> >> >> Thanks,
> >> >> Elena
> >> >
> >> >
> >> >
> >> >
> >>
> >
> >
> >
>


-- 
Thanks,
Elena

------=_Part_134687_30762638.1165928267976--