Mailing-List: contact dev-help@continuum.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@continuum.apache.org
Received-SPF: pass (athena.apache.org: local policy includes SPF record at
 spf.trusted-forwarder.org)
Sender: Brett Porter <brett@porterclan.net>
Content-Type: text/plain; charset=us-ascii
Mime-Version: 1.0 (Mac OS X Mail 7.2 \(1874\))
Subject: Re: Looking for testing on the Struts upgrade
From: Brett Porter <brett@apache.org>
In-Reply-To: 
 <CALyHw0Fps=jNUepTX4FtJPHL2TEdjm9XR50RDbR0drXs7tbNfA@mail.gmail.com>
Date: Fri, 23 May 2014 12:21:33 +1000
Content-Transfer-Encoding: quoted-printable
Message-Id: <5567664D-473F-4EC0-8451-0EA1EC791A75@apache.org>
References: <914AF167-B01E-4F31-94D2-5D810E5A764E@apache.org>
 <CALyHw0H6TLXSvPgfqd-7bXFnvv42nKggiBEPRyo_5PDrSrDN0Q@mail.gmail.com>
 <5942C279-D8C0-44AD-871C-037142F0A5F9@apache.org>
 <CALyHw0Fps=jNUepTX4FtJPHL2TEdjm9XR50RDbR0drXs7tbNfA@mail.gmail.com>
To: dev@continuum.apache.org


On 23 May 2014, at 12:21 am, Brent Atkinson <brent.atkinson@gmail.com> =
wrote:

> I have had challenges verifying using the web tests. It seems the =
tests are
> not repeatable unless I rebuild the whole project. I recall that there =
were
> some commits to ensure repeatable tests. Should I expect running clean
> install in the continuum-webapp-test directory multiple times will =
give the
> same result without a clean build?

When you say clean build, you mean rebuilding the other modules? Yes, =
that should never be needed unless you make changes. If you run mvn =
clean install in the webapp-test directory, that will wipe out the whole =
installation and start over from the last built war, so there should be =
no reproducibility issues due to existing data (though there might be =
some due to general flakiness).

The reproducibility commits where so that tests could be run repeatedly =
from the IDE without cleaning the target directory or restarting the =
test server.

That said, the testing I think would be most interesting at the moment =
are the things the webapp tests don't cover - like pages where =
formatting doesn't look right. The Struts upgrade changed some of the =
HTML tags they rendered.

- Brett