Mailing-List: contact cloudstack-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: cloudstack-dev@incubator.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
MIME-Version: 1.0
In-Reply-To: 
 <C66C814C1ABFA8449FF65CB44953A8B4012CBB65BCE9@SJCPMAILBOX01.citrite.net>
References: 
 <CAGyVKdvJS6XPEQU+62C-XXbzcbJJ9zfruvFYicVpPP39=q=i0g@mail.gmail.com>
 <C66C814C1ABFA8449FF65CB44953A8B4012CBB65BCE9@SJCPMAILBOX01.citrite.net>
From: David Nalley <david@gnsa.us>
Date: Tue, 18 Sep 2012 08:50:39 -0400
Message-ID: 
 <CAKprHVZapS92GQ+DqZ+GEchMAoM_NkZUgpEq1=oemvz=ODxA_A@mail.gmail.com>
Subject: Re: unit tests for api/src/com/cloud/agent/api
To: cloudstack-dev@incubator.apache.org
Cc: Prasanna Santhanam <Prasanna.Santhanam@citrix.com>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

On Mon, Sep 17, 2012 at 7:24 PM, Edison Su <Edison.su@citrix.com> wrote:
> First, thanks for working on test stuff, we really need more automate tes=
t cases.
> If you plan to work on the API test, we have a python test framework: htt=
ps://cwiki.apache.org/CLOUDSTACK/testing-with-python.html. The most compell=
ing feature is that it supports code completion for cloudstack API, very ea=
sy to write test case in Eclipse environment. And we are setting up a test =
infrastructure, which will execute all the test cases written for this fram=
ework.
> We already have around 500+ test cases, or maybe more, but apparently it'=
s not enough. If you like to work on it, that will be great!
>

While I like the functional/integration tests, as you note we have
500+ currently. Those tests also take many hours to run at present.
Unit tests should be something fast, a sanity check, and we only have
25 right now for the entire code base, so while I like
func/integration tests, I'd really like for our unit tests to be
runnable on every commit, and provide some decent level of coverage so
that we have a bit of confidence that code works well, and provide
good feedback to folks on whether their commit passes the sniff test.

--David