Return-Path: X-Original-To: apmail-airavata-dev-archive@www.apache.org Delivered-To: apmail-airavata-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D22B510BC8 for ; Thu, 21 Nov 2013 21:20:07 +0000 (UTC) Received: (qmail 81521 invoked by uid 500); 21 Nov 2013 21:20:07 -0000 Delivered-To: apmail-airavata-dev-archive@airavata.apache.org Received: (qmail 81489 invoked by uid 500); 21 Nov 2013 21:20:07 -0000 Mailing-List: contact dev-help@airavata.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@airavata.apache.org Delivered-To: mailing list dev@airavata.apache.org Received: (qmail 81482 invoked by uid 99); 21 Nov 2013 21:20:07 -0000 Received: from minotaur.apache.org (HELO minotaur.apache.org) (140.211.11.9) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 21 Nov 2013 21:20:07 +0000 Received: from localhost (HELO [10.199.2.229]) (127.0.0.1) (smtp-auth username smarru, mechanism plain) by minotaur.apache.org (qpsmtpd/0.29) with ESMTP; Thu, 21 Nov 2013 21:20:07 +0000 Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 (Mac OS X Mail 7.0 \(1822\)) Subject: Re: Airavata Release Testing From: Suresh Marru In-Reply-To: Date: Thu, 21 Nov 2013 14:20:04 -0700 Content-Transfer-Encoding: quoted-printable Message-Id: <027ED02C-8442-436A-81D0-3FA28D7133F4@apache.org> References: To: Airavata Dev X-Mailer: Apple Mail (2.1822) One more reason for automated testing: * Humans are lazy by nature :) + 1 for everything.=20 Suresh On Nov 21, 2013, at 2:12 PM, Amila Jayasekara = wrote: > Hi Raman, >=20 > Thank you for initiating this [1]. This list [1] is great. > =20 > I have few comments related to verifying samples. >=20 > It will be really great if we can automate most of these testing. = Ideally we should only do UI testing manually (Maybe we can automate = that too). Further we need to automate real scenarios (like running job = against trestles/stampede) >=20 > I see automation is necessary due to following reasons; >=20 > 1. Humans are not perfect > 2. We have lot of things in our minds so we are always eager to finish = one thing and go to next. Therefore high chance we miss something. = Further we dont have a way to assure that release manager did all the = verifications. > 3. We dont need to wait till release time to figure out something is = broken. > 4. We are a small team is small. Therefore we need to automate as much = as possible. Infact that is the way most of the apache projects do. >=20 > [1] = https://cwiki.apache.org/confluence/display/AIRAVATA/Airavata+Release+Test= ing >=20 > Thanks > Amila