cloudstack-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harikrishna Patnala" <harikrishna.patn...@citrix.com>
Subject Re: Review Request 21971: [Automation] Disabling the failed test cases in Xenserver and KVM runs
Date Wed, 28 May 2014 09:01:29 GMT


> On May 28, 2014, 6:29 a.m., Prasanna Santhanam wrote:
> > Why are you disabling the test? The bug reports indicate a problem in the setup
of the SSVM's network. The SSVM is unable to download the ISO because of an unreachable network.
That's got nothing to do with the test itself.

Our current automation and CI process is as follows (https://cwiki.apache.org/confluence/display/CLOUDSTACK/Infrastructure,CI,Simulator,Automation+Changes)

QA\Team Responsibilities in CI Run:  Once QA\Team identifies failures in the test reports,
and logs bugs for the failures, then they can mark individual test case with bugid information.
EX: If a test case by name “test_deploy_vm_start_failure” fails under test suite “test_deploy_vm.py”
, the  it need to be marked with bugid and push these changes as below. So, this will disable
test case from run in CI, till it gets fixed.

@attr(tags = ['selfservice'],BugId="234")

def test_deploy_vm_start_failure(self):

Developers Responsibilities in CI Run: Developers once they fix the bug, can remove the bugId
information for the test case. Once disabled, it will again be part of CI run. 


- Harikrishna


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21971/#review44100
-----------------------------------------------------------


On May 28, 2014, 6:14 a.m., Harikrishna Patnala wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/21971/
> -----------------------------------------------------------
> 
> (Updated May 28, 2014, 6:14 a.m.)
> 
> 
> Review request for cloudstack, Abhinandan Prateek and Koushik Das.
> 
> 
> Bugs: CLOUDSTACK-6769 and CLOUDSTACK-6774
>     https://issues.apache.org/jira/browse/CLOUDSTACK-6769
>     https://issues.apache.org/jira/browse/CLOUDSTACK-6774
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> -------
> 
> [Automation] Disabling the failed test cases mentioned in the following tickets
>     
> integration.smoke.test_iso - CLOUDSTACK-6769, CLOUDSTACK-6774
> 
> 
> Diffs
> -----
> 
>   test/integration/smoke/test_iso.py 93f436f 
> 
> Diff: https://reviews.apache.org/r/21971/diff/
> 
> 
> Testing
> -------
> 
> 
> Thanks,
> 
> Harikrishna Patnala
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message