cloudstack-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Santhosh Kumar Edukulla (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CLOUDSTACK-4971) Verifying proper Setup Issues EX:Server Down, other prerequisites for test setup to minimize test script failures.
Date Mon, 28 Oct 2013 19:40:30 GMT

     [ https://issues.apache.org/jira/browse/CLOUDSTACK-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Santhosh Kumar Edukulla updated CLOUDSTACK-4971:
------------------------------------------------

    Description: 
1, Currently test scripts are running despite the test setup has issues. EX: In one of the
test scenario, where ldap server was down, test suite or test cases depending upon them were
still running. 

2, Ideally, the setup( test module setup ) should check for these dependencies before running
the test script and exit wherever possible with proper log and reporting.

3, We may not be able to cover all setup issues under setup class of test module or feature
test class, but the purpose of setup  is also to check for its existence and dependencies.
Scripts depending upon particular server conditions, should have a proper setup verifying
the server existence before proceeding further. 

4, I believe running test cases when setup is down is also not idealistic. 

5. Purpose is to reduce script errors vs failures due to product bugs. 

6. Logging this bug to track the setup issue cases or script failures. 

  was:
1, Currently test scripts are running despite the test setup has issues. EX: In one of the
test scenario, where ldap server was down, test suite or test cases depending upon them was
still running. 

2, Ideally, the setup should check for these dependencies before running the test script and
exit wherever possible with proper log and reporting .

3,  We may not be able to cover all setup issues, but the purpose of setup is also to check
for its existence and dependencies. Scripts depending upon particular server conditions, should
have a proper setup verifying the server existence before proceeding further. 

4, I believe running test cases when setup is down is also not idealistic. 

5. Purpose is to reduce script errors vs failures due to product bugs. 

6. Logging this bug to track the setup issue cases or script failures. 


> Verifying proper Setup Issues EX:Server Down, other prerequisites for test setup to minimize
test script failures.
> ------------------------------------------------------------------------------------------------------------------
>
>                 Key: CLOUDSTACK-4971
>                 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4971
>             Project: CloudStack
>          Issue Type: Bug
>      Security Level: Public(Anyone can view this level - this is the default.) 
>         Environment: Regression,Smoke tests etc.
>            Reporter: Santhosh Kumar Edukulla
>            Assignee: sadhu suresh
>
> 1, Currently test scripts are running despite the test setup has issues. EX: In one of
the test scenario, where ldap server was down, test suite or test cases depending upon them
were still running. 
> 2, Ideally, the setup( test module setup ) should check for these dependencies before
running the test script and exit wherever possible with proper log and reporting.
> 3, We may not be able to cover all setup issues under setup class of test module or feature
test class, but the purpose of setup  is also to check for its existence and dependencies.
Scripts depending upon particular server conditions, should have a proper setup verifying
the server existence before proceeding further. 
> 4, I believe running test cases when setup is down is also not idealistic. 
> 5. Purpose is to reduce script errors vs failures due to product bugs. 
> 6. Logging this bug to track the setup issue cases or script failures. 



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message