cloudstack-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raja Pullela <raja.pull...@citrix.com>
Subject BVT report for the week of 12/7
Date Tue, 08 Dec 2015 12:23:03 GMT
Here are the BVT results based on the latest master, going forward please expect to see an
email on the BVTs beginning of every week:
- XS Basic - 97.3% (4.6 RC passrate 96.9%)
- XS Adv - 92.7% (4.6 RC passrate 93.4%)
- KVM Basic - 98.6% (4.6 RC passrate - 98.6%)
- KVM Adv - 96.4% (4.6 RC passrate - 96.3%)

Following are failing on both XS Adv and KVM Adv setups and possible product defects
* <nose.suite.ContextSuite context=TestVMLifeCycle>:setup  //Issue: Failed to create
firewall rule
* <nose.suite.ContextSuite context=TestCreateVolume>:setup  //Issue: Failed to apply
port forwarding rule
* integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_privategw_static_routes
//Issue: Ping to outside world from VM should be successful
* integration.smoke.test_privategw_acl.TestPrivateGwACL.test_03_rvpc_privategw_static_routes
//Issue: Ping to outside world from VM should be successful

Failed Test cases -  
XS Basic - 
- integration.smoke.test_vm_snapshots.TestSnapshots.test_01_test_vm_volume_snapshot  // testcase
issue
- integration.smoke.test_iso.TestISO.test_07_list_default_iso  //known testcase issue
KVM Basic -
* integration.smoke.test_iso.TestCreateIso.test_01_create_iso  //Timeout waiting for response
from storage host
* integration.smoke.test_iso.TestISO.test_07_list_default_iso  //known testcase issue
XS Adv - 
* integration.smoke.test_quota.TestQuota.test_01_quota //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_02_quota //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_03_quota //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_04_quota //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_05_quota //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_06_quota //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_07_quota //New tests added, test setup issue
* <nose.suite.ContextSuite context=TestVMLifeCycle>:setup  //Issue: Failed to create
firewall rule
* <nose.suite.ContextSuite context=TestCreateVolume>:setup  //Issue: Failed to apply
port forwarding rule
* integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_privategw_static_routes
//Issue: Ping to outside world from VM should be successful
* integration.smoke.test_privategw_acl.TestPrivateGwACL.test_03_rvpc_privategw_static_routes
//Issue: Ping to outside world from VM should be successful
* integration.smoke.test_vpc_vpn.TestVpcRemoteAccessVpn.test_vpc_remote_access_vpn
* integration.smoke.test_vpc_vpn.TestVpcSite2SiteVpn.test_vpc_site2site_vpn //testcase issue
* integration.smoke.test_internal_lb.TestInternalLb.test02_internallb_haproxy_stats_on_all_interfaces
 //testcase issue
* integration.smoke.test_internal_lb.TestInternalLb.test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80
 // testcase issue
* integration.smoke.test_vm_snapshots.TestSnapshots.test_01_test_vm_volume_snapshot  // testcase
issue
* integration.smoke.test_iso.TestISO.test_07_list_default_iso  // known testcase issue
KVM Adv- 
* integration.smoke.test_quota.TestQuota.test_01_quota //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_02_quota //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_03_quota  //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_04_quota  //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_05_quota  //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_06_quota  //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_07_quota  //New tests added, test setup issue
* <nose.suite.ContextSuite context=TestVpcSite2SiteVpn>:setup  //Testcase issue
* integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_privategw_static_routes
 //Issue: Ping to outside world from VM should be successful
* integration.smoke.test_privategw_acl.TestPrivateGwACL.test_03_rvpc_privategw_static_routes
 //Issue: Ping to outside world from VM should be successful
* integration.smoke.test_iso.TestISO.test_07_list_default_iso //known testcase issue

--------------------------------------end---------------------

Mime
View raw message