cloudstack-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Wilder Rodrigues <WRodrig...@schubergphilis.com>
Subject Re: BVT report for week of 12/14
Date Tue, 15 Dec 2015 11:52:03 GMT
Hi Raja,

Yes, those were moved and have been tested - as they to smoke tests instead of component.
All of them are passing and they have been executed not only by me. There are all green on
both KVM and Xen.

You can find my DC configurations here:

https://github.com/schubergphilis/MCT-shared/blob/master/marvin/mct-zone1-kvm1-ISOLATED.cfg
https://github.com/schubergphilis/MCT-shared/blob/master/marvin/mct-zone1-xen1-ISOLATED.cfg

But the tests do not depend on anything special.

The templates I use can be found here: http://dl.openvm.eu/cloudstack/macchinina/x86_64/

Cheers,
Wilder

On 15 Dec 2015, at 12:37, Raja Pullela <raja.pullela@citrix.com<mailto:raja.pullela@citrix.com>>
wrote:

Sebastien,   Yes, was looking at the details, found out the following details on the failures:

1) CLOUDSTACK-9120 - Moves tests to the smoke directory - test_router_dhcphosts.py, test_routers_iptables_default_policy.py,
test_routers_network_ops.py, test_vpc_redundant.py, test_vpc_router_nics.py.  the changes
were done around a week ago.

2) CLOUDSTACK-9153: When negative credits are added to an account- test_quota.py.  This one
added by Abhinandan Prateek.  I did see the PR related this with results showing it is passing.
 However, in my env these tests were failing with error " global name 'quotaTariffList' is
not defined".

Wilder,  can you comment on if all the tests in these scripts were passing in your env?

Best,
Raja
-----Original Message-----
From: Sebastien Goasguen [mailto:runseb@gmail.com]
Sent: Tuesday, December 15, 2015 3:31 PM
To: dev@cloudstack.apache.org<mailto:dev@cloudstack.apache.org>
Subject: Re: BVT report for week of 12/14


On Dec 15, 2015, at 10:45 AM, Raja Pullela <raja.pullela@citrix.com<mailto:raja.pullela@citrix.com>>
wrote:

Hi,

Here is the BVT report for this week -
- XS Basic - 97.0% (4.6 RC passrate 96.9%)
- XS Adv - 79.5% (4.6 RC passrate 93.4%)    //  went down from 92.7% to 79.5%

Hi Raja, with very few commits getting into master it should be relatively easy to identify
the commits responsible for this.
Do you know which one(s) it was.

- KVM Basic - 98.6% (4.6 RC passrate - 98.6%)
- KVM Adv - 79.7% (4.6 RC passrate - 96.3%) // went down from 96.4% to
79.7%

Summary:
- Breakage in Adv Network cases, the following suites need to be run
both Xen and Adv
- test_quota.py - all the test failing, we should look at the PR that has checked in this
code.
- test_vpc_vpn.py - couple of tests failing
- test_vpc_redundant.py - couple of test failing
- test_routers_network_ops.py - 5-6 tests failing
- test_routers_iptables_default_policy.py -
- test_privategw_acl.py

Let me know if you have any questions, Raja

Following are the failed tests:
- XS Basic  (both the following are test script issues)
-
integration.smoke.test_vm_snapshots.TestSnapshots.test_01_test_vm_volu
me_snapshot
- integration.smoke.test_iso.TestISO.test_07_list_default_iso

- KVM Basic (following is a test script issue)
- integration.smoke.test_iso.TestISO.test_07_list_default_iso //known
testcase issue

- XS Adv
- integration.smoke.test_nic.TestNic.test_01_nic
-
integration.smoke.test_routers_network_ops.TestIsolatedNetworks.test_0
2_isolate_network_FW_PF_default_routes_egress_false
- <nose.suite.ContextSuite context=TestRouterDHCPHosts>:setup
-
integration.smoke.test_routers_iptables_default_policy.TestRouterIpTab
lesPolicies.test_02_routervm_iptables_policies
-
integration.smoke.test_routers_iptables_default_policy.TestVPCIpTables
Policies.test_01_single_VPC_iptables_policies
-
integration.smoke.test_routers_network_ops.TestIsolatedNetworks.test_0
1_isolate_network_FW_PF_default_routes_egress_true
-
integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork
s.test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true
-
integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork
s.test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false
-
integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork
s.test_03_RVR_Network_check_router_state
-
integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_02_redunda
nt_VPC_default_routes
-
integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_03_create_
redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers
-
integration.smoke.test_vpc_router_nics.TestVPCNics.test_02_VPC_default
_routes
- integration.smoke.test_quota.TestQuota.test_01_quota
- integration.smoke.test_quota.TestQuota.test_02_quota
- integration.smoke.test_quota.TestQuota.test_03_quota
- integration.smoke.test_quota.TestQuota.test_04_quota
- integration.smoke.test_quota.TestQuota.test_05_quota
- integration.smoke.test_quota.TestQuota.test_06_quota
- integration.smoke.test_quota.TestQuota.test_07_quota
-
integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_priv
ategw_static_routes
-
integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_priv
ategw_static_routes
-
integration.smoke.test_privategw_acl.TestPrivateGwACL.test_03_rvpc_pri
vategw_static_routes
-
integration.smoke.test_vpc_vpn.TestVpcRemoteAccessVpn.test_vpc_remote_
access_vpn
-
integration.smoke.test_vpc_vpn.TestVpcSite2SiteVpn.test_vpc_site2site_
vpn
-
integration.smoke.test_internal_lb.TestInternalLb.test02_internallb_ha
proxy_stats_on_all_interfaces
-
integration.smoke.test_vm_snapshots.TestSnapshots.test_01_test_vm_volu
me_snapshot
- integration.smoke.test_iso.TestISO.test_07_list_default_iso

- KVM ADV
-
integration.smoke.test_deploy_vm_iso.TestDeployVMFromISO.test_deploy_v
m_from_iso
-
integration.smoke.test_routers.TestRouterServices.test_04_restart_netw
ork_wo_cleanup
-
integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork
s.test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false
-
integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork
s.test_03_RVR_Network_check_router_state
-
integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_01_create_
redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL
-
integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_01_create_
redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL
- <nose.suite.ContextSuite context=TestRouterDHCPHosts>:setup
-
integration.smoke.test_routers_iptables_default_policy.TestRouterIpTab
lesPolicies.test_02_routervm_iptables_policies
-
integration.smoke.test_routers_iptables_default_policy.TestVPCIpTables
Policies.test_01_single_VPC_iptables_policies
-
integration.smoke.test_routers_network_ops.TestIsolatedNetworks.test_0
1_isolate_network_FW_PF_default_routes_egress_true
-
integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork
s.test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true
-
integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_02_redunda
nt_VPC_default_routes
-
integration.smoke.test_vpc_router_nics.TestVPCNics.test_02_VPC_default
_routes
-
integration.smoke.test_internal_lb.TestInternalLb.test_01_internallb_r
oundrobin_1VPC_3VM_HTTP_port80
-
integration.smoke.test_vpc_vpn.TestVpcSite2SiteVpn.test_vpc_site2site_
vpn
- integration.smoke.test_quota.TestQuota.test_01_quota
- integration.smoke.test_quota.TestQuota.test_02_quota
- integration.smoke.test_quota.TestQuota.test_03_quota
- integration.smoke.test_quota.TestQuota.test_04_quota
- integration.smoke.test_quota.TestQuota.test_05_quota
- integration.smoke.test_quota.TestQuota.test_06_quota
- integration.smoke.test_quota.TestQuota.test_07_quota
-
integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_priv
ategw_static_routes
-
integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_priv
ategw_static_routes
-
integration.smoke.test_privategw_acl.TestPrivateGwACL.test_03_rvpc_pri
vategw_static_routes
- integration.smoke.test_iso.TestISO.test_07_list_default_iso

----------------------------------------------------------------------
--end-----------------------



Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message