cloudstack-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raja Pullela <raja.pull...@citrix.com>
Subject RE: BVT report for week of 12/14
Date Tue, 15 Dec 2015 11:37:05 GMT
Sebastien,   Yes, was looking at the details, found out the following details on the failures:

1) CLOUDSTACK-9120 - Moves tests to the smoke directory - test_router_dhcphosts.py, test_routers_iptables_default_policy.py,
test_routers_network_ops.py, test_vpc_redundant.py, test_vpc_router_nics.py.  the changes
were done around a week ago.  

2) CLOUDSTACK-9153: When negative credits are added to an account- test_quota.py.  This one
added by Abhinandan Prateek.  I did see the PR related this with results showing it is passing.
 However, in my env these tests were failing with error " global name 'quotaTariffList' is
not defined".  

Wilder,  can you comment on if all the tests in these scripts were passing in your env?  

Best,
Raja
-----Original Message-----
From: Sebastien Goasguen [mailto:runseb@gmail.com] 
Sent: Tuesday, December 15, 2015 3:31 PM
To: dev@cloudstack.apache.org
Subject: Re: BVT report for week of 12/14


> On Dec 15, 2015, at 10:45 AM, Raja Pullela <raja.pullela@citrix.com> wrote:
> 
> Hi,
> 
> Here is the BVT report for this week -
> - XS Basic - 97.0% (4.6 RC passrate 96.9%)  
> - XS Adv - 79.5% (4.6 RC passrate 93.4%)    //  went down from 92.7% to 79.5%

Hi Raja, with very few commits getting into master it should be relatively easy to identify
the commits responsible for this.
Do you know which one(s) it was.

> - KVM Basic - 98.6% (4.6 RC passrate - 98.6%)
> - KVM Adv - 79.7% (4.6 RC passrate - 96.3%) // went down from 96.4% to 
> 79.7%
> 
> Summary: 
> - Breakage in Adv Network cases, the following suites need to be run 
> both Xen and Adv
> - test_quota.py - all the test failing, we should look at the PR that has checked in
this code. 
> - test_vpc_vpn.py - couple of tests failing
> - test_vpc_redundant.py - couple of test failing
> - test_routers_network_ops.py - 5-6 tests failing
> - test_routers_iptables_default_policy.py -
> - test_privategw_acl.py
> 
> Let me know if you have any questions, Raja
> 
> Following are the failed tests: 
> - XS Basic  (both the following are test script issues)
> - 
> integration.smoke.test_vm_snapshots.TestSnapshots.test_01_test_vm_volu
> me_snapshot
> - integration.smoke.test_iso.TestISO.test_07_list_default_iso
> 
> - KVM Basic (following is a test script issue)
> - integration.smoke.test_iso.TestISO.test_07_list_default_iso //known 
> testcase issue
> 
> - XS Adv
> - integration.smoke.test_nic.TestNic.test_01_nic
> - 
> integration.smoke.test_routers_network_ops.TestIsolatedNetworks.test_0
> 2_isolate_network_FW_PF_default_routes_egress_false
> - <nose.suite.ContextSuite context=TestRouterDHCPHosts>:setup
> - 
> integration.smoke.test_routers_iptables_default_policy.TestRouterIpTab
> lesPolicies.test_02_routervm_iptables_policies
> - 
> integration.smoke.test_routers_iptables_default_policy.TestVPCIpTables
> Policies.test_01_single_VPC_iptables_policies
> - 
> integration.smoke.test_routers_network_ops.TestIsolatedNetworks.test_0
> 1_isolate_network_FW_PF_default_routes_egress_true
> - 
> integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork
> s.test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true
> - 
> integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork
> s.test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false
> - 
> integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork
> s.test_03_RVR_Network_check_router_state
> - 
> integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_02_redunda
> nt_VPC_default_routes
> - 
> integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_03_create_
> redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers
> - 
> integration.smoke.test_vpc_router_nics.TestVPCNics.test_02_VPC_default
> _routes
> - integration.smoke.test_quota.TestQuota.test_01_quota
> - integration.smoke.test_quota.TestQuota.test_02_quota
> - integration.smoke.test_quota.TestQuota.test_03_quota
> - integration.smoke.test_quota.TestQuota.test_04_quota
> - integration.smoke.test_quota.TestQuota.test_05_quota
> - integration.smoke.test_quota.TestQuota.test_06_quota
> - integration.smoke.test_quota.TestQuota.test_07_quota
> - 
> integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_priv
> ategw_static_routes
> - 
> integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_priv
> ategw_static_routes
> - 
> integration.smoke.test_privategw_acl.TestPrivateGwACL.test_03_rvpc_pri
> vategw_static_routes
> - 
> integration.smoke.test_vpc_vpn.TestVpcRemoteAccessVpn.test_vpc_remote_
> access_vpn
> - 
> integration.smoke.test_vpc_vpn.TestVpcSite2SiteVpn.test_vpc_site2site_
> vpn
> - 
> integration.smoke.test_internal_lb.TestInternalLb.test02_internallb_ha
> proxy_stats_on_all_interfaces
> - 
> integration.smoke.test_vm_snapshots.TestSnapshots.test_01_test_vm_volu
> me_snapshot
> - integration.smoke.test_iso.TestISO.test_07_list_default_iso
> 
> - KVM ADV
> - 
> integration.smoke.test_deploy_vm_iso.TestDeployVMFromISO.test_deploy_v
> m_from_iso
> - 
> integration.smoke.test_routers.TestRouterServices.test_04_restart_netw
> ork_wo_cleanup
> - 
> integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork
> s.test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false
> - 
> integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork
> s.test_03_RVR_Network_check_router_state
> - 
> integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_01_create_
> redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL
> - 
> integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_01_create_
> redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL
> - <nose.suite.ContextSuite context=TestRouterDHCPHosts>:setup
> - 
> integration.smoke.test_routers_iptables_default_policy.TestRouterIpTab
> lesPolicies.test_02_routervm_iptables_policies
> - 
> integration.smoke.test_routers_iptables_default_policy.TestVPCIpTables
> Policies.test_01_single_VPC_iptables_policies
> - 
> integration.smoke.test_routers_network_ops.TestIsolatedNetworks.test_0
> 1_isolate_network_FW_PF_default_routes_egress_true
> - 
> integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork
> s.test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true
> - 
> integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_02_redunda
> nt_VPC_default_routes
> - 
> integration.smoke.test_vpc_router_nics.TestVPCNics.test_02_VPC_default
> _routes
> - 
> integration.smoke.test_internal_lb.TestInternalLb.test_01_internallb_r
> oundrobin_1VPC_3VM_HTTP_port80
> - 
> integration.smoke.test_vpc_vpn.TestVpcSite2SiteVpn.test_vpc_site2site_
> vpn
> - integration.smoke.test_quota.TestQuota.test_01_quota
> - integration.smoke.test_quota.TestQuota.test_02_quota
> - integration.smoke.test_quota.TestQuota.test_03_quota
> - integration.smoke.test_quota.TestQuota.test_04_quota
> - integration.smoke.test_quota.TestQuota.test_05_quota
> - integration.smoke.test_quota.TestQuota.test_06_quota
> - integration.smoke.test_quota.TestQuota.test_07_quota
> - 
> integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_priv
> ategw_static_routes
> - 
> integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_priv
> ategw_static_routes
> - 
> integration.smoke.test_privategw_acl.TestPrivateGwACL.test_03_rvpc_pri
> vategw_static_routes
> - integration.smoke.test_iso.TestISO.test_07_list_default_iso
> 
> ----------------------------------------------------------------------
> --end-----------------------


Mime
View raw message