cloudstack-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raja Pullela <raja.pull...@citrix.com>
Subject RE: BVT report for week of 12/14
Date Tue, 15 Dec 2015 11:40:29 GMT
Wilder, the failures were due to checkins happened after my report from last week.  Let me
know if the tests (pl see my last email) you have moved to smoke folder worked in your env.
 If there are any specific changes/global settings to be done, please let me know,

Best,
Raja

-----Original Message-----
From: Wilder Rodrigues [mailto:WRodrigues@schubergphilis.com] 
Sent: Tuesday, December 15, 2015 4:15 PM
To: dev@cloudstack.apache.org
Subject: Re: BVT report for week of 12/14

Raja,

We need your help in order to understand what went wrong. Except for the Quota tests, all
the others you mentioned have been executed successfully agains master several times last
weeks.

Could you please past the error messages / exception stack trace and also tell us what kind
of environment (OS, etc) you have?

Your -1 would be difficult to sustain if all the other people get it to work fine, like Boris,
Remi and I already did over the weekend.

Cheers,
Wilder

> On 15 Dec 2015, at 10:45, Raja Pullela <raja.pullela@citrix.com> wrote:
> 
> Hi,
> 
> Here is the BVT report for this week -
> - XS Basic - 97.0% (4.6 RC passrate 96.9%)  
> - XS Adv - 79.5% (4.6 RC passrate 93.4%)    //  went down from 92.7% to 79.5%
> - KVM Basic - 98.6% (4.6 RC passrate - 98.6%)
> - KVM Adv - 79.7% (4.6 RC passrate - 96.3%) // went down from 96.4% to 
> 79.7%
> 
> Summary: 
> - Breakage in Adv Network cases, the following suites need to be run 
> both Xen and Adv
> - test_quota.py - all the test failing, we should look at the PR that has checked in
this code. 
> - test_vpc_vpn.py - couple of tests failing
> - test_vpc_redundant.py - couple of test failing
> - test_routers_network_ops.py - 5-6 tests failing
> - test_routers_iptables_default_policy.py -
> - test_privategw_acl.py
> 
> Let me know if you have any questions, Raja
> 
> Following are the failed tests: 
> - XS Basic  (both the following are test script issues)
> - 
> integration.smoke.test_vm_snapshots.TestSnapshots.test_01_test_vm_volu
> me_snapshot
> - integration.smoke.test_iso.TestISO.test_07_list_default_iso
> 
> - KVM Basic (following is a test script issue)
> - integration.smoke.test_iso.TestISO.test_07_list_default_iso //known 
> testcase issue
> 
> - XS Adv
> - integration.smoke.test_nic.TestNic.test_01_nic
> - 
> integration.smoke.test_routers_network_ops.TestIsolatedNetworks.test_0
> 2_isolate_network_FW_PF_default_routes_egress_false
> - <nose.suite.ContextSuite context=TestRouterDHCPHosts>:setup
> - 
> integration.smoke.test_routers_iptables_default_policy.TestRouterIpTab
> lesPolicies.test_02_routervm_iptables_policies
> - 
> integration.smoke.test_routers_iptables_default_policy.TestVPCIpTables
> Policies.test_01_single_VPC_iptables_policies
> - 
> integration.smoke.test_routers_network_ops.TestIsolatedNetworks.test_0
> 1_isolate_network_FW_PF_default_routes_egress_true
> - 
> integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork
> s.test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true
> - 
> integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork
> s.test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false
> - 
> integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork
> s.test_03_RVR_Network_check_router_state
> - 
> integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_02_redunda
> nt_VPC_default_routes
> - 
> integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_03_create_
> redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers
> - 
> integration.smoke.test_vpc_router_nics.TestVPCNics.test_02_VPC_default
> _routes
> - integration.smoke.test_quota.TestQuota.test_01_quota
> - integration.smoke.test_quota.TestQuota.test_02_quota
> - integration.smoke.test_quota.TestQuota.test_03_quota
> - integration.smoke.test_quota.TestQuota.test_04_quota
> - integration.smoke.test_quota.TestQuota.test_05_quota
> - integration.smoke.test_quota.TestQuota.test_06_quota
> - integration.smoke.test_quota.TestQuota.test_07_quota
> - 
> integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_priv
> ategw_static_routes
> - 
> integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_priv
> ategw_static_routes
> - 
> integration.smoke.test_privategw_acl.TestPrivateGwACL.test_03_rvpc_pri
> vategw_static_routes
> - 
> integration.smoke.test_vpc_vpn.TestVpcRemoteAccessVpn.test_vpc_remote_
> access_vpn
> - 
> integration.smoke.test_vpc_vpn.TestVpcSite2SiteVpn.test_vpc_site2site_
> vpn
> - 
> integration.smoke.test_internal_lb.TestInternalLb.test02_internallb_ha
> proxy_stats_on_all_interfaces
> - 
> integration.smoke.test_vm_snapshots.TestSnapshots.test_01_test_vm_volu
> me_snapshot
> - integration.smoke.test_iso.TestISO.test_07_list_default_iso
> 
> - KVM ADV
> - 
> integration.smoke.test_deploy_vm_iso.TestDeployVMFromISO.test_deploy_v
> m_from_iso
> - 
> integration.smoke.test_routers.TestRouterServices.test_04_restart_netw
> ork_wo_cleanup
> - 
> integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork
> s.test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false
> - 
> integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork
> s.test_03_RVR_Network_check_router_state
> - 
> integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_01_create_
> redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL
> - 
> integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_01_create_
> redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL
> - <nose.suite.ContextSuite context=TestRouterDHCPHosts>:setup
> - 
> integration.smoke.test_routers_iptables_default_policy.TestRouterIpTab
> lesPolicies.test_02_routervm_iptables_policies
> - 
> integration.smoke.test_routers_iptables_default_policy.TestVPCIpTables
> Policies.test_01_single_VPC_iptables_policies
> - 
> integration.smoke.test_routers_network_ops.TestIsolatedNetworks.test_0
> 1_isolate_network_FW_PF_default_routes_egress_true
> - 
> integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork
> s.test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true
> - 
> integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_02_redunda
> nt_VPC_default_routes
> - 
> integration.smoke.test_vpc_router_nics.TestVPCNics.test_02_VPC_default
> _routes
> - 
> integration.smoke.test_internal_lb.TestInternalLb.test_01_internallb_r
> oundrobin_1VPC_3VM_HTTP_port80
> - 
> integration.smoke.test_vpc_vpn.TestVpcSite2SiteVpn.test_vpc_site2site_
> vpn
> - integration.smoke.test_quota.TestQuota.test_01_quota
> - integration.smoke.test_quota.TestQuota.test_02_quota
> - integration.smoke.test_quota.TestQuota.test_03_quota
> - integration.smoke.test_quota.TestQuota.test_04_quota
> - integration.smoke.test_quota.TestQuota.test_05_quota
> - integration.smoke.test_quota.TestQuota.test_06_quota
> - integration.smoke.test_quota.TestQuota.test_07_quota
> - 
> integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_priv
> ategw_static_routes
> - 
> integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_priv
> ategw_static_routes
> - 
> integration.smoke.test_privategw_acl.TestPrivateGwACL.test_03_rvpc_pri
> vategw_static_routes
> - integration.smoke.test_iso.TestISO.test_07_list_default_iso
> 
> ----------------------------------------------------------------------
> --end-----------------------


Mime
View raw message