cloudstack-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Daan Hoogland <daan.hoogl...@gmail.com>
Subject Re: Automation data on master...
Date Tue, 28 Jul 2015 07:16:32 GMT
Raja, this sounds very bad: 61 failures not considering some reported
failures are in setup methods, not in tests. Can you shed your light
on the results and causes?

On Tue, Jul 28, 2015 at 9:10 AM, Raja Pullela <raja.pullela@citrix.com> wrote:
> Hi,
>
> Here an automation summary on Master - ran it on a local env and happy to share logs
if needed.  For the bugs filed, the details are there in the tickets.
>
> Raja
>
> Config
>
> Passrate
>
> Bugs filed
>
> Failed Cases
>
> Simulator Basic
>
> 100
>
> NA
>
> NA
>
> Simulator Adv
>
> 100
>
> NA
>
> NA
>
> KVM Adv
>
> 94.3
>
> TBF
>
> Test Result (6 failures / ±0)
> ·         integration.smoke.test_snapshots.TestSnapshotRootDisk.test_01_snapshot_root_disk
> ·         integration.smoke.test_internal_lb.TestInternalLb.test_internallb
> ·         integration.smoke.test_nic.TestNic.test_01_nic
> ·         integration.smoke.test_regions.TestRegions.test_createRegion
> ·         integration.smoke.test_ssvm.TestSSVMs.test_07_reboot_ssvm
> ·         integration.smoke.test_ssvm.TestSSVMs.test_08_reboot_cpvm
>
> KVM Basic
>
> 42.4
>
> CLOUDSTACK-8668<https://issues.apache.org/jira/browse/CLOUDSTACK-8668>
>
> Test Result (20 failures / ±0)
> ·         integration.smoke.test_ssvm.TestSSVMs.test_08_reboot_cpvm
> ·         integration.smoke.test_affinity_groups.TestDeployVmWithAffinityGroup.test_DeployVmAntiAffinityGroup
> ·         integration.smoke.test_deploy_vm_iso.TestDeployVMFromISO.test_deploy_vm_from_iso
> ·         integration.smoke.test_deploy_vm_root_resize.TestDeployVM.test_00_deploy_vm_root_resize
> ·         integration.smoke.test_deploy_vm_with_userdata.TestDeployVmWithUserData.test_deployvm_userdata
> ·         integration.smoke.test_deploy_vm_with_userdata.TestDeployVmWithUserData.test_deployvm_userdata_post
> ·         integration.smoke.test_deploy_vms_with_varied_deploymentplanners.TestDeployVmWithVariedPlanners.test_deployvm_firstfit
> ·         integration.smoke.test_deploy_vms_with_varied_deploymentplanners.TestDeployVmWithVariedPlanners.test_deployvm_userconcentrated
> ·         integration.smoke.test_deploy_vms_with_varied_deploymentplanners.TestDeployVmWithVariedPlanners.test_deployvm_userdispersing
> ·         integration.smoke.test_multipleips_per_nic.TestDeployVM.test_nic_secondaryip_add_remove
> ·         integration.smoke.test_regions.TestRegions.test_createRegion
> ·         <nose.suite.ContextSuite context=TestResetVmOnReboot>:setup
> ·         <nose.suite.ContextSuite context=TestRouterServices>:setup
> ·         <nose.suite.ContextSuite context=TestServiceOfferings>:setup
> ·         <nose.suite.ContextSuite context=TestTemplates>:setup
> ·         <nose.suite.ContextSuite context=TestDeployVM>:setup
> ·         <nose.suite.ContextSuite context=TestVMLifeCycle>:setup
> ·         <nose.suite.ContextSuite context=TestCreateVolume>:setup
> ·         <nose.suite.ContextSuite context=TestVolumes>:setup
> ·         integration.smoke.test_ssvm.TestSSVMs.test_07_reboot_ssvm
>
> XS Adv
>
> 97.1
>
> TBF
>
> Test Result (3 failures / ±0)
> ·         integration.smoke.test_internal_lb.TestInternalLb.test_internallb
> ·         integration.smoke.test_nic.TestNic.test_01_nic
> ·         integration.smoke.test_regions.TestRegions.test_createRegion
>
> XS Basic
>
> 49.2
>
> CLOUDSTACK-8668<https://issues.apache.org/jira/browse/CLOUDSTACK-8668>
>
> Test Result (19 failures / ±0)
> ·         integration.smoke.test_affinity_groups.TestDeployVmWithAffinityGroup.test_DeployVmAntiAffinityGroup
> ·         integration.smoke.test_deploy_vm_iso.TestDeployVMFromISO.test_deploy_vm_from_iso
> ·         integration.smoke.test_deploy_vm_with_userdata.TestDeployVmWithUserData.test_deployvm_userdata
> ·         integration.smoke.test_deploy_vm_with_userdata.TestDeployVmWithUserData.test_deployvm_userdata_post
> ·         integration.smoke.test_deploy_vms_with_varied_deploymentplanners.TestDeployVmWithVariedPlanners.test_deployvm_firstfit
> ·         integration.smoke.test_deploy_vms_with_varied_deploymentplanners.TestDeployVmWithVariedPlanners.test_deployvm_userconcentrated
> ·         integration.smoke.test_deploy_vms_with_varied_deploymentplanners.TestDeployVmWithVariedPlanners.test_deployvm_userdispersing
> ·         integration.smoke.test_multipleips_per_nic.TestDeployVM.test_nic_secondaryip_add_remove
> ·         integration.smoke.test_regions.TestRegions.test_createRegion
> ·         <nose.suite.ContextSuite context=TestResetVmOnReboot>:setup
> ·         <nose.suite.ContextSuite context=TestRouterServices>:setup
> ·         <nose.suite.ContextSuite context=TestScaleVm>:setup
> ·         <nose.suite.ContextSuite context=TestServiceOfferings>:setup
> ·         <nose.suite.ContextSuite context=TestTemplates>:setup
> ·         <nose.suite.ContextSuite context=TestDeployVM>:setup
> ·         <nose.suite.ContextSuite context=TestVMLifeCycle>:setup
> ·         integration.smoke.test_vm_snapshots.TestSnapshots.test_01_test_vm_volume_snapshot
> ·         <nose.suite.ContextSuite context=TestCreateVolume>:setup
> ·         <nose.suite.ContextSuite context=TestVolumes>:setup
>
> VMWare
>
> 88.2
>
> CLOUDSTACK-8671<https://issues.apache.org/jira/browse/CLOUDSTACK-8671>
> CLOUDSTACK-8669<https://issues.apache.org/jira/browse/CLOUDSTACK-8669>
>
> ·         Test Result (13 failures / ±0)
> ·         integration.smoke.test_volumes.TestCreateVolume.test_01_create_volume
> ·         integration.smoke.test_volumes.TestVolumes.test_02_attach_volume
> ·         integration.smoke.test_volumes.TestVolumes.test_03_download_attached_volume
> ·         integration.smoke.test_volumes.TestVolumes.test_04_delete_attached_volume
> ·         integration.smoke.test_volumes.TestVolumes.test_05_detach_volume
> ·         integration.smoke.test_volumes.TestVolumes.test_06_download_detached_volume
> ·         integration.smoke.test_volumes.TestVolumes.test_07_resize_fail
> ·         integration.smoke.test_volumes.TestVolumes.test_08_resize_volume
> ·         integration.smoke.test_volumes.TestVolumes.test_09_delete_detached_volume
> ·         integration.smoke.test_deploy_vm_iso.TestDeployVMFromISO.test_deploy_vm_from_iso
> ·         integration.smoke.test_internal_lb.TestInternalLb.test_internallb
> ·         integration.smoke.test_nic.TestNic.test_01_nic
> ·         integration.smoke.test_regions.TestRegions.test_createRegion
>
>
>



-- 
Daan

Mime
View raw message