Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id CF78C200CBE for ; Fri, 7 Jul 2017 12:13:06 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id CE205168C25; Fri, 7 Jul 2017 10:13:06 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id C4153168C27 for ; Fri, 7 Jul 2017 12:13:05 +0200 (CEST) Received: (qmail 49473 invoked by uid 500); 7 Jul 2017 10:13:05 -0000 Mailing-List: contact issues-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cloudstack.apache.org Delivered-To: mailing list issues@cloudstack.apache.org Received: (qmail 49464 invoked by uid 500); 7 Jul 2017 10:13:04 -0000 Delivered-To: apmail-incubator-cloudstack-issues@incubator.apache.org Received: (qmail 49461 invoked by uid 99); 7 Jul 2017 10:13:04 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 07 Jul 2017 10:13:04 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 7787F1A03A5 for ; Fri, 7 Jul 2017 10:13:04 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id KMBhqyCzXnLA for ; Fri, 7 Jul 2017 10:13:02 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 3A3915FB40 for ; Fri, 7 Jul 2017 10:13:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 7FBB6E0373 for ; Fri, 7 Jul 2017 10:13:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 285AA24695 for ; Fri, 7 Jul 2017 10:13:00 +0000 (UTC) Date: Fri, 7 Jul 2017 10:13:00 +0000 (UTC) From: "Boris Stoyanov (JIRA)" To: cloudstack-issues@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (CLOUDSTACK-9989) Extend smoketests suite MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Fri, 07 Jul 2017 10:13:07 -0000 [ https://issues.apache.org/jira/browse/CLOUDSTACK-9989?page=3Dcom.atl= assian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Stoyanov updated CLOUDSTACK-9989: --------------------------------------- Description:=20 This improvement is to identify areas in smoketests to improve.=20 Item we could move from components tests into smoketests:=20 test_accounts.py test_host_maintenance.py test_regions.py test_usage.py * test_usage.py:=20 {code} [root@trl-722-k-cs410-bstoyanov-marvin ~]# cat /marvin//MarvinLogs/test_usa= ge_QZE99I/failed_plus_exceptions.txt 2017-07-07 08:50:54,314 - CRITICAL - EXCEPTION: None: ['Traceback (most rec= ent call last):\n', ' File "/usr/lib/python2.7/site-packages/nose/suite.py= ", line 209, in run\n self.setUp()\n', ' File "/usr/lib/python2.7/site-= packages/nose/suite.py", line 292, in setUp\n self.setupContext(ancestor= )\n', ' File "/usr/lib/python2.7/site-packages/nose/suite.py", line 315, i= n setupContext\n try_run(context, names)\n', ' File "/usr/lib/python2.7= /site-packages/nose/util.py", line 471, in try_run\n return func()\n', '= File "/marvin/tests/component/test_usage.py", line 1023, in setUpClass\n = cls.iso.id\n', 'Exception: ISO download failed exception: Failed to down= load ISO: ad2e9212-5aef-461e-9f7d-7cc86044f1ce\n'] 2017-07-07 09:09:18,458 - CRITICAL - EXCEPTION: test_01_template_usage: ['T= raceback (most recent call last):\n', ' File "/usr/lib64/python2.7/unittes= t/case.py", line 369, in run\n testMethod()\n', ' File "/marvin/tests/c= omponent/test_usage.py", line 928, in test_01_template_usage\n self.temp= late.delete(self.userapiclient)\n', ' File "/usr/lib/python2.7/site-packag= es/marvin/lib/base.py", line 1333, in delete\n apiclient.deleteTemplate(= cmd)\n', ' File "/usr/lib/python2.7/site-packages/marvin/cloudstackAPI/clo= udstackAPIClient.py", line 1874, in deleteTemplate\n response =3D self.c= onnection.marvinRequest(command, response_type=3Dresponse, method=3Dmethod)= \n', ' File "/usr/lib/python2.7/site-packages/marvin/cloudstackConnection.= py", line 379, in marvinRequest\n raise e\n', "Exception: Job failed: {j= obprocstatus : 0, created : u'2017-07-07T09:09:05+0000', jobresult : {error= code : 530, errortext : u'Failed to delete template'}, cmd : u'org.apache.c= loudstack.api.command.user.template.DeleteTemplateCmd', userid : u'ad0cc9a7= -2b64-404d-8b93-7fb64642e6a5', jobstatus : 2, jobid : u'5e1a9a95-164d-40b0-= af84-1bcd6713c513', jobresultcode : 530, jobinstanceid : u'47998d73-3ee5-45= 35-9c43-82f2b47d2d5d', jobresulttype : u'object', jobinstancetype : u'Templ= ate', accountid : u'e3104721-4a36-42ac-9238-1e7d0583f9ff'}\n"] 2017-07-07 09:16:08,697 - CRITICAL - EXCEPTION: test_01_volume_usage: ['Tra= ceback (most recent call last):\n', ' File "/usr/lib64/python2.7/unittest/= case.py", line 369, in run\n testMethod()\n', ' File "/marvin/tests/com= ponent/test_usage.py", line 693, in test_01_volume_usage\n "url"] =3D se= lf.testdata["coreos_volume"]["urlkvm"]\n', "KeyError: 'coreos_volume'\n"] Ran 8 tests in 3271.872s FAILED (errors=3D3) {code} Test regions: {code}Test for duplicate checks on region id ... =3D=3D=3D TestName: test_c= reateRegionWithExistingRegionId | Status : SUCCESS =3D=3D=3D ok Test for duplicate checks on region name ... =3D=3D=3D TestName: test_creat= eRegionWithExistingRegionName | Status : SUCCESS =3D=3D=3D ok Test for update Region ... =3D=3D=3D TestName: test_updateRegion | Status := SUCCESS =3D=3D=3D ok ---------------------------------------------------------------------- Ran 3 tests in 0.250s OK{code} test_host_maintance.py: It's being skipped if hosts are <2, can be refactored to <=3D 2. {code}test_01_cancel_host_maintenace_with_no_migration_jobs (tests.componen= t.test_host_maintenance.TestHostMaintenance) ... SKIP: Cancel host maintena= nce when VMs are migrating should be tested for 2 or more hosts test_02_cancel_host_maintenace_with_migration_jobs (tests.component.test_ho= st_maintenance.TestHostMaintenance) ... SKIP: Cancel host maintenance when = VMs are migrating can only be tested with 2 hosts ---------------------------------------------------------------------- Ran 2 tests in 0.118s OK (SKIP=3D2){code} all these areas are not covered in the smoketests was: This improvement is to identify areas in smoketests to improve.=20 Item we could move from components tests into smoketests:=20 test_accounts.py test_host_maintenance.py test_regions.py test_usage.py * test_usage.py:=20 {code} [root@trl-722-k-cs410-bstoyanov-marvin ~]# cat /marvin//MarvinLogs/test_usa= ge_QZE99I/failed_plus_exceptions.txt 2017-07-07 08:50:54,314 - CRITICAL - EXCEPTION: None: ['Traceback (most rec= ent call last):\n', ' File "/usr/lib/python2.7/site-packages/nose/suite.py= ", line 209, in run\n self.setUp()\n', ' File "/usr/lib/python2.7/site-= packages/nose/suite.py", line 292, in setUp\n self.setupContext(ancestor= )\n', ' File "/usr/lib/python2.7/site-packages/nose/suite.py", line 315, i= n setupContext\n try_run(context, names)\n', ' File "/usr/lib/python2.7= /site-packages/nose/util.py", line 471, in try_run\n return func()\n', '= File "/marvin/tests/component/test_usage.py", line 1023, in setUpClass\n = cls.iso.id\n', 'Exception: ISO download failed exception: Failed to down= load ISO: ad2e9212-5aef-461e-9f7d-7cc86044f1ce\n'] 2017-07-07 09:09:18,458 - CRITICAL - EXCEPTION: test_01_template_usage: ['T= raceback (most recent call last):\n', ' File "/usr/lib64/python2.7/unittes= t/case.py", line 369, in run\n testMethod()\n', ' File "/marvin/tests/c= omponent/test_usage.py", line 928, in test_01_template_usage\n self.temp= late.delete(self.userapiclient)\n', ' File "/usr/lib/python2.7/site-packag= es/marvin/lib/base.py", line 1333, in delete\n apiclient.deleteTemplate(= cmd)\n', ' File "/usr/lib/python2.7/site-packages/marvin/cloudstackAPI/clo= udstackAPIClient.py", line 1874, in deleteTemplate\n response =3D self.c= onnection.marvinRequest(command, response_type=3Dresponse, method=3Dmethod)= \n', ' File "/usr/lib/python2.7/site-packages/marvin/cloudstackConnection.= py", line 379, in marvinRequest\n raise e\n', "Exception: Job failed: {j= obprocstatus : 0, created : u'2017-07-07T09:09:05+0000', jobresult : {error= code : 530, errortext : u'Failed to delete template'}, cmd : u'org.apache.c= loudstack.api.command.user.template.DeleteTemplateCmd', userid : u'ad0cc9a7= -2b64-404d-8b93-7fb64642e6a5', jobstatus : 2, jobid : u'5e1a9a95-164d-40b0-= af84-1bcd6713c513', jobresultcode : 530, jobinstanceid : u'47998d73-3ee5-45= 35-9c43-82f2b47d2d5d', jobresulttype : u'object', jobinstancetype : u'Templ= ate', accountid : u'e3104721-4a36-42ac-9238-1e7d0583f9ff'}\n"] 2017-07-07 09:16:08,697 - CRITICAL - EXCEPTION: test_01_volume_usage: ['Tra= ceback (most recent call last):\n', ' File "/usr/lib64/python2.7/unittest/= case.py", line 369, in run\n testMethod()\n', ' File "/marvin/tests/com= ponent/test_usage.py", line 693, in test_01_volume_usage\n "url"] =3D se= lf.testdata["coreos_volume"]["urlkvm"]\n', "KeyError: 'coreos_volume'\n"] Ran 8 tests in 3271.872s FAILED (errors=3D3) {code} Test regions: {code}Test for duplicate checks on region id ... =3D=3D=3D TestName: test_c= reateRegionWithExistingRegionId | Status : SUCCESS =3D=3D=3D ok Test for duplicate checks on region name ... =3D=3D=3D TestName: test_creat= eRegionWithExistingRegionName | Status : SUCCESS =3D=3D=3D ok Test for update Region ... =3D=3D=3D TestName: test_updateRegion | Status := SUCCESS =3D=3D=3D ok ---------------------------------------------------------------------- Ran 3 tests in 0.250s OK{code} all these areas are not covered in the smoketests > Extend smoketests suite > ----------------------- > > Key: CLOUDSTACK-9989 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-998= 9 > Project: CloudStack > Issue Type: Improvement > Security Level: Public(Anyone can view this level - this is the defa= ult.)=20 > Components: marvin > Reporter: Boris Stoyanov > > This improvement is to identify areas in smoketests to improve.=20 > Item we could move from components tests into smoketests:=20 > test_accounts.py > test_host_maintenance.py > test_regions.py > test_usage.py > * test_usage.py:=20 > {code} > [root@trl-722-k-cs410-bstoyanov-marvin ~]# cat /marvin//MarvinLogs/test_u= sage_QZE99I/failed_plus_exceptions.txt > 2017-07-07 08:50:54,314 - CRITICAL - EXCEPTION: None: ['Traceback (most r= ecent call last):\n', ' File "/usr/lib/python2.7/site-packages/nose/suite.= py", line 209, in run\n self.setUp()\n', ' File "/usr/lib/python2.7/sit= e-packages/nose/suite.py", line 292, in setUp\n self.setupContext(ancest= or)\n', ' File "/usr/lib/python2.7/site-packages/nose/suite.py", line 315,= in setupContext\n try_run(context, names)\n', ' File "/usr/lib/python2= .7/site-packages/nose/util.py", line 471, in try_run\n return func()\n',= ' File "/marvin/tests/component/test_usage.py", line 1023, in setUpClass\= n cls.iso.id\n', 'Exception: ISO download failed exception: Failed to do= wnload ISO: ad2e9212-5aef-461e-9f7d-7cc86044f1ce\n'] > 2017-07-07 09:09:18,458 - CRITICAL - EXCEPTION: test_01_template_usage: [= 'Traceback (most recent call last):\n', ' File "/usr/lib64/python2.7/unitt= est/case.py", line 369, in run\n testMethod()\n', ' File "/marvin/tests= /component/test_usage.py", line 928, in test_01_template_usage\n self.te= mplate.delete(self.userapiclient)\n', ' File "/usr/lib/python2.7/site-pack= ages/marvin/lib/base.py", line 1333, in delete\n apiclient.deleteTemplat= e(cmd)\n', ' File "/usr/lib/python2.7/site-packages/marvin/cloudstackAPI/c= loudstackAPIClient.py", line 1874, in deleteTemplate\n response =3D self= .connection.marvinRequest(command, response_type=3Dresponse, method=3Dmetho= d)\n', ' File "/usr/lib/python2.7/site-packages/marvin/cloudstackConnectio= n.py", line 379, in marvinRequest\n raise e\n', "Exception: Job failed: = {jobprocstatus : 0, created : u'2017-07-07T09:09:05+0000', jobresult : {err= orcode : 530, errortext : u'Failed to delete template'}, cmd : u'org.apache= .cloudstack.api.command.user.template.DeleteTemplateCmd', userid : u'ad0cc9= a7-2b64-404d-8b93-7fb64642e6a5', jobstatus : 2, jobid : u'5e1a9a95-164d-40b= 0-af84-1bcd6713c513', jobresultcode : 530, jobinstanceid : u'47998d73-3ee5-= 4535-9c43-82f2b47d2d5d', jobresulttype : u'object', jobinstancetype : u'Tem= plate', accountid : u'e3104721-4a36-42ac-9238-1e7d0583f9ff'}\n"] > 2017-07-07 09:16:08,697 - CRITICAL - EXCEPTION: test_01_volume_usage: ['T= raceback (most recent call last):\n', ' File "/usr/lib64/python2.7/unittes= t/case.py", line 369, in run\n testMethod()\n', ' File "/marvin/tests/c= omponent/test_usage.py", line 693, in test_01_volume_usage\n "url"] =3D = self.testdata["coreos_volume"]["urlkvm"]\n', "KeyError: 'coreos_volume'\n"] > Ran 8 tests in 3271.872s > FAILED (errors=3D3) > {code} > Test regions: > {code}Test for duplicate checks on region id ... =3D=3D=3D TestName: test= _createRegionWithExistingRegionId | Status : SUCCESS =3D=3D=3D > ok > Test for duplicate checks on region name ... =3D=3D=3D TestName: test_cre= ateRegionWithExistingRegionName | Status : SUCCESS =3D=3D=3D > ok > Test for update Region ... =3D=3D=3D TestName: test_updateRegion | Status= : SUCCESS =3D=3D=3D > ok > ---------------------------------------------------------------------- > Ran 3 tests in 0.250s > OK{code} > test_host_maintance.py: > It's being skipped if hosts are <2, can be refactored to <=3D 2. > {code}test_01_cancel_host_maintenace_with_no_migration_jobs (tests.compon= ent.test_host_maintenance.TestHostMaintenance) ... SKIP: Cancel host mainte= nance when VMs are migrating should be tested for 2 or more hosts > test_02_cancel_host_maintenace_with_migration_jobs (tests.component.test_= host_maintenance.TestHostMaintenance) ... SKIP: Cancel host maintenance whe= n VMs are migrating can only be tested with 2 hosts > ---------------------------------------------------------------------- > Ran 2 tests in 0.118s > OK (SKIP=3D2){code} > all these areas are not covered in the smoketests -- This message was sent by Atlassian JIRA (v6.4.14#64029)