Mailing-List: contact issues-help@cloudstack.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@cloudstack.apache.org
Date: Fri, 17 Nov 2017 09:14:00 +0000 (UTC)
From: "ASF GitHub Bot (JIRA)" <jira@apache.org>
To: cloudstack-issues@incubator.apache.org
Message-ID: <JIRA.13085446.1499416348000.264885.1510910040165@Atlassian.JIRA>
In-Reply-To: <JIRA.13085446.1499416348000@Atlassian.JIRA>
References: <JIRA.13085446.1499416348000@Atlassian.JIRA> <JIRA.13085446.1499416348265@jira-lw-us.apache.org>
Subject: [jira] [Commented] (CLOUDSTACK-9989) Extend smoketests suite
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
archived-at: Fri, 17 Nov 2017 09:14:07 -0000


    [ https://issues.apache.org/jira/browse/CLOUDSTACK-9989?page=3Dcom.atla=
ssian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=
=3D16256694#comment-16256694 ]=20

ASF GitHub Bot commented on CLOUDSTACK-9989:
--------------------------------------------

blueorangutan commented on issue #2219: CLOUDSTACK-9989: Extend smoketests =
suite
URL: https://github.com/apache/cloudstack/pull/2219#issuecomment-345187279
=20
=20
   @rhtyd a Jenkins job has been kicked to build packages. I'll keep you po=
sted as I make progress.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
=20
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Extend smoketests suite
> -----------------------
>
>                 Key: CLOUDSTACK-9989
>                 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-998=
9
>             Project: CloudStack
>          Issue Type: Improvement
>      Security Level: Public(Anyone can view this level - this is the defa=
ult.)=20
>          Components: marvin
>            Reporter: Boris Stoyanov
>
> This improvement is to identify areas in smoketests to improve.=20
> Item we could move from components tests into smoketests:=20
> test_accounts.py
> test_host_maintenance.py
> test_regions.py
> test_usage.py
> test_projects
> * test_usage.py:=20
> {code}
> [root@trl-722-k-cs410-bstoyanov-marvin ~]# cat /marvin//MarvinLogs/test_u=
sage_QZE99I/failed_plus_exceptions.txt
> 2017-07-07 08:50:54,314 - CRITICAL - EXCEPTION: None: ['Traceback (most r=
ecent call last):\n', '  File "/usr/lib/python2.7/site-packages/nose/suite.=
py", line 209, in run\n    self.setUp()\n', '  File "/usr/lib/python2.7/sit=
e-packages/nose/suite.py", line 292, in setUp\n    self.setupContext(ancest=
or)\n', '  File "/usr/lib/python2.7/site-packages/nose/suite.py", line 315,=
 in setupContext\n    try_run(context, names)\n', '  File "/usr/lib/python2=
.7/site-packages/nose/util.py", line 471, in try_run\n    return func()\n',=
 '  File "/marvin/tests/component/test_usage.py", line 1023, in setUpClass\=
n    cls.iso.id\n', 'Exception: ISO download failed exception: Failed to do=
wnload ISO: ad2e9212-5aef-461e-9f7d-7cc86044f1ce\n']
> 2017-07-07 09:09:18,458 - CRITICAL - EXCEPTION: test_01_template_usage: [=
'Traceback (most recent call last):\n', '  File "/usr/lib64/python2.7/unitt=
est/case.py", line 369, in run\n    testMethod()\n', '  File "/marvin/tests=
/component/test_usage.py", line 928, in test_01_template_usage\n    self.te=
mplate.delete(self.userapiclient)\n', '  File "/usr/lib/python2.7/site-pack=
ages/marvin/lib/base.py", line 1333, in delete\n    apiclient.deleteTemplat=
e(cmd)\n', '  File "/usr/lib/python2.7/site-packages/marvin/cloudstackAPI/c=
loudstackAPIClient.py", line 1874, in deleteTemplate\n    response =3D self=
.connection.marvinRequest(command, response_type=3Dresponse, method=3Dmetho=
d)\n', '  File "/usr/lib/python2.7/site-packages/marvin/cloudstackConnectio=
n.py", line 379, in marvinRequest\n    raise e\n', "Exception: Job failed: =
{jobprocstatus : 0, created : u'2017-07-07T09:09:05+0000', jobresult : {err=
orcode : 530, errortext : u'Failed to delete template'}, cmd : u'org.apache=
.cloudstack.api.command.user.template.DeleteTemplateCmd', userid : u'ad0cc9=
a7-2b64-404d-8b93-7fb64642e6a5', jobstatus : 2, jobid : u'5e1a9a95-164d-40b=
0-af84-1bcd6713c513', jobresultcode : 530, jobinstanceid : u'47998d73-3ee5-=
4535-9c43-82f2b47d2d5d', jobresulttype : u'object', jobinstancetype : u'Tem=
plate', accountid : u'e3104721-4a36-42ac-9238-1e7d0583f9ff'}\n"]
> 2017-07-07 09:16:08,697 - CRITICAL - EXCEPTION: test_01_volume_usage: ['T=
raceback (most recent call last):\n', '  File "/usr/lib64/python2.7/unittes=
t/case.py", line 369, in run\n    testMethod()\n', '  File "/marvin/tests/c=
omponent/test_usage.py", line 693, in test_01_volume_usage\n    "url"] =3D =
self.testdata["coreos_volume"]["urlkvm"]\n', "KeyError: 'coreos_volume'\n"]
> Ran 8 tests in 3271.872s
> FAILED (errors=3D3)
> {code}
> Test regions:
> {code}Test for duplicate checks on region id ... =3D=3D=3D TestName: test=
_createRegionWithExistingRegionId | Status : SUCCESS =3D=3D=3D
> ok
> Test for duplicate checks on region name ... =3D=3D=3D TestName: test_cre=
ateRegionWithExistingRegionName | Status : SUCCESS =3D=3D=3D
> ok
> Test for update Region ... =3D=3D=3D TestName: test_updateRegion | Status=
 : SUCCESS =3D=3D=3D
> ok
> ----------------------------------------------------------------------
> Ran 3 tests in 0.250s
> OK{code}
> test_host_maintance.py:
> It's being skipped if hosts are <2, can be refactored to <=3D 2.
> {code}test_01_cancel_host_maintenace_with_no_migration_jobs (tests.compon=
ent.test_host_maintenance.TestHostMaintenance) ... SKIP: Cancel host mainte=
nance when VMs are migrating should be tested for 2 or more hosts
> test_02_cancel_host_maintenace_with_migration_jobs (tests.component.test_=
host_maintenance.TestHostMaintenance) ... SKIP: Cancel host maintenance whe=
n VMs are migrating can only be tested with 2 hosts
> ----------------------------------------------------------------------
> Ran 2 tests in 0.118s
> OK (SKIP=3D2){code}
> test_accounts.py
> {code}-------------------------------------------------------------------=
---
> [root@trl-722-k-cs410-bstoyanov-marvin ~]# cat /marvin//MarvinLogs/test_a=
ccounts_9JJBCO/failed_plus_exceptions.txt
> 2017-07-07 10:41:13,365 - CRITICAL - EXCEPTION: test_01_service_offering_=
siblings: ['Traceback (most recent call last):\n', '  File "/usr/lib/python=
2.7/site-packages/nose/suite.py", line 209, in run\n    self.setUp()\n', ' =
 File "/usr/lib/python2.7/site-packages/nose/suite.py", line 292, in setUp\=
n    self.setupContext(ancestor)\n', '  File "/usr/lib/python2.7/site-packa=
ges/nose/suite.py", line 315, in setupContext\n    try_run(context, names)\=
n', '  File "/usr/lib/python2.7/site-packages/nose/util.py", line 471, in t=
ry_run\n    return func()\n', '  File "/marvin/tests/component/test_account=
s.py", line 827, in setUpClass\n    builtin_info =3D get_builtin_template_i=
nfo(cls.api_client, cls.zone.id)\n', '  File "/usr/lib/python2.7/site-packa=
ges/marvin/lib/common.py", line 502, in get_builtin_template_info\n    zone=
id)\n', '  File "/usr/lib/python2.7/site-packages/marvin/lib/base.py", line=
 1289, in extract\n    return apiclient.extractTemplate(cmd)\n', '  File "/=
usr/lib/python2.7/site-packages/marvin/cloudstackAPI/cloudstackAPIClient.py=
", line 2939, in extractTemplate\n    response =3D self.connection.marvinRe=
quest(command, response_type=3Dresponse, method=3Dmethod)\n', '  File "/usr=
/lib/python2.7/site-packages/marvin/cloudstackConnection.py", line 379, in =
marvinRequest\n    raise e\n', "Exception: Job failed: {jobprocstatus : 0, =
created : u'2017-07-07T10:41:00+0000', jobresult : {errorcode : 530, errort=
ext : u'Unable to create a link for entity at template/tmpl/1/4/a647a939-57=
64-3211-8f93-0c7357de21cf.qcow2 on ssvm,No remote endpoint to send command,=
 check if host or ssvm is down?'}, cmd : u'org.apache.cloudstack.api.comman=
d.user.template.ExtractTemplateCmd', userid : u'fe25b2c4-5b42-11e7-bd75-063=
5a0010739', jobstatus : 2, jobid : u'18248038-e3d3-41c6-99dd-982fed3c13c2',=
 jobresultcode : 530, jobinstanceid : u'c7373f24-5b42-11e7-bd75-0635a001073=
9', jobresulttype : u'object', jobinstancetype : u'Template', accountid : u=
'fe25a83f-5b42-11e7-bd75-0635a0010739'}\n"]
> 2017-07-07 10:41:15,811 - CRITICAL - FAILED: test_user_key_renew_same_acc=
ount: ['Traceback (most recent call last):\n', '  File "/usr/lib64/python2.=
7/unittest/case.py", line 369, in run\n    testMethod()\n', '  File "/marvi=
n/tests/component/test_accounts.py", line 1655, in test_user_key_renew_same=
_account\n    "Check User having secret key")\n', '  File "/usr/lib64/pytho=
n2.7/unittest/case.py", line 553, in assertEqual\n    assertion_func(first,=
 second, msg=3Dmsg)\n', '  File "/usr/lib64/python2.7/unittest/case.py", li=
ne 546, in _baseAssertEqual\n    raise self.failureException(msg)\n', 'Asse=
rtionError: Check User having secret key\n']
> 2017-07-07 10:41:54,559 - CRITICAL - EXCEPTION: test_LoginApiDomain: ['Tr=
aceback (most recent call last):\n', '  File "/usr/lib64/python2.7/unittest=
/case.py", line 369, in run\n    testMethod()\n', '  File "/marvin/tests/co=
mponent/test_accounts.py", line 1522, in test_LoginApiDomain\n    domainid=
=3Ddomain.id)\n', '  File "/usr/lib/python2.7/site-packages/marvin/lib/base=
.py", line 315, in login\n    return apiclient.login(cmd)\n', '  File "/usr=
/lib/python2.7/site-packages/marvin/cloudstackAPI/cloudstackAPIClient.py", =
line 1639, in login\n    response =3D self.connection.marvinRequest(command=
, response_type=3Dresponse, method=3Dmethod)\n', '  File "/usr/lib/python2.=
7/site-packages/marvin/cloudstackConnection.py", line 379, in marvinRequest=
\n    raise e\n', 'ValueError: No JSON object could be decoded\n']
> 2017-07-07 10:42:00,288 - CRITICAL - EXCEPTION: test_LoginApiUuidResponse=
: ['Traceback (most recent call last):\n', '  File "/usr/lib64/python2.7/un=
ittest/case.py", line 369, in run\n    testMethod()\n', '  File "/marvin/te=
sts/component/test_accounts.py", line 1450, in test_LoginApiUuidResponse\n =
   password=3Dself.services["account"]["password"]\n', '  File "/usr/lib/py=
thon2.7/site-packages/marvin/lib/base.py", line 315, in login\n    return a=
piclient.login(cmd)\n', '  File "/usr/lib/python2.7/site-packages/marvin/cl=
oudstackAPI/cloudstackAPIClient.py", line 1639, in login\n    response =3D =
self.connection.marvinRequest(command, response_type=3Dresponse, method=3Dm=
ethod)\n', '  File "/usr/lib/python2.7/site-packages/marvin/cloudstackConne=
ction.py", line 379, in marvinRequest\n    raise e\n', 'ValueError: No JSON=
 object could be decoded\n']
> Ran 15 tests in 1222.303s
> FAILED (errors=3D3, failures=3D1)
> {code}
> test_projects looking good:=20
> {code}[root@trl-722-k-cs410-bstoyanov-marvin ~]# cat /marvin//MarvinLogs/=
test_projects_5JAJZW/results.txt
> Verify No cross domain projects ... =3D=3D=3D TestName: test_02_cross_dom=
ain_account_add | Status : SUCCESS =3D=3D=3D
> ok
> Test As long as the project exists, its owner can't be removed ... =3D=3D=
=3D TestName: test_03_delete_account_with_project | Status : SUCCESS =3D=3D=
=3D
> ok
> Test Verify delete domain with cleanup=3Dtrue should delete projects ... =
=3D=3D=3D TestName: test_04_delete_domain_with_project | Status : SUCCESS =
=3D=3D=3D
> ok
> Verify an account can own multiple projects and can belong to multiple pr=
ojects ... =3D=3D=3D TestName: test_01_create_multiple_projects_by_account =
| Status : SUCCESS =3D=3D=3D
> ok
> Test Verify a project user can be later promoted to become a ... =3D=3D=
=3D TestName: test_05_user_project_owner_promotion | Status : SUCCESS =3D=
=3D=3D
> ok
> Test Verify there can only be one owner of a project at a time ... =3D=3D=
=3D TestName: test_06_max_one_project_owner | Status : SUCCESS =3D=3D=3D
> ok
> Test Verify after an account is removed from the project, all its resourc=
es stay with the project. ... =3D=3D=3D TestName: test_07_project_resources=
_account_delete | Status : SUCCESS =3D=3D=3D
> ok
> Test accounts are unassigned from project after project deletion ... =3D=
=3D=3D TestName: test_08_cleanup_after_project_delete | Status : SUCCESS =
=3D=3D=3D
> ok
> Test Verify after an account is removed from the project, all his ... =3D=
=3D=3D TestName: test_09_project_suspend | Status : SUCCESS =3D=3D=3D
> ok
> Test project activation after suspension ... =3D=3D=3D TestName: test_10_=
project_activation | Status : SUCCESS =3D=3D=3D
> ok
> ----------------------------------------------------------------------
> Ran 10 tests in 699.622s
> OK{code}
> all these areas are not covered in the smoketests


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)