cloudstack-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Boris Stoyanov (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CLOUDSTACK-9989) Extend smoketests suite
Date Fri, 07 Jul 2017 10:13:00 GMT

     [ https://issues.apache.org/jira/browse/CLOUDSTACK-9989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Boris Stoyanov updated CLOUDSTACK-9989:
---------------------------------------
    Description: 
This improvement is to identify areas in smoketests to improve. 

Item we could move from components tests into smoketests: 
test_accounts.py
test_host_maintenance.py
test_regions.py
test_usage.py


* test_usage.py: 
{code}
[root@trl-722-k-cs410-bstoyanov-marvin ~]# cat /marvin//MarvinLogs/test_usage_QZE99I/failed_plus_exceptions.txt
2017-07-07 08:50:54,314 - CRITICAL - EXCEPTION: None: ['Traceback (most recent call last):\n',
'  File "/usr/lib/python2.7/site-packages/nose/suite.py", line 209, in run\n    self.setUp()\n',
'  File "/usr/lib/python2.7/site-packages/nose/suite.py", line 292, in setUp\n    self.setupContext(ancestor)\n',
'  File "/usr/lib/python2.7/site-packages/nose/suite.py", line 315, in setupContext\n    try_run(context,
names)\n', '  File "/usr/lib/python2.7/site-packages/nose/util.py", line 471, in try_run\n
   return func()\n', '  File "/marvin/tests/component/test_usage.py", line 1023, in setUpClass\n
   cls.iso.id\n', 'Exception: ISO download failed exception: Failed to download ISO: ad2e9212-5aef-461e-9f7d-7cc86044f1ce\n']
2017-07-07 09:09:18,458 - CRITICAL - EXCEPTION: test_01_template_usage: ['Traceback (most
recent call last):\n', '  File "/usr/lib64/python2.7/unittest/case.py", line 369, in run\n
   testMethod()\n', '  File "/marvin/tests/component/test_usage.py", line 928, in test_01_template_usage\n
   self.template.delete(self.userapiclient)\n', '  File "/usr/lib/python2.7/site-packages/marvin/lib/base.py",
line 1333, in delete\n    apiclient.deleteTemplate(cmd)\n', '  File "/usr/lib/python2.7/site-packages/marvin/cloudstackAPI/cloudstackAPIClient.py",
line 1874, in deleteTemplate\n    response = self.connection.marvinRequest(command, response_type=response,
method=method)\n', '  File "/usr/lib/python2.7/site-packages/marvin/cloudstackConnection.py",
line 379, in marvinRequest\n    raise e\n', "Exception: Job failed: {jobprocstatus : 0, created
: u'2017-07-07T09:09:05+0000', jobresult : {errorcode : 530, errortext : u'Failed to delete
template'}, cmd : u'org.apache.cloudstack.api.command.user.template.DeleteTemplateCmd', userid
: u'ad0cc9a7-2b64-404d-8b93-7fb64642e6a5', jobstatus : 2, jobid : u'5e1a9a95-164d-40b0-af84-1bcd6713c513',
jobresultcode : 530, jobinstanceid : u'47998d73-3ee5-4535-9c43-82f2b47d2d5d', jobresulttype
: u'object', jobinstancetype : u'Template', accountid : u'e3104721-4a36-42ac-9238-1e7d0583f9ff'}\n"]
2017-07-07 09:16:08,697 - CRITICAL - EXCEPTION: test_01_volume_usage: ['Traceback (most recent
call last):\n', '  File "/usr/lib64/python2.7/unittest/case.py", line 369, in run\n    testMethod()\n',
'  File "/marvin/tests/component/test_usage.py", line 693, in test_01_volume_usage\n    "url"]
= self.testdata["coreos_volume"]["urlkvm"]\n', "KeyError: 'coreos_volume'\n"]

Ran 8 tests in 3271.872s

FAILED (errors=3)
{code}

Test regions:
{code}Test for duplicate checks on region id ... === TestName: test_createRegionWithExistingRegionId
| Status : SUCCESS ===
ok
Test for duplicate checks on region name ... === TestName: test_createRegionWithExistingRegionName
| Status : SUCCESS ===
ok
Test for update Region ... === TestName: test_updateRegion | Status : SUCCESS ===
ok

----------------------------------------------------------------------
Ran 3 tests in 0.250s

OK{code}

test_host_maintance.py:
It's being skipped if hosts are <2, can be refactored to <= 2.

{code}test_01_cancel_host_maintenace_with_no_migration_jobs (tests.component.test_host_maintenance.TestHostMaintenance)
... SKIP: Cancel host maintenance when VMs are migrating should be tested for 2 or more hosts
test_02_cancel_host_maintenace_with_migration_jobs (tests.component.test_host_maintenance.TestHostMaintenance)
... SKIP: Cancel host maintenance when VMs are migrating can only be tested with 2 hosts

----------------------------------------------------------------------
Ran 2 tests in 0.118s

OK (SKIP=2){code}

all these areas are not covered in the smoketests

  was:
This improvement is to identify areas in smoketests to improve. 

Item we could move from components tests into smoketests: 
test_accounts.py
test_host_maintenance.py
test_regions.py
test_usage.py


* test_usage.py: 
{code}
[root@trl-722-k-cs410-bstoyanov-marvin ~]# cat /marvin//MarvinLogs/test_usage_QZE99I/failed_plus_exceptions.txt
2017-07-07 08:50:54,314 - CRITICAL - EXCEPTION: None: ['Traceback (most recent call last):\n',
'  File "/usr/lib/python2.7/site-packages/nose/suite.py", line 209, in run\n    self.setUp()\n',
'  File "/usr/lib/python2.7/site-packages/nose/suite.py", line 292, in setUp\n    self.setupContext(ancestor)\n',
'  File "/usr/lib/python2.7/site-packages/nose/suite.py", line 315, in setupContext\n    try_run(context,
names)\n', '  File "/usr/lib/python2.7/site-packages/nose/util.py", line 471, in try_run\n
   return func()\n', '  File "/marvin/tests/component/test_usage.py", line 1023, in setUpClass\n
   cls.iso.id\n', 'Exception: ISO download failed exception: Failed to download ISO: ad2e9212-5aef-461e-9f7d-7cc86044f1ce\n']
2017-07-07 09:09:18,458 - CRITICAL - EXCEPTION: test_01_template_usage: ['Traceback (most
recent call last):\n', '  File "/usr/lib64/python2.7/unittest/case.py", line 369, in run\n
   testMethod()\n', '  File "/marvin/tests/component/test_usage.py", line 928, in test_01_template_usage\n
   self.template.delete(self.userapiclient)\n', '  File "/usr/lib/python2.7/site-packages/marvin/lib/base.py",
line 1333, in delete\n    apiclient.deleteTemplate(cmd)\n', '  File "/usr/lib/python2.7/site-packages/marvin/cloudstackAPI/cloudstackAPIClient.py",
line 1874, in deleteTemplate\n    response = self.connection.marvinRequest(command, response_type=response,
method=method)\n', '  File "/usr/lib/python2.7/site-packages/marvin/cloudstackConnection.py",
line 379, in marvinRequest\n    raise e\n', "Exception: Job failed: {jobprocstatus : 0, created
: u'2017-07-07T09:09:05+0000', jobresult : {errorcode : 530, errortext : u'Failed to delete
template'}, cmd : u'org.apache.cloudstack.api.command.user.template.DeleteTemplateCmd', userid
: u'ad0cc9a7-2b64-404d-8b93-7fb64642e6a5', jobstatus : 2, jobid : u'5e1a9a95-164d-40b0-af84-1bcd6713c513',
jobresultcode : 530, jobinstanceid : u'47998d73-3ee5-4535-9c43-82f2b47d2d5d', jobresulttype
: u'object', jobinstancetype : u'Template', accountid : u'e3104721-4a36-42ac-9238-1e7d0583f9ff'}\n"]
2017-07-07 09:16:08,697 - CRITICAL - EXCEPTION: test_01_volume_usage: ['Traceback (most recent
call last):\n', '  File "/usr/lib64/python2.7/unittest/case.py", line 369, in run\n    testMethod()\n',
'  File "/marvin/tests/component/test_usage.py", line 693, in test_01_volume_usage\n    "url"]
= self.testdata["coreos_volume"]["urlkvm"]\n', "KeyError: 'coreos_volume'\n"]

Ran 8 tests in 3271.872s

FAILED (errors=3)
{code}

Test regions:
{code}Test for duplicate checks on region id ... === TestName: test_createRegionWithExistingRegionId
| Status : SUCCESS ===
ok
Test for duplicate checks on region name ... === TestName: test_createRegionWithExistingRegionName
| Status : SUCCESS ===
ok
Test for update Region ... === TestName: test_updateRegion | Status : SUCCESS ===
ok

----------------------------------------------------------------------
Ran 3 tests in 0.250s

OK{code}

all these areas are not covered in the smoketests


> Extend smoketests suite
> -----------------------
>
>                 Key: CLOUDSTACK-9989
>                 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-9989
>             Project: CloudStack
>          Issue Type: Improvement
>      Security Level: Public(Anyone can view this level - this is the default.) 
>          Components: marvin
>            Reporter: Boris Stoyanov
>
> This improvement is to identify areas in smoketests to improve. 
> Item we could move from components tests into smoketests: 
> test_accounts.py
> test_host_maintenance.py
> test_regions.py
> test_usage.py
> * test_usage.py: 
> {code}
> [root@trl-722-k-cs410-bstoyanov-marvin ~]# cat /marvin//MarvinLogs/test_usage_QZE99I/failed_plus_exceptions.txt
> 2017-07-07 08:50:54,314 - CRITICAL - EXCEPTION: None: ['Traceback (most recent call last):\n',
'  File "/usr/lib/python2.7/site-packages/nose/suite.py", line 209, in run\n    self.setUp()\n',
'  File "/usr/lib/python2.7/site-packages/nose/suite.py", line 292, in setUp\n    self.setupContext(ancestor)\n',
'  File "/usr/lib/python2.7/site-packages/nose/suite.py", line 315, in setupContext\n    try_run(context,
names)\n', '  File "/usr/lib/python2.7/site-packages/nose/util.py", line 471, in try_run\n
   return func()\n', '  File "/marvin/tests/component/test_usage.py", line 1023, in setUpClass\n
   cls.iso.id\n', 'Exception: ISO download failed exception: Failed to download ISO: ad2e9212-5aef-461e-9f7d-7cc86044f1ce\n']
> 2017-07-07 09:09:18,458 - CRITICAL - EXCEPTION: test_01_template_usage: ['Traceback (most
recent call last):\n', '  File "/usr/lib64/python2.7/unittest/case.py", line 369, in run\n
   testMethod()\n', '  File "/marvin/tests/component/test_usage.py", line 928, in test_01_template_usage\n
   self.template.delete(self.userapiclient)\n', '  File "/usr/lib/python2.7/site-packages/marvin/lib/base.py",
line 1333, in delete\n    apiclient.deleteTemplate(cmd)\n', '  File "/usr/lib/python2.7/site-packages/marvin/cloudstackAPI/cloudstackAPIClient.py",
line 1874, in deleteTemplate\n    response = self.connection.marvinRequest(command, response_type=response,
method=method)\n', '  File "/usr/lib/python2.7/site-packages/marvin/cloudstackConnection.py",
line 379, in marvinRequest\n    raise e\n', "Exception: Job failed: {jobprocstatus : 0, created
: u'2017-07-07T09:09:05+0000', jobresult : {errorcode : 530, errortext : u'Failed to delete
template'}, cmd : u'org.apache.cloudstack.api.command.user.template.DeleteTemplateCmd', userid
: u'ad0cc9a7-2b64-404d-8b93-7fb64642e6a5', jobstatus : 2, jobid : u'5e1a9a95-164d-40b0-af84-1bcd6713c513',
jobresultcode : 530, jobinstanceid : u'47998d73-3ee5-4535-9c43-82f2b47d2d5d', jobresulttype
: u'object', jobinstancetype : u'Template', accountid : u'e3104721-4a36-42ac-9238-1e7d0583f9ff'}\n"]
> 2017-07-07 09:16:08,697 - CRITICAL - EXCEPTION: test_01_volume_usage: ['Traceback (most
recent call last):\n', '  File "/usr/lib64/python2.7/unittest/case.py", line 369, in run\n
   testMethod()\n', '  File "/marvin/tests/component/test_usage.py", line 693, in test_01_volume_usage\n
   "url"] = self.testdata["coreos_volume"]["urlkvm"]\n', "KeyError: 'coreos_volume'\n"]
> Ran 8 tests in 3271.872s
> FAILED (errors=3)
> {code}
> Test regions:
> {code}Test for duplicate checks on region id ... === TestName: test_createRegionWithExistingRegionId
| Status : SUCCESS ===
> ok
> Test for duplicate checks on region name ... === TestName: test_createRegionWithExistingRegionName
| Status : SUCCESS ===
> ok
> Test for update Region ... === TestName: test_updateRegion | Status : SUCCESS ===
> ok
> ----------------------------------------------------------------------
> Ran 3 tests in 0.250s
> OK{code}
> test_host_maintance.py:
> It's being skipped if hosts are <2, can be refactored to <= 2.
> {code}test_01_cancel_host_maintenace_with_no_migration_jobs (tests.component.test_host_maintenance.TestHostMaintenance)
... SKIP: Cancel host maintenance when VMs are migrating should be tested for 2 or more hosts
> test_02_cancel_host_maintenace_with_migration_jobs (tests.component.test_host_maintenance.TestHostMaintenance)
... SKIP: Cancel host maintenance when VMs are migrating can only be tested with 2 hosts
> ----------------------------------------------------------------------
> Ran 2 tests in 0.118s
> OK (SKIP=2){code}
> all these areas are not covered in the smoketests



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message