cloudstack-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From umesh kute <umeshvk...@gmail.com>
Subject Re: Regarding cloudstack automation
Date Thu, 02 Jan 2014 12:06:19 GMT
Thank you once again Santhosh & Chandan.

I have gone through the management server logs. The deployment of VM got
fired to the setup correctly and there are couple of errors in the
management-server log.
I am summarizing those below:

test data in "test_deploy_vm.py"
 def __init__(self):
        self.testdata = {
            #data to create an account
            "account": {
                "email": "test@test.com",
                "firstname": "Test",
                "lastname": "User",
                "username": "test",
                "password": "password",
            },
            #data reqd for virtual machine creation
            "virtual_machine" : {
                "name" : "testvmshr",
                "displayname" : "Test VM shr",
            },
            #small service offering
            "service_offering": {
                "small": {
                    "name": "SOSmall",
                    "displaytext": "Small Instance",
                    "cpunumber": 1,
                    "cpuspeed": 2000,
                    "memory": 1024,
                },
            },
            "ostype": 'CentOS 6.4 (64-bit)',
        }


1. Account is successfully created
2. Service offering is successfully created
3. Management server logs - management-server.log has following error:


2014-01-02 01:43:40,693 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-109:job-26355 = [ 78b8af27-89dc-426e-bba7-acf693f071f2 ])
Lock is released for network Ntwk[326|Guest|15] as a part of network
shutdown
2014-01-02 01:43:40,695 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-109:job-26355 = [ 78b8af27-89dc-426e-bba7-acf693f071f2 ])
Lock is released for network id 326 as a part of network implement
2014-01-02 01:43:40,695 INFO  [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-109:job-26355 = [ 78b8af27-89dc-426e-bba7-acf693f071f2 ])
Insufficient capacity
com.cloud.exception.InsufficientAddressCapacityException: Insufficient
address capacityScope=interface com.cloud.dc.DataCenter; id=1
at
com.cloud.network.NetworkManagerImpl.fetchNewPublicIp(NetworkManagerImpl.java:479)
at
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at
com.cloud.network.NetworkManagerImpl.assignDedicateIpAddress(NetworkManagerImpl.java:613)
at
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at
com.cloud.network.NetworkManagerImpl.assignSourceNatIpAddressToGuestNetwork(NetworkManagerImpl.java:582)
at
com.cloud.network.NetworkManagerImpl.implementNetworkElementsAndResources(NetworkManagerImpl.java:2013)
at
com.cloud.network.NetworkManagerImpl.implementNetwork(NetworkManagerImpl.java:1939)
at
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at
com.cloud.network.NetworkManagerImpl.prepare(NetworkManagerImpl.java:2120)
at
com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:887)
at
com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:578)
at
org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:227)
at
org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:209)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3406)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2966)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2952)
at
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at
org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:420)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:679)
2014-01-02 01:43:40,703 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-109:job-26355 = [ 78b8af27-89dc-426e-bba7-acf693f071f2 ])
Cleaning up resources for the vm VM[User|testvmshr] in Starting state

4. When i checked the database for the network id 326 in table "networks",
it has following entry:

| 326 | test-TestDeployVM-test_deploy_vm-QQ91N0-network |
b7cb9e31-835f-47e3-9585-97e3b4084e4d |
test-TestDeployVM-test_deploy_vm-QQ91N0-network | Guest        | Vlan
           | NULL          | 10.1.1.1       | 10.1.1.0/24     | Dhcp   |
               15 |                 200 |              1 |
ExternalGuestNetworkGuru | Destroy     |     326 |         1 |        305 |
8.8.8.8 | 8.8.4.4 | NULL      |          0 | Account  | cs131cloud.internal
| ecf5b617-04da-469b-b378-f53e05d8cc53 | Isolated   |                0 |
2014-01-02 06:43:39 | 2014-01-02 06:43:46 |                 0 |   NULL |
NULL        | NULL     | NULL         |               1 |           NULL |


Basically it tries to create a network offering (id=15) : "HA Isolated
Network With Source Nat"


5. I think the script creates a network shown in above table:
"test-TestDeployVM-test_deploy_vm-QQ91N0-network".

I am not sure why it still gives the Insufficient address capacityScope
exception.

6. One more thing i observed. I have provided the "ostype": 'CentOS 6.4
(64-bit)'. But in DeployVMCmd it uses the template id:
"03ffb96f-2cfa-11e3-a4f0-f245a5b3ba0f" which is for template "Windows
Server 2008 R2 Enterprise with SQL 2012 Web Edition".


I am attaching the management-server logs and script logs for references.

If somebody can help me what's wrong here, would really be helpful.


Thanks and Regards
-- Umesh Kute


On Thu, Jan 2, 2014 at 2:59 PM, Santhosh Edukulla <
santhosh.edukulla@citrix.com> wrote:

> 1. Is it still failing post this registration?
>
> 2. If yes, may be you can verify\provide the management server logs.
> ________________________________________
> From: umesh kute [umeshvkute@gmail.com]
> Sent: Thursday, January 02, 2014 4:16 AM
> To: users@cloudstack.apache.org
> Cc: Chandan Purushothama; Sudha Ponnaganti
> Subject: Re: Regarding cloudstack automation
>
> Thanks Santhosh.
> Yes, I have registered the following template which i am using.
>
> "ostype": 'CentOS 6.4 (64-bit)',
>
> Thanks and Regards
> -- Umesh Kute
>
>
> On Mon, Dec 30, 2013 at 5:50 PM, Santhosh Edukulla <
> santhosh.edukulla@citrix.com> wrote:
>
> > Umesh,
> >
> > One question : Did you registered the template for ostype:     "ostype":
> > 'CentOS 5.3 (64-bit)'?
> >
> > Regards,
> > Santhosh
> > ________________________________________
> > From: umesh kute [umeshvkute@gmail.com]
> > Sent: Monday, December 30, 2013 6:32 AM
> > To: Chandan Purushothama
> > Cc: users@cloudstack.apache.org; Sudha Ponnaganti
> > Subject: Re: Regarding cloudstack automation
> >
> > Hi Chandan,
> > Thanks for your response.
> > I have the latest Marvin repository (December 20th). I am able to proceed
> > further. There was an issue of firewall for that machine and it got
> > resolved.
> >
> > But now i am getting another error when i tried to run the script
> > "test_deploy_vm.py"
> >
> > I have attached the log. Can somebody please have a look on it and help
> me
> > in resolving the issue?
> >
> >
> >
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > test_deploy_vm (integration.smoke.test_deploy_vm.TestDeployVM): CRITICAL:
> > EXCEPTION: test_deploy_vm: Traceback (most recent call last):
> >   File "/usr/local/lib/python2.7/unittest/case.py", line 327, in run
> >     testMethod()
> >   File
> > "/DataDisk/temp/cloudstack/test/integration/smoke/test_deploy_vm.py",
> line
> > 116, in test_deploy_vm
> >     templateid=self.template.id<http://self.template.id>
> >   File
> > "/usr/local/lib/python2.7/site-packages/marvin/integration/lib/base.py",
> > line 415, in create
> >     virtual_machine = apiclient.deployVirtualMachine(cmd, method=method)
> >   File
> >
> "/usr/local/lib/python2.7/site-packages/marvin/cloudstackAPI/cloudstackAPIClient.py",
> > line 593, in deployVirtualMachine
> >     response = self.connection.marvinRequest(command,
> > response_type=response, method=method)
> >   File
> > "/usr/local/lib/python2.7/site-packages/marvin/cloudstackConnection.py",
> > line 280, in marvinRequest
> >     response = self.poll(asyncJobId, response_type)
> >   File
> > "/usr/local/lib/python2.7/site-packages/marvin/cloudstackConnection.py",
> > line 86, in poll
> >     "asyncquery", asyncResonse.jobresult)
> > cloudstackAPIException: Execute cmd: asyncquery failed, due to:
> {errorcode
> > : 533, errortext : u'Unable to create a deployment for
> VM[User|testvmshr]'}
> >
> >
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >
> > PFA entire logs.
> >
> > Please let me know in case if anything is required.
> >
> > Thanks and Regards
> > -- Umesh Kute
> >
> >
> > On Sun, Dec 29, 2013 at 10:32 PM, Chandan Purushothama <
> > Chandan.Purushothama@citrix.com<mailto:Chandan.Purushothama@citrix.com>>
> > wrote:
> >
> > Hello Umesh,
> >
> > I had a similar experience with an older Marvin build. I updated mine to
> > the latest and tried again and it worked. I recommend you to kindly try
> > again with the latest Marvin build and see if you are able to work with
> the
> > automation framework,
> >
> > Thank you,
> > Chandan
> >
> >
> > -------- Original message --------
> > From: umesh kute
> > Date:12/26/2013 12:29 AM (GMT-08:00)
> > To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org
> >,Sudha
> > Ponnaganti
> > Subject: Re: Regarding cloudstack automation
> >
> > Hi All,
> > I have created a Marvin setup on CentOS6.3 by following the document:
> >
> >
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Marvin+-+Testing+with+Python
> >
> > All the pre-requisites are installed successfully.
> >
> > I tried to run the sample script test_deploy_vm.py
> > (cloudstack/test/integration/smoke/), I am getting following error:
> >
> >
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > [root@localhost smoke]# nosetests --with-marvin
> > --marvin-config=/DataDisk/temp/cloudstack/tools/marvin/dist/demo.cfg
> --load
> > test_deploy_vm.py
> >
> >  Exception Occurred Under __deployDC :
> > HTTPConnectionPool(host='10.88.91.100', port=8096): Max retries exceeded
> > with url: /client/api?account=admin&command=listUsers&response=json
> (Caused
> > by <class 'socket.error'>: [Errno 110] Connection timed out)
> > Traceback (most recent call last):
> >   File "/usr/local/bin/nosetests", line 9, in <module>
> >     load_entry_point('nose==1.3.0', 'console_scripts', 'nosetests')()
> >   File
> >
> "/usr/local/lib/python2.7/site-packages/nose-1.3.0-py2.7.egg/nose/core.py",
> > line 118, in __init__
> >     **extra_args)
> >   File "/usr/local/lib/python2.7/unittest/main.py", line 95, in __init__
> >     self.runTests()
> >   File
> >
> "/usr/local/lib/python2.7/site-packages/nose-1.3.0-py2.7.egg/nose/core.py",
> > line 197, in runTests
> >     result = self.testRunner.run(self.test)
> >   File
> >
> "/usr/local/lib/python2.7/site-packages/nose-1.3.0-py2.7.egg/nose/core.py",
> > line 61, in run
> >     test(result)
> >   File
> >
> >
> "/usr/local/lib/python2.7/site-packages/nose-1.3.0-py2.7.egg/nose/suite.py",
> > line 176, in __call__
> >     return self.run(*arg, **kw)
> >   File
> >
> >
> "/usr/local/lib/python2.7/site-packages/nose-1.3.0-py2.7.egg/nose/suite.py",
> > line 223, in run
> >     test(orig)
> >   File
> >
> >
> "/usr/local/lib/python2.7/site-packages/nose-1.3.0-py2.7.egg/nose/suite.py",
> > line 176, in __call__
> >     return self.run(*arg, **kw)
> >   File
> >
> >
> "/usr/local/lib/python2.7/site-packages/nose-1.3.0-py2.7.egg/nose/suite.py",
> > line 223, in run
> >     test(orig)
> >   File
> >
> >
> "/usr/local/lib/python2.7/site-packages/nose-1.3.0-py2.7.egg/nose/suite.py",
> > line 176, in __call__
> >     return self.run(*arg, **kw)
> >   File
> >
> >
> "/usr/local/lib/python2.7/site-packages/nose-1.3.0-py2.7.egg/nose/suite.py",
> > line 223, in run
> >     test(orig)
> >   File
> >
> >
> "/usr/local/lib/python2.7/site-packages/nose-1.3.0-py2.7.egg/nose/suite.py",
> > line 176, in __call__
> >     return self.run(*arg, **kw)
> >   File
> >
> >
> "/usr/local/lib/python2.7/site-packages/nose-1.3.0-py2.7.egg/nose/suite.py",
> > line 223, in run
> >     test(orig)
> >   File
> >
> >
> "/usr/local/lib/python2.7/site-packages/nose-1.3.0-py2.7.egg/nose/suite.py",
> > line 176, in __call__
> >     return self.run(*arg, **kw)
> >   File
> >
> >
> "/usr/local/lib/python2.7/site-packages/nose-1.3.0-py2.7.egg/nose/suite.py",
> > line 223, in run
> >     test(orig)
> >   File
> >
> >
> "/usr/local/lib/python2.7/site-packages/nose-1.3.0-py2.7.egg/nose/suite.py",
> > line 176, in __call__
> >     return self.run(*arg, **kw)
> >   File
> >
> >
> "/usr/local/lib/python2.7/site-packages/nose-1.3.0-py2.7.egg/nose/suite.py",
> > line 223, in run
> >     test(orig)
> >   File
> >
> "/usr/local/lib/python2.7/site-packages/nose-1.3.0-py2.7.egg/nose/case.py",
> > line 45, in __call__
> >     return self.run(*arg, **kwarg)
> >   File
> >
> "/usr/local/lib/python2.7/site-packages/nose-1.3.0-py2.7.egg/nose/case.py",
> > line 138, in run
> >     result.addError(self, err)
> >   File
> >
> >
> "/usr/local/lib/python2.7/site-packages/nose-1.3.0-py2.7.egg/nose/proxy.py",
> > line 124, in addError
> >     plugin_handled = plugins.handleError(self.test, err)
> >   File
> >
> >
> "/usr/local/lib/python2.7/site-packages/nose-1.3.0-py2.7.egg/nose/plugins/manager.py",
> > line 99, in __call__
> >     return self.call(*arg, **kw)
> >   File
> >
> >
> "/usr/local/lib/python2.7/site-packages/nose-1.3.0-py2.7.egg/nose/plugins/manager.py",
> > line 167, in simple
> >     result = meth(*arg, **kw)
> >   File "/usr/local/lib/python2.7/site-packages/marvin/marvinPlugin.py",
> > line 155, in handleError
> >     self.tcRunLogger.fatal("%s: %s: %s" %
> > AttributeError: 'NoneType' object has no attribute 'fatal'
> >
> >
> >
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >
> > The logs are generated at /tmp and the log has following error.
> >
> >
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > 2013-12-26 13:40:51,797 - DEBUG - CSLog - sending GET request: listUsers
> > {'account': 'admin'}
> > 2013-12-26 13:41:54,825 - DEBUG - CSLog - Connection refused. Reason:
> > http://10.88.91.100:8096/client/api :
> > HTTPConnectionPool(host='10.88.91.100', port=8096): Max retries exceeded
> > with url: /client/api?account=admin&command=listUsers&response=json
> (Caused
> > by <class 'socket.error'>: [Errno 110] Connection timed out)
> >
> >
> >
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >
> > Please note: I have opened the integration port 8096 on management
> server.
> > Also, changed the global settings integration.api.port
> > on cloudstack GUI to 8096 and restarted the management server.
> >
> > Still I am getting the above issue. I am not sure if i missed any
> > configuration.
> >
> > Can somebody please help me with resolution of this issue?
> > Appreciate your help here!!!
> >
> > Thanks and Regards
> > -- Umesh Kute
> >
> >
> > On Mon, Dec 9, 2013 at 1:57 PM, umesh kute <umeshvkute@gmail.com<mailto:
> > umeshvkute@gmail.com>> wrote:
> >
> > > Thanks a lot Sudha for your quick response.
> > > I will setup the Marvin on local machine and get back in case if I face
> > > any challenges in setup.
> > >
> > > Thanks and Regards
> > > -- Umesh Kute
> > >
> > >
> > >
> > > On Sun, Dec 8, 2013 at 4:05 PM, Sudha Ponnaganti <
> > > sudha.ponnaganti@citrix.com<mailto:sudha.ponnaganti@citrix.com>>
> wrote:
> > >
> > >> Hi Umesh,
> > >>
> > >> Looks like you have started on right track - Marvin is the framework
> to
> > >> use for functional or integration automation.
> > >> There are sizable number of test cases exist and you can review them.
> > >>  There are some wiki pages already written explaining Marvin [1]. Also
> > best
> > >> practices are published by community as well [2]. You can contribute
> to
> > it
> > >> as much as you can.
> > >>
> > >> Besides this, there is Junit framework (unit Test), Selenium framework
> > >> (UI automation) which are not as popular as Marvin. Marvin is perfect
> > for
> > >> majority of the validation. You can use simulator as well with Marvin.
> > >>
> > >> Please do pursue these and post questions to the community if you run
> in
> > >> to any issues in setting up env and running tests. There are jobs
> setup
> > by
> > >> various community members to test Master or current releases in
> various
> > >> labs and can help answer questions.
> > >>
> > >> [1]
> > >>
> >
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Marvin+-+Testing+with+Python
> > >>
> > >>
> > >> Thanks
> > >> /Sudha
> > >>
> > >>
> > >> -----Original Message-----
> > >> From: umesh kute [mailto:umeshvkute@gmail.com]
> > >> Sent: Saturday, December 07, 2013 10:29 PM
> > >> To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
> > >> Subject: Regarding cloudstack automation
> > >>
> > >> Hi All,
> > >> Good morning !!!
> > >> I am working as QA engineer and I am new to the cloudstack community.
> > >> We have started using cloudstack and deployed it in our
> infrastructure.
> > >>
> > >> Can somebody please help me in identifying the good automation
> > >> framework/tool/anything? The main intention is we want to automate the
> > >> infrastructure validation related cases (for e.g. create/update/delete
> > >> cases for instances, project, network, etc...)
> > >>
> > >> It would be good if you can help in identifying it.
> > >>
> > >> Please note: I have gone through cloudmonkey. But i haven't found much
> > >> help on it. May be i need to search a bit more.. I am also going
> through
> > >> the marvin and planning to setup it. If apart from these two, if
> anyone
> > has
> > >> different view please suggest.
> > >>
> > >> Also, if somebody has any pointers on cloudmonkey and marvin or any
> more
> > >> info on this (like, if it would suffice the infrastructure validation
> > >> related cases i mentioned above) any pros/cons would really be helpful
> > for
> > >> me...
> > >>
> > >> Appreciate any help on this and looking forward for the response on
> > >> this!!!
> > >>
> > >> Thanks and Regards
> > >> -- Umesh Kute
> > >>
> > >
> > >
> >
> >
>

Mime
View raw message