Mailing-List: contact dev-help@cloudstack.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@cloudstack.apache.org
Received-SPF: error (athena.apache.org: local policy)
Date: Fri, 2 Aug 2013 14:42:51 +0530
From: Prasanna Santhanam <tsp@apache.org>
To: dev@cloudstack.apache.org
Subject: Re: Can not launch instances on 4.2 today
Message-ID: <20130802091251.GA11023@cloud-2.local>
Mail-Followup-To: dev@cloudstack.apache.org
References: <1375424540.25523.31.camel@bertha>
 <20130802064735.GF2250@cloud-2.local>
 <1375426678.25523.36.camel@bertha>
 <20130802070433.GA6647@cloud-2.local>
 <1375428672.25523.38.camel@bertha>
 <1375432400.25523.41.camel@bertha>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <1375432400.25523.41.camel@bertha>
User-Agent: Mutt/1.5.21 (2010-09-15)

I made a mistake - the vmdata goes into the router deployed by
cloudstack but is called by the router_proxy.sh script within the
/usr/lib/xcp directory of the host over ssh.

root@r-5-VM:/# find . -name vmdata.py
./opt/cloud/bin/vmdata.py

The tests are passing now and VM deploy works fine:

nosetests --with-marvin --marvin-config=setup/dev/advanced.cfg test/integration/smoke/test_vm_life_cycle.py --load -a tags=devcloud
Test Deploy Virtual Machine ... ok
Test Stop Virtual Machine ... ok
Test Start Virtual Machine ... ok
Test Reboot Virtual Machine ... ok
Test destroy Virtual Machine ... ok
Test recover Virtual Machine ... ok
Test destroy(expunge) Virtual Machine ... ok

----------------------------------------------------------------------
Ran 7 tests in 287.641s

OK

On Fri, Aug 02, 2013 at 05:33:20PM +0900, Thomas O'Dowd wrote:
> Prasanna,
> 
> when I first ran deploysvr after a new database install, I had quite a
> lot of starting and crashing of the system vms (which seems new to me)
> but I waited and it settled down.
> 
> I was then able to launch an instance again after the usual other steps.
> The instance now tells me the password in a pop up box which is also
> new.
> 
> Anyway, thanks again for your help!
> 
> Tom.
> 
> On Fri, 2013-08-02 at 16:31 +0900, Thomas O'Dowd wrote:
> > Ok. I've just copied it over. Its the only one that ends with .py and
> > I've chmod'd it to 755 also.
> > 
> > Will check it shortly. I'm building.
> > 
> > Tom.
> > 
> > root@devcloud:~# ls -l /usr/lib/xcp/plugins/
> > total 164
> > -rwxrwxrwx 1 root root  8304 Nov  5  2012 coalesce-leaf
> > -rwxrwxrwx 1 root root   301 Nov 27  2012 echo
> > -rwxrwxrwx 1 root root  1660 Nov  5  2012 lvhd-thin
> > -rwxrwxrwx 1 root root  1873 Nov  5  2012 nfs-on-slave
> > -rwxrwxrwx 1 root root  2289 Nov  5  2012 on-slave
> > -rwxr-xr-x 1 root root 10327 Jan  7  2013 ovstunnel
> > -rwxr-xr-x 1 root root 10059 Aug  2 06:48 s3xen
> > -rwxrwxrwx 1 root root  5386 Nov  5  2012 tapdisk-pause
> > -rwxrwxrwx 1 root root   517 Nov  5  2012 testing-hooks
> > -rwxr-xr-x 1 root root  6200 Aug  2 07:29 vmdata.py
> > -rwxr-xr-x 1 root root 55574 Jan  7  2013 vmops
> > -rwxr-xr-x 1 root root  4434 Jan  7  2013 vmopspremium
> > -rwxr-xr-x 1 root root 20967 Jan  7  2013 vmopsSnapshot
> > -rwxrwxrwx 1 root root  2754 Nov  5  2012 vss_control
> > 
> > 
> > On Fri, 2013-08-02 at 12:34 +0530, Prasanna Santhanam wrote:
> > > Yeah this was a recent change that Marcus made to optimize the vmdata
> > > passed to guests. I'll verify why the change is not working shortly.
> > > Running some other tests at the moment on my setup.
> > > 
> > > Meanwhile, Could you manually copy that to where you see the s3xen
> > > plugin and retry?
> > > 
> > > 
> > > On Fri, Aug 02, 2013 at 03:57:58PM +0900, Thomas O'Dowd wrote:
> > > > Hi Prasanna,
> > > > 
> > > > I've just finished re-initializing a brand new devcloud and am about to
> > > > start things up again.
> > > > 
> > > > root@devcloud:~# find / -name vmdata.py
> > > > root@devcloud:~# 
> > > > 
> > > > Maybe it was there before in my previous install. How would it be copied
> > > > to devcloud usually? For example for the s3xen plugin I need to manually
> > > > copy it over myself to the xcp plugins directory. Then again I can't
> > > > imagine why it went missing since yesterday from my previous devcloud.
> > > > 
> > > > Tom.
> > > > 
> > > > On Fri, 2013-08-02 at 12:17 +0530, Prasanna Santhanam wrote:
> > > > > On devcloud
> > > > > 
> > > > > $ cd /
> > > > > $ find . -name vmdata.py
> > > > > 
> > > > > Do you see a file by that name anywhere in the XCP plugins? If not -
> > > > > it failed to copy over into the devcloud plugins for some reason when
> > > > > adding the host.
> > > > > 
> > > > > On Fri, Aug 02, 2013 at 03:22:20PM +0900, Thomas O'Dowd wrote:
> > > > > > This was working yesterday but the launching of instances for me on 4.2
> > > > > > is currently not working. I have twice now tried a clean build along
> > > > > > with deploydb and deploysvr in the usual manner but no luck.
> > > > > > 
> > > > > > On the UI I get: 
> > > > > >     Unable to create a deployment for VM[User|tom1]
> > > > > > 
> > > > > > On the management server output I get.
> > > > > > 
> > > > > > INFO  [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-1:job-8 = [ 16ba488a-acbc-4c38-9384-9503123
> > > > > > 4b9c8 ]) Unable to contact resource.
> > > > > > com.cloud.exception.ResourceUnavailableException: Resource [Pod:1] is unreachable: Unable to apply u
> > > > > > serdata and password entry on router
> > > > > >         at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkAppl
> > > > > > ianceManagerImpl.java:3810)
> > > > > >         at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyUserData(VirtualNetworkA
> > > > > > pplianceManagerImpl.java:2997)
> > > > > >         at com.cloud.network.element.VirtualRouterElement.addPasswordAndUserdata(VirtualRouterElemen
> > > > > > t.java:941)
> > > > > >         at com.cloud.network.NetworkManagerImpl.prepareElement(NetworkManagerImpl.java:2035)
> > > > > >         at com.cloud.network.NetworkManagerImpl.prepareNic(NetworkManagerImpl.java:2141)
> > > > > >         at com.cloud.network.NetworkManagerImpl.prepare(NetworkManagerImpl.java:2082)
> > > > > >         at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:932)
> > > > > >         at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:624)
> > > > > >         at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VM
> > > > > > EntityManagerImpl.java:227)
> > > > > >         at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMach
> > > > > > ineEntityImpl.java:209)
> > > > > >         at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3408)
> > > > > >         at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2968)
> > > > > >         at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2954)
> > > > > >         at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
> > > > > >         at org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:420)
> > > > > >         at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
> > > > > >         at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
> > > > > >         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> > > > > >         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> > > > > >         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> > > > > >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > > > > >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > > > > >         at java.lang.Thread.run(Thread.java:724)
> > > > > > INFO  [xen.resource.CitrixResourceBase] (DirectAgent-22:) VM does not exist on XenServer9d4c9db8-32f7-25c3-0435-eab4bf3adcea
> > > > > > ERROR [network.element.SspElement] (Job-Executor-1:job-8 = [ 16ba488a-acbc-4c38-9384-95031234b9c8 ]) ReservationContext was null for NicProfile[8-3-68dd1f54-5d10-4e4e-9637-59fdc238c8b0-192.168.56.102-vlan://untagged Ntwk[204|Guest|6]
> > > > > > WARN  [apache.cloudstack.alerts] (Job-Executor-1:job-8 = [ 16ba488a-acbc-4c38-9384-95031234b9c8 ])  alertType:: 8 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed to deploy Vm with Id: 3, on Host with Id: null
> > > > > > INFO  [user.vm.DeployVMCmd] (Job-Executor-1:job-8 = [ 16ba488a-acbc-4c38-9384-95031234b9c8 ]) com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|tom1]Scope=interface com.cloud.dc.DataCenter; id=1
> > > > > > INFO  [user.vm.DeployVMCmd] (Job-Executor-1:job-8 = [ 16ba488a-acbc-4c38-9384-95031234b9c8 ]) Unable to create a deployment for VM[User|tom1]
> > > > > > com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|tom1]Scope=interface com.cloud.dc.DataCenter; id=1
> > > > > >         at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:888)
> > > > > >         at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:624)
> > > > > >         at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
> > > > > >         at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:209)
> > > > > >         at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3408)
> > > > > >         at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2968)
> > > > > >         at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2954)
> > > > > >         at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
> > > > > >         at org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:420)
> > > > > >         at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
> > > > > >         at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
> > > > > >         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> > > > > >         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> > > > > >         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> > > > > >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > > > > >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > > > > >         at java.lang.Thread.run(Thread.java:724)
> > > > > > INFO  [cloud.vm.UserVmManagerImpl] (UserVm-Scavenger-2:) Found 1 vms to expunge.
> > > > > > INFO  [storage.volume.VolumeServiceImpl] (UserVm-Scavenger-2:) Expunge volume with no data store specified
> > > > > > INFO  [network.security.SecurityGroupManagerImpl] (UserVm-Scavenger-2:) Disassociated 1 network groups  from uservm 3
> > > > > > 
> > > > > > 
> > > > > > I'll try to re-install a fresh copy of devcloud just in case something
> > > > > > is causing the issue.
> > > > > > 
> > > > > > Tom.
> > > > > > -- 
> > > > > > Cloudian KK - http://www.cloudian.com/get-started.html
> > > > > > Fancy 100TB of full featured S3 Storage?
> > > > > > Checkout the Cloudian?? Community Edition!
> > > > > 
> > > > 
> > > > -- 
> > > > Cloudian KK - http://www.cloudian.com/get-started.html
> > > > Fancy 100TB of full featured S3 Storage?
> > > > Checkout the Cloudian?? Community Edition!
> > > 
> > 
> 
> -- 
> Cloudian KK - http://www.cloudian.com/get-started.html
> Fancy 100TB of full featured S3 Storage?
> Checkout the Cloudian?? Community Edition!

-- 
Prasanna.,

------------------------
Powered by BigRock.com