Return-Path: X-Original-To: apmail-cloudstack-users-archive@www.apache.org Delivered-To: apmail-cloudstack-users-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D1B7E109C2 for ; Thu, 5 Dec 2013 17:25:49 +0000 (UTC) Received: (qmail 66885 invoked by uid 500); 5 Dec 2013 17:25:48 -0000 Delivered-To: apmail-cloudstack-users-archive@cloudstack.apache.org Received: (qmail 66455 invoked by uid 500); 5 Dec 2013 17:25:47 -0000 Mailing-List: contact users-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@cloudstack.apache.org Delivered-To: mailing list users@cloudstack.apache.org Received: (qmail 66435 invoked by uid 99); 5 Dec 2013 17:25:46 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Dec 2013 17:25:46 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [204.168.68.187] (HELO vm-exch2k10-1.systemsmadesimple.com) (204.168.68.187) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Dec 2013 17:25:42 +0000 Received: from VM-EXCH2K10-4.systemsmadesimple.com ([fe80::5150:1d89:6c9c:6767]) by vm-exch2k10-1.systemsmadesimple.com ([::1]) with mapi id 14.01.0438.000; Thu, 5 Dec 2013 12:25:20 -0500 From: "Vosbury, David" To: "users@cloudstack.apache.org" Subject: RE: System VMs not starting Thread-Topic: System VMs not starting Thread-Index: AQHO8c8bnah6GD0guU6/JAV9NSXkAppF0LwQ Date: Thu, 5 Dec 2013 17:25:20 +0000 Message-ID: <0F07F4AB3334014B9987D15B496B2BBD0DEBC85A@vm-exch2k10-4.systemsmadesimple.com> References: <0F07F4AB3334014B9987D15B496B2BBD0DEBC7B6@vm-exch2k10-4.systemsmadesimple.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [204.27.207.133] Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org Okay, I tried that and it still does the same thing after reseeding with th= e new template. It seems as if it can't start the system vms and then gives= up and deletes the SSVM out of the GUI but leaves the console proxy alone,= then tries to recreate a new SSVM and possibly from the error tries to cre= ate the console proxy vm again but that one never gets deleted from the GUI= so it has issue with that as well. Although this time I do see in the logs= that the management server is looking for a vmdk file to try to do somethi= ng with it. (see included log snippet) but it can't find the file. When I l= ook at the properties of that vm root-233 the vmdk file is named different = than what CS manager seems to be looking for. On the actual hypervisor host= the name of the file is /root-233/root-233-000001.vmdk not what it appears= CS is looking for root-233-000001.vmdk. That probably explains why it neve= r deletes the vms and just leaves them out there. I'm assuming that CS is t= rying to delete the vm because it can't start it for some reason, but I cou= ld be wrong, then can't delete it because the file name is wrong. Anyway, here is the latest log snippet. 2013-12-05 11:45:10,639 DEBUG [cloud.storage.VolumeManagerImpl] (secstorage= -1:null) Unable to create Vol[232|vm=3D232|ROOT]:java.lang.RuntimeException= : The name 'ROOT-232' already exists. 2013-12-05 11:45:10,639 INFO [cloud.vm.VirtualMachineManagerImpl] (secstor= age-1:null) Unable to contact resource. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:4] i= s unreachable: Unable to create Vol[232|vm=3D232|ROOT]:java.lang.RuntimeExc= eption: The name 'ROOT-232' already exists. 2013-12-05 11:45:10,768 DEBUG [cloud.capacity.CapacityManagerImpl] (console= proxy-1:null) VM state transitted from :Starting to Stopped with event: Ope= rationFailedvm's original host id: null new host id: null host id before st= ate transiti on: 1 2013-12-05 11:45:10,789 WARN [cloud.consoleproxy.ConsoleProxyManagerImpl] = (consoleproxy-1:null) Exception while trying to start console proxy com.cloud.exception.InsufficientServerCapacityException: Unable to create a= deployment for VM[ConsoleProxy|v-230-VM]Scope=3Dinterface com.cloud.dc.Dat= aCenter; id=3D1 2013-12-05 11:45:10,829 DEBUG [cloud.capacity.CapacityManagerImpl] (secstor= age-1:null) VM state transitted from :Starting to Stopped with event: Opera= tionFailedvm's original host id: null new host id: null host id before stat= e transition : 2 2013-12-05 11:45:10,846 WARN [storage.secondary.SecondaryStorageManagerImp= l] (secstorage-1:null) Exception while trying to start secondary storage vm com.cloud.exception.InsufficientServerCapacityException: Unable to create a= deployment for VM[SecondaryStorageVm|s-232-VM]Scope=3Dinterface com.cloud.= dc.DataCenter; id=3D1 2013-12-05 11:45:10,850 INFO [storage.secondary.SecondaryStorageManagerImp= l] (secstorage-1:null) Unable to start secondary storage vm for standby cap= acity, secStorageVm vm Id : 232, will recycle it and start a new one 2013-12-05 11:45:40,471 ERROR [storage.resource.VmwareStorageProcessor] (Di= rectAgent-102:esxi2.ammscloud.com) clone volume from base image failed due = to Exception: java.lang.RuntimeException java.lang.RuntimeException: The name 'ROOT-230' already exists. 2013-12-05 11:45:40,474 DEBUG [agent.transport.Request] (DirectAgent-102:nu= ll) Seq 1-645201977: Processing: { Ans: , MgmtId: 146454222325, via: 1, Ve= r: v1, Flags: 110, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":= {"result":fa lse,"details":"java.lang.RuntimeException: The name 'ROOT-230' already exis= ts.","wait":0}}] } 2013-12-05 11:45:40,485 WARN [storage.datastore.ObjectInDataStoreManagerIm= pl] (consoleproxy-1:null) Unsupported data object (VOLUME, org.apache.cloud= stack.storage.datastore.PrimaryDataStoreImpl@2fd75404), no need to delete f= rom object i n store ref table 2013-12-05 11:45:40,486 DEBUG [cloud.storage.VolumeManagerImpl] (consolepro= xy-1:null) Unable to create Vol[230|vm=3D230|ROOT]:java.lang.RuntimeExcepti= on: The name 'ROOT-230' already exists. 2013-12-05 11:45:40,486 INFO [cloud.vm.VirtualMachineManagerImpl] (console= proxy-1:null) Unable to contact resource. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:4] i= s unreachable: Unable to create Vol[230|vm=3D230|ROOT]:java.lang.RuntimeExc= eption: The name 'ROOT-230' already exists. 2013-12-05 11:46:03,533 ERROR [storage.resource.VmwareStorageProcessor] (Di= rectAgent-103:esxi1.ammscloud.com) clone volume from base image failed due = to Exception: java.lang.RuntimeException java.lang.RuntimeException: File [iSCSI-Datastore-1] ROOT-233/ROOT-233.vmdk= was not found 2013-12-05 11:46:03,536 DEBUG [agent.transport.Request] (DirectAgent-103:nu= ll) Seq 2-1810104381: Processing: { Ans: , MgmtId: 146454222325, via: 2, V= er: v1, Flags: 110, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer"= :{"result":f alse,"details":"java.lang.RuntimeException: File [iSCSI-Datastore-1] ROOT-2= 33/ROOT-233.vmdk was not found","wait":0}}] } 2013-12-05 11:46:03,548 WARN [storage.datastore.ObjectInDataStoreManagerIm= pl] (secstorage-1:null) Unsupported data object (VOLUME, org.apache.cloudst= ack.storage.datastore.PrimaryDataStoreImpl@c885065), no need to delete from= object in s tore ref table 2013-12-05 11:46:03,548 DEBUG [cloud.storage.VolumeManagerImpl] (secstorage= -1:null) Unable to create Vol[233|vm=3D233|ROOT]:java.lang.RuntimeException= : File [iSCSI-Datastore-1] ROOT-233/ROOT-233.vmdk was not found 2013-12-05 11:46:03,549 INFO [cloud.vm.VirtualMachineManagerImpl] (secstor= age-1:null) Unable to contact resource. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:4] i= s unreachable: Unable to create Vol[233|vm=3D233|ROOT]:java.lang.RuntimeExc= eption: File [iSCSI-Datastore-1] ROOT-233/ROOT-233.vmdk was not found 2013-12-05 11:46:03,704 DEBUG [cloud.capacity.CapacityManagerImpl] (console= proxy-1:null) VM state transitted from :Starting to Stopped with event: Ope= rationFailedvm's original host id: null new host id: null host id before st= ate transiti on: 2 2013-12-05 11:46:03,725 WARN [cloud.consoleproxy.ConsoleProxyManagerImpl] = (consoleproxy-1:null) Exception while trying to start console proxy com.cloud.exception.InsufficientServerCapacityException: Unable to create a= deployment for VM[ConsoleProxy|v-230-VM]Scope=3Dinterface com.cloud.dc.Dat= aCenter; id=3D1 2013-12-05 11:46:03,755 DEBUG [cloud.capacity.CapacityManagerImpl] (secstor= age-1:null) VM state transitted from :Starting to Stopped with event: Opera= tionFailedvm's original host id: null new host id: null host id before stat= e transition : 1 2013-12-05 11:46:03,774 WARN [storage.secondary.SecondaryStorageManagerImp= l] (secstorage-1:null) Exception while trying to start secondary storage vm com.cloud.exception.InsufficientServerCapacityException: Unable to create a= deployment for VM[SecondaryStorageVm|s-233-VM]Scope=3Dinterface com.cloud.= dc.DataCenter; id=3D1 2013-12-05 11:46:03,777 INFO [storage.secondary.SecondaryStorageManagerImp= l] (secstorage-1:null) Unable to start secondary storage vm for standby cap= acity, secStorageVm vm Id : 233, will recycle it and start a new one David =A0 -----Original Message----- From: Paul Angus [mailto:paul.angus@shapeblue.com]=20 Sent: Thursday, December 05, 2013 10:31 AM To: users@cloudstack.apache.org Subject: RE: System VMs not starting Hi David I suspect that your problem is that the documentation hasn't been updated f= ully for 4.2. You're probably using system VM template 'systemvmtemplate-4.2-vh7.ova' whi= ch is misnamed as it's for 4.1 The correct download path for the 4.2 template for ESXi is: http://download.cloud.com/templates/4.2/systemvmtemplate-4.2-vh8.ova It can be a bit of a pain to kill off the old/wrong template. So to re-seed sec storage... Remember to use -F to force an overwrite when re-running the cloud-install-= sys-tmplt script. Also disable the zone and destroy any system VMs. If you = want to go belt and braces; find the old ESXi system VM templates in second= ary storage and delete '...vh7' and the template.properties file too before= re-running cloud-install-sys-tmplt. Regards, Paul Angus S: +44 20 3603 0540 | M: +447711418784 paul.angus@shapeblue.com From: Vosbury, David [mailto:david.vosbury@systemsmadesimple.com] Sent: 05 December 2013 14:34 To: users@cloudstack.apache.org Subject: System VMs not starting From: Vosbury, David Sent: Thursday, December 05, 2013 12:33 AM To: 'dev@cloudstack.apache.org'; 'users@cloudstack.apache.org' Subject: System VMs not starting Hello, I've been trying to get an new install of CloudStack 4.2 working with a Vsp= here cluster. I've went through creating my zone with advanced networking. = I can see the system VMs but they are not started. The secondary storage vm= seems to keep appearing and disappearing however. When I look in vcenter I= see that vms are being created one after another named root-2 and then roo= t-192, root-193 etc. They keep creating one after another until I shutdown = the management service. The vm's never start-up. Here is part of the manag= ement-server.log Has anyone seen this before? I've seen some references to bugs that sound l= ike this problem (cloudstack-1228)that were supposedly fixed back in August= . I don' t know if I have an earlier build of 4.2, but I downloaded and com= piled it just last week and I'm having this issue. I've tried some of the w= orkarounds listed in this bug report and still can't get the system vm's to= start and stop respawing on my vmware hypervisor hosts. Any help would be greatly appreciated. I'm getting to the point where I'm g= oing to look for another solution as I can't seem to get Cloudstack working= with Vsphere. 2013-12-05 00:07:28,642 WARN [utils.crypt.EncryptionSecretKeyChecker] (Tim= er-2:null) Encryption already enabled, is check() called twice? 2013-12-05 00:07:29,394 DEBUG [cloud.server.ConfigurationServerImpl] (Timer= -2:null) mount: warning: /systemvm_mnt seems to be mounted read-only. 2013-12-05 00:07:30,316 INFO [xen.resource.XenServerConnectionPool] (Timer= -2:null) XenServer Connection Pool Configs: manage.xenserver.pool.master=3D= true; sleep.interval.on.error=3D10000 2013-12-05 00:07:30,997 WARN [utils.crypt.EncryptionSecretKeyChecker] (Tim= er-2:null) Encryption already enabled, is check() called twice? 2013-12-05 00:07:34,050 WARN [apache.cloudstack.alerts] (Cluster-Notificat= ion-1:null) alertType:: 14 // dataCenterId:: 0 // podId:: 0 // clusterId::= null // message:: Management server node 10.2.150.100 is up 2013-12-05 00:07:34,071 WARN [cloud.cluster.ClusterManagerImpl] (Cluster-N= otification-1:null) Notifying management server join event took 39 ms 2013-12-05 00:08:33,140 ERROR [storage.resource.VmwareStorageProcessor] (Di= rectAgent-2:esxi2.ammscloud.com) clone volume from base image failed due to= Exception: java.lang.RuntimeException java.lang.RuntimeException: The name 'ROOT-2' already exists. 2013-12-05 00:08:33,145 DEBUG [agent.transport.Request] (DirectAgent-2:null= ) Seq 1-1861287941: Processing: { Ans: , MgmtId: 146454222325, via: 1, Ver= : v1, Flags: 110, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{= "result":false,"details":"java.lang.RuntimeException: The name 'ROOT-2' alr= eady exists.","wait":0}}] } 2013-12-05 00:08:33,163 WARN [storage.datastore.ObjectInDataStoreManagerIm= pl] (consoleproxy-1:null) Unsupported data object (VOLUME, org.apache.cloud= stack.storage.datastore.PrimaryDataStoreImpl@4838d3f7), no need to delet= e from object in store ref table 2013-12-05 00:08:33,164 DEBUG [cloud.storage.VolumeManagerImpl] (consolepro= xy-1:null) Unable to create Vol[2|vm=3D2|ROOT]:java.lang.RuntimeException: = The name 'ROOT-2' already exists. 2013-12-05 00:08:33,169 INFO [cloud.vm.VirtualMachineManagerImpl] (console= proxy-1:null) Unable to contact resource. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:4] i= s unreachable: Unable to create Vol[2|vm=3D2|ROOT]:java.lang.RuntimeExcepti= on: The name 'ROOT-2' already exists. 2013-12-05 00:08:56,958 ERROR [storage.resource.VmwareStorageProcessor] (Di= rectAgent-4:esxi1.ammscloud.com) clone volume from base image failed due to= Exception: java.lang.RuntimeException java.lang.RuntimeException: File [iSCSI-Datastore-1] ROOT-203/ROOT-203.vmdk= was not found 2013-12-05 00:08:56,960 DEBUG [agent.transport.Request] (DirectAgent-4:null= ) Seq 2-2058223621: Processing: { Ans: , MgmtId: 146454222325, via: 2, Ver= : v1, Flags: 110, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{= "result":false,"details":"java.lang.RuntimeException: File [iSCSI-Datastore= -1] ROOT-203/ROOT-203.vmdk was not found","wait":0}}] } 2013-12-05 00:08:56,978 WARN [storage.datastore.ObjectInDataStoreManagerIm= pl] (secstorage-1:null) Unsupported data object (VOLUME, org.apache.cloudst= ack.storage.datastore.PrimaryDataStoreImpl@6e0e449e), no need to delete = from object in store ref table 2013-12-05 00:08:56,979 DEBUG [cloud.storage.VolumeManagerImpl] (secstorage= -1:null) Unable to create Vol[203|vm=3D203|ROOT]:java.lang.RuntimeException= : File [iSCSI-Datastore-1] ROOT-203/ROOT-203.vmdk was not found 2013-12-05 00:08:56,980 INFO [cloud.vm.VirtualMachineManagerImpl] (secstor= age-1:null) Unable to contact resource. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:4] i= s unreachable: Unable to create Vol[203|vm=3D203|ROOT]:java.lang.RuntimeExc= eption: File [iSCSI-Datastore-1] ROOT-203/ROOT-203.vmdk was not found 2013-12-05 00:08:57,231 DEBUG [cloud.capacity.CapacityManagerImpl] (console= proxy-1:null) VM state transitted from :Starting to Stopped with event: Ope= rationFailedvm's original host id: null new host id: null host id before st= ate transition: 2 2013-12-05 00:08:57,272 WARN [cloud.consoleproxy.ConsoleProxyManagerImpl] = (consoleproxy-1:null) Exception while trying to start console proxy com.cloud.exception.InsufficientServerCapacityException: Unable to create a= deployment for VM[ConsoleProxy|v-2-VM]Scope=3Dinterface com.cloud.dc.DataC= enter; id=3D1 2013-12-05 00:08:57,333 DEBUG [cloud.capacity.CapacityManagerImpl] (secstor= age-1:null) VM state transitted from :Starting to Stopped with event: Opera= tionFailedvm's original host id: null new host id: null host id before stat= e transition: 2 2013-12-05 00:08:57,370 WARN [storage.secondary.SecondaryStorageManagerImp= l] (secstorage-1:null) Exception while trying to start secondary storage vm com.cloud.exception.InsufficientServerCapacityException: Unable to create a= deployment for VM[SecondaryStorageVm|s-203-VM]Scope=3Dinterface com.cloud.= dc.DataCenter; id=3D1 2013-12-05 00:08:57,376 INFO [storage.secondary.SecondaryStorageManagerImp= l] (secstorage-1:null) Unable to start secondary storage vm for standby cap= acity, secStorageVm vm Id : 203, will recycle it and start a new one 2013-12-05 00:09:02,891 ERROR [storage.resource.VmwareStorageProcessor] (Di= rectAgent-15:esxi1.ammscloud.com) clone volume from base image failed due t= o Exception: java.lang.RuntimeException java.lang.RuntimeException: The name 'ROOT-203' already exists. 2013-12-05 00:09:02,896 DEBUG [agent.transport.Request] (DirectAgent-15:nul= l) Seq 2-2058223626: Processing: { Ans: , MgmtId: 146454222325, via: 2, Ve= r: v1, Flags: 110, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":= {"result":false,"details":"java.lang.RuntimeException: The name 'ROOT-203' = already exists.","wait":0}}] } 2013-12-05 00:09:02,911 WARN [storage.datastore.ObjectInDataStoreManagerIm= pl] (secstorage-1:null) Unsupported data object (VOLUME, org.apache.cloudst= ack.storage.datastore.PrimaryDataStoreImpl@555bb5a1), no need to delete = from object in store ref table 2013-12-05 00:09:02,912 DEBUG [cloud.storage.VolumeManagerImpl] (secstorage= -1:null) Unable to create Vol[203|vm=3D203|ROOT]:java.lang.RuntimeException= : The name 'ROOT-203' already exists. 2013-12-05 00:09:02,912 INFO [cloud.vm.VirtualMachineManagerImpl] (secstor= age-1:null) Unable to contact resource. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:4] i= s unreachable: Unable to create Vol[203|vm=3D203|ROOT]:java.lang.RuntimeExc= eption: The name 'ROOT-203' already exists. 2013-12-05 00:09:03,011 ERROR [storage.resource.VmwareStorageProcessor] (Di= rectAgent-1:esxi2.ammscloud.com) clone volume from base image failed due to= Exception: java.lang.RuntimeException java.lang.RuntimeException: The name 'ROOT-2' already exists. 2013-12-05 00:09:03,015 DEBUG [agent.transport.Request] (DirectAgent-1:null= ) Seq 1-1861287943: Processing: { Ans: , MgmtId: 146454222325, via: 1, Ver= : v1, Flags: 110, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{= "result":false,"details":"java.lang.RuntimeException: The name 'ROOT-2' alr= eady exists.","wait":0}}] } 2013-12-05 00:09:03,031 WARN [storage.datastore.ObjectInDataStoreManagerIm= pl] (consoleproxy-1:null) Unsupported data object (VOLUME, org.apache.cloud= stack.storage.datastore.PrimaryDataStoreImpl@10aba5d3), no need to delet= e from object in store ref table 2013-12-05 00:09:03,032 DEBUG [cloud.storage.VolumeManagerImpl] (consolepro= xy-1:null) Unable to create Vol[2|vm=3D2|ROOT]:java.lang.RuntimeException: = The name 'ROOT-2' already exists. 2013-12-05 00:09:03,032 INFO [cloud.vm.VirtualMachineManagerImpl] (console= proxy-1:null) Unable to contact resource. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:4] i= s unreachable: Unable to create Vol[2|vm=3D2|ROOT]:java.lang.RuntimeExcepti= on: The name 'ROOT-2' already exists. 2013-12-05 00:09:03,171 DEBUG [cloud.capacity.CapacityManagerImpl] (secstor= age-1:null) VM state transitted from :Starting to Stopped with event: Opera= tionFailedvm's original host id: null new host id: null host id before stat= e transition: 2 2013-12-05 00:09:03,205 WARN [storage.secondary.SecondaryStorageManagerImp= l] (secstorage-1:null) Exception while trying to start secondary storage vm com.cloud.exception.InsufficientServerCapacityException: Unable to create a= deployment for VM[SecondaryStorageVm|s-203-VM]Scope=3Dinterface com.cloud.= dc.DataCenter; id=3D1 2013-12-05 00:09:03,209 INFO [storage.secondary.SecondaryStorageManagerImp= l] (secstorage-1:null) Unable to start secondary storage vm for standby cap= acity, secStorageVm vm Id : 203, will recycle it and start a new one 2013-12-05 00:09:03,312 DEBUG [cloud.capacity.CapacityManagerImpl] (console= proxy-1:null) VM state transitted from :Starting to Stopped with event: Ope= rationFailedvm's original host id: null new host id: null host id before st= ate transition: 2 2013-12-05 00:09:03,346 WARN [cloud.consoleproxy.ConsoleProxyManagerImpl] = (consoleproxy-1:null) Exception while trying to start console proxy com.cloud.exception.InsufficientServerCapacityException: Unable to create a= deployment for VM[ConsoleProxy|v-2-VM]Scope=3Dinterface com.cloud.dc.DataC= enter; id=3D1 2013-12-05 00:09:32,800 ERROR [storage.resource.VmwareStorageProcessor] (Di= rectAgent-16:esxi2.ammscloud.com) clone volume from base image failed due t= o Exception: java.lang.RuntimeException java.lang.RuntimeException: The name 'ROOT-2' already exists. 2013-12-05 00:09:32,804 DEBUG [agent.transport.Request] (DirectAgent-16:nul= l) Seq 1-1861287944: Processing: { Ans: , MgmtId: 146454222325, via: 1, Ve= r: v1, Flags: 110, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":= {"result":false,"details":"java.lang.RuntimeException: The name 'ROOT-2' al= ready exists.","wait":0}}] } 2013-12-05 00:09:32,816 WARN [storage.datastore.ObjectInDataStoreManagerIm= pl] (consoleproxy-1:null) Unsupported data object (VOLUME, org.apache.cloud= stack.storage.datastore.PrimaryDataStoreImpl@761b309), no need to delete = from object in store ref table 2013-12-05 00:09:32,817 DEBUG [cloud.storage.VolumeManagerImpl] (consolepro= xy-1:null) Unable to create Vol[2|vm=3D2|ROOT]:java.lang.RuntimeException: = The name 'ROOT-2' already exists. 2013-12-05 00:09:32,817 INFO [cloud.vm.VirtualMachineManagerImpl] (console= proxy-1:null) Unable to contact resource. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:4] i= s unreachable: Unable to create Vol[2|vm=3D2|ROOT]:java.lang.RuntimeExcepti= on: The name 'ROOT-2' already exists. 2013-12-05 00:09:55,743 ERROR [storage.resource.VmwareStorageProcessor] (Di= rectAgent-6:esxi1.ammscloud.com) clone volume from base image failed due to= Exception: java.lang.RuntimeException java.lang.RuntimeException: File [iSCSI-Datastore-1] ROOT-204/ROOT-204.vmdk= was not found 2013-12-05 00:09:55,747 DEBUG [agent.transport.Request] (DirectAgent-6:null= ) Seq 2-2058223629: Processing: { Ans: , MgmtId: 146454222325, via: 2, Ver= : v1, Flags: 110, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{= "result":false,"details":"java.lang.RuntimeException: File [iSCSI-Datastore= -1] ROOT-204/ROOT-204.vmdk was not found","wait":0}}] } 2013-12-05 00:09:55,762 WARN [storage.datastore.ObjectInDataStoreManagerIm= pl] (secstorage-1:null) Unsupported data object (VOLUME, org.apache.cloudst= ack.storage.datastore.PrimaryDataStoreImpl@5022c22d), no need to delete = from object in store ref table 2013-12-05 00:09:55,763 DEBUG [cloud.storage.VolumeManagerImpl] (secstorage= -1:null) Unable to create Vol[204|vm=3D204|ROOT]:java.lang.RuntimeException= : File [iSCSI-Datastore-1] ROOT-204/ROOT-204.vmdk was not found 2013-12-05 00:09:55,763 INFO [cloud.vm.VirtualMachineManagerImpl] (secstor= age-1:null) Unable to contact resource. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:4] i= s unreachable: Unable to create Vol[204|vm=3D204|ROOT]:java.lang.RuntimeExc= eption: File [iSCSI-Datastore-1] ROOT-204/ROOT-204.vmdk was not found 2013-12-05 00:09:55,979 DEBUG [cloud.capacity.CapacityManagerImpl] (console= proxy-1:null) VM state transitted from :Starting to Stopped with event: Ope= rationFailedvm's original host id: null new host id: null host id before st= ate transition: 2 2013-12-05 00:09:56,007 WARN [cloud.consoleproxy.ConsoleProxyManagerImpl] = (consoleproxy-1:null) Exception while trying to start console proxy com.cloud.exception.InsufficientServerCapacityException: Unable to create a= deployment for VM[ConsoleProxy|v-2-VM]Scope=3Dinterface com.cloud.dc.DataC= enter; id=3D1 2013-12-05 00:09:56,047 DEBUG [cloud.capacity.CapacityManagerImpl] (secstor= age-1:null) VM state transitted from :Starting to Stopped with event: Opera= tionFailedvm's original host id: null new host id: null host id before stat= e transition: 2 2013-12-05 00:09:56,074 WARN [storage.secondary.SecondaryStorageManagerImp= l] (secstorage-1:null) Exception while trying to start secondary storage vm com.cloud.exception.InsufficientServerCapacityException: Unable to create a= deployment for VM[SecondaryStorageVm|s-204-VM]Scope=3Dinterface com.cloud.= dc.DataCenter; id=3D1 2013-12-05 00:09:56,078 INFO [storage.secondary.SecondaryStorageManagerImp= l] (secstorage-1:null) Unable to start secondary storage vm for standby cap= acity, secStorageVm vm Id : 204, will recycle it and start a new one 2013-12-05 00:10:02,419 ERROR [storage.resource.VmwareStorageProcessor] (Di= rectAgent-7:esxi2.ammscloud.com) clone volume from base image failed due to= Exception: java.lang.RuntimeException java.lang.RuntimeException: The name 'ROOT-204' already exists. 2013-12-05 00:10:02,420 DEBUG [agent.transport.Request] (DirectAgent-7:null= ) Seq 1-1861287947: Processing: { Ans: , MgmtId: 146454222325, via: 1, Ver= : v1, Flags: 110, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{= "result":false,"details":"java.lang.RuntimeException: The name 'ROOT-204' a= lready exists.","wait":0}}] } 2013-12-05 00:10:02,435 WARN [storage.datastore.ObjectInDataStoreManagerIm= pl] (secstorage-1:null) Unsupported data object (VOLUME, org.apache.cloudst= ack.storage.datastore.PrimaryDataStoreImpl@1d6a89e1), no need to delete = from object in store ref table 2013-12-05 00:10:02,436 DEBUG [cloud.storage.VolumeManagerImpl] (secstorage= -1:null) Unable to create Vol[204|vm=3D204|ROOT]:java.lang.RuntimeException= : The name 'ROOT-204' already exists. 2013-12-05 00:10:02,436 INFO [cloud.vm.VirtualMachineManagerImpl] (secstor= age-1:null) Unable to contact resource. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:4] i= s unreachable: Unable to create Vol[204|vm=3D204|ROOT]:java.lang.RuntimeExc= eption: The name 'ROOT-204' already exists. 2013-12-05 00:10:02,704 DEBUG [cloud.capacity.CapacityManagerImpl] (secstor= age-1:null) VM state transitted from :Starting to Stopped with event: Opera= tionFailedvm's original host id: null new host id: null host id before stat= e transition: 2 2013-12-05 00:10:02,731 WARN [storage.secondary.SecondaryStorageManagerImp= l] (secstorage-1:null) Exception while trying to start secondary storage vm com.cloud.exception.InsufficientServerCapacityException: Unable to create a= deployment for VM[SecondaryStorageVm|s-204-VM]Scope=3Dinterface com.cloud.= dc.DataCenter; id=3D1 2013-12-05 00:10:02,735 INFO [storage.secondary.SecondaryStorageManagerImp= l] (secstorage-1:null) Unable to start secondary storage vm for standby cap= acity, secStorageVm vm Id : 204, will recycle it and start a new one 2013-12-05 00:10:03,762 ERROR [storage.resource.VmwareStorageProcessor] (Di= rectAgent-23:esxi2.ammscloud.com) clone volume from base image failed due t= o Exception: java.lang.RuntimeException java.lang.RuntimeException: The name 'ROOT-2' already exists. 2013-12-05 00:10:03,766 DEBUG [agent.transport.Request] (DirectAgent-23:nul= l) Seq 1-1861287948: Processing: { Ans: , MgmtId: 146454222325, via: 1, Ve= r: v1, Flags: 110, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":= {"result":false,"details":"java.lang.RuntimeException: The name 'ROOT-2' al= ready exists.","wait":0}}] } 2013-12-05 00:10:03,780 WARN [storage.datastore.ObjectInDataStoreManagerIm= pl] (consoleproxy-1:null) Unsupported data object (VOLUME, org.apache.cloud= stack.storage.datastore.PrimaryDataStoreImpl@53e3d60f), no need to delet= e from object in store ref table 2013-12-05 00:10:03,781 DEBUG [cloud.storage.VolumeManagerImpl] (consolepro= xy-1:null) Unable to create Vol[2|vm=3D2|ROOT]:java.lang.RuntimeException: = The name 'ROOT-2' already exists. 2013-12-05 00:10:03,781 INFO [cloud.vm.VirtualMachineManagerImpl] (console= proxy-1:null) Unable to contact resource. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:4] i= s unreachable: Unable to create Vol[2|vm=3D2|ROOT]:java.lang.RuntimeExcepti= on: The name 'ROOT-2' already exists. 2013-12-05 00:10:04,006 DEBUG [cloud.capacity.CapacityManagerImpl] (console= proxy-1:null) VM state transitted from :Starting to Stopped with event: Ope= rationFailedvm's original host id: null new host id: null host id before st= ate transition: 1 2013-12-05 00:10:04,020 WARN [cloud.consoleproxy.ConsoleProxyManagerImpl] = (consoleproxy-1:null) Exception while trying to start console proxy com.cloud.exception.InsufficientServerCapacityException: Unable to create a= deployment for VM[ConsoleProxy|v-2-VM]Scope=3Dinterface com.cloud.dc.DataC= enter; id=3D1 David Vosbury, Applications Systems Analyst Phone: (800) 893-9883 x7052 Mobile: (315) 679-7641 david.vosbury@systemsmadesimple.com [cid:image001.jpg@01CCCA0D.B5979EA0] One of the Inc. 500 Fastest Growing Privately Held Companies in the U.S. This is a PRIVATE message. If you are not the intended recipient, please de= lete without copying and kindly advise us by telephone or e-mail of the mis= take in delivery. NOTE: Regardless of content, this e-mail shall not operat= e to bind Systems Made Simple (SMS) to any order or other contract unless p= ursuant to explicit written agreement or government initiative expressly pe= rmitting the use of e-mail for such purpose. This email and any attachments to it may be confidential and are intended s= olely for the use of the individual to whom it is addressed. Any views or o= pinions expressed are solely those of the author and do not necessarily rep= resent those of Shape Blue Ltd or related companies. If you are not the int= ended recipient of this email, you must neither take any action based upon = its contents, nor copy or show it to anyone. Please contact the sender if y= ou believe you have received this email in error. Shape Blue Ltd is a compa= ny incorporated in England & Wales. ShapeBlue Services India LLP is a compa= ny incorporated in India and is operated under license from Shape Blue Ltd.= Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and= is operated under license from Shape Blue Ltd. ShapeBlue is a registered t= rademark.