Return-Path: X-Original-To: apmail-cloudstack-dev-archive@www.apache.org Delivered-To: apmail-cloudstack-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F3485FB82 for ; Mon, 8 Apr 2013 17:55:08 +0000 (UTC) Received: (qmail 10621 invoked by uid 500); 8 Apr 2013 17:55:08 -0000 Delivered-To: apmail-cloudstack-dev-archive@cloudstack.apache.org Received: (qmail 10584 invoked by uid 500); 8 Apr 2013 17:55:08 -0000 Mailing-List: contact dev-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cloudstack.apache.org Delivered-To: mailing list dev@cloudstack.apache.org Received: (qmail 10574 invoked by uid 99); 8 Apr 2013 17:55:08 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Apr 2013 17:55:08 +0000 X-ASF-Spam-Status: No, hits=-5.0 required=5.0 tests=RCVD_IN_DNSWL_HI,SPF_HELO_PASS,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of Prachi.Damle@citrix.com designates 66.165.176.89 as permitted sender) Received: from [66.165.176.89] (HELO SMTP.CITRIX.COM) (66.165.176.89) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Apr 2013 17:54:55 +0000 X-IronPort-AV: E=Sophos;i="4.87,432,1363132800"; d="scan'208";a="18149646" Received: from sjcpmailmx01.citrite.net ([10.216.14.74]) by FTLPIPO01.CITRIX.COM with ESMTP/TLS/RC4-MD5; 08 Apr 2013 17:54:27 +0000 Received: from SJCPMAILBOX01.citrite.net ([10.216.4.73]) by SJCPMAILMX01.citrite.net ([10.216.14.74]) with mapi; Mon, 8 Apr 2013 10:54:27 -0700 From: Prachi Damle To: "dev@cloudstack.apache.org" Date: Mon, 8 Apr 2013 10:54:23 -0700 Subject: RE: VM deployed to wrong storage repository Thread-Topic: VM deployed to wrong storage repository Thread-Index: Ac40bSz/kLVr9UHYRkyXKYihi0k/sgAFKyYg Message-ID: <7A92FF96DF135843B4B608FB576BFC3E0141EAB92F91@SJCPMAILBOX01.citrite.net> References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org Hi Mike, I checked the logs, looks like the RandomStoragePoolAllocator is being pick= ed up for the storage allocation - this allocatordoes not match any tags. You should use FirstFitStoragePoolAllocator instead - change the component.= xml to use this allocator and not the random Thanks, -Prachi -----Original Message----- From: Mike Tutkowski [mailto:mike.tutkowski@solidfire.com] Sent: Monday, April 08, 2013 8:23 AM To: dev@cloudstack.apache.org Subject: Re: VM deployed to wrong storage repository I plan to update to the latest 4.1 today and re-try this. If I still see the problem, I'll open a bug. On Sun, Apr 7, 2013 at 4:26 PM, Mike Tutkowski wrote: > I don't see anything in vmops.log to indicate that another primary storag= e > was tried first. What do you think? > > 2013-04-07 00:30:51,459 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-11:null) Investigating why host 6 has disconnected with > event PingTimeout > 2013-04-07 00:30:51,459 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-11:null) checking if agent (6) is alive > 2013-04-07 00:30:51,460 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-16:null) Investigating why host 5 has disconnected with > event PingTimeout > 2013-04-07 00:30:51,460 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-16:null) checking if agent (5) is alive > 2013-04-07 00:30:51,462 DEBUG [agent.transport.Request] > (AgentTaskPool-11:null) Seq 6-324993302: Sending { Cmd , MgmtId: 1, via: > 6, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:30:51,462 DEBUG [agent.transport.Request] > (AgentTaskPool-11:null) Seq 6-324993302: Executing: { Cmd , MgmtId: 1, > via: 6, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:30:51,462 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-26:null) Seq 6-324993302: Executing request > 2013-04-07 00:30:51,464 DEBUG [agent.transport.Request] > (AgentTaskPool-16:null) Seq 5-614334808: Sending { Cmd , MgmtId: 1, via: > 5, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:30:51,464 DEBUG [agent.transport.Request] > (AgentTaskPool-16:null) Seq 5-614334808: Executing: { Cmd , MgmtId: 1, > via: 5, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:30:51,465 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-163:null) Seq 5-614334808: Executing request > 2013-04-07 00:30:51,511 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-26:null) Seq 6-324993302: Response Received: > 2013-04-07 00:30:51,512 DEBUG [agent.transport.Request] > (DirectAgent-26:null) Seq 6-324993302: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":true,"details":"resource is > alive","wait":0}}] } > 2013-04-07 00:30:51,512 DEBUG [agent.transport.Request] > (AgentTaskPool-11:null) Seq 6-324993302: Received: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-04-07 00:30:51,512 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-11:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is alive > 2013-04-07 00:30:51,512 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-11:null) agent (6) responded to checkHeathCommand, reporti= ng > that agent is Up > 2013-04-07 00:30:51,512 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-11:null) The state determined is Up > 2013-04-07 00:30:51,512 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-11:null) Agent is determined to be up and running > 2013-04-07 00:30:51,512 DEBUG [cloud.host.Status] (AgentTaskPool-11:null) > Transition:[Resource state =3D Enabled, Agent event =3D Ping, Host id =3D= 6, name > =3D Tut-XenServer] > 2013-04-07 00:30:51,515 DEBUG [cloud.host.Status] (AgentTaskPool-11:null) > Agent status update: [id =3D 6; name =3D Tut-XenServer; old status =3D Up= ; event > =3D Ping; new status =3D Up; old update count =3D 307; new update count = =3D 308] > 2013-04-07 00:30:51,517 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-163:null) Seq 5-614334808: Response Received: > 2013-04-07 00:30:51,517 DEBUG [agent.transport.Request] > (DirectAgent-163:null) Seq 5-614334808: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":true,"details":"resource is > alive","wait":0}}] } > 2013-04-07 00:30:51,517 DEBUG [agent.transport.Request] > (AgentTaskPool-16:null) Seq 5-614334808: Received: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-04-07 00:30:51,517 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-16:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is alive > 2013-04-07 00:30:51,517 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-16:null) agent (5) responded to checkHeathCommand, reporti= ng > that agent is Up > 2013-04-07 00:30:51,518 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-16:null) The state determined is Up > 2013-04-07 00:30:51,518 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-16:null) Agent is determined to be up and running > 2013-04-07 00:30:51,518 DEBUG [cloud.host.Status] (AgentTaskPool-16:null) > Transition:[Resource state =3D Enabled, Agent event =3D Ping, Host id =3D= 5, name > =3D Tut-XenServer2] > 2013-04-07 00:30:51,522 DEBUG [cloud.host.Status] (AgentTaskPool-16:null) > Agent status update: [id =3D 5; name =3D Tut-XenServer2; old status =3D U= p; event > =3D Ping; new status =3D Up; old update count =3D 144; new update count = =3D 145] > 2013-04-07 00:30:52,927 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-157:null) Seq 6-324993301: Response Received: > 2013-04-07 00:30:52,927 DEBUG [agent.transport.Request] > (DirectAgent-157:null) Seq 6-324993301: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 110, [{"Answer":{"result":true,"wait":0}}] } > 2013-04-07 00:30:52,927 DEBUG [agent.transport.Request] > (Job-Executor-35:job-42) Seq 6-324993301: Received: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 110, { Answer } } > 2013-04-07 00:30:52,927 DEBUG [agent.manager.AgentAttache] > (DirectAgent-157:null) Seq 6-324993301: No more commands found > 2013-04-07 00:30:52,938 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (Job-Executor-35:job-42) Applying userdata and password entry in network > Ntwk[204|Guest|6] > 2013-04-07 00:30:52,952 DEBUG [agent.transport.Request] > (Job-Executor-35:job-42) Seq 6-324993303: Sending { Cmd , MgmtId: 1, via= : > 6, Ver: v1, Flags: 100111, > [{"routing.SavePasswordCommand":{"password":"fnirq_cnffjbeq","vmIpAddress= ":"192.168.56.195","vmName":"c18ddf7c-fc61-40b0-af75-fdef05f8eae6","accessD= etails":{"router.guest.ip":"192.168.56.102","zone.network.type":"Basic","ro= uter.ip":"169.254.1.168"," > router.name > ":"r-4-VM"},"wait":0}},{"routing.VmDataCommand":{"vmIpAddress":"192.168.5= 6.195","vmName":"c18ddf7c-fc61-40b0-af75-fdef05f8eae6","accessDetails":{"ro= uter.guest.ip":"192.168.56.102","zone.network.type":"Basic","router.ip":"16= 9.254.1.168"," > router.name":"r-4-VM"},"wait":0}}] } > 2013-04-07 00:30:52,953 DEBUG [agent.transport.Request] > (Job-Executor-35:job-42) Seq 6-324993303: Executing: { Cmd , MgmtId: 1, > via: 6, Ver: v1, Flags: 100111, > [{"routing.SavePasswordCommand":{"password":"fnirq_cnffjbeq","vmIpAddress= ":"192.168.56.195","vmName":"c18ddf7c-fc61-40b0-af75-fdef05f8eae6","accessD= etails":{"router.guest.ip":"192.168.56.102","zone.network.type":"Basic","ro= uter.ip":"169.254.1.168"," > router.name > ":"r-4-VM"},"wait":0}},{"routing.VmDataCommand":{"vmIpAddress":"192.168.5= 6.195","vmName":"c18ddf7c-fc61-40b0-af75-fdef05f8eae6","accessDetails":{"ro= uter.guest.ip":"192.168.56.102","zone.network.type":"Basic","router.ip":"16= 9.254.1.168"," > router.name":"r-4-VM"},"wait":0}}] } > 2013-04-07 00:30:52,953 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-37:null) Seq 6-324993303: Executing request > 2013-04-07 00:30:53,093 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 53091 > 2013-04-07 00:30:53,110 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 53091 > 2013-04-07 00:30:56,093 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 56091 > 2013-04-07 00:30:56,109 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 56091 > 2013-04-07 00:30:59,094 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 59092 > 2013-04-07 00:30:59,111 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 59092 > 2013-04-07 00:31:02,095 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 62093 > 2013-04-07 00:31:02,110 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 62093 > 2013-04-07 00:31:04,860 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-145:null) Ping from 6 > 2013-04-07 00:31:05,099 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 65096 > 2013-04-07 00:31:05,114 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 65096 > 2013-04-07 00:31:06,234 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-372:null) Ping from 5 > 2013-04-07 00:31:06,909 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-149:null) Seq 6-324993028: Executing request > 2013-04-07 00:31:07,239 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-149:null) Seq 6-324993028: Response Received: > 2013-04-07 00:31:07,239 DEBUG [agent.transport.Request] > (DirectAgent-149:null) Seq 6-324993028: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, > [{"ClusterSyncAnswer":{"_clusterId":2,"_newStates":{},"_isExecuted":false= ,"result":true,"wait":0}}] > } > 2013-04-07 00:31:07,424 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-37:null) Seq 6-324993303: Response Received: > 2013-04-07 00:31:07,424 DEBUG [agent.transport.Request] > (DirectAgent-37:null) Seq 6-324993303: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 110, > [{"Answer":{"result":true,"wait":0}},{"Answer":{"result":true,"wait":0}}]= } > 2013-04-07 00:31:07,424 DEBUG [agent.transport.Request] > (Job-Executor-35:job-42) Seq 6-324993303: Received: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 110, { Answer, Answer } } > 2013-04-07 00:31:07,424 DEBUG [agent.manager.AgentAttache] > (DirectAgent-37:null) Seq 6-324993303: No more commands found > 2013-04-07 00:31:07,424 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-35:job-42) Asking VpcVirtualRouter to prepare for > Nic[18-12-6416c373-20d8-4617-8dcb-30a8ff9d0f34-192.168.56.195] > 2013-04-07 00:31:07,424 WARN [network.element.VpcVirtualRouterElement] > (Job-Executor-35:job-42) Network Ntwk[204|Guest|6] is not associated with > any VPC > 2013-04-07 00:31:07,429 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-35:job-42) Asking NiciraNvp to prepare for > Nic[18-12-6416c373-20d8-4617-8dcb-30a8ff9d0f34-192.168.56.195] > 2013-04-07 00:31:07,429 DEBUG [network.element.NiciraNvpElement] > (Job-Executor-35:job-42) Checking if NiciraNvpElement can handle service > Connectivity on network guestNetworkForBasicZone > 2013-04-07 00:31:07,432 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-35:job-42) Asking JuniperSRX to prepare for > Nic[18-12-6416c373-20d8-4617-8dcb-30a8ff9d0f34-192.168.56.195] > 2013-04-07 00:31:07,436 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-35:job-42) Asking Netscaler to prepare for > Nic[18-12-6416c373-20d8-4617-8dcb-30a8ff9d0f34-192.168.56.195] > 2013-04-07 00:31:07,441 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-35:job-42) Asking F5BigIP to prepare for > Nic[18-12-6416c373-20d8-4617-8dcb-30a8ff9d0f34-192.168.56.195] > 2013-04-07 00:31:07,445 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-35:job-42) Asking CiscoNexus1000vVSM to prepare for > Nic[18-12-6416c373-20d8-4617-8dcb-30a8ff9d0f34-192.168.56.195] > 2013-04-07 00:31:07,449 DEBUG [cloud.storage.StorageManagerImpl] > (Job-Executor-35:job-42) Checking if we need to prepare 1 volumes for > VM[User|c18ddf7c-fc61-40b0-af75-fdef05f8eae6] > 2013-04-07 00:31:07,451 DEBUG [cloud.storage.StorageManagerImpl] > (Job-Executor-35:job-42) Creating volume: Vol[12|vm=3D12|ROOT] > 2013-04-07 00:31:07,451 DEBUG [cloud.storage.StorageManagerImpl] > (Job-Executor-35:job-42) Trying to create in Pool[257|PreSetup] > 2013-04-07 00:31:07,459 DEBUG [cloud.template.TemplateManagerImpl] > (Job-Executor-35:job-42) Downloading template 5 to pool 257 > 2013-04-07 00:31:07,466 DEBUG [cloud.template.TemplateManagerImpl] > (Job-Executor-35:job-42) Downloading 5 via 5 > 2013-04-07 00:31:07,470 DEBUG [agent.transport.Request] > (Job-Executor-35:job-42) Seq 5-614334809: Sending { Cmd , MgmtId: 1, > via: 5, Ver: v1, Flags: 100111, > [{"storage.PrimaryStorageDownloadCommand":{"localPath":"/mnt/9a008517-e32= 1-37a0-a941-44695f9b6fe7","poolUuid":"iSCSI_SR_3","poolId":257,"primaryPool= ":{"id":257,"uuid":"iSCSI_SR_3","host":"192.168.56.9","path":"/iSCSI_SR_3",= "port":0,"type":"PreSetup"},"secondaryStorageUrl":"nfs://192.168.56.10: > /opt/storage/secondary","primaryStorageUrl":"nfs://192.168.56.9/iSCSI_SR_= 3 > ","url":"nfs://192.168.56.10:/opt/storage/secondary/template/tmpl/1/5//ce= 5b212e-215a-3461-94fb-814a635b2215.vhd","format":"VHD","accountId":1,"name"= :"tiny > Linux","wait":10800}}] } > 2013-04-07 00:31:07,470 DEBUG [agent.transport.Request] > (Job-Executor-35:job-42) Seq 5-614334809: Executing: { Cmd , MgmtId: 1, > via: 5, Ver: v1, Flags: 100111, > [{"storage.PrimaryStorageDownloadCommand":{"localPath":"/mnt/9a008517-e32= 1-37a0-a941-44695f9b6fe7","poolUuid":"iSCSI_SR_3","poolId":257,"primaryPool= ":{"id":257,"uuid":"iSCSI_SR_3","host":"192.168.56.9","path":"/iSCSI_SR_3",= "port":0,"type":"PreSetup"},"secondaryStorageUrl":"nfs://192.168.56.10: > /opt/storage/secondary","primaryStorageUrl":"nfs://192.168.56.9/iSCSI_SR_= 3 > ","url":"nfs://192.168.56.10:/opt/storage/secondary/template/tmpl/1/5//ce= 5b212e-215a-3461-94fb-814a635b2215.vhd","format":"VHD","accountId":1,"name"= :"tiny > Linux","wait":10800}}] } > 2013-04-07 00:31:07,470 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-174:null) Seq 5-614334809: Executing request > 2013-04-07 00:31:08,097 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 68095 > 2013-04-07 00:31:08,115 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 68095 > 2013-04-07 00:31:11,023 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-309:null) Seq 5-614334468: Executing request > 2013-04-07 00:31:11,099 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 71096 > 2013-04-07 00:31:11,121 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 71096 > 2013-04-07 00:31:11,363 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-309:null) Seq 5-614334468: Response Received: > 2013-04-07 00:31:11,363 DEBUG [agent.transport.Request] > (DirectAgent-309:null) Seq 5-614334468: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, [{"Answer":{"result":true,"wait":0}}] } > 2013-04-07 00:31:14,100 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 74097 > 2013-04-07 00:31:14,124 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 74097 > 2013-04-07 00:31:16,197 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316276194 > 2013-04-07 00:31:16,219 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316276194 > 2013-04-07 00:31:17,101 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 77098 > 2013-04-07 00:31:17,123 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 77098 > 2013-04-07 00:31:17,954 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVolumes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316277950 > 2013-04-07 00:31:17,972 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVolumes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316277950 > 2013-04-07 00:31:20,102 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 80099 > 2013-04-07 00:31:20,118 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 80099 > 2013-04-07 00:31:20,454 DEBUG > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone = 1 > is ready to launch secondary storage VM > 2013-04-07 00:31:20,558 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl= ] > (consoleproxy-1:null) Zone 1 is ready to launch console proxy > 2013-04-07 00:31:20,820 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:31:20,821 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:31:20,852 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:31:20,853 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:31:21,075 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVolumes&id=3Daed71ae1-732b-48d7-833f-e23287e2b2b9&response= =3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316281073 > 2013-04-07 00:31:21,097 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVolumes&id=3Daed71ae1-732b-48d7-833f-e23287e2b2b9&response= =3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316281073 > 2013-04-07 00:31:21,120 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistTags&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8G= oVA%3D&resourceId=3Daed71ae1-732b-48d7-833f-e23287e2b2b9&resourceType=3DVol= ume&listAll=3Dtrue&_=3D1365316281117 > 2013-04-07 00:31:21,142 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistTags&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8G= oVA%3D&resourceId=3Daed71ae1-732b-48d7-833f-e23287e2b2b9&resourceType=3DVol= ume&listAll=3Dtrue&_=3D1365316281117 > 2013-04-07 00:31:23,102 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 83100 > 2013-04-07 00:31:23,122 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 83100 > 2013-04-07 00:31:24,894 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-9:null) Ping from 4 > 2013-04-07 00:31:26,102 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 86100 > 2013-04-07 00:31:26,117 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 86100 > 2013-04-07 00:31:27,217 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-164:null) Ping from 1 > 2013-04-07 00:31:28,079 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-174:null) Seq 5-614334809: Response Received: > 2013-04-07 00:31:28,079 DEBUG [agent.transport.Request] > (DirectAgent-174:null) Seq 5-614334809: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 110, > [{"storage.PrimaryStorageDownloadAnswer":{"installPath":"a8414926-81d6-4b= 54-9b4b-feb498489df0","templateSize":54525952,"result":true,"wait":0}}] > } > 2013-04-07 00:31:28,079 DEBUG [agent.transport.Request] > (Job-Executor-35:job-42) Seq 5-614334809: Received: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 110, { PrimaryStorageDownloadAnswer } } > 2013-04-07 00:31:28,079 DEBUG [agent.manager.AgentAttache] > (DirectAgent-174:null) Seq 5-614334809: No more commands found > 2013-04-07 00:31:28,081 DEBUG [cloud.template.TemplateManagerImpl] > (Job-Executor-35:job-42) Template 5 is downloaded via 5 > 2013-04-07 00:31:28,085 DEBUG [agent.transport.Request] > (Job-Executor-35:job-42) Seq 5-614334810: Sending { Cmd , MgmtId: 1, via= : > 5, Ver: v1, Flags: 100111, > [{"storage.CreateCommand":{"volId":12,"pool":{"id":257,"uuid":"iSCSI_SR_3= ","host":"192.168.56.9","path":"/iSCSI_SR_3","port":0,"type":"PreSetup"},"d= iskCharacteristics":{"size":52428800,"tags":["iSCSI_SR_3"],"type":"ROOT","n= ame":"ROOT-12","useLocalStorage":false,"recreatable":true,"diskOfferingId":= 37,"volumeId":12,"hyperType":"XenServer"},"templateUrl":"a8414926-81d6-4b54= -9b4b-feb498489df0","wait":0}}] > } > 2013-04-07 00:31:28,086 DEBUG [agent.transport.Request] > (Job-Executor-35:job-42) Seq 5-614334810: Executing: { Cmd , MgmtId: 1, > via: 5, Ver: v1, Flags: 100111, > [{"storage.CreateCommand":{"volId":12,"pool":{"id":257,"uuid":"iSCSI_SR_3= ","host":"192.168.56.9","path":"/iSCSI_SR_3","port":0,"type":"PreSetup"},"d= iskCharacteristics":{"size":52428800,"tags":["iSCSI_SR_3"],"type":"ROOT","n= ame":"ROOT-12","useLocalStorage":false,"recreatable":true,"diskOfferingId":= 37,"volumeId":12,"hyperType":"XenServer"},"templateUrl":"a8414926-81d6-4b54= -9b4b-feb498489df0","wait":0}}] > } > 2013-04-07 00:31:28,086 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-327:null) Seq 5-614334810: Executing request > 2013-04-07 00:31:28,227 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-327:null) SR retrieved for iSCSI_SR_3 > 2013-04-07 00:31:28,240 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-327:null) Checking iSCSI_SR_3 or SR > fe8ca696-22f5-ba1f-af68-7c3cf5a3cb39 on > XS[5e02c608-155d-432e-a20f-f8c600ef3ab7-192.168.56.11] > 2013-04-07 00:31:29,095 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-84:null) Seq 1-90046472: Executing request > 2013-04-07 00:31:29,106 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 89101 > 2013-04-07 00:31:29,130 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 89101 > 2013-04-07 00:31:29,687 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-84:null) Seq 1-90046472: Response Received: > 2013-04-07 00:31:29,688 DEBUG [agent.transport.Request] > (DirectAgent-84:null) Seq 1-90046472: Processing: { Ans: , MgmtId: 1, vi= a: > 1, Ver: v1, Flags: 10, > [{"ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false= ,"result":true,"wait":0}}] > } > 2013-04-07 00:31:30,685 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-327:null) Succesfully created VDI for > com.cloud.agent.api.storage.CreateCommand. Uuid =3D > 40a39639-e8aa-45b5-bfa1-591b68571d0c > 2013-04-07 00:31:30,686 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-327:null) Seq 5-614334810: Response Received: > 2013-04-07 00:31:30,686 DEBUG [agent.transport.Request] > (DirectAgent-327:null) Seq 5-614334810: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 110, > [{"storage.CreateAnswer":{"volume":{"id":12,"name":"ROOT-12","mountPoint"= :"/iSCSI_SR_3","path":"40a39639-e8aa-45b5-bfa1-591b68571d0c","size":5242880= 0,"type":"ROOT","storagePoolType":"PreSetup","storagePoolUuid":"iSCSI_SR_3"= ,"deviceId":0},"requestTemplateReload":false,"result":true,"wait":0}}] > } > 2013-04-07 00:31:30,686 DEBUG [agent.transport.Request] > (Job-Executor-35:job-42) Seq 5-614334810: Received: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 110, { CreateAnswer } } > 2013-04-07 00:31:30,686 DEBUG [agent.manager.AgentAttache] > (DirectAgent-327:null) Seq 5-614334810: No more commands found > 2013-04-07 00:31:30,689 DEBUG [cloud.storage.StorageManagerImpl] > (Job-Executor-35:job-42) Volume Vol[12|vm=3D12|ROOT] is created on > Pool[257|PreSetup] > 2013-04-07 00:31:30,705 DEBUG [agent.transport.Request] > (Job-Executor-35:job-42) Seq 5-614334811: Sending { Cmd , MgmtId: 1, via= : > 5, Ver: v1, Flags: 100111, > [{"StartCommand":{"vm":{"id":12,"name":"i-2-12-VM","bootloader":"PyGrub",= "type":"User","cpus":1,"speed":100,"minRam":1073741824,"maxRam":1073741824,= "arch":"x86_64","os":"CentOS > 5.3 > (64-bit)","bootArgs":"","rebootOnCrash":false,"enableHA":false,"limitCpuU= se":false,"vncPassword":"a0ed1e002d55dc0b","params":{},"uuid":"c18ddf7c-fc6= 1-40b0-af75-fdef05f8eae6","disks":[{"id":12,"name":"ROOT-12","mountPoint":"= /iSCSI_SR_3","path":"40a39639-e8aa-45b5-bfa1-591b68571d0c","size":52428800,= "type":"ROOT","storagePoolType":"PreSetup","storagePoolUuid":"iSCSI_SR_3","= deviceId":0},{"id":12,"name":"tiny > Linux","size":0,"type":"ISO","storagePoolType":"ISO","deviceId":3}],"nics= ":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"uuid":"70472c43-4= 913-4e0a-8e1d-87b030404b0a","ip":"192.168.56.195","netmask":"255.255.255.0"= ,"gateway":"192.168.56.1","mac":"06:c8:0e:00:00:75","dns1":"8.8.8.8","dns2"= :"4.4.4.4","broadcastType":"Native","type":"Guest","broadcastUri":"vlan://u= ntagged","isolationUri":"ec2://untagged","isSecurityGroupEnabled":true}]},"= hostIp":"192.168.56.11","wait":0}}] > } > 2013-04-07 00:31:30,705 DEBUG [agent.transport.Request] > (Job-Executor-35:job-42) Seq 5-614334811: Executing: { Cmd , MgmtId: 1, > via: 5, Ver: v1, Flags: 100111, > [{"StartCommand":{"vm":{"id":12,"name":"i-2-12-VM","bootloader":"PyGrub",= "type":"User","cpus":1,"speed":100,"minRam":1073741824,"maxRam":1073741824,= "arch":"x86_64","os":"CentOS > 5.3 > (64-bit)","bootArgs":"","rebootOnCrash":false,"enableHA":false,"limitCpuU= se":false,"vncPassword":"a0ed1e002d55dc0b","params":{},"uuid":"c18ddf7c-fc6= 1-40b0-af75-fdef05f8eae6","disks":[{"id":12,"name":"ROOT-12","mountPoint":"= /iSCSI_SR_3","path":"40a39639-e8aa-45b5-bfa1-591b68571d0c","size":52428800,= "type":"ROOT","storagePoolType":"PreSetup","storagePoolUuid":"iSCSI_SR_3","= deviceId":0},{"id":12,"name":"tiny > Linux","size":0,"type":"ISO","storagePoolType":"ISO","deviceId":3}],"nics= ":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"uuid":"70472c43-4= 913-4e0a-8e1d-87b030404b0a","ip":"192.168.56.195","netmask":"255.255.255.0"= ,"gateway":"192.168.56.1","mac":"06:c8:0e:00:00:75","dns1":"8.8.8.8","dns2"= :"4.4.4.4","broadcastType":"Native","type":"Guest","broadcastUri":"vlan://u= ntagged","isolationUri":"ec2://untagged","isSecurityGroupEnabled":true}]},"= hostIp":"192.168.56.11","wait":0}}] > } > 2013-04-07 00:31:30,705 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-265:null) Seq 5-614334811: Executing request > 2013-04-07 00:31:30,848 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-265:null) 1. The VM i-2-12-VM is in Starting state. > 2013-04-07 00:31:30,907 DEBUG [xen.resource.XenServer56FP1Resource] > (DirectAgent-265:null) Created VM 6b192a90-bce6-7347-f184-d5b84538647a fo= r > i-2-12-VM > 2013-04-07 00:31:30,959 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-265:null) VBD 9ea8a64a-9d04-76df-9d8b-103371b21d86 created f= or > Vol[12|ROOT|40a39639-e8aa-45b5-bfa1-591b68571d0c|52428800] > 2013-04-07 00:31:30,985 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-265:null) VBD 0fb43cee-0512-beed-5d24-a33a2ceceeda created f= or > Vol[12|ISO|null|0] > 2013-04-07 00:31:30,985 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-265:null) Creating VIF for i-2-12-VM on nic > [Nic:Guest-192.168.56.195-vlan://untagged] > 2013-04-07 00:31:31,037 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-265:null) Created a vif adbeb814-7d38-1fda-1bdb-b6850c7cb342 > on 0 > 2013-04-07 00:31:32,105 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 92102 > 2013-04-07 00:31:32,122 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 92102 > 2013-04-07 00:31:35,106 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 95103 > 2013-04-07 00:31:35,125 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 95103 > 2013-04-07 00:31:38,106 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 98104 > 2013-04-07 00:31:38,126 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653162= 98104 > 2013-04-07 00:31:41,108 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 01106 > 2013-04-07 00:31:41,133 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 01106 > 2013-04-07 00:31:43,708 INFO [xen.resource.CitrixResourceBase] > (DirectAgent-265:null) Programmed default network rules for i-2-12-VM on > nic with ip:192.168.56.195 mac:06:c8:0e:00:00:75 > 2013-04-07 00:31:43,708 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-265:null) 2. The VM i-2-12-VM is in Running state. > 2013-04-07 00:31:43,708 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-265:null) Seq 5-614334811: Response Received: > 2013-04-07 00:31:43,709 DEBUG [agent.transport.Request] > (DirectAgent-265:null) Seq 5-614334811: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 110, > [{"StartAnswer":{"vm":{"id":12,"name":"i-2-12-VM","bootloader":"PyGrub","= type":"User","cpus":1,"speed":100,"minRam":1073741824,"maxRam":1073741824,"= arch":"x86_64","os":"CentOS > 5.3 > (64-bit)","bootArgs":"","rebootOnCrash":false,"enableHA":false,"limitCpuU= se":false,"vncPassword":"a0ed1e002d55dc0b","params":{},"uuid":"c18ddf7c-fc6= 1-40b0-af75-fdef05f8eae6","disks":[{"id":12,"name":"ROOT-12","mountPoint":"= /iSCSI_SR_3","path":"40a39639-e8aa-45b5-bfa1-591b68571d0c","size":52428800,= "type":"ROOT","storagePoolType":"PreSetup","storagePoolUuid":"iSCSI_SR_3","= deviceId":0},{"id":12,"name":"tiny > Linux","size":0,"type":"ISO","storagePoolType":"ISO","deviceId":3}],"nics= ":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"uuid":"70472c43-4= 913-4e0a-8e1d-87b030404b0a","ip":"192.168.56.195","netmask":"255.255.255.0"= ,"gateway":"192.168.56.1","mac":"06:c8:0e:00:00:75","dns1":"8.8.8.8","dns2"= :"4.4.4.4","broadcastType":"Native","type":"Guest","broadcastUri":"vlan://u= ntagged","isolationUri":"ec2://untagged","isSecurityGroupEnabled":true}]},"= result":true,"wait":0}}] > } > 2013-04-07 00:31:43,709 DEBUG [agent.transport.Request] > (Job-Executor-35:job-42) Seq 5-614334811: Received: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 110, { StartAnswer } } > 2013-04-07 00:31:43,709 DEBUG [agent.manager.AgentAttache] > (DirectAgent-265:null) Seq 5-614334811: No more commands found > 2013-04-07 00:31:43,763 DEBUG [network.security.SecurityGroupManagerImpl] > (Job-Executor-35:job-42) Security Group Mgr v2: scheduling ruleset update= s > for 1 vms (unique=3D1), current queue size=3D0 > 2013-04-07 00:31:43,765 DEBUG [network.security.SecurityGroupManagerImpl] > (Job-Executor-35:job-42) Security Group Mgr v2: done scheduling ruleset > updates for 1 vms: num new jobs=3D1 num rows insert or updated=3D1 time t= aken=3D2 > 2013-04-07 00:31:43,769 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-35:job-42) VM state transitted from :Starting to Running wi= th > event: OperationSucceededvm's original host id: 5 new host id: 5 host id > before state transition: 5 > 2013-04-07 00:31:43,769 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (Job-Executor-35:job-42) Start completed for VM > VM[User|c18ddf7c-fc61-40b0-af75-fdef05f8eae6] > 2013-04-07 00:31:43,773 DEBUG [network.security.SecurityGroupManagerImpl] > (SecGrp-Worker-3:null) SecurityGroupManager v2: sending ruleset update fo= r > vm i-2-12-VM:ingress num rules=3D0:egress num rules=3D0 num cidrs=3D0 > sig=3Dd41d8cd98f00b204e9800998ecf8427e > 2013-04-07 00:31:43,777 DEBUG [cloud.async.AsyncJobManagerImpl] > (Job-Executor-35:job-42) Complete async job-42, jobStatus: 1, resultCode: > 0, result: org.apache.cloudstack.api.response.UserVmResponse@d9c5b6f > 2013-04-07 00:31:43,782 DEBUG [cloud.async.AsyncJobManagerImpl] > (Job-Executor-35:job-42) Done executing > org.apache.cloudstack.api.command.user.vm.DeployVMCmd for job-42 > 2013-04-07 00:31:43,796 DEBUG [agent.transport.Request] > (SecGrp-Worker-3:null) Seq 5-614334812: Sending { Cmd , MgmtId: 1, via: = 5, > Ver: v1, Flags: 100111, > [{"SecurityGroupRulesCmd":{"guestIp":"192.168.56.195","vmName":"i-2-12-VM= ","guestMac":"06:c8:0e:00:00:75","signature":"d41d8cd98f00b204e9800998ecf84= 27e","seqNum":1,"vmId":12,"msId":1,"ingressRuleSet":[],"egressRuleSet":[],"= wait":0}}] > } > 2013-04-07 00:31:43,796 DEBUG [agent.transport.Request] > (SecGrp-Worker-3:null) Seq 5-614334812: Executing: { Cmd , MgmtId: 1, vi= a: > 5, Ver: v1, Flags: 100111, > [{"SecurityGroupRulesCmd":{"guestIp":"192.168.56.195","vmName":"i-2-12-VM= ","guestMac":"06:c8:0e:00:00:75","signature":"d41d8cd98f00b204e9800998ecf84= 27e","seqNum":1,"vmId":12,"msId":1,"ingressRuleSet":[],"egressRuleSet":[],"= wait":0}}] > } > 2013-04-07 00:31:43,796 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-77:null) Seq 5-614334812: Executing request > 2013-04-07 00:31:44,109 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 04106 > 2013-04-07 00:31:44,122 DEBUG [cloud.async.AsyncJobManagerImpl] > (1161145101@qtp-1008805148-33:null) Async job-42 completed > 2013-04-07 00:31:44,131 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3Df75d8ce8-1193-43bf-b171-f43d2534e6= bc&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 04106 > 2013-04-07 00:31:44,351 INFO [xen.resource.CitrixResourceBase] > (DirectAgent-77:null) Programmed network rules for vm i-2-12-VM > guestIp=3D192.168.56.195, ingress numrules=3D0, egress numrules=3D0 > 2013-04-07 00:31:44,351 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-77:null) Seq 5-614334812: Response Received: > 2013-04-07 00:31:44,352 DEBUG [agent.transport.Request] > (DirectAgent-77:null) Seq 5-614334812: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 110, > [{"SecurityGroupRuleAnswer":{"logSequenceNumber":1,"vmId":12,"reason":"NO= NE","result":true,"wait":0}}] > } > 2013-04-07 00:31:44,353 DEBUG [network.security.SecurityGroupListener] > (DirectAgent-77:null) Successfully programmed rule > com.cloud.agent.api.SecurityGroupRuleAnswer into host 5 > 2013-04-07 00:31:44,357 DEBUG [network.security.SecurityGroupListener] > (DirectAgent-77:null) Successfully programmed rule > com.cloud.agent.api.SecurityGroupRuleAnswer into host 5 > 2013-04-07 00:31:44,359 DEBUG [agent.manager.AgentAttache] > (DirectAgent-77:null) Seq 5-614334812: No more commands found > 2013-04-07 00:31:47,679 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-10:null) Ping from 3 > 2013-04-07 00:31:50,451 DEBUG > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone = 1 > is ready to launch secondary storage VM > 2013-04-07 00:31:50,553 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl= ] > (consoleproxy-1:null) Zone 1 is ready to launch console proxy > 2013-04-07 00:31:50,819 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:31:50,820 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:31:50,851 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:31:50,852 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:31:51,459 INFO [agent.manager.AgentMonitor] > (Thread-11:null) Found the following agents behind on ping: [6, 5] > 2013-04-07 00:31:51,460 DEBUG [cloud.host.Status] (Thread-11:null) Ping > timeout for host 6, do invstigation > 2013-04-07 00:31:51,461 DEBUG [cloud.host.Status] (Thread-11:null) Ping > timeout for host 5, do invstigation > 2013-04-07 00:31:51,462 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-2:null) Investigating why host 6 has disconnected with eve= nt > PingTimeout > 2013-04-07 00:31:51,462 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-2:null) checking if agent (6) is alive > 2013-04-07 00:31:51,463 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-14:null) Investigating why host 5 has disconnected with > event PingTimeout > 2013-04-07 00:31:51,463 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-14:null) checking if agent (5) is alive > 2013-04-07 00:31:51,465 DEBUG [agent.transport.Request] > (AgentTaskPool-2:null) Seq 6-324993304: Sending { Cmd , MgmtId: 1, via: = 6, > Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:31:51,465 DEBUG [agent.transport.Request] > (AgentTaskPool-2:null) Seq 6-324993304: Executing: { Cmd , MgmtId: 1, vi= a: > 6, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:31:51,465 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-151:null) Seq 6-324993304: Executing request > 2013-04-07 00:31:51,466 DEBUG [agent.transport.Request] > (AgentTaskPool-14:null) Seq 5-614334813: Sending { Cmd , MgmtId: 1, via: > 5, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:31:51,467 DEBUG [agent.transport.Request] > (AgentTaskPool-14:null) Seq 5-614334813: Executing: { Cmd , MgmtId: 1, > via: 5, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:31:51,467 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-113:null) Seq 5-614334813: Executing request > 2013-04-07 00:31:51,525 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-151:null) Seq 6-324993304: Response Received: > 2013-04-07 00:31:51,525 DEBUG [agent.transport.Request] > (DirectAgent-151:null) Seq 6-324993304: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":true,"details":"resource is > alive","wait":0}}] } > 2013-04-07 00:31:51,526 DEBUG [agent.transport.Request] > (AgentTaskPool-2:null) Seq 6-324993304: Received: { Ans: , MgmtId: 1, vi= a: > 6, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-04-07 00:31:51,526 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-2:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is alive > 2013-04-07 00:31:51,526 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-2:null) agent (6) responded to checkHeathCommand, reportin= g > that agent is Up > 2013-04-07 00:31:51,526 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-2:null) The state determined is Up > 2013-04-07 00:31:51,526 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-2:null) Agent is determined to be up and running > 2013-04-07 00:31:51,526 DEBUG [cloud.host.Status] (AgentTaskPool-2:null) > Transition:[Resource state =3D Enabled, Agent event =3D Ping, Host id =3D= 6, name > =3D Tut-XenServer] > 2013-04-07 00:31:51,529 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-113:null) Seq 5-614334813: Response Received: > 2013-04-07 00:31:51,529 DEBUG [agent.transport.Request] > (DirectAgent-113:null) Seq 5-614334813: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":true,"details":"resource is > alive","wait":0}}] } > 2013-04-07 00:31:51,529 DEBUG [agent.transport.Request] > (AgentTaskPool-14:null) Seq 5-614334813: Received: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-04-07 00:31:51,529 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-14:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is alive > 2013-04-07 00:31:51,529 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-14:null) agent (5) responded to checkHeathCommand, reporti= ng > that agent is Up > 2013-04-07 00:31:51,529 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-14:null) The state determined is Up > 2013-04-07 00:31:51,529 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-14:null) Agent is determined to be up and running > 2013-04-07 00:31:51,530 DEBUG [cloud.host.Status] (AgentTaskPool-2:null) > Agent status update: [id =3D 6; name =3D Tut-XenServer; old status =3D Up= ; event > =3D Ping; new status =3D Up; old update count =3D 308; new update count = =3D 309] > 2013-04-07 00:31:51,530 DEBUG [cloud.host.Status] (AgentTaskPool-14:null) > Transition:[Resource state =3D Enabled, Agent event =3D Ping, Host id =3D= 5, name > =3D Tut-XenServer2] > 2013-04-07 00:31:51,533 DEBUG [cloud.host.Status] (AgentTaskPool-14:null) > Agent status update: [id =3D 5; name =3D Tut-XenServer2; old status =3D U= p; event > =3D Ping; new status =3D Up; old update count =3D 145; new update count = =3D 146] > 2013-04-07 00:31:58,908 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316318906 > 2013-04-07 00:31:58,925 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316318906 > 2013-04-07 00:32:00,065 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVolumes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316320063 > 2013-04-07 00:32:00,079 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVolumes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316320063 > 2013-04-07 00:32:02,019 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316322017 > 2013-04-07 00:32:02,034 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316322017 > 2013-04-07 00:32:03,004 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVolumes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316323002 > 2013-04-07 00:32:03,019 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVolumes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316323002 > 2013-04-07 00:32:04,060 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316324057 > 2013-04-07 00:32:04,076 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316324057 > 2013-04-07 00:32:04,815 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-240:null) Ping from 6 > 2013-04-07 00:32:06,151 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-401:null) Ping from 5 > 2013-04-07 00:32:06,571 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistZones&available=3Dtrue&response=3Djson&sessionkey=3DZ6QqzU= 0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316326569 > 2013-04-07 00:32:06,578 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistZones&available=3Dtrue&response=3Djson&sessionkey=3DZ6QqzU= 0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316326569 > 2013-04-07 00:32:06,909 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-334:null) Seq 6-324993028: Executing request > 2013-04-07 00:32:07,152 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-334:null) Seq 6-324993028: Response Received: > 2013-04-07 00:32:07,152 DEBUG [agent.transport.Request] > (DirectAgent-334:null) Seq 6-324993028: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, > [{"ClusterSyncAnswer":{"_clusterId":2,"_newStates":{},"_isExecuted":false= ,"result":true,"wait":0}}] > } > 2013-04-07 00:32:08,422 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistHypervisors&zoneid=3D3a62dec3-cf95-4ba2-9af0-af2190af35e3&= response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163284= 20 > 2013-04-07 00:32:08,431 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistHypervisors&zoneid=3D3a62dec3-cf95-4ba2-9af0-af2190af35e3&= response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163284= 20 > 2013-04-07 00:32:08,434 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistTemplates&templatefilter=3Dfeatured&zoneid=3D3a62dec3-cf95= -4ba2-9af0-af2190af35e3&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl= 8GoVA%3D&_=3D1365316328432 > 2013-04-07 00:32:08,461 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistTemplates&templatefilter=3Dfeatured&zoneid=3D3a62dec3-cf95= -4ba2-9af0-af2190af35e3&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl= 8GoVA%3D&_=3D1365316328432 > 2013-04-07 00:32:08,464 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistTemplates&templatefilter=3Dcommunity&zoneid=3D3a62dec3-cf9= 5-4ba2-9af0-af2190af35e3&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&_=3D1365316328462 > 2013-04-07 00:32:08,492 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistTemplates&templatefilter=3Dcommunity&zoneid=3D3a62dec3-cf9= 5-4ba2-9af0-af2190af35e3&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&_=3D1365316328462 > 2013-04-07 00:32:08,495 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistTemplates&templatefilter=3Dselfexecutable&zoneid=3D3a62dec= 3-cf95-4ba2-9af0-af2190af35e3&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bM= gnRRfl8GoVA%3D&_=3D1365316328493 > 2013-04-07 00:32:08,508 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistTemplates&templatefilter=3Dselfexecutable&zoneid=3D3a62dec= 3-cf95-4ba2-9af0-af2190af35e3&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bM= gnRRfl8GoVA%3D&_=3D1365316328493 > 2013-04-07 00:32:09,476 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistServiceOfferings&issystem=3Dfalse&response=3Djson&sessionk= ey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316329474 > 2013-04-07 00:32:09,489 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistServiceOfferings&issystem=3Dfalse&response=3Djson&sessionk= ey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316329474 > 2013-04-07 00:32:11,022 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-161:null) Seq 5-614334468: Executing request > 2013-04-07 00:32:11,174 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-161:null) Seq 5-614334468: Response Received: > 2013-04-07 00:32:11,174 DEBUG [agent.transport.Request] > (DirectAgent-161:null) Seq 5-614334468: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, [{"Answer":{"result":true,"wait":0}}] } > 2013-04-07 00:32:13,261 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistDiskOfferings&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13b= MgnRRfl8GoVA%3D&_=3D1365316333259 > 2013-04-07 00:32:13,272 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistDiskOfferings&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13b= MgnRRfl8GoVA%3D&_=3D1365316333259 > 2013-04-07 00:32:14,028 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistNetworks&trafficType=3DGuest&zoneId=3D3a62dec3-cf95-4ba2-9= af0-af2190af35e3&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3= D&_=3D1365316334026 > 2013-04-07 00:32:14,053 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistNetworks&trafficType=3DGuest&zoneId=3D3a62dec3-cf95-4ba2-9= af0-af2190af35e3&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3= D&_=3D1365316334026 > 2013-04-07 00:32:14,056 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistSecurityGroups&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13= bMgnRRfl8GoVA%3D&domainid=3De4ec5ddc-9e1c-11e2-a770-6e70e42a2333&account=3D= admin&_=3D1365316334054 > 2013-04-07 00:32:14,062 DEBUG [cloud.user.AccountManagerImpl] > (1161145101@qtp-1008805148-33:null) Access granted to Acct[2-admin] to > Domain:1/ by DomainChecker > 2013-04-07 00:32:14,068 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistSecurityGroups&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13= bMgnRRfl8GoVA%3D&domainid=3De4ec5ddc-9e1c-11e2-a770-6e70e42a2333&account=3D= admin&_=3D1365316334054 > 2013-04-07 00:32:15,282 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DdeployVirtualMachine&zoneId=3D3a62dec3-cf95-4ba2-9af0-af2190af= 35e3&templateId=3De4a7df4a-9e1c-11e2-a770-6e70e42a2333&hypervisor=3DXenServ= er&serviceOfferingId=3D425cf3cf-4bc4-4e53-82a0-ba6c20dd3688&response=3Djson= &sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316335280 > 2013-04-07 00:32:15,290 DEBUG [cloud.api.ApiDispatcher] > (1161145101@qtp-1008805148-33:null) InfrastructureEntity name > is:com.cloud.offering.ServiceOffering > 2013-04-07 00:32:15,292 DEBUG [cloud.api.ApiDispatcher] > (1161145101@qtp-1008805148-33:null) ControlledEntity name > is:com.cloud.template.VirtualMachineTemplate > 2013-04-07 00:32:15,316 DEBUG [cloud.vm.UserVmManagerImpl] > (1161145101@qtp-1008805148-33:null) Allocating in the DB for vm > 2013-04-07 00:32:15,327 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (1161145101@qtp-1008805148-33:null) Allocating entries for VM: > VM[User|94ddc16f-04fc-4da1-8326-01d8d5cdeb44] > 2013-04-07 00:32:15,327 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (1161145101@qtp-1008805148-33:null) Allocating nics for > VM[User|94ddc16f-04fc-4da1-8326-01d8d5cdeb44] > 2013-04-07 00:32:15,328 DEBUG [cloud.network.NetworkManagerImpl] > (1161145101@qtp-1008805148-33:null) Allocating nic for vm > VM[User|94ddc16f-04fc-4da1-8326-01d8d5cdeb44] in network Ntwk[204|Guest|6= ] > with requested profile NicProfile[0-0-null-null-null > 2013-04-07 00:32:15,335 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (1161145101@qtp-1008805148-33:null) Allocaing disks for > VM[User|94ddc16f-04fc-4da1-8326-01d8d5cdeb44] > 2013-04-07 00:32:15,342 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (1161145101@qtp-1008805148-33:null) Allocation completed for VM: > VM[User|94ddc16f-04fc-4da1-8326-01d8d5cdeb44] > 2013-04-07 00:32:15,342 DEBUG [cloud.vm.UserVmManagerImpl] > (1161145101@qtp-1008805148-33:null) Successfully allocated DB entry for > VM[User|94ddc16f-04fc-4da1-8326-01d8d5cdeb44] > 2013-04-07 00:32:15,374 DEBUG [cloud.async.AsyncJobManagerImpl] > (1161145101@qtp-1008805148-33:null) submit async job-43, details: > AsyncJobVO {id:43, userId: 2, accountId: 2, sessionKey: null, instanceTyp= e: > null, instanceId: 13, cmd: > org.apache.cloudstack.api.command.user.vm.DeployVMCmd, cmdOriginator: nul= l, > cmdInfo: > {"id":"13","templateId":"e4a7df4a-9e1c-11e2-a770-6e70e42a2333","response"= :"json","sessionkey":"Z6QqzU0Fq1iT13bMgnRRfl8GoVA\u003d","ctxUserId":"2","h= ypervisor":"XenServer","serviceOfferingId":"425cf3cf-4bc4-4e53-82a0-ba6c20d= d3688","_":"1365316335280","ctxAccountId":"2","ctxStartEventId":"48","zoneI= d":"3a62dec3-cf95-4ba2-9af0-af2190af35e3"}, > cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, > processStatus: 0, resultCode: 0, result: null, initMsid: 1, completeMsid: > null, lastUpdated: null, lastPolled: null, created: null} > 2013-04-07 00:32:15,375 DEBUG [cloud.async.AsyncJobManagerImpl] > (Job-Executor-36:job-43) Executing > org.apache.cloudstack.api.command.user.vm.DeployVMCmd for job-43 > 2013-04-07 00:32:15,376 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DdeployVirtualMachine&zoneId=3D3a62dec3-cf95-4ba2-9af0-af2190af= 35e3&templateId=3De4a7df4a-9e1c-11e2-a770-6e70e42a2333&hypervisor=3DXenServ= er&serviceOfferingId=3D425cf3cf-4bc4-4e53-82a0-ba6c20dd3688&response=3Djson= &sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316335280 > 2013-04-07 00:32:15,380 DEBUG [cloud.api.ApiDispatcher] > (Job-Executor-36:job-43) InfrastructureEntity name > is:com.cloud.offering.ServiceOffering > 2013-04-07 00:32:15,383 DEBUG [cloud.api.ApiDispatcher] > (Job-Executor-36:job-43) ControlledEntity name > is:com.cloud.template.VirtualMachineTemplate > 2013-04-07 00:32:15,425 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) DeploymentPlanner allocation algorithm: random > 2013-04-07 00:32:15,425 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Trying to allocate a host and storage pools from > dc:1, pod:null,cluster:null, requested cpu: 100, requested ram: 107374182= 4 > 2013-04-07 00:32:15,425 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Is ROOT volume READY (pool already allocated)?: = No > 2013-04-07 00:32:15,425 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Searching all possible resources under this Zone= : 1 > 2013-04-07 00:32:15,427 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Listing clusters in order of aggregate capacity, > that have (atleast one host with) enough CPU and RAM capacity under this > Zone: 1 > 2013-04-07 00:32:15,428 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) CPUOverprovisioningFactor considered: 1.0 > 2013-04-07 00:32:15,442 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Cannot allocate cluster list [1] for vm creation > since their allocated percentage crosses the disable capacity threshold: > 0.85 for capacity Type : 0, skipping these clusters > 2013-04-07 00:32:15,444 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Checking resources in Cluster: 2 under Pod: 1 > 2013-04-07 00:32:15,444 DEBUG [allocator.impl.RandomAllocator] > (Job-Executor-36:job-43) Looking for hosts in dc: 1 pod:1 cluster:2 > 2013-04-07 00:32:15,447 DEBUG [allocator.impl.RandomAllocator] > (Job-Executor-36:job-43) Random Allocator found 2 hosts > 2013-04-07 00:32:15,447 DEBUG [allocator.impl.RandomAllocator] > (Job-Executor-36:job-43) Random Host Allocator returning 2 suitable hosts > 2013-04-07 00:32:15,448 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Checking suitable pools for volume (Id, Type): > (13,ROOT) > 2013-04-07 00:32:15,448 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) We need to allocate new storagepool for this vol= ume > 2013-04-07 00:32:15,451 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Calling StoragePoolAllocators to find suitable > pools > 2013-04-07 00:32:15,455 DEBUG > [storage.allocator.RandomStoragePoolAllocator] (Job-Executor-36:job-43) > Looking for pools in dc: 1 pod:1 cluster:2 > 2013-04-07 00:32:15,457 DEBUG > [storage.allocator.RandomStoragePoolAllocator] (Job-Executor-36:job-43) > RandomStoragePoolAllocator has 5 pools to check for allocation > 2013-04-07 00:32:15,458 DEBUG > [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-36:job-43) > Checking if storage pool is suitable, name: Tut-XenServer2 Local Storage > ,poolId: 201 > 2013-04-07 00:32:15,458 DEBUG > [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-36:job-43) > Is localStorageAllocationNeeded? false > 2013-04-07 00:32:15,458 DEBUG > [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-36:job-43) > Is storage pool shared? false > 2013-04-07 00:32:15,458 DEBUG > [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-36:job-43) > StoragePool is not of correct type, skipping this pool > 2013-04-07 00:32:15,458 DEBUG > [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-36:job-43) > Checking if storage pool is suitable, name: iSCSI_SR_3 ,poolId: 257 > 2013-04-07 00:32:15,458 DEBUG > [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-36:job-43) > Is localStorageAllocationNeeded? false > 2013-04-07 00:32:15,458 DEBUG > [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-36:job-43) > Is storage pool shared? true > 2013-04-07 00:32:15,467 DEBUG [cloud.storage.StorageManagerImpl] > (Job-Executor-36:job-43) Checking pool: 257 for volume allocation > [Vol[13|vm=3D13|ROOT]], maxSize : 2084569088, totalAllocatedSize : 106954= 752, > askingSize : 52428800, allocated disable threshold: 0.85 > 2013-04-07 00:32:15,467 DEBUG > [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-36:job-43) > Checking if storage pool is suitable, name: iSCSI_SR_4 ,poolId: 262 > 2013-04-07 00:32:15,467 DEBUG > [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-36:job-43) > Is localStorageAllocationNeeded? false > 2013-04-07 00:32:15,467 DEBUG > [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-36:job-43) > Is storage pool shared? true > 2013-04-07 00:32:15,479 DEBUG [cloud.storage.StorageManagerImpl] > (Job-Executor-36:job-43) Checking pool: 262 for volume allocation > [Vol[13|vm=3D13|ROOT]], maxSize : 2084569088, totalAllocatedSize : 545259= 52, > askingSize : 52428800, allocated disable threshold: 0.85 > 2013-04-07 00:32:15,479 DEBUG > [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-36:job-43) > Checking if storage pool is suitable, name: Tut-XenServer Local Storage > ,poolId: 202 > 2013-04-07 00:32:15,479 DEBUG > [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-36:job-43) > Is localStorageAllocationNeeded? false > 2013-04-07 00:32:15,479 DEBUG > [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-36:job-43) > Is storage pool shared? false > 2013-04-07 00:32:15,479 DEBUG > [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-36:job-43) > StoragePool is not of correct type, skipping this pool > 2013-04-07 00:32:15,479 DEBUG > [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-36:job-43) > Checking if storage pool is suitable, name: iSCSI_SR_2 ,poolId: 256 > 2013-04-07 00:32:15,479 DEBUG > [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-36:job-43) > Is localStorageAllocationNeeded? false > 2013-04-07 00:32:15,479 DEBUG > [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-36:job-43) > Is storage pool shared? true > 2013-04-07 00:32:15,489 DEBUG [cloud.storage.StorageManagerImpl] > (Job-Executor-36:job-43) Checking pool: 256 for volume allocation > [Vol[13|vm=3D13|ROOT]], maxSize : 2084569088, totalAllocatedSize : 545259= 52, > askingSize : 52428800, allocated disable threshold: 0.85 > 2013-04-07 00:32:15,489 DEBUG > [storage.allocator.RandomStoragePoolAllocator] (Job-Executor-36:job-43) > RandomStoragePoolAllocator returning 3 suitable storage pools > 2013-04-07 00:32:15,489 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Trying to find a potenial host and associated > storage pools from the suitable host/pool lists for this VM > 2013-04-07 00:32:15,489 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Checking if host: 6 can access any suitable > storage pool for volume: ROOT > 2013-04-07 00:32:15,492 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Host: 6 can access pool: 257 > 2013-04-07 00:32:15,492 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Found a potential host id: 6 name: Tut-XenServer > and associated storage pools for this VM > 2013-04-07 00:32:15,494 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Returning Deployment Destination: > Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(= Id))] > : > Dest[Zone(1)-Pod(1)-Cluster(2)-Host(6)-Storage(Volume(13|ROOT-->Pool(257)= )] > 2013-04-07 00:32:15,514 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-36:job-43) VM state transitted from :Stopped to Starting wi= th > event: StartRequestedvm's original host id: null new host id: null host i= d > before state transition: null > 2013-04-07 00:32:15,514 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (Job-Executor-36:job-43) Successfully transitioned to start state for > VM[User|94ddc16f-04fc-4da1-8326-01d8d5cdeb44] reservation id =3D > a8349669-6ff2-443f-88d3-c5d69100df3a > 2013-04-07 00:32:15,518 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (Job-Executor-36:job-43) Trying to deploy VM, vm has dcId: 1 and podId: n= ull > 2013-04-07 00:32:15,518 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (Job-Executor-36:job-43) advanceStart: DeploymentPlan is provided, using > dcId:1, podId: 1, clusterId: 2, hostId: 6, poolId: 257 > 2013-04-07 00:32:15,518 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (Job-Executor-36:job-43) Deploy avoids pods: null, clusters: null, hosts: > null > 2013-04-07 00:32:15,521 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) DeploymentPlanner allocation algorithm: random > 2013-04-07 00:32:15,521 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Trying to allocate a host and storage pools from > dc:1, pod:1,cluster:2, requested cpu: 100, requested ram: 1073741824 > 2013-04-07 00:32:15,522 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Is ROOT volume READY (pool already allocated)?: = Yes > 2013-04-07 00:32:15,522 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) DeploymentPlan has host_id specified, making no > checks on this host, looks like admin test: 6 > 2013-04-07 00:32:15,523 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Looking for suitable pools for this host under > zone: 1, pod: 1, cluster: 2 > 2013-04-07 00:32:15,525 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Checking suitable pools for volume (Id, Type): > (13,ROOT) > 2013-04-07 00:32:15,525 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Volume has pool already allocated, checking if > pool can be reused, poolId: null > 2013-04-07 00:32:15,527 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Planner need not allocate a pool for this volume > since its READY > 2013-04-07 00:32:15,527 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Trying to find a potenial host and associated > storage pools from the suitable host/pool lists for this VM > 2013-04-07 00:32:15,527 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Checking if host: 6 can access any suitable > storage pool for volume: ROOT > 2013-04-07 00:32:15,529 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Host: 6 can access pool: 257 > 2013-04-07 00:32:15,529 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Found a potential host id: 6 name: Tut-XenServer > and associated storage pools for this VM > 2013-04-07 00:32:15,530 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-36:job-43) Returning Deployment Destination: > Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(= Id))] > : > Dest[Zone(1)-Pod(1)-Cluster(2)-Host(6)-Storage(Volume(13|ROOT-->Pool(257)= )] > 2013-04-07 00:32:15,530 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (Job-Executor-36:job-43) Deployment found - > P0=3DVM[User|94ddc16f-04fc-4da1-8326-01d8d5cdeb44], > P0=3DDest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->= Pool(Id))] > : > Dest[Zone(1)-Pod(1)-Cluster(2)-Host(6)-Storage(Volume(13|ROOT-->Pool(257)= )] > 2013-04-07 00:32:15,535 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-36:job-43) VM state transitted from :Starting to Starting > with event: OperationRetryvm's original host id: null new host id: 6 host > id before state transition: null > 2013-04-07 00:32:15,551 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-36:job-43) Hosts's actual total CPU: 2382 and CPU after > applying overprovisioning: 2382 > 2013-04-07 00:32:15,551 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-36:job-43) We are allocating VM, increasing the used capaci= ty > of this host:6 > 2013-04-07 00:32:15,552 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-36:job-43) Current Used CPU: 100 , Free CPU:2282 ,Requested > CPU: 100 > 2013-04-07 00:32:15,552 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-36:job-43) Current Used RAM: 104857600 , Free RAM:156683782= 4 > ,Requested RAM: 1073741824 > 2013-04-07 00:32:15,552 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-36:job-43) CPU STATS after allocation: for host: 6, old use= d: > 100, old reserved: 0, actual total: 2382, total with overprovisioning: > 2382; new used:200, reserved:0; requested cpu:100,alloc_from_last:false > 2013-04-07 00:32:15,552 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-36:job-43) RAM STATS after allocation: for host: 6, old use= d: > 104857600, old reserved: 0, total: 1671695424; new used: 1178599424, > reserved: 0; requested mem: 1073741824,alloc_from_last:false > 2013-04-07 00:32:15,555 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (Job-Executor-36:job-43) VM is being created in podId: 1 > 2013-04-07 00:32:15,559 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-36:job-43) Lock is acquired for network id 204 as a part of > network implement > 2013-04-07 00:32:15,559 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-36:job-43) Network id=3D204 is already implemented > 2013-04-07 00:32:15,560 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-36:job-43) Lock is released for network id 204 as a part of > network implement > 2013-04-07 00:32:15,592 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-36:job-43) Changing active number of nics for network id=3D= 204 > on 1 > 2013-04-07 00:32:15,594 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-36:job-43) Asking ElasticLoadBalancerElement to prepare for > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:32:15,600 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-36:job-43) Asking NiciraNvpElement to prepare for > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:32:15,600 DEBUG [network.element.NiciraNvpElement] > (Job-Executor-36:job-43) Checking if NiciraNvpElement can handle service > Connectivity on network guestNetworkForBasicZone > 2013-04-07 00:32:15,606 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-36:job-43) Asking BigSwitchVnsElement to prepare for > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:32:15,606 DEBUG [network.element.BigSwitchVnsElement] > (Job-Executor-36:job-43) Checking if BigSwitchVnsElement can handle servi= ce > Connectivity on network guestNetworkForBasicZone > 2013-04-07 00:32:15,612 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-36:job-43) Asking Ovs to prepare for > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:32:15,612 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-36:job-43) Asking BareMetalDhcp to prepare for > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:32:15,617 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-36:job-43) Asking BareMetalPxe to prepare for > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:32:15,623 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-36:job-43) Asking BareMetalUserdata to prepare for > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:32:15,629 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-36:job-43) Asking SecurityGroupProvider to prepare for > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:32:15,637 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-36:job-43) Asking VirtualRouter to prepare for > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:32:15,653 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (Job-Executor-36:job-43) Lock is acquired for network id 204 as a part of > router startup in > Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(= Id))] > : > Dest[Zone(1)-Pod(1)-Cluster(2)-Host(6)-Storage(Volume(13|ROOT-->Pool(257)= )] > 2013-04-07 00:32:15,657 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (Job-Executor-36:job-43) Skipping VR deployment: Found a running or > starting VR in Pod null id=3D1 > 2013-04-07 00:32:15,658 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (Job-Executor-36:job-43) Lock is released for network id 204 as a part of > router startup in > Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(= Id))] > : > Dest[Zone(1)-Pod(1)-Cluster(2)-Host(6)-Storage(Volume(13|ROOT-->Pool(257)= )] > 2013-04-07 00:32:15,674 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (Job-Executor-36:job-43) Applying dhcp entry in network Ntwk[204|Guest|6] > 2013-04-07 00:32:15,706 DEBUG [agent.transport.Request] > (Job-Executor-36:job-43) Seq 6-324993305: Sending { Cmd , MgmtId: 1, via= : > 6, Ver: v1, Flags: 100111, > [{"routing.DhcpEntryCommand":{"vmMac":"06:06:fe:00:00:44","vmIpAddress":"= 192.168.56.146","vmName":"94ddc16f-04fc-4da1-8326-01d8d5cdeb44","defaultRou= ter":"192.168.56.1","defaultDns":"192.168.56.102","duid":"00:03:00:01:06:06= :fe:00:00:44","accessDetails":{"router.guest.ip":"192.168.56.102","zone.net= work.type":"Basic"," > router.name":"r-4-VM","router.ip":"169.254.1.168"},"wait":0}}] } > 2013-04-07 00:32:15,706 DEBUG [agent.transport.Request] > (Job-Executor-36:job-43) Seq 6-324993305: Executing: { Cmd , MgmtId: 1, > via: 6, Ver: v1, Flags: 100111, > [{"routing.DhcpEntryCommand":{"vmMac":"06:06:fe:00:00:44","vmIpAddress":"= 192.168.56.146","vmName":"94ddc16f-04fc-4da1-8326-01d8d5cdeb44","defaultRou= ter":"192.168.56.1","defaultDns":"192.168.56.102","duid":"00:03:00:01:06:06= :fe:00:00:44","accessDetails":{"router.guest.ip":"192.168.56.102","zone.net= work.type":"Basic"," > router.name":"r-4-VM","router.ip":"169.254.1.168"},"wait":0}}] } > 2013-04-07 00:32:15,706 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-89:null) Seq 6-324993305: Executing request > 2013-04-07 00:32:18,273 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-89:null) Seq 6-324993305: Response Received: > 2013-04-07 00:32:18,273 DEBUG [agent.transport.Request] > (DirectAgent-89:null) Seq 6-324993305: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 110, [{"Answer":{"result":true,"wait":0}}] } > 2013-04-07 00:32:18,273 DEBUG [agent.manager.AgentAttache] > (DirectAgent-89:null) Seq 6-324993305: No more commands found > 2013-04-07 00:32:18,273 DEBUG [agent.transport.Request] > (Job-Executor-36:job-43) Seq 6-324993305: Received: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 110, { Answer } } > 2013-04-07 00:32:18,286 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (Job-Executor-36:job-43) Applying userdata and password entry in network > Ntwk[204|Guest|6] > 2013-04-07 00:32:18,303 DEBUG [agent.transport.Request] > (Job-Executor-36:job-43) Seq 6-324993306: Sending { Cmd , MgmtId: 1, via= : > 6, Ver: v1, Flags: 100111, > [{"routing.SavePasswordCommand":{"password":"fnirq_cnffjbeq","vmIpAddress= ":"192.168.56.146","vmName":"94ddc16f-04fc-4da1-8326-01d8d5cdeb44","accessD= etails":{"router.guest.ip":"192.168.56.102","zone.network.type":"Basic","ro= uter.ip":"169.254.1.168"," > router.name > ":"r-4-VM"},"wait":0}},{"routing.VmDataCommand":{"vmIpAddress":"192.168.5= 6.146","vmName":"94ddc16f-04fc-4da1-8326-01d8d5cdeb44","accessDetails":{"ro= uter.guest.ip":"192.168.56.102","zone.network.type":"Basic","router.ip":"16= 9.254.1.168"," > router.name":"r-4-VM"},"wait":0}}] } > 2013-04-07 00:32:18,304 DEBUG [agent.transport.Request] > (Job-Executor-36:job-43) Seq 6-324993306: Executing: { Cmd , MgmtId: 1, > via: 6, Ver: v1, Flags: 100111, > [{"routing.SavePasswordCommand":{"password":"fnirq_cnffjbeq","vmIpAddress= ":"192.168.56.146","vmName":"94ddc16f-04fc-4da1-8326-01d8d5cdeb44","accessD= etails":{"router.guest.ip":"192.168.56.102","zone.network.type":"Basic","ro= uter.ip":"169.254.1.168"," > router.name > ":"r-4-VM"},"wait":0}},{"routing.VmDataCommand":{"vmIpAddress":"192.168.5= 6.146","vmName":"94ddc16f-04fc-4da1-8326-01d8d5cdeb44","accessDetails":{"ro= uter.guest.ip":"192.168.56.102","zone.network.type":"Basic","router.ip":"16= 9.254.1.168"," > router.name":"r-4-VM"},"wait":0}}] } > 2013-04-07 00:32:18,304 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-20:null) Seq 6-324993306: Executing request > 2013-04-07 00:32:18,391 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3D00aeb7f7-459c-477e-a0a1-5d9262bc58= 3a&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 38388 > 2013-04-07 00:32:18,412 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3D00aeb7f7-459c-477e-a0a1-5d9262bc58= 3a&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 38388 > 2013-04-07 00:32:20,452 DEBUG > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone = 1 > is ready to launch secondary storage VM > 2013-04-07 00:32:20,554 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl= ] > (consoleproxy-1:null) Zone 1 is ready to launch console proxy > 2013-04-07 00:32:20,819 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:32:20,821 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:32:20,851 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:32:20,852 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:32:21,391 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3D00aeb7f7-459c-477e-a0a1-5d9262bc58= 3a&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 41388 > 2013-04-07 00:32:21,408 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3D00aeb7f7-459c-477e-a0a1-5d9262bc58= 3a&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 41388 > 2013-04-07 00:32:24,392 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3D00aeb7f7-459c-477e-a0a1-5d9262bc58= 3a&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 44390 > 2013-04-07 00:32:24,407 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3D00aeb7f7-459c-477e-a0a1-5d9262bc58= 3a&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 44390 > 2013-04-07 00:32:24,892 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-11:null) Ping from 4 > 2013-04-07 00:32:27,183 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-273:null) Ping from 1 > 2013-04-07 00:32:27,392 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3D00aeb7f7-459c-477e-a0a1-5d9262bc58= 3a&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 47390 > 2013-04-07 00:32:27,407 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3D00aeb7f7-459c-477e-a0a1-5d9262bc58= 3a&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 47390 > 2013-04-07 00:32:29,095 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-131:null) Seq 1-90046472: Executing request > 2013-04-07 00:32:29,345 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-131:null) Seq 1-90046472: Response Received: > 2013-04-07 00:32:29,345 DEBUG [agent.transport.Request] > (DirectAgent-131:null) Seq 1-90046472: Processing: { Ans: , MgmtId: 1, > via: 1, Ver: v1, Flags: 10, > [{"ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false= ,"result":true,"wait":0}}] > } > 2013-04-07 00:32:30,393 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3D00aeb7f7-459c-477e-a0a1-5d9262bc58= 3a&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 50391 > 2013-04-07 00:32:30,408 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3D00aeb7f7-459c-477e-a0a1-5d9262bc58= 3a&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 50391 > 2013-04-07 00:32:32,146 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-20:null) Seq 6-324993306: Response Received: > 2013-04-07 00:32:32,146 DEBUG [agent.transport.Request] > (DirectAgent-20:null) Seq 6-324993306: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 110, > [{"Answer":{"result":true,"wait":0}},{"Answer":{"result":true,"wait":0}}]= } > 2013-04-07 00:32:32,146 DEBUG [agent.manager.AgentAttache] > (DirectAgent-20:null) Seq 6-324993306: No more commands found > 2013-04-07 00:32:32,146 DEBUG [agent.transport.Request] > (Job-Executor-36:job-43) Seq 6-324993306: Received: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 110, { Answer, Answer } } > 2013-04-07 00:32:32,146 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-36:job-43) Asking VpcVirtualRouter to prepare for > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:32:32,146 WARN [network.element.VpcVirtualRouterElement] > (Job-Executor-36:job-43) Network Ntwk[204|Guest|6] is not associated with > any VPC > 2013-04-07 00:32:32,151 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-36:job-43) Asking NiciraNvp to prepare for > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:32:32,151 DEBUG [network.element.NiciraNvpElement] > (Job-Executor-36:job-43) Checking if NiciraNvpElement can handle service > Connectivity on network guestNetworkForBasicZone > 2013-04-07 00:32:32,154 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-36:job-43) Asking JuniperSRX to prepare for > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:32:32,157 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-36:job-43) Asking Netscaler to prepare for > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:32:32,160 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-36:job-43) Asking F5BigIP to prepare for > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:32:32,164 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-36:job-43) Asking CiscoNexus1000vVSM to prepare for > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:32:32,168 DEBUG [cloud.storage.StorageManagerImpl] > (Job-Executor-36:job-43) Checking if we need to prepare 1 volumes for > VM[User|94ddc16f-04fc-4da1-8326-01d8d5cdeb44] > 2013-04-07 00:32:32,169 DEBUG [cloud.storage.StorageManagerImpl] > (Job-Executor-36:job-43) Creating volume: Vol[13|vm=3D13|ROOT] > 2013-04-07 00:32:32,170 DEBUG [cloud.storage.StorageManagerImpl] > (Job-Executor-36:job-43) Trying to create in Pool[257|PreSetup] > 2013-04-07 00:32:32,175 DEBUG [cloud.template.TemplateManagerImpl] > (Job-Executor-36:job-43) Template 5 has already been downloaded to pool 2= 57 > 2013-04-07 00:32:32,179 DEBUG [agent.transport.Request] > (Job-Executor-36:job-43) Seq 6-324993307: Sending { Cmd , MgmtId: 1, via= : > 6, Ver: v1, Flags: 100111, > [{"storage.CreateCommand":{"volId":13,"pool":{"id":257,"uuid":"iSCSI_SR_3= ","host":"192.168.56.9","path":"/iSCSI_SR_3","port":0,"type":"PreSetup"},"d= iskCharacteristics":{"size":52428800,"tags":["iSCSI_SR_4"],"type":"ROOT","n= ame":"ROOT-13","useLocalStorage":false,"recreatable":true,"diskOfferingId":= 38,"volumeId":13,"hyperType":"XenServer"},"templateUrl":"a8414926-81d6-4b54= -9b4b-feb498489df0","wait":0}}] > } > 2013-04-07 00:32:32,180 DEBUG [agent.transport.Request] > (Job-Executor-36:job-43) Seq 6-324993307: Executing: { Cmd , MgmtId: 1, > via: 6, Ver: v1, Flags: 100111, > [{"storage.CreateCommand":{"volId":13,"pool":{"id":257,"uuid":"iSCSI_SR_3= ","host":"192.168.56.9","path":"/iSCSI_SR_3","port":0,"type":"PreSetup"},"d= iskCharacteristics":{"size":52428800,"tags":["iSCSI_SR_4"],"type":"ROOT","n= ame":"ROOT-13","useLocalStorage":false,"recreatable":true,"diskOfferingId":= 38,"volumeId":13,"hyperType":"XenServer"},"templateUrl":"a8414926-81d6-4b54= -9b4b-feb498489df0","wait":0}}] > } > 2013-04-07 00:32:32,180 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-59:null) Seq 6-324993307: Executing request > 2013-04-07 00:32:32,265 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-59:null) SR retrieved for iSCSI_SR_3 > 2013-04-07 00:32:32,276 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-59:null) Checking iSCSI_SR_3 or SR > fe8ca696-22f5-ba1f-af68-7c3cf5a3cb39 on > XS[f7a017da-3064-456a-89cd-28ee9e2d36b3-192.168.56.9] > 2013-04-07 00:32:33,395 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3D00aeb7f7-459c-477e-a0a1-5d9262bc58= 3a&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 53392 > 2013-04-07 00:32:33,419 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3D00aeb7f7-459c-477e-a0a1-5d9262bc58= 3a&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 53392 > 2013-04-07 00:32:34,687 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-59:null) Succesfully created VDI for > com.cloud.agent.api.storage.CreateCommand. Uuid =3D > 99154d9c-2665-465d-8c71-e60f1748895b > 2013-04-07 00:32:34,687 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-59:null) Seq 6-324993307: Response Received: > 2013-04-07 00:32:34,688 DEBUG [agent.transport.Request] > (DirectAgent-59:null) Seq 6-324993307: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 110, > [{"storage.CreateAnswer":{"volume":{"id":13,"name":"ROOT-13","mountPoint"= :"/iSCSI_SR_3","path":"99154d9c-2665-465d-8c71-e60f1748895b","size":5242880= 0,"type":"ROOT","storagePoolType":"PreSetup","storagePoolUuid":"iSCSI_SR_3"= ,"deviceId":0},"requestTemplateReload":false,"result":true,"wait":0}}] > } > 2013-04-07 00:32:34,688 DEBUG [agent.transport.Request] > (Job-Executor-36:job-43) Seq 6-324993307: Received: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 110, { CreateAnswer } } > 2013-04-07 00:32:34,688 DEBUG [agent.manager.AgentAttache] > (DirectAgent-59:null) Seq 6-324993307: No more commands found > 2013-04-07 00:32:34,690 DEBUG [cloud.storage.StorageManagerImpl] > (Job-Executor-36:job-43) Volume Vol[13|vm=3D13|ROOT] is created on > Pool[257|PreSetup] > 2013-04-07 00:32:34,701 DEBUG [agent.transport.Request] > (Job-Executor-36:job-43) Seq 6-324993308: Sending { Cmd , MgmtId: 1, via= : > 6, Ver: v1, Flags: 100111, > [{"StartCommand":{"vm":{"id":13,"name":"i-2-13-VM","bootloader":"PyGrub",= "type":"User","cpus":1,"speed":100,"minRam":1073741824,"maxRam":1073741824,= "arch":"x86_64","os":"CentOS > 5.3 > (64-bit)","bootArgs":"","rebootOnCrash":false,"enableHA":false,"limitCpuU= se":false,"vncPassword":"2e91fc6d6f16609d","params":{},"uuid":"94ddc16f-04f= c-4da1-8326-01d8d5cdeb44","disks":[{"id":13,"name":"ROOT-13","mountPoint":"= /iSCSI_SR_3","path":"99154d9c-2665-465d-8c71-e60f1748895b","size":52428800,= "type":"ROOT","storagePoolType":"PreSetup","storagePoolUuid":"iSCSI_SR_3","= deviceId":0},{"id":13,"name":"tiny > Linux","size":0,"type":"ISO","storagePoolType":"ISO","deviceId":3}],"nics= ":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"uuid":"59b9a8aa-c= 867-40b8-95bb-6e40273569c9","ip":"192.168.56.146","netmask":"255.255.255.0"= ,"gateway":"192.168.56.1","mac":"06:06:fe:00:00:44","dns1":"8.8.8.8","dns2"= :"4.4.4.4","broadcastType":"Native","type":"Guest","broadcastUri":"vlan://u= ntagged","isolationUri":"ec2://untagged","isSecurityGroupEnabled":true}]},"= hostIp":"192.168.56.9","wait":0}}] > } > 2013-04-07 00:32:34,702 DEBUG [agent.transport.Request] > (Job-Executor-36:job-43) Seq 6-324993308: Executing: { Cmd , MgmtId: 1, > via: 6, Ver: v1, Flags: 100111, > [{"StartCommand":{"vm":{"id":13,"name":"i-2-13-VM","bootloader":"PyGrub",= "type":"User","cpus":1,"speed":100,"minRam":1073741824,"maxRam":1073741824,= "arch":"x86_64","os":"CentOS > 5.3 > (64-bit)","bootArgs":"","rebootOnCrash":false,"enableHA":false,"limitCpuU= se":false,"vncPassword":"2e91fc6d6f16609d","params":{},"uuid":"94ddc16f-04f= c-4da1-8326-01d8d5cdeb44","disks":[{"id":13,"name":"ROOT-13","mountPoint":"= /iSCSI_SR_3","path":"99154d9c-2665-465d-8c71-e60f1748895b","size":52428800,= "type":"ROOT","storagePoolType":"PreSetup","storagePoolUuid":"iSCSI_SR_3","= deviceId":0},{"id":13,"name":"tiny > Linux","size":0,"type":"ISO","storagePoolType":"ISO","deviceId":3}],"nics= ":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"uuid":"59b9a8aa-c= 867-40b8-95bb-6e40273569c9","ip":"192.168.56.146","netmask":"255.255.255.0"= ,"gateway":"192.168.56.1","mac":"06:06:fe:00:00:44","dns1":"8.8.8.8","dns2"= :"4.4.4.4","broadcastType":"Native","type":"Guest","broadcastUri":"vlan://u= ntagged","isolationUri":"ec2://untagged","isSecurityGroupEnabled":true}]},"= hostIp":"192.168.56.9","wait":0}}] > } > 2013-04-07 00:32:34,702 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-334:null) Seq 6-324993308: Executing request > 2013-04-07 00:32:34,787 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-334:null) 1. The VM i-2-13-VM is in Starting state. > 2013-04-07 00:32:34,862 DEBUG [xen.resource.XenServer56FP1Resource] > (DirectAgent-334:null) Created VM f21a0243-f342-fd59-98d8-00ed89224305 fo= r > i-2-13-VM > 2013-04-07 00:32:34,912 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-334:null) VBD 6e16b739-13fb-1891-fc66-f786b8db522b created f= or > Vol[13|ROOT|99154d9c-2665-465d-8c71-e60f1748895b|52428800] > 2013-04-07 00:32:34,937 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-334:null) VBD f9ad291b-2a8d-4c81-94a5-ef8b8b38be8c created f= or > Vol[13|ISO|null|0] > 2013-04-07 00:32:34,937 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-334:null) Creating VIF for i-2-13-VM on nic > [Nic:Guest-192.168.56.146-vlan://untagged] > 2013-04-07 00:32:34,991 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-334:null) Created a vif bec5565a-8c80-48a1-3ea4-88971784ce3b > on 0 > 2013-04-07 00:32:36,396 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3D00aeb7f7-459c-477e-a0a1-5d9262bc58= 3a&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 56393 > 2013-04-07 00:32:36,418 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3D00aeb7f7-459c-477e-a0a1-5d9262bc58= 3a&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 56393 > 2013-04-07 00:32:39,395 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3D00aeb7f7-459c-477e-a0a1-5d9262bc58= 3a&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 59393 > 2013-04-07 00:32:39,410 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3D00aeb7f7-459c-477e-a0a1-5d9262bc58= 3a&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 59393 > 2013-04-07 00:32:41,550 INFO [xen.resource.CitrixResourceBase] > (DirectAgent-334:null) Programmed default network rules for i-2-13-VM on > nic with ip:192.168.56.146 mac:06:06:fe:00:00:44 > 2013-04-07 00:32:41,550 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-334:null) 2. The VM i-2-13-VM is in Running state. > 2013-04-07 00:32:41,550 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-334:null) Seq 6-324993308: Response Received: > 2013-04-07 00:32:41,551 DEBUG [agent.transport.Request] > (DirectAgent-334:null) Seq 6-324993308: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 110, > [{"StartAnswer":{"vm":{"id":13,"name":"i-2-13-VM","bootloader":"PyGrub","= type":"User","cpus":1,"speed":100,"minRam":1073741824,"maxRam":1073741824,"= arch":"x86_64","os":"CentOS > 5.3 > (64-bit)","bootArgs":"","rebootOnCrash":false,"enableHA":false,"limitCpuU= se":false,"vncPassword":"2e91fc6d6f16609d","params":{},"uuid":"94ddc16f-04f= c-4da1-8326-01d8d5cdeb44","disks":[{"id":13,"name":"ROOT-13","mountPoint":"= /iSCSI_SR_3","path":"99154d9c-2665-465d-8c71-e60f1748895b","size":52428800,= "type":"ROOT","storagePoolType":"PreSetup","storagePoolUuid":"iSCSI_SR_3","= deviceId":0},{"id":13,"name":"tiny > Linux","size":0,"type":"ISO","storagePoolType":"ISO","deviceId":3}],"nics= ":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"uuid":"59b9a8aa-c= 867-40b8-95bb-6e40273569c9","ip":"192.168.56.146","netmask":"255.255.255.0"= ,"gateway":"192.168.56.1","mac":"06:06:fe:00:00:44","dns1":"8.8.8.8","dns2"= :"4.4.4.4","broadcastType":"Native","type":"Guest","broadcastUri":"vlan://u= ntagged","isolationUri":"ec2://untagged","isSecurityGroupEnabled":true}]},"= result":true,"wait":0}}] > } > 2013-04-07 00:32:41,551 DEBUG [agent.transport.Request] > (Job-Executor-36:job-43) Seq 6-324993308: Received: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 110, { StartAnswer } } > 2013-04-07 00:32:41,551 DEBUG [agent.manager.AgentAttache] > (DirectAgent-334:null) Seq 6-324993308: No more commands found > 2013-04-07 00:32:41,592 DEBUG [network.security.SecurityGroupManagerImpl] > (Job-Executor-36:job-43) Security Group Mgr v2: scheduling ruleset update= s > for 1 vms (unique=3D1), current queue size=3D0 > 2013-04-07 00:32:41,593 DEBUG [network.security.SecurityGroupManagerImpl] > (Job-Executor-36:job-43) Security Group Mgr v2: done scheduling ruleset > updates for 1 vms: num new jobs=3D1 num rows insert or updated=3D1 time t= aken=3D1 > 2013-04-07 00:32:41,596 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-36:job-43) VM state transitted from :Starting to Running wi= th > event: OperationSucceededvm's original host id: 6 new host id: 6 host id > before state transition: 6 > 2013-04-07 00:32:41,596 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (Job-Executor-36:job-43) Start completed for VM > VM[User|94ddc16f-04fc-4da1-8326-01d8d5cdeb44] > 2013-04-07 00:32:41,601 DEBUG [network.security.SecurityGroupManagerImpl] > (SecGrp-Worker-4:null) SecurityGroupManager v2: sending ruleset update fo= r > vm i-2-13-VM:ingress num rules=3D0:egress num rules=3D0 num cidrs=3D0 > sig=3Dd41d8cd98f00b204e9800998ecf8427e > 2013-04-07 00:32:41,605 DEBUG [agent.transport.Request] > (SecGrp-Worker-4:null) Seq 6-324993309: Sending { Cmd , MgmtId: 1, via: = 6, > Ver: v1, Flags: 100111, > [{"SecurityGroupRulesCmd":{"guestIp":"192.168.56.146","vmName":"i-2-13-VM= ","guestMac":"06:06:fe:00:00:44","signature":"d41d8cd98f00b204e9800998ecf84= 27e","seqNum":1,"vmId":13,"msId":1,"ingressRuleSet":[],"egressRuleSet":[],"= wait":0}}] > } > 2013-04-07 00:32:41,605 DEBUG [cloud.async.AsyncJobManagerImpl] > (Job-Executor-36:job-43) Complete async job-43, jobStatus: 1, resultCode: > 0, result: org.apache.cloudstack.api.response.UserVmResponse@68779e71 > 2013-04-07 00:32:41,605 DEBUG [agent.transport.Request] > (SecGrp-Worker-4:null) Seq 6-324993309: Executing: { Cmd , MgmtId: 1, vi= a: > 6, Ver: v1, Flags: 100111, > [{"SecurityGroupRulesCmd":{"guestIp":"192.168.56.146","vmName":"i-2-13-VM= ","guestMac":"06:06:fe:00:00:44","signature":"d41d8cd98f00b204e9800998ecf84= 27e","seqNum":1,"vmId":13,"msId":1,"ingressRuleSet":[],"egressRuleSet":[],"= wait":0}}] > } > 2013-04-07 00:32:41,606 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-275:null) Seq 6-324993309: Executing request > 2013-04-07 00:32:41,611 DEBUG [cloud.async.AsyncJobManagerImpl] > (Job-Executor-36:job-43) Done executing > org.apache.cloudstack.api.command.user.vm.DeployVMCmd for job-43 > 2013-04-07 00:32:41,866 INFO [xen.resource.CitrixResourceBase] > (DirectAgent-275:null) Programmed network rules for vm i-2-13-VM > guestIp=3D192.168.56.146, ingress numrules=3D0, egress numrules=3D0 > 2013-04-07 00:32:41,866 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-275:null) Seq 6-324993309: Response Received: > 2013-04-07 00:32:41,866 DEBUG [agent.transport.Request] > (DirectAgent-275:null) Seq 6-324993309: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 110, > [{"SecurityGroupRuleAnswer":{"logSequenceNumber":1,"vmId":13,"reason":"NO= NE","result":true,"wait":0}}] > } > 2013-04-07 00:32:41,866 DEBUG [network.security.SecurityGroupListener] > (DirectAgent-275:null) Successfully programmed rule > com.cloud.agent.api.SecurityGroupRuleAnswer into host 6 > 2013-04-07 00:32:41,868 DEBUG [network.security.SecurityGroupListener] > (DirectAgent-275:null) Successfully programmed rule > com.cloud.agent.api.SecurityGroupRuleAnswer into host 6 > 2013-04-07 00:32:41,869 DEBUG [agent.manager.AgentAttache] > (DirectAgent-275:null) Seq 6-324993309: No more commands found > 2013-04-07 00:32:42,396 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3D00aeb7f7-459c-477e-a0a1-5d9262bc58= 3a&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 62394 > 2013-04-07 00:32:42,406 DEBUG [cloud.async.AsyncJobManagerImpl] > (1161145101@qtp-1008805148-33:null) Async job-43 completed > 2013-04-07 00:32:42,412 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3D00aeb7f7-459c-477e-a0a1-5d9262bc58= 3a&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653163= 62394 > 2013-04-07 00:32:45,427 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVolumes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316365425 > 2013-04-07 00:32:45,442 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVolumes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316365425 > 2013-04-07 00:32:47,667 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVolumes&id=3D44d56727-6e5f-438a-8187-42adfac7c906&response= =3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316367665 > 2013-04-07 00:32:47,679 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-12:null) Ping from 3 > 2013-04-07 00:32:47,684 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVolumes&id=3D44d56727-6e5f-438a-8187-42adfac7c906&response= =3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316367665 > 2013-04-07 00:32:47,698 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistTags&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8G= oVA%3D&resourceId=3D44d56727-6e5f-438a-8187-42adfac7c906&resourceType=3DVol= ume&listAll=3Dtrue&_=3D1365316367696 > 2013-04-07 00:32:47,708 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistTags&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8G= oVA%3D&resourceId=3D44d56727-6e5f-438a-8187-42adfac7c906&resourceType=3DVol= ume&listAll=3Dtrue&_=3D1365316367696 > 2013-04-07 00:32:50,453 DEBUG > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone = 1 > is ready to launch secondary storage VM > 2013-04-07 00:32:50,556 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl= ] > (consoleproxy-1:null) Zone 1 is ready to launch console proxy > 2013-04-07 00:32:50,815 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] (RouterMonitor-1:null= ) > Found 0 running routers. > 2013-04-07 00:32:50,820 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:32:50,821 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:32:50,851 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] (RouterMonitor-1:null= ) > Found 0 running routers. > 2013-04-07 00:32:50,851 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:32:50,852 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:32:50,908 DEBUG > [cloud.network.ExternalLoadBalancerUsageManagerImpl] > (ExternalNetworkMonitor-1:null) External devices stats collector is > running... > 2013-04-07 00:32:50,919 DEBUG [storage.snapshot.SnapshotSchedulerImpl] > (SnapshotPollTask:null) Snapshot scheduler.poll is being called at > 2013-04-07 06:32:50 GMT > 2013-04-07 00:32:50,920 DEBUG [storage.snapshot.SnapshotSchedulerImpl] > (SnapshotPollTask:null) Got 0 snapshots to be executed at 2013-04-07 > 06:32:50 GMT > 2013-04-07 00:32:51,462 INFO [agent.manager.AgentMonitor] > (Thread-11:null) Found the following agents behind on ping: [6, 5] > 2013-04-07 00:32:51,464 DEBUG [cloud.host.Status] (Thread-11:null) Ping > timeout for host 6, do invstigation > 2013-04-07 00:32:51,465 DEBUG [cloud.host.Status] (Thread-11:null) Ping > timeout for host 5, do invstigation > 2013-04-07 00:32:51,465 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-15:null) Investigating why host 6 has disconnected with > event PingTimeout > 2013-04-07 00:32:51,465 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-15:null) checking if agent (6) is alive > 2013-04-07 00:32:51,467 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-1:null) Investigating why host 5 has disconnected with eve= nt > PingTimeout > 2013-04-07 00:32:51,467 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-1:null) checking if agent (5) is alive > 2013-04-07 00:32:51,469 DEBUG [agent.transport.Request] > (AgentTaskPool-15:null) Seq 6-324993310: Sending { Cmd , MgmtId: 1, via: > 6, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:32:51,469 DEBUG [agent.transport.Request] > (AgentTaskPool-15:null) Seq 6-324993310: Executing: { Cmd , MgmtId: 1, > via: 6, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:32:51,469 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-335:null) Seq 6-324993310: Executing request > 2013-04-07 00:32:51,473 DEBUG [agent.transport.Request] > (AgentTaskPool-1:null) Seq 5-614334814: Sending { Cmd , MgmtId: 1, via: = 5, > Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:32:51,473 DEBUG [agent.transport.Request] > (AgentTaskPool-1:null) Seq 5-614334814: Executing: { Cmd , MgmtId: 1, vi= a: > 5, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:32:51,473 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-30:null) Seq 5-614334814: Executing request > 2013-04-07 00:32:51,536 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-335:null) Seq 6-324993310: Response Received: > 2013-04-07 00:32:51,536 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-30:null) Seq 5-614334814: Response Received: > 2013-04-07 00:32:51,536 DEBUG [agent.transport.Request] > (DirectAgent-30:null) Seq 5-614334814: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":true,"details":"resource is > alive","wait":0}}] } > 2013-04-07 00:32:51,536 DEBUG [agent.transport.Request] > (DirectAgent-335:null) Seq 6-324993310: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":true,"details":"resource is > alive","wait":0}}] } > 2013-04-07 00:32:51,536 DEBUG [agent.transport.Request] > (AgentTaskPool-1:null) Seq 5-614334814: Received: { Ans: , MgmtId: 1, vi= a: > 5, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-04-07 00:32:51,536 DEBUG [agent.transport.Request] > (AgentTaskPool-15:null) Seq 6-324993310: Received: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-04-07 00:32:51,536 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-1:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is alive > 2013-04-07 00:32:51,536 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-1:null) agent (5) responded to checkHeathCommand, reportin= g > that agent is Up > 2013-04-07 00:32:51,536 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-15:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is alive > 2013-04-07 00:32:51,536 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-1:null) The state determined is Up > 2013-04-07 00:32:51,536 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-1:null) Agent is determined to be up and running > 2013-04-07 00:32:51,536 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-15:null) agent (6) responded to checkHeathCommand, reporti= ng > that agent is Up > 2013-04-07 00:32:51,536 DEBUG [cloud.host.Status] (AgentTaskPool-1:null) > Transition:[Resource state =3D Enabled, Agent event =3D Ping, Host id =3D= 5, name > =3D Tut-XenServer2] > 2013-04-07 00:32:51,536 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-15:null) The state determined is Up > 2013-04-07 00:32:51,537 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-15:null) Agent is determined to be up and running > 2013-04-07 00:32:51,540 DEBUG [cloud.host.Status] (AgentTaskPool-1:null) > Agent status update: [id =3D 5; name =3D Tut-XenServer2; old status =3D U= p; event > =3D Ping; new status =3D Up; old update count =3D 146; new update count = =3D 147] > 2013-04-07 00:32:51,540 DEBUG [cloud.host.Status] (AgentTaskPool-15:null) > Transition:[Resource state =3D Enabled, Agent event =3D Ping, Host id =3D= 6, name > =3D Tut-XenServer] > 2013-04-07 00:32:51,542 DEBUG [cloud.host.Status] (AgentTaskPool-15:null) > Agent status update: [id =3D 6; name =3D Tut-XenServer; old status =3D Up= ; event > =3D Ping; new status =3D Up; old update count =3D 309; new update count = =3D 310] > 2013-04-07 00:33:04,820 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-422:null) Ping from 6 > 2013-04-07 00:33:06,176 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-135:null) Ping from 5 > 2013-04-07 00:33:06,909 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-152:null) Seq 6-324993028: Executing request > 2013-04-07 00:33:07,151 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-152:null) Seq 6-324993028: Response Received: > 2013-04-07 00:33:07,151 DEBUG [agent.transport.Request] > (DirectAgent-152:null) Seq 6-324993028: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, > [{"ClusterSyncAnswer":{"_clusterId":2,"_newStates":{},"_isExecuted":false= ,"result":true,"wait":0}}] > } > 2013-04-07 00:33:11,022 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-50:null) Seq 5-614334468: Executing request > 2013-04-07 00:33:11,169 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-50:null) Seq 5-614334468: Response Received: > 2013-04-07 00:33:11,169 DEBUG [agent.transport.Request] > (DirectAgent-50:null) Seq 5-614334468: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, [{"Answer":{"result":true,"wait":0}}] } > 2013-04-07 00:33:20,451 DEBUG > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone = 1 > is ready to launch secondary storage VM > 2013-04-07 00:33:20,553 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl= ] > (consoleproxy-1:null) Zone 1 is ready to launch console proxy > 2013-04-07 00:33:20,819 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:33:20,820 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:33:20,851 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:33:20,852 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:33:20,921 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Running Capacity Checker ... > 2013-04-07 00:33:20,921 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) recalculating system capacity > 2013-04-07 00:33:20,921 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Executing cpu/ram capacity update > 2013-04-07 00:33:20,929 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) Found 2 VMs on host 1 > 2013-04-07 00:33:20,931 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) Found 0 VM, not running on host 1 > 2013-04-07 00:33:20,933 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) No need to calibrate cpu capacity, host:1 usedCpu: > 200 reservedCpu: 0 > 2013-04-07 00:33:20,933 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) No need to calibrate memory capacity, host:1 > usedMem: 209715200 reservedMem: 0 > 2013-04-07 00:33:20,939 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) Found 1 VMs on host 5 > 2013-04-07 00:33:20,940 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) Found 0 VM, not running on host 5 > 2013-04-07 00:33:20,942 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) No need to calibrate cpu capacity, host:5 usedCpu: > 100 reservedCpu: 0 > 2013-04-07 00:33:20,942 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) No need to calibrate memory capacity, host:5 > usedMem: 1073741824 reservedMem: 0 > 2013-04-07 00:33:20,948 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) Found 2 VMs on host 6 > 2013-04-07 00:33:20,949 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) Found 0 VM, not running on host 6 > 2013-04-07 00:33:20,951 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) No need to calibrate cpu capacity, host:6 usedCpu: > 200 reservedCpu: 0 > 2013-04-07 00:33:20,951 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) No need to calibrate memory capacity, host:6 > usedMem: 1178599424 reservedMem: 0 > 2013-04-07 00:33:20,951 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Done executing cpu/ram capacity update > 2013-04-07 00:33:20,951 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Executing storage capacity update > 2013-04-07 00:33:20,956 DEBUG [cloud.storage.StorageManagerImpl] > (CapacityChecker:null) Successfully set Capacity - 31004332032 for capaci= ty > type - 9 , DataCenterId - 1, HostOrPoolId - 200, PodId 1 > 2013-04-07 00:33:20,959 DEBUG [cloud.storage.StorageManagerImpl] > (CapacityChecker:null) Successfully set Capacity - 97221701632 for capaci= ty > type - 9 , DataCenterId - 1, HostOrPoolId - 201, PodId 1 > 2013-04-07 00:33:20,963 DEBUG [cloud.storage.StorageManagerImpl] > (CapacityChecker:null) Successfully set Capacity - 97221701632 for capaci= ty > type - 9 , DataCenterId - 1, HostOrPoolId - 202, PodId 1 > 2013-04-07 00:33:20,967 DEBUG [cloud.storage.StorageManagerImpl] > (CapacityChecker:null) Successfully set Capacity - 2084569088 for capacit= y > type - 3 , DataCenterId - 1, HostOrPoolId - 256, PodId 1 > 2013-04-07 00:33:20,971 DEBUG [cloud.storage.StorageManagerImpl] > (CapacityChecker:null) Successfully set Capacity - 2084569088 for capacit= y > type - 3 , DataCenterId - 1, HostOrPoolId - 257, PodId 1 > 2013-04-07 00:33:20,975 DEBUG [cloud.storage.StorageManagerImpl] > (CapacityChecker:null) Successfully set Capacity - 2084569088 for capacit= y > type - 3 , DataCenterId - 1, HostOrPoolId - 262, PodId 1 > 2013-04-07 00:33:20,975 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Done executing storage capacity update > 2013-04-07 00:33:20,975 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Executing capacity updates for public ip and Vlans > 2013-04-07 00:33:20,983 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Done capacity updates for public ip and Vlans > 2013-04-07 00:33:20,983 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Executing capacity updates for private ip > 2013-04-07 00:33:20,990 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Done executing capacity updates for private ip > 2013-04-07 00:33:20,990 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Done recalculating system capacity > 2013-04-07 00:33:21,012 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Done running Capacity Checker ... > 2013-04-07 00:33:24,891 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-13:null) Ping from 4 > 2013-04-07 00:33:27,159 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-459:null) Ping from 1 > 2013-04-07 00:33:29,095 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-457:null) Seq 1-90046472: Executing request > 2013-04-07 00:33:29,329 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-457:null) Seq 1-90046472: Response Received: > 2013-04-07 00:33:29,330 DEBUG [agent.transport.Request] > (DirectAgent-457:null) Seq 1-90046472: Processing: { Ans: , MgmtId: 1, > via: 1, Ver: v1, Flags: 10, > [{"ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false= ,"result":true,"wait":0}}] > } > 2013-04-07 00:33:33,192 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316413189 > 2013-04-07 00:33:33,210 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316413189 > 2013-04-07 00:33:35,033 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistZones&available=3Dtrue&response=3Djson&sessionkey=3DZ6QqzU= 0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316415031 > 2013-04-07 00:33:35,040 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistZones&available=3Dtrue&response=3Djson&sessionkey=3DZ6QqzU= 0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316415031 > 2013-04-07 00:33:36,745 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistHypervisors&zoneid=3D3a62dec3-cf95-4ba2-9af0-af2190af35e3&= response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653164167= 43 > 2013-04-07 00:33:36,753 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistHypervisors&zoneid=3D3a62dec3-cf95-4ba2-9af0-af2190af35e3&= response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653164167= 43 > 2013-04-07 00:33:36,756 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistTemplates&templatefilter=3Dfeatured&zoneid=3D3a62dec3-cf95= -4ba2-9af0-af2190af35e3&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl= 8GoVA%3D&_=3D1365316416754 > 2013-04-07 00:33:36,781 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistTemplates&templatefilter=3Dfeatured&zoneid=3D3a62dec3-cf95= -4ba2-9af0-af2190af35e3&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl= 8GoVA%3D&_=3D1365316416754 > 2013-04-07 00:33:36,784 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistTemplates&templatefilter=3Dcommunity&zoneid=3D3a62dec3-cf9= 5-4ba2-9af0-af2190af35e3&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&_=3D1365316416782 > 2013-04-07 00:33:36,812 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistTemplates&templatefilter=3Dcommunity&zoneid=3D3a62dec3-cf9= 5-4ba2-9af0-af2190af35e3&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&_=3D1365316416782 > 2013-04-07 00:33:36,815 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistTemplates&templatefilter=3Dselfexecutable&zoneid=3D3a62dec= 3-cf95-4ba2-9af0-af2190af35e3&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bM= gnRRfl8GoVA%3D&_=3D1365316416813 > 2013-04-07 00:33:36,829 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistTemplates&templatefilter=3Dselfexecutable&zoneid=3D3a62dec= 3-cf95-4ba2-9af0-af2190af35e3&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bM= gnRRfl8GoVA%3D&_=3D1365316416813 > 2013-04-07 00:33:37,503 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistServiceOfferings&issystem=3Dfalse&response=3Djson&sessionk= ey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316417501 > 2013-04-07 00:33:37,514 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistServiceOfferings&issystem=3Dfalse&response=3Djson&sessionk= ey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316417501 > 2013-04-07 00:33:41,151 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistDiskOfferings&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13b= MgnRRfl8GoVA%3D&_=3D1365316421149 > 2013-04-07 00:33:41,162 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistDiskOfferings&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13b= MgnRRfl8GoVA%3D&_=3D1365316421149 > 2013-04-07 00:33:41,970 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistNetworks&trafficType=3DGuest&zoneId=3D3a62dec3-cf95-4ba2-9= af0-af2190af35e3&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3= D&_=3D1365316421968 > 2013-04-07 00:33:41,994 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistNetworks&trafficType=3DGuest&zoneId=3D3a62dec3-cf95-4ba2-9= af0-af2190af35e3&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3= D&_=3D1365316421968 > 2013-04-07 00:33:41,997 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistSecurityGroups&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13= bMgnRRfl8GoVA%3D&domainid=3De4ec5ddc-9e1c-11e2-a770-6e70e42a2333&account=3D= admin&_=3D1365316421995 > 2013-04-07 00:33:42,003 DEBUG [cloud.user.AccountManagerImpl] > (1161145101@qtp-1008805148-33:null) Access granted to Acct[2-admin] to > Domain:1/ by DomainChecker > 2013-04-07 00:33:42,009 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistSecurityGroups&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13= bMgnRRfl8GoVA%3D&domainid=3De4ec5ddc-9e1c-11e2-a770-6e70e42a2333&account=3D= admin&_=3D1365316421995 > 2013-04-07 00:33:44,477 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DdeployVirtualMachine&zoneId=3D3a62dec3-cf95-4ba2-9af0-af2190af= 35e3&templateId=3De4a7df4a-9e1c-11e2-a770-6e70e42a2333&hypervisor=3DXenServ= er&serviceOfferingId=3D9c1e08a2-2dfe-4fa8-aea9-3e4955a69cc2&response=3Djson= &sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316424475 > 2013-04-07 00:33:44,484 DEBUG [cloud.api.ApiDispatcher] > (1161145101@qtp-1008805148-33:null) InfrastructureEntity name > is:com.cloud.offering.ServiceOffering > 2013-04-07 00:33:44,486 DEBUG [cloud.api.ApiDispatcher] > (1161145101@qtp-1008805148-33:null) ControlledEntity name > is:com.cloud.template.VirtualMachineTemplate > 2013-04-07 00:33:44,510 DEBUG [cloud.vm.UserVmManagerImpl] > (1161145101@qtp-1008805148-33:null) Allocating in the DB for vm > 2013-04-07 00:33:44,523 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (1161145101@qtp-1008805148-33:null) Allocating entries for VM: > VM[User|a30b991d-1c38-4bae-803f-ab3be57a384f] > 2013-04-07 00:33:44,523 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (1161145101@qtp-1008805148-33:null) Allocating nics for > VM[User|a30b991d-1c38-4bae-803f-ab3be57a384f] > 2013-04-07 00:33:44,524 DEBUG [cloud.network.NetworkManagerImpl] > (1161145101@qtp-1008805148-33:null) Allocating nic for vm > VM[User|a30b991d-1c38-4bae-803f-ab3be57a384f] in network Ntwk[204|Guest|6= ] > with requested profile NicProfile[0-0-null-null-null > 2013-04-07 00:33:44,531 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (1161145101@qtp-1008805148-33:null) Allocaing disks for > VM[User|a30b991d-1c38-4bae-803f-ab3be57a384f] > 2013-04-07 00:33:44,538 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (1161145101@qtp-1008805148-33:null) Allocation completed for VM: > VM[User|a30b991d-1c38-4bae-803f-ab3be57a384f] > 2013-04-07 00:33:44,538 DEBUG [cloud.vm.UserVmManagerImpl] > (1161145101@qtp-1008805148-33:null) Successfully allocated DB entry for > VM[User|a30b991d-1c38-4bae-803f-ab3be57a384f] > 2013-04-07 00:33:44,571 DEBUG [cloud.async.AsyncJobManagerImpl] > (1161145101@qtp-1008805148-33:null) submit async job-44, details: > AsyncJobVO {id:44, userId: 2, accountId: 2, sessionKey: null, instanceTyp= e: > null, instanceId: 14, cmd: > org.apache.cloudstack.api.command.user.vm.DeployVMCmd, cmdOriginator: nul= l, > cmdInfo: > {"id":"14","templateId":"e4a7df4a-9e1c-11e2-a770-6e70e42a2333","response"= :"json","sessionkey":"Z6QqzU0Fq1iT13bMgnRRfl8GoVA\u003d","ctxUserId":"2","h= ypervisor":"XenServer","serviceOfferingId":"9c1e08a2-2dfe-4fa8-aea9-3e4955a= 69cc2","_":"1365316424475","ctxAccountId":"2","ctxStartEventId":"49","zoneI= d":"3a62dec3-cf95-4ba2-9af0-af2190af35e3"}, > cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, > processStatus: 0, resultCode: 0, result: null, initMsid: 1, completeMsid: > null, lastUpdated: null, lastPolled: null, created: null} > 2013-04-07 00:33:44,572 DEBUG [cloud.async.AsyncJobManagerImpl] > (Job-Executor-37:job-44) Executing > org.apache.cloudstack.api.command.user.vm.DeployVMCmd for job-44 > 2013-04-07 00:33:44,573 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DdeployVirtualMachine&zoneId=3D3a62dec3-cf95-4ba2-9af0-af2190af= 35e3&templateId=3De4a7df4a-9e1c-11e2-a770-6e70e42a2333&hypervisor=3DXenServ= er&serviceOfferingId=3D9c1e08a2-2dfe-4fa8-aea9-3e4955a69cc2&response=3Djson= &sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316424475 > 2013-04-07 00:33:44,578 DEBUG [cloud.api.ApiDispatcher] > (Job-Executor-37:job-44) InfrastructureEntity name > is:com.cloud.offering.ServiceOffering > 2013-04-07 00:33:44,581 DEBUG [cloud.api.ApiDispatcher] > (Job-Executor-37:job-44) ControlledEntity name > is:com.cloud.template.VirtualMachineTemplate > 2013-04-07 00:33:44,624 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-37:job-44) DeploymentPlanner allocation algorithm: random > 2013-04-07 00:33:44,624 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-37:job-44) Trying to allocate a host and storage pools from > dc:1, pod:null,cluster:null, requested cpu: 100, requested ram: 107374182= 4 > 2013-04-07 00:33:44,624 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-37:job-44) Is ROOT volume READY (pool already allocated)?: = No > 2013-04-07 00:33:44,624 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-37:job-44) Searching all possible resources under this Zone= : 1 > 2013-04-07 00:33:44,625 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-37:job-44) Listing clusters in order of aggregate capacity, > that have (atleast one host with) enough CPU and RAM capacity under this > Zone: 1 > 2013-04-07 00:33:44,626 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-37:job-44) CPUOverprovisioningFactor considered: 1.0 > 2013-04-07 00:33:44,638 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-37:job-44) Cannot allocate cluster list [1, 2] for vm > creation since their allocated percentage crosses the disable capacity > threshold: 0.85 for capacity Type : 0, skipping these clusters > 2013-04-07 00:33:44,639 DEBUG [cloud.deploy.FirstFitPlanner] > (Job-Executor-37:job-44) Could not find suitable Deployment Destination f= or > this VM under any clusters, returning. > 2013-04-07 00:33:44,641 DEBUG [cloud.vm.UserVmManagerImpl] > (Job-Executor-37:job-44) Destroying vm > VM[User|a30b991d-1c38-4bae-803f-ab3be57a384f] as it failed to create on > Host with Id:null > 2013-04-07 00:33:44,646 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-37:job-44) VM state transitted from :Stopped to Error with > event: OperationFailedToErrorvm's original host id: null new host id: nul= l > host id before state transition: null > 2013-04-07 00:33:44,672 INFO [user.vm.DeployVMCmd] > (Job-Executor-37:job-44) > com.cloud.exception.InsufficientServerCapacityException: Unable to create= a > deployment for VM[User|a30b991d-1c38-4bae-803f-ab3be57a384f]Scope=3Dinter= face > com.cloud.dc.DataCenter; id=3D1 > 2013-04-07 00:33:44,672 INFO [user.vm.DeployVMCmd] > (Job-Executor-37:job-44) Unable to create a deployment for > VM[User|a30b991d-1c38-4bae-803f-ab3be57a384f] > com.cloud.exception.InsufficientServerCapacityException: Unable to create > a deployment for > VM[User|a30b991d-1c38-4bae-803f-ab3be57a384f]Scope=3Dinterface > com.cloud.dc.DataCenter; id=3D1 > at > org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.reserve= VirtualMachine(VMEntityManagerImpl.java:186) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java= :39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI= mpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(A= opUtils.java:319) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpo= int(ReflectiveMethodInvocation.java:183) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Refl= ectiveMethodInvocation.java:150) > at > org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proce= ed(MethodInvocationProceedingJoinPoint.java:80) > at > com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(TransactionC= ontextBuilder.java:37) > at sun.reflect.GeneratedMethodAccessor37.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI= mpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodW= ithGivenArgs(AbstractAspectJAdvice.java:621) > at > org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(= AbstractAspectJAdvice.java:610) > at > org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundA= dvice.java:65) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Refl= ectiveMethodInvocation.java:172) > at > org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(Ex= poseInvocationInterceptor.java:90) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Refl= ectiveMethodInvocation.java:172) > at > org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAop= Proxy.java:202) > at com.sun.proxy.$Proxy297.reserveVirtualMachine(Unknown Source) > at > org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.re= serve(VirtualMachineEntityImpl.java:198) > at > com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java= :3859) > at > com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java= :3458) > at > com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java= :3444) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java= :39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI= mpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(A= opUtils.java:319) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpo= int(ReflectiveMethodInvocation.java:183) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Refl= ectiveMethodInvocation.java:150) > at > org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proce= ed(MethodInvocationProceedingJoinPoint.java:80) > at > com.cloud.event.ActionEventInterceptor.AroundAnyMethod(ActionEventInterce= ptor.java:53) > at sun.reflect.GeneratedMethodAccessor359.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI= mpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodW= ithGivenArgs(AbstractAspectJAdvice.java:621) > at > org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(= AbstractAspectJAdvice.java:610) > at > org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundA= dvice.java:65) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Refl= ectiveMethodInvocation.java:161) > at > org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proce= ed(MethodInvocationProceedingJoinPoint.java:80) > at > com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(TransactionC= ontextBuilder.java:37) > at sun.reflect.GeneratedMethodAccessor37.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI= mpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodW= ithGivenArgs(AbstractAspectJAdvice.java:621) > at > org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(= AbstractAspectJAdvice.java:610) > at > org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundA= dvice.java:65) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Refl= ectiveMethodInvocation.java:172) > at > org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(Ex= poseInvocationInterceptor.java:90) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Refl= ectiveMethodInvocation.java:172) > at > org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAop= Proxy.java:202) > at com.sun.proxy.$Proxy263.startVirtualMachine(Unknown Source) > at > org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd= .java:379) > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:163) > at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) > at > org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.in= vokeJoinpoint(Cglib2AopProxy.java:689) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Refl= ectiveMethodInvocation.java:150) > at > org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proce= ed(MethodInvocationProceedingJoinPoint.java:80) > at > com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(TransactionC= ontextBuilder.java:37) > at sun.reflect.GeneratedMethodAccessor37.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI= mpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodW= ithGivenArgs(AbstractAspectJAdvice.java:621) > at > org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(= AbstractAspectJAdvice.java:610) > at > org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundA= dvice.java:65) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Refl= ectiveMethodInvocation.java:172) > at > org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(Ex= poseInvocationInterceptor.java:90) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Refl= ectiveMethodInvocation.java:172) > at > org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedIntercepto= r.intercept(Cglib2AopProxy.java:622) > at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:437= ) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor= .java:895) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav= a:918) > at java.lang.Thread.run(Thread.java:680) > 2013-04-07 00:33:44,674 DEBUG [cloud.async.AsyncJobManagerImpl] > (Job-Executor-37:job-44) Complete async job-44, jobStatus: 2, resultCode: > 530, result: Error Code: 533 Error text: Unable to create a deployment fo= r > VM[User|a30b991d-1c38-4bae-803f-ab3be57a384f] > 2013-04-07 00:33:47,591 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3D8dd191cc-2709-4223-aee5-3ecd759d4a= fd&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653164= 27589 > 2013-04-07 00:33:47,601 DEBUG [cloud.async.AsyncJobManagerImpl] > (1161145101@qtp-1008805148-33:null) Async job-44 completed > 2013-04-07 00:33:47,605 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3D8dd191cc-2709-4223-aee5-3ecd759d4a= fd&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653164= 27589 > 2013-04-07 00:33:47,608 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVirtualMachines&id=3Da30b991d-1c38-4bae-803f-ab3be57a384f&= response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653164276= 06 > 2013-04-07 00:33:47,621 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVirtualMachines&id=3Da30b991d-1c38-4bae-803f-ab3be57a384f&= response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653164276= 06 > 2013-04-07 00:33:47,678 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-14:null) Ping from 3 > 2013-04-07 00:33:50,451 DEBUG > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone = 1 > is ready to launch secondary storage VM > 2013-04-07 00:33:50,559 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl= ] > (consoleproxy-1:null) Zone 1 is ready to launch console proxy > 2013-04-07 00:33:50,819 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:33:50,820 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:33:50,851 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:33:50,852 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:33:51,465 INFO [agent.manager.AgentMonitor] > (Thread-11:null) Found the following agents behind on ping: [6, 5] > 2013-04-07 00:33:51,467 DEBUG [cloud.host.Status] (Thread-11:null) Ping > timeout for host 6, do invstigation > 2013-04-07 00:33:51,468 DEBUG [cloud.host.Status] (Thread-11:null) Ping > timeout for host 5, do invstigation > 2013-04-07 00:33:51,468 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-4:null) Investigating why host 6 has disconnected with eve= nt > PingTimeout > 2013-04-07 00:33:51,468 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-4:null) checking if agent (6) is alive > 2013-04-07 00:33:51,469 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-3:null) Investigating why host 5 has disconnected with eve= nt > PingTimeout > 2013-04-07 00:33:51,470 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-3:null) checking if agent (5) is alive > 2013-04-07 00:33:51,471 DEBUG [agent.transport.Request] > (AgentTaskPool-4:null) Seq 6-324993311: Sending { Cmd , MgmtId: 1, via: = 6, > Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:33:51,471 DEBUG [agent.transport.Request] > (AgentTaskPool-4:null) Seq 6-324993311: Executing: { Cmd , MgmtId: 1, vi= a: > 6, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:33:51,472 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-448:null) Seq 6-324993311: Executing request > 2013-04-07 00:33:51,473 DEBUG [agent.transport.Request] > (AgentTaskPool-3:null) Seq 5-614334815: Sending { Cmd , MgmtId: 1, via: = 5, > Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:33:51,473 DEBUG [agent.transport.Request] > (AgentTaskPool-3:null) Seq 5-614334815: Executing: { Cmd , MgmtId: 1, vi= a: > 5, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:33:51,473 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-261:null) Seq 5-614334815: Executing request > 2013-04-07 00:33:51,527 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-448:null) Seq 6-324993311: Response Received: > 2013-04-07 00:33:51,527 DEBUG [agent.transport.Request] > (DirectAgent-448:null) Seq 6-324993311: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":true,"details":"resource is > alive","wait":0}}] } > 2013-04-07 00:33:51,527 DEBUG [agent.transport.Request] > (AgentTaskPool-4:null) Seq 6-324993311: Received: { Ans: , MgmtId: 1, vi= a: > 6, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-04-07 00:33:51,528 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-4:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is alive > 2013-04-07 00:33:51,528 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-4:null) agent (6) responded to checkHeathCommand, reportin= g > that agent is Up > 2013-04-07 00:33:51,528 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-4:null) The state determined is Up > 2013-04-07 00:33:51,528 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-4:null) Agent is determined to be up and running > 2013-04-07 00:33:51,528 DEBUG [cloud.host.Status] (AgentTaskPool-4:null) > Transition:[Resource state =3D Enabled, Agent event =3D Ping, Host id =3D= 6, name > =3D Tut-XenServer] > 2013-04-07 00:33:51,531 DEBUG [cloud.host.Status] (AgentTaskPool-4:null) > Agent status update: [id =3D 6; name =3D Tut-XenServer; old status =3D Up= ; event > =3D Ping; new status =3D Up; old update count =3D 310; new update count = =3D 311] > 2013-04-07 00:33:51,531 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-261:null) Seq 5-614334815: Response Received: > 2013-04-07 00:33:51,531 DEBUG [agent.transport.Request] > (DirectAgent-261:null) Seq 5-614334815: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":true,"details":"resource is > alive","wait":0}}] } > 2013-04-07 00:33:51,531 DEBUG [agent.transport.Request] > (AgentTaskPool-3:null) Seq 5-614334815: Received: { Ans: , MgmtId: 1, vi= a: > 5, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-04-07 00:33:51,532 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-3:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is alive > 2013-04-07 00:33:51,532 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-3:null) agent (5) responded to checkHeathCommand, reportin= g > that agent is Up > 2013-04-07 00:33:51,532 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-3:null) The state determined is Up > 2013-04-07 00:33:51,532 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-3:null) Agent is determined to be up and running > 2013-04-07 00:33:51,532 DEBUG [cloud.host.Status] (AgentTaskPool-3:null) > Transition:[Resource state =3D Enabled, Agent event =3D Ping, Host id =3D= 5, name > =3D Tut-XenServer2] > 2013-04-07 00:33:51,535 DEBUG [cloud.host.Status] (AgentTaskPool-3:null) > Agent status update: [id =3D 5; name =3D Tut-XenServer2; old status =3D U= p; event > =3D Ping; new status =3D Up; old update count =3D 147; new update count = =3D 148] > 2013-04-07 00:34:04,860 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-239:null) Ping from 6 > 2013-04-07 00:34:06,170 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-185:null) Ping from 5 > 2013-04-07 00:34:06,909 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-461:null) Seq 6-324993028: Executing request > 2013-04-07 00:34:07,107 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-461:null) Seq 6-324993028: Response Received: > 2013-04-07 00:34:07,107 DEBUG [agent.transport.Request] > (DirectAgent-461:null) Seq 6-324993028: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, > [{"ClusterSyncAnswer":{"_clusterId":2,"_newStates":{},"_isExecuted":false= ,"result":true,"wait":0}}] > } > 2013-04-07 00:34:11,023 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-450:null) Seq 5-614334468: Executing request > 2013-04-07 00:34:11,168 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-450:null) Seq 5-614334468: Response Received: > 2013-04-07 00:34:11,168 DEBUG [agent.transport.Request] > (DirectAgent-450:null) Seq 5-614334468: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, [{"Answer":{"result":true,"wait":0}}] } > 2013-04-07 00:34:20,451 DEBUG > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone = 1 > is ready to launch secondary storage VM > 2013-04-07 00:34:20,553 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl= ] > (consoleproxy-1:null) Zone 1 is ready to launch console proxy > 2013-04-07 00:34:20,820 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:34:20,821 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:34:20,850 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:34:20,851 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:34:24,891 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-15:null) Ping from 4 > 2013-04-07 00:34:27,175 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-126:null) Ping from 1 > 2013-04-07 00:34:29,095 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-182:null) Seq 1-90046472: Executing request > 2013-04-07 00:34:29,323 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-182:null) Seq 1-90046472: Response Received: > 2013-04-07 00:34:29,323 DEBUG [agent.transport.Request] > (DirectAgent-182:null) Seq 1-90046472: Processing: { Ans: , MgmtId: 1, > via: 1, Ver: v1, Flags: 10, > [{"ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false= ,"result":true,"wait":0}}] > } > 2013-04-07 00:34:36,532 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVolumes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316476530 > 2013-04-07 00:34:36,548 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVolumes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316476530 > 2013-04-07 00:34:39,285 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVolumes&id=3D44d56727-6e5f-438a-8187-42adfac7c906&response= =3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316479283 > 2013-04-07 00:34:39,309 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVolumes&id=3D44d56727-6e5f-438a-8187-42adfac7c906&response= =3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316479283 > 2013-04-07 00:34:39,325 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistTags&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8G= oVA%3D&resourceId=3D44d56727-6e5f-438a-8187-42adfac7c906&resourceType=3DVol= ume&listAll=3Dtrue&_=3D1365316479323 > 2013-04-07 00:34:39,334 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistTags&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8G= oVA%3D&resourceId=3D44d56727-6e5f-438a-8187-42adfac7c906&resourceType=3DVol= ume&listAll=3Dtrue&_=3D1365316479323 > 2013-04-07 00:34:47,678 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-1:null) Ping from 3 > 2013-04-07 00:34:50,455 DEBUG > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone = 1 > is ready to launch secondary storage VM > 2013-04-07 00:34:50,557 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl= ] > (consoleproxy-1:null) Zone 1 is ready to launch console proxy > 2013-04-07 00:34:50,820 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:34:50,821 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:34:50,850 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:34:50,851 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:34:51,468 INFO [agent.manager.AgentMonitor] > (Thread-11:null) Found the following agents behind on ping: [6, 5] > 2013-04-07 00:34:51,470 DEBUG [cloud.host.Status] (Thread-11:null) Ping > timeout for host 6, do invstigation > 2013-04-07 00:34:51,471 DEBUG [cloud.host.Status] (Thread-11:null) Ping > timeout for host 5, do invstigation > 2013-04-07 00:34:51,472 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-5:null) Investigating why host 6 has disconnected with eve= nt > PingTimeout > 2013-04-07 00:34:51,472 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-5:null) checking if agent (6) is alive > 2013-04-07 00:34:51,473 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-6:null) Investigating why host 5 has disconnected with eve= nt > PingTimeout > 2013-04-07 00:34:51,473 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-6:null) checking if agent (5) is alive > 2013-04-07 00:34:51,475 DEBUG [agent.transport.Request] > (AgentTaskPool-5:null) Seq 6-324993312: Sending { Cmd , MgmtId: 1, via: = 6, > Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:34:51,475 DEBUG [agent.transport.Request] > (AgentTaskPool-5:null) Seq 6-324993312: Executing: { Cmd , MgmtId: 1, vi= a: > 6, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:34:51,475 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-42:null) Seq 6-324993312: Executing request > 2013-04-07 00:34:51,476 DEBUG [agent.transport.Request] > (AgentTaskPool-6:null) Seq 5-614334816: Sending { Cmd , MgmtId: 1, via: = 5, > Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:34:51,476 DEBUG [agent.transport.Request] > (AgentTaskPool-6:null) Seq 5-614334816: Executing: { Cmd , MgmtId: 1, vi= a: > 5, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:34:51,477 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-164:null) Seq 5-614334816: Executing request > 2013-04-07 00:34:51,534 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-164:null) Seq 5-614334816: Response Received: > 2013-04-07 00:34:51,535 DEBUG [agent.transport.Request] > (DirectAgent-164:null) Seq 5-614334816: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":true,"details":"resource is > alive","wait":0}}] } > 2013-04-07 00:34:51,535 DEBUG [agent.transport.Request] > (AgentTaskPool-6:null) Seq 5-614334816: Received: { Ans: , MgmtId: 1, vi= a: > 5, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-04-07 00:34:51,535 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-6:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is alive > 2013-04-07 00:34:51,535 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-6:null) agent (5) responded to checkHeathCommand, reportin= g > that agent is Up > 2013-04-07 00:34:51,535 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-6:null) The state determined is Up > 2013-04-07 00:34:51,535 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-6:null) Agent is determined to be up and running > 2013-04-07 00:34:51,535 DEBUG [cloud.host.Status] (AgentTaskPool-6:null) > Transition:[Resource state =3D Enabled, Agent event =3D Ping, Host id =3D= 5, name > =3D Tut-XenServer2] > 2013-04-07 00:34:51,538 DEBUG [cloud.host.Status] (AgentTaskPool-6:null) > Agent status update: [id =3D 5; name =3D Tut-XenServer2; old status =3D U= p; event > =3D Ping; new status =3D Up; old update count =3D 148; new update count = =3D 149] > 2013-04-07 00:34:51,539 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-42:null) Seq 6-324993312: Response Received: > 2013-04-07 00:34:51,539 DEBUG [agent.transport.Request] > (DirectAgent-42:null) Seq 6-324993312: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":true,"details":"resource is > alive","wait":0}}] } > 2013-04-07 00:34:51,539 DEBUG [agent.transport.Request] > (AgentTaskPool-5:null) Seq 6-324993312: Received: { Ans: , MgmtId: 1, vi= a: > 6, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-04-07 00:34:51,539 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-5:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is alive > 2013-04-07 00:34:51,539 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-5:null) agent (6) responded to checkHeathCommand, reportin= g > that agent is Up > 2013-04-07 00:34:51,539 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-5:null) The state determined is Up > 2013-04-07 00:34:51,539 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-5:null) Agent is determined to be up and running > 2013-04-07 00:34:51,539 DEBUG [cloud.host.Status] (AgentTaskPool-5:null) > Transition:[Resource state =3D Enabled, Agent event =3D Ping, Host id =3D= 6, name > =3D Tut-XenServer] > 2013-04-07 00:34:51,542 DEBUG [cloud.host.Status] (AgentTaskPool-5:null) > Agent status update: [id =3D 6; name =3D Tut-XenServer; old status =3D Up= ; event > =3D Ping; new status =3D Up; old update count =3D 311; new update count = =3D 312] > 2013-04-07 00:34:54,349 INFO [cloud.vm.UserVmManagerImpl] > (UserVm-Scavenger-1:null) Found 1 vms to expunge. > 2013-04-07 00:34:54,349 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (UserVm-Scavenger-1:null) Stopped called on > VM[User|a30b991d-1c38-4bae-803f-ab3be57a384f] but the state is Error > 2013-04-07 00:34:54,352 DEBUG [cloud.capacity.CapacityManagerImpl] > (UserVm-Scavenger-1:null) VM state transitted from :Error to Expunging wi= th > event: ExpungeOperationvm's original host id: null new host id: null host > id before state transition: null > 2013-04-07 00:34:54,352 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (UserVm-Scavenger-1:null) Destroying vm > VM[User|a30b991d-1c38-4bae-803f-ab3be57a384f] > 2013-04-07 00:34:54,352 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (UserVm-Scavenger-1:null) Cleaning up NICS > 2013-04-07 00:34:54,352 DEBUG [cloud.network.NetworkManagerImpl] > (UserVm-Scavenger-1:null) Cleaning network for vm: 14 > 2013-04-07 00:34:54,360 DEBUG [network.guru.DirectNetworkGuru] > (UserVm-Scavenger-1:null) Deallocate network: networkId: 204, ip: null > 2013-04-07 00:34:54,362 DEBUG [cloud.network.NetworkManagerImpl] > (UserVm-Scavenger-1:null) Removed nic id=3D20 > 2013-04-07 00:34:54,362 DEBUG [cloud.storage.StorageManagerImpl] > (UserVm-Scavenger-1:null) Cleaning storage for vm: 14 > 2013-04-07 00:34:54,363 DEBUG [cloud.storage.StorageManagerImpl] > (UserVm-Scavenger-1:null) Expunging Vol[14|vm=3D14|ROOT] > 2013-04-07 00:34:54,365 DEBUG [cloud.storage.StorageManagerImpl] > (UserVm-Scavenger-1:null) Marking volume that was never created as > destroyed: Vol[14|vm=3D14|ROOT] > 2013-04-07 00:34:54,368 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (UserVm-Scavenger-1:null) Expunged > VM[User|a30b991d-1c38-4bae-803f-ab3be57a384f] > 2013-04-07 00:34:54,368 DEBUG [cloud.vm.UserVmManagerImpl] > (UserVm-Scavenger-1:null) Starting cleaning up vm > VM[User|a30b991d-1c38-4bae-803f-ab3be57a384f] resources... > 2013-04-07 00:34:54,371 INFO [network.security.SecurityGroupManagerImpl] > (UserVm-Scavenger-1:null) Disassociated 1 network groups from uservm 14 > 2013-04-07 00:34:54,372 DEBUG [network.security.SecurityGroupManagerImpl] > (UserVm-Scavenger-1:null) Security group mappings are removed successfull= y > for vm id=3D14 > 2013-04-07 00:34:54,376 DEBUG [network.firewall.FirewallManagerImpl] > (UserVm-Scavenger-1:null) No firewall rules are found for vm id=3D14 > 2013-04-07 00:34:54,376 DEBUG [cloud.vm.UserVmManagerImpl] > (UserVm-Scavenger-1:null) Firewall rules are removed successfully as a pa= rt > of vm id=3D14 expunge > 2013-04-07 00:34:54,378 DEBUG [network.rules.RulesManagerImpl] > (UserVm-Scavenger-1:null) No port forwarding rules are found for vm id=3D= 14 > 2013-04-07 00:34:54,378 DEBUG [cloud.vm.UserVmManagerImpl] > (UserVm-Scavenger-1:null) Port forwarding rules are removed successfully = as > a part of vm id=3D14 expunge > 2013-04-07 00:34:54,379 DEBUG [cloud.vm.UserVmManagerImpl] > (UserVm-Scavenger-1:null) Removed vm id=3D14 from all load balancers as a > part of expunge process > 2013-04-07 00:34:54,379 DEBUG [cloud.vm.UserVmManagerImpl] > (UserVm-Scavenger-1:null) Successfully cleaned up vm > VM[User|a30b991d-1c38-4bae-803f-ab3be57a384f] resources as a part of > expunge process > 2013-04-07 00:34:54,873 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316494871 > 2013-04-07 00:34:54,891 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316494871 > 2013-04-07 00:34:57,672 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistZones&id=3D3a62dec3-cf95-4ba2-9af0-af2190af35e3&response= =3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316497670 > 2013-04-07 00:34:57,679 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistZones&id=3D3a62dec3-cf95-4ba2-9af0-af2190af35e3&response= =3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316497670 > 2013-04-07 00:34:57,683 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistNetworks&id=3D9d28211f-440e-4233-86d1-214b404074eb&respons= e=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316497681 > 2013-04-07 00:34:57,708 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistNetworks&id=3D9d28211f-440e-4233-86d1-214b404074eb&respons= e=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316497681 > 2013-04-07 00:34:57,714 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVirtualMachines&id=3D94ddc16f-04fc-4da1-8326-01d8d5cdeb44&= response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653164977= 12 > 2013-04-07 00:34:57,731 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVirtualMachines&id=3D94ddc16f-04fc-4da1-8326-01d8d5cdeb44&= response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653164977= 12 > 2013-04-07 00:34:57,738 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistOsTypes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&_=3D1365316497736 > 2013-04-07 00:34:57,754 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistTags&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8G= oVA%3D&resourceId=3D94ddc16f-04fc-4da1-8326-01d8d5cdeb44&resourceType=3DUse= rVm&listAll=3Dtrue&_=3D1365316497750 > 2013-04-07 00:34:57,763 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistTags&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8G= oVA%3D&resourceId=3D94ddc16f-04fc-4da1-8326-01d8d5cdeb44&resourceType=3DUse= rVm&listAll=3Dtrue&_=3D1365316497750 > 2013-04-07 00:34:57,889 DEBUG [cloud.api.ApiServlet] > (1161145101@qtp-1008805148-33:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistOsTypes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&_=3D1365316497736 > 2013-04-07 00:35:01,051 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistServiceOfferings&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT= 13bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&issystem=3Dfalse&_= =3D1365316501047 > 2013-04-07 00:35:01,064 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistServiceOfferings&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT= 13bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&issystem=3Dfalse&_= =3D1365316501047 > 2013-04-07 00:35:03,427 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistServiceOfferings&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT= 13bMgnRRfl8GoVA%3D&issystem=3Dfalse&id=3D425cf3cf-4bc4-4e53-82a0-ba6c20dd36= 88&_=3D1365316503425 > 2013-04-07 00:35:03,439 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistServiceOfferings&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT= 13bMgnRRfl8GoVA%3D&issystem=3Dfalse&id=3D425cf3cf-4bc4-4e53-82a0-ba6c20dd36= 88&_=3D1365316503425 > 2013-04-07 00:35:04,848 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-349:null) Ping from 6 > 2013-04-07 00:35:06,206 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-292:null) Ping from 5 > 2013-04-07 00:35:06,909 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-334:null) Seq 6-324993028: Executing request > 2013-04-07 00:35:07,112 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-334:null) Seq 6-324993028: Response Received: > 2013-04-07 00:35:07,112 DEBUG [agent.transport.Request] > (DirectAgent-334:null) Seq 6-324993028: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, > [{"ClusterSyncAnswer":{"_clusterId":2,"_newStates":{},"_isExecuted":false= ,"result":true,"wait":0}}] > } > 2013-04-07 00:35:08,821 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistConfigurations&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13= bMgnRRfl8GoVA%3D&page=3D1&pagesize=3D20&_=3D1365316508819 > 2013-04-07 00:35:08,845 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistConfigurations&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13= bMgnRRfl8GoVA%3D&page=3D1&pagesize=3D20&_=3D1365316508819 > 2013-04-07 00:35:10,407 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistZones&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8= GoVA%3D&_=3D1365316510405 > 2013-04-07 00:35:10,416 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistZones&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8= GoVA%3D&_=3D1365316510405 > 2013-04-07 00:35:10,429 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistPods&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8G= oVA%3D&page=3D1&pagesize=3D1&_=3D1365316510426 > 2013-04-07 00:35:10,436 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistPods&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8G= oVA%3D&page=3D1&pagesize=3D1&_=3D1365316510426 > 2013-04-07 00:35:10,440 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistClusters&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRR= fl8GoVA%3D&page=3D1&pagesize=3D1&_=3D1365316510438 > 2013-04-07 00:35:10,448 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistClusters&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRR= fl8GoVA%3D&page=3D1&pagesize=3D1&_=3D1365316510438 > 2013-04-07 00:35:10,451 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistHosts&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8= GoVA%3D&type=3Drouting&page=3D1&pagesize=3D1&_=3D1365316510449 > 2013-04-07 00:35:10,456 DEBUG [api.query.QueryManagerImpl] > (1109449945@qtp-1008805148-34:null) >>>Searching for hosts>>> > 2013-04-07 00:35:10,461 DEBUG [api.query.QueryManagerImpl] > (1109449945@qtp-1008805148-34:null) >>>Generating Response>>> > 2013-04-07 00:35:10,466 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistHosts&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8= GoVA%3D&type=3Drouting&page=3D1&pagesize=3D1&_=3D1365316510449 > 2013-04-07 00:35:10,470 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistStoragePools&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bM= gnRRfl8GoVA%3D&page=3D1&pagesize=3D1&_=3D1365316510468 > 2013-04-07 00:35:10,479 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistStoragePools&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bM= gnRRfl8GoVA%3D&page=3D1&pagesize=3D1&_=3D1365316510468 > 2013-04-07 00:35:10,483 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistHosts&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8= GoVA%3D&type=3DSecondaryStorage&page=3D1&pagesize=3D1&_=3D1365316510481 > 2013-04-07 00:35:10,488 DEBUG [api.query.QueryManagerImpl] > (1109449945@qtp-1008805148-34:null) >>>Searching for hosts>>> > 2013-04-07 00:35:10,493 DEBUG [api.query.QueryManagerImpl] > (1109449945@qtp-1008805148-34:null) >>>Generating Response>>> > 2013-04-07 00:35:10,494 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistHosts&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8= GoVA%3D&type=3DSecondaryStorage&page=3D1&pagesize=3D1&_=3D1365316510481 > 2013-04-07 00:35:10,500 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistSystemVms&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnR= Rfl8GoVA%3D&page=3D1&pagesize=3D1&_=3D1365316510496 > 2013-04-07 00:35:10,564 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistSystemVms&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnR= Rfl8GoVA%3D&page=3D1&pagesize=3D1&_=3D1365316510496 > 2013-04-07 00:35:10,568 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistRouters&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&projectid=3D-1&page=3D1&pagesize=3D1&_=3D1365316510566 > 2013-04-07 00:35:10,576 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistRouters&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&projectid=3D-1&page=3D1&pagesize=3D1&_=3D1365316510566 > 2013-04-07 00:35:10,579 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistRouters&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D1&_=3D1365316510577 > 2013-04-07 00:35:10,591 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistRouters&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D1&_=3D1365316510577 > 2013-04-07 00:35:10,595 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistCapacity&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRR= fl8GoVA%3D&_=3D1365316510593 > 2013-04-07 00:35:10,609 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistCapacity&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRR= fl8GoVA%3D&_=3D1365316510593 > 2013-04-07 00:35:11,022 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-298:null) Seq 5-614334468: Executing request > 2013-04-07 00:35:11,171 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-298:null) Seq 5-614334468: Response Received: > 2013-04-07 00:35:11,172 DEBUG [agent.transport.Request] > (DirectAgent-298:null) Seq 5-614334468: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, [{"Answer":{"result":true,"wait":0}}] } > 2013-04-07 00:35:12,493 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistStoragePools&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bM= gnRRfl8GoVA%3D&page=3D1&pageSize=3D20&listAll=3Dtrue&_=3D1365316512490 > 2013-04-07 00:35:12,508 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistStoragePools&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bM= gnRRfl8GoVA%3D&page=3D1&pageSize=3D20&listAll=3Dtrue&_=3D1365316512490 > 2013-04-07 00:35:18,008 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistZones&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8= GoVA%3D&id=3D3a62dec3-cf95-4ba2-9af0-af2190af35e3&_=3D1365316518006 > 2013-04-07 00:35:18,016 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistZones&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8= GoVA%3D&id=3D3a62dec3-cf95-4ba2-9af0-af2190af35e3&_=3D1365316518006 > 2013-04-07 00:35:18,022 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistStoragePools&id=3DiSCSI_SR_4&response=3Djson&sessionkey=3D= Z6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316518019 > 2013-04-07 00:35:18,036 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistStoragePools&id=3DiSCSI_SR_4&response=3Djson&sessionkey=3D= Z6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316518019 > 2013-04-07 00:35:20,457 DEBUG > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone = 1 > is ready to launch secondary storage VM > 2013-04-07 00:35:20,560 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl= ] > (consoleproxy-1:null) Zone 1 is ready to launch console proxy > 2013-04-07 00:35:20,820 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:35:20,821 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:35:20,850 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:35:20,851 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:35:23,644 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistZones&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8= GoVA%3D&id=3D3a62dec3-cf95-4ba2-9af0-af2190af35e3&_=3D1365316523642 > 2013-04-07 00:35:23,652 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistZones&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8= GoVA%3D&id=3D3a62dec3-cf95-4ba2-9af0-af2190af35e3&_=3D1365316523642 > 2013-04-07 00:35:23,657 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistStoragePools&id=3DiSCSI_SR_3&response=3Djson&sessionkey=3D= Z6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316523655 > 2013-04-07 00:35:23,670 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistStoragePools&id=3DiSCSI_SR_3&response=3Djson&sessionkey=3D= Z6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D1365316523655 > 2013-04-07 00:35:24,890 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-2:null) Ping from 4 > 2013-04-07 00:35:25,447 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistZones&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8= GoVA%3D&_=3D1365316525443 > 2013-04-07 00:35:25,456 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistZones&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8= GoVA%3D&_=3D1365316525443 > 2013-04-07 00:35:25,467 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistPods&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8G= oVA%3D&page=3D1&pagesize=3D1&_=3D1365316525465 > 2013-04-07 00:35:25,474 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistPods&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8G= oVA%3D&page=3D1&pagesize=3D1&_=3D1365316525465 > 2013-04-07 00:35:25,477 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistClusters&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRR= fl8GoVA%3D&page=3D1&pagesize=3D1&_=3D1365316525475 > 2013-04-07 00:35:25,485 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistClusters&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRR= fl8GoVA%3D&page=3D1&pagesize=3D1&_=3D1365316525475 > 2013-04-07 00:35:25,488 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistHosts&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8= GoVA%3D&type=3Drouting&page=3D1&pagesize=3D1&_=3D1365316525486 > 2013-04-07 00:35:25,493 DEBUG [api.query.QueryManagerImpl] > (1109449945@qtp-1008805148-34:null) >>>Searching for hosts>>> > 2013-04-07 00:35:25,498 DEBUG [api.query.QueryManagerImpl] > (1109449945@qtp-1008805148-34:null) >>>Generating Response>>> > 2013-04-07 00:35:25,504 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistHosts&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8= GoVA%3D&type=3Drouting&page=3D1&pagesize=3D1&_=3D1365316525486 > 2013-04-07 00:35:25,507 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistStoragePools&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bM= gnRRfl8GoVA%3D&page=3D1&pagesize=3D1&_=3D1365316525505 > 2013-04-07 00:35:25,517 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistStoragePools&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bM= gnRRfl8GoVA%3D&page=3D1&pagesize=3D1&_=3D1365316525505 > 2013-04-07 00:35:25,522 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistHosts&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8= GoVA%3D&type=3DSecondaryStorage&page=3D1&pagesize=3D1&_=3D1365316525519 > 2013-04-07 00:35:25,526 DEBUG [api.query.QueryManagerImpl] > (1109449945@qtp-1008805148-34:null) >>>Searching for hosts>>> > 2013-04-07 00:35:25,531 DEBUG [api.query.QueryManagerImpl] > (1109449945@qtp-1008805148-34:null) >>>Generating Response>>> > 2013-04-07 00:35:25,533 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistHosts&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8= GoVA%3D&type=3DSecondaryStorage&page=3D1&pagesize=3D1&_=3D1365316525519 > 2013-04-07 00:35:25,536 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistSystemVms&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnR= Rfl8GoVA%3D&page=3D1&pagesize=3D1&_=3D1365316525534 > 2013-04-07 00:35:25,591 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistSystemVms&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnR= Rfl8GoVA%3D&page=3D1&pagesize=3D1&_=3D1365316525534 > 2013-04-07 00:35:25,595 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistRouters&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&projectid=3D-1&page=3D1&pagesize=3D1&_=3D1365316525593 > 2013-04-07 00:35:25,603 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistRouters&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&projectid=3D-1&page=3D1&pagesize=3D1&_=3D1365316525593 > 2013-04-07 00:35:25,606 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistRouters&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D1&_=3D1365316525604 > 2013-04-07 00:35:25,617 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistRouters&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D1&_=3D1365316525604 > 2013-04-07 00:35:25,621 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistCapacity&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRR= fl8GoVA%3D&_=3D1365316525619 > 2013-04-07 00:35:25,634 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistCapacity&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRR= fl8GoVA%3D&_=3D1365316525619 > 2013-04-07 00:35:27,158 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-276:null) Ping from 1 > 2013-04-07 00:35:29,095 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-139:null) Seq 1-90046472: Executing request > 2013-04-07 00:35:29,302 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-139:null) Seq 1-90046472: Response Received: > 2013-04-07 00:35:29,303 DEBUG [agent.transport.Request] > (DirectAgent-139:null) Seq 1-90046472: Processing: { Ans: , MgmtId: 1, > via: 1, Ver: v1, Flags: 10, > [{"ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false= ,"result":true,"wait":0}}] > } > 2013-04-07 00:35:31,624 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316531622 > 2013-04-07 00:35:31,644 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316531622 > 2013-04-07 00:35:32,710 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVolumes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316532708 > 2013-04-07 00:35:32,724 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVolumes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316532708 > 2013-04-07 00:35:33,917 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316533915 > 2013-04-07 00:35:33,935 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316533915 > 2013-04-07 00:35:35,668 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVirtualMachines&id=3Dc18ddf7c-fc61-40b0-af75-fdef05f8eae6&= response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165356= 66 > 2013-04-07 00:35:35,689 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVirtualMachines&id=3Dc18ddf7c-fc61-40b0-af75-fdef05f8eae6&= response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165356= 66 > 2013-04-07 00:35:35,695 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistOsTypes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&_=3D1365316535693 > 2013-04-07 00:35:35,873 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistOsTypes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&_=3D1365316535693 > 2013-04-07 00:35:39,081 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DdestroyVirtualMachine&id=3Dc18ddf7c-fc61-40b0-af75-fdef05f8eae= 6&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D136531653= 9079 > 2013-04-07 00:35:39,103 DEBUG [cloud.async.AsyncJobManagerImpl] > (1109449945@qtp-1008805148-34:null) submit async job-45, details: > AsyncJobVO {id:45, userId: 2, accountId: 2, sessionKey: null, instanceTyp= e: > null, instanceId: 12, cmd: > org.apache.cloudstack.api.command.user.vm.DestroyVMCmd, cmdOriginator: > null, cmdInfo: > {"id":"c18ddf7c-fc61-40b0-af75-fdef05f8eae6","response":"json","sessionke= y":"Z6QqzU0Fq1iT13bMgnRRfl8GoVA\u003d","ctxUserId":"2","_":"1365316539079",= "ctxAccountId":"2","ctxStartEventId":"50"}, > cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, > processStatus: 0, resultCode: 0, result: null, initMsid: 1, completeMsid: > null, lastUpdated: null, lastPolled: null, created: null} > 2013-04-07 00:35:39,104 DEBUG [cloud.async.AsyncJobManagerImpl] > (Job-Executor-38:job-45) Executing > org.apache.cloudstack.api.command.user.vm.DestroyVMCmd for job-45 > 2013-04-07 00:35:39,105 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DdestroyVirtualMachine&id=3Dc18ddf7c-fc61-40b0-af75-fdef05f8eae= 6&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D136531653= 9079 > 2013-04-07 00:35:39,119 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (Job-Executor-38:job-45) Destroying vm > VM[User|c18ddf7c-fc61-40b0-af75-fdef05f8eae6] > 2013-04-07 00:35:39,123 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-38:job-45) VM state transitted from :Running to Stopping wi= th > event: StopRequestedvm's original host id: 5 new host id: 5 host id befor= e > state transition: 5 > 2013-04-07 00:35:39,125 DEBUG [agent.transport.Request] > (Job-Executor-38:job-45) Seq 5-614334817: Sending { Cmd , MgmtId: 1, via= : > 5, Ver: v1, Flags: 100111, > [{"StopCommand":{"isProxy":false,"vmName":"i-2-12-VM","wait":0}}] } > 2013-04-07 00:35:39,125 DEBUG [agent.transport.Request] > (Job-Executor-38:job-45) Seq 5-614334817: Executing: { Cmd , MgmtId: 1, > via: 5, Ver: v1, Flags: 100111, > [{"StopCommand":{"isProxy":false,"vmName":"i-2-12-VM","wait":0}}] } > 2013-04-07 00:35:39,125 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-414:null) Seq 5-614334817: Executing request > 2013-04-07 00:35:39,289 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-414:null) 9. The VM i-2-12-VM is in Stopping state > 2013-04-07 00:35:39,720 INFO [xen.resource.CitrixResourceBase] > (DirectAgent-414:null) Removed network rules for vm i-2-12-VM > 2013-04-07 00:35:42,113 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3D1288fa5b-8b5f-4952-b056-b180437edf= d5&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165= 42111 > 2013-04-07 00:35:42,127 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3D1288fa5b-8b5f-4952-b056-b180437edf= d5&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165= 42111 > 2013-04-07 00:35:45,114 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3D1288fa5b-8b5f-4952-b056-b180437edf= d5&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165= 45112 > 2013-04-07 00:35:45,129 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3D1288fa5b-8b5f-4952-b056-b180437edf= d5&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165= 45112 > 2013-04-07 00:35:47,682 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-3:null) Ping from 3 > 2013-04-07 00:35:48,115 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3D1288fa5b-8b5f-4952-b056-b180437edf= d5&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165= 48112 > 2013-04-07 00:35:48,133 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3D1288fa5b-8b5f-4952-b056-b180437edf= d5&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165= 48112 > 2013-04-07 00:35:50,456 DEBUG > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone = 1 > is ready to launch secondary storage VM > 2013-04-07 00:35:50,564 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl= ] > (consoleproxy-1:null) Zone 1 is ready to launch console proxy > 2013-04-07 00:35:50,819 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:35:50,821 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:35:50,851 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:35:50,852 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:35:51,117 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3D1288fa5b-8b5f-4952-b056-b180437edf= d5&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165= 51115 > 2013-04-07 00:35:51,132 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3D1288fa5b-8b5f-4952-b056-b180437edf= d5&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165= 51115 > 2013-04-07 00:35:51,242 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-414:null) 10. The VM i-2-12-VM is in Stopped state > 2013-04-07 00:35:51,242 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-414:null) Seq 5-614334817: Response Received: > 2013-04-07 00:35:51,243 DEBUG [agent.transport.Request] > (DirectAgent-414:null) Seq 5-614334817: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 110, > [{"StopAnswer":{"vncPort":0,"result":true,"details":"Stop VM i-2-12-VM > Succeed","wait":0}}] } > 2013-04-07 00:35:51,243 DEBUG [agent.transport.Request] > (Job-Executor-38:job-45) Seq 5-614334817: Received: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 110, { StopAnswer } } > 2013-04-07 00:35:51,243 DEBUG [agent.manager.AgentAttache] > (DirectAgent-414:null) Seq 5-614334817: No more commands found > 2013-04-07 00:35:51,244 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (Job-Executor-38:job-45) VM[User|c18ddf7c-fc61-40b0-af75-fdef05f8eae6] is > stopped on the host. Proceeding to release resource held. > 2013-04-07 00:35:51,251 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-38:job-45) Changing active number of nics for network id=3D= 204 > on -1 > 2013-04-07 00:35:51,252 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-38:job-45) Asking ElasticLoadBalancerElement to release > Nic[18-12-6416c373-20d8-4617-8dcb-30a8ff9d0f34-192.168.56.195] > 2013-04-07 00:35:51,252 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-38:job-45) Asking NiciraNvpElement to release > Nic[18-12-6416c373-20d8-4617-8dcb-30a8ff9d0f34-192.168.56.195] > 2013-04-07 00:35:51,252 DEBUG [network.element.NiciraNvpElement] > (Job-Executor-38:job-45) Checking if NiciraNvpElement can handle service > Connectivity on network guestNetworkForBasicZone > 2013-04-07 00:35:51,252 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-38:job-45) Asking BigSwitchVnsElement to release > Nic[18-12-6416c373-20d8-4617-8dcb-30a8ff9d0f34-192.168.56.195] > 2013-04-07 00:35:51,252 DEBUG [network.element.BigSwitchVnsElement] > (Job-Executor-38:job-45) Checking if BigSwitchVnsElement can handle servi= ce > Connectivity on network guestNetworkForBasicZone > 2013-04-07 00:35:51,252 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-38:job-45) Asking Ovs to release > Nic[18-12-6416c373-20d8-4617-8dcb-30a8ff9d0f34-192.168.56.195] > 2013-04-07 00:35:51,252 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-38:job-45) Asking BareMetalDhcp to release > Nic[18-12-6416c373-20d8-4617-8dcb-30a8ff9d0f34-192.168.56.195] > 2013-04-07 00:35:51,252 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-38:job-45) Asking BareMetalPxe to release > Nic[18-12-6416c373-20d8-4617-8dcb-30a8ff9d0f34-192.168.56.195] > 2013-04-07 00:35:51,252 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-38:job-45) Asking BareMetalUserdata to release > Nic[18-12-6416c373-20d8-4617-8dcb-30a8ff9d0f34-192.168.56.195] > 2013-04-07 00:35:51,252 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-38:job-45) Asking SecurityGroupProvider to release > Nic[18-12-6416c373-20d8-4617-8dcb-30a8ff9d0f34-192.168.56.195] > 2013-04-07 00:35:51,252 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-38:job-45) Asking VirtualRouter to release > Nic[18-12-6416c373-20d8-4617-8dcb-30a8ff9d0f34-192.168.56.195] > 2013-04-07 00:35:51,253 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-38:job-45) Asking VpcVirtualRouter to release > Nic[18-12-6416c373-20d8-4617-8dcb-30a8ff9d0f34-192.168.56.195] > 2013-04-07 00:35:51,253 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-38:job-45) Asking NiciraNvp to release > Nic[18-12-6416c373-20d8-4617-8dcb-30a8ff9d0f34-192.168.56.195] > 2013-04-07 00:35:51,253 DEBUG [network.element.NiciraNvpElement] > (Job-Executor-38:job-45) Checking if NiciraNvpElement can handle service > Connectivity on network guestNetworkForBasicZone > 2013-04-07 00:35:51,253 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-38:job-45) Asking JuniperSRX to release > Nic[18-12-6416c373-20d8-4617-8dcb-30a8ff9d0f34-192.168.56.195] > 2013-04-07 00:35:51,253 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-38:job-45) Asking Netscaler to release > Nic[18-12-6416c373-20d8-4617-8dcb-30a8ff9d0f34-192.168.56.195] > 2013-04-07 00:35:51,253 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-38:job-45) Asking F5BigIP to release > Nic[18-12-6416c373-20d8-4617-8dcb-30a8ff9d0f34-192.168.56.195] > 2013-04-07 00:35:51,253 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-38:job-45) Asking CiscoNexus1000vVSM to release > Nic[18-12-6416c373-20d8-4617-8dcb-30a8ff9d0f34-192.168.56.195] > 2013-04-07 00:35:51,253 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (Job-Executor-38:job-45) Successfully released network resources for the = vm > VM[User|c18ddf7c-fc61-40b0-af75-fdef05f8eae6] > 2013-04-07 00:35:51,253 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (Job-Executor-38:job-45) Successfully released storage resources for the = vm > VM[User|c18ddf7c-fc61-40b0-af75-fdef05f8eae6] > 2013-04-07 00:35:51,298 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-38:job-45) VM state transitted from :Stopping to Stopped wi= th > event: OperationSucceededvm's original host id: 5 new host id: null host = id > before state transition: 5 > 2013-04-07 00:35:51,302 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-38:job-45) Hosts's actual total CPU: 2479 and CPU after > applying overprovisioning: 2479 > 2013-04-07 00:35:51,303 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-38:job-45) release cpu from host: 5, old used: 100,reserved= : > 0, actual total: 2479, total with overprovisioning: 2479; new used: > 0,reserved:100; movedfromreserved: false,moveToReserveredtrue > 2013-04-07 00:35:51,303 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-38:job-45) release mem from host: 5, old used: > 1073741824,reserved: 0, total: 1671695424; new used: 0,reserved:107374182= 4; > movedfromreserved: false,moveToReserveredtrue > 2013-04-07 00:35:51,308 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-38:job-45) VM state transitted from :Stopped to Destroyed > with event: DestroyRequestedvm's original host id: 5 new host id: null ho= st > id before state transition: null > 2013-04-07 00:35:51,313 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-38:job-45) Hosts's actual total CPU: 2479 and CPU after > applying overprovisioning: 2479 > 2013-04-07 00:35:51,313 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-38:job-45) release cpu from host: 5, old used: 0,reserved: > 100, actual total: 2479, total with overprovisioning: 2479; new used: > 0,reserved:0; movedfromreserved: true,moveToReserveredfalse > 2013-04-07 00:35:51,313 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-38:job-45) release mem from host: 5, old used: 0,reserved: > 1073741824, total: 1671695424; new used: 0,reserved:0; movedfromreserved: > true,moveToReserveredfalse > 2013-04-07 00:35:51,328 DEBUG [cloud.async.AsyncJobManagerImpl] > (Job-Executor-38:job-45) Complete async job-45, jobStatus: 1, resultCode: > 0, result: org.apache.cloudstack.api.response.UserVmResponse@324f6e41 > 2013-04-07 00:35:51,332 DEBUG [cloud.async.AsyncJobManagerImpl] > (Job-Executor-38:job-45) Done executing > org.apache.cloudstack.api.command.user.vm.DestroyVMCmd for job-45 > 2013-04-07 00:35:51,397 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVirtualMachines&id=3D94ddc16f-04fc-4da1-8326-01d8d5cdeb44&= response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165513= 94 > 2013-04-07 00:35:51,417 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVirtualMachines&id=3D94ddc16f-04fc-4da1-8326-01d8d5cdeb44&= response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165513= 94 > 2013-04-07 00:35:51,425 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistOsTypes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&_=3D1365316551423 > 2013-04-07 00:35:51,472 INFO [agent.manager.AgentMonitor] > (Thread-11:null) Found the following agents behind on ping: [6, 5] > 2013-04-07 00:35:51,473 DEBUG [cloud.host.Status] (Thread-11:null) Ping > timeout for host 6, do invstigation > 2013-04-07 00:35:51,475 DEBUG [cloud.host.Status] (Thread-11:null) Ping > timeout for host 5, do invstigation > 2013-04-07 00:35:51,475 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-7:null) Investigating why host 6 has disconnected with eve= nt > PingTimeout > 2013-04-07 00:35:51,475 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-7:null) checking if agent (6) is alive > 2013-04-07 00:35:51,478 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-8:null) Investigating why host 5 has disconnected with eve= nt > PingTimeout > 2013-04-07 00:35:51,478 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-8:null) checking if agent (5) is alive > 2013-04-07 00:35:51,480 DEBUG [agent.transport.Request] > (AgentTaskPool-7:null) Seq 6-324993313: Sending { Cmd , MgmtId: 1, via: = 6, > Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:35:51,481 DEBUG [agent.transport.Request] > (AgentTaskPool-7:null) Seq 6-324993313: Executing: { Cmd , MgmtId: 1, vi= a: > 6, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:35:51,481 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-361:null) Seq 6-324993313: Executing request > 2013-04-07 00:35:51,488 DEBUG [agent.transport.Request] > (AgentTaskPool-8:null) Seq 5-614334818: Sending { Cmd , MgmtId: 1, via: = 5, > Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:35:51,489 DEBUG [agent.transport.Request] > (AgentTaskPool-8:null) Seq 5-614334818: Executing: { Cmd , MgmtId: 1, vi= a: > 5, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:35:51,489 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-290:null) Seq 5-614334818: Executing request > 2013-04-07 00:35:51,556 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-290:null) Seq 5-614334818: Response Received: > 2013-04-07 00:35:51,557 DEBUG [agent.transport.Request] > (DirectAgent-290:null) Seq 5-614334818: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":true,"details":"resource is > alive","wait":0}}] } > 2013-04-07 00:35:51,557 DEBUG [agent.transport.Request] > (AgentTaskPool-8:null) Seq 5-614334818: Received: { Ans: , MgmtId: 1, vi= a: > 5, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-04-07 00:35:51,557 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-8:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is alive > 2013-04-07 00:35:51,557 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-8:null) agent (5) responded to checkHeathCommand, reportin= g > that agent is Up > 2013-04-07 00:35:51,557 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-8:null) The state determined is Up > 2013-04-07 00:35:51,557 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-8:null) Agent is determined to be up and running > 2013-04-07 00:35:51,557 DEBUG [cloud.host.Status] (AgentTaskPool-8:null) > Transition:[Resource state =3D Enabled, Agent event =3D Ping, Host id =3D= 5, name > =3D Tut-XenServer2] > 2013-04-07 00:35:51,563 DEBUG [cloud.host.Status] (AgentTaskPool-8:null) > Agent status update: [id =3D 5; name =3D Tut-XenServer2; old status =3D U= p; event > =3D Ping; new status =3D Up; old update count =3D 149; new update count = =3D 150] > 2013-04-07 00:35:51,568 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-361:null) Seq 6-324993313: Response Received: > 2013-04-07 00:35:51,568 DEBUG [agent.transport.Request] > (DirectAgent-361:null) Seq 6-324993313: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":true,"details":"resource is > alive","wait":0}}] } > 2013-04-07 00:35:51,569 DEBUG [agent.transport.Request] > (AgentTaskPool-7:null) Seq 6-324993313: Received: { Ans: , MgmtId: 1, vi= a: > 6, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-04-07 00:35:51,569 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-7:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is alive > 2013-04-07 00:35:51,569 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-7:null) agent (6) responded to checkHeathCommand, reportin= g > that agent is Up > 2013-04-07 00:35:51,569 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-7:null) The state determined is Up > 2013-04-07 00:35:51,569 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-7:null) Agent is determined to be up and running > 2013-04-07 00:35:51,569 DEBUG [cloud.host.Status] (AgentTaskPool-7:null) > Transition:[Resource state =3D Enabled, Agent event =3D Ping, Host id =3D= 6, name > =3D Tut-XenServer] > 2013-04-07 00:35:51,574 DEBUG [cloud.host.Status] (AgentTaskPool-7:null) > Agent status update: [id =3D 6; name =3D Tut-XenServer; old status =3D Up= ; event > =3D Ping; new status =3D Up; old update count =3D 312; new update count = =3D 313] > 2013-04-07 00:35:51,668 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistOsTypes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&_=3D1365316551423 > 2013-04-07 00:35:54,118 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3D1288fa5b-8b5f-4952-b056-b180437edf= d5&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165= 54116 > 2013-04-07 00:35:54,129 DEBUG [cloud.async.AsyncJobManagerImpl] > (1109449945@qtp-1008805148-34:null) Async job-45 completed > 2013-04-07 00:35:54,135 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3D1288fa5b-8b5f-4952-b056-b180437edf= d5&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165= 54116 > 2013-04-07 00:35:55,077 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DdestroyVirtualMachine&id=3D94ddc16f-04fc-4da1-8326-01d8d5cdeb4= 4&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D136531655= 5075 > 2013-04-07 00:35:55,098 DEBUG [cloud.async.AsyncJobManagerImpl] > (1109449945@qtp-1008805148-34:null) submit async job-46, details: > AsyncJobVO {id:46, userId: 2, accountId: 2, sessionKey: null, instanceTyp= e: > null, instanceId: 13, cmd: > org.apache.cloudstack.api.command.user.vm.DestroyVMCmd, cmdOriginator: > null, cmdInfo: > {"id":"94ddc16f-04fc-4da1-8326-01d8d5cdeb44","response":"json","sessionke= y":"Z6QqzU0Fq1iT13bMgnRRfl8GoVA\u003d","ctxUserId":"2","_":"1365316555075",= "ctxAccountId":"2","ctxStartEventId":"51"}, > cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, > processStatus: 0, resultCode: 0, result: null, initMsid: 1, completeMsid: > null, lastUpdated: null, lastPolled: null, created: null} > 2013-04-07 00:35:55,098 DEBUG [cloud.async.AsyncJobManagerImpl] > (Job-Executor-39:job-46) Executing > org.apache.cloudstack.api.command.user.vm.DestroyVMCmd for job-46 > 2013-04-07 00:35:55,100 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DdestroyVirtualMachine&id=3D94ddc16f-04fc-4da1-8326-01d8d5cdeb4= 4&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D136531655= 5075 > 2013-04-07 00:35:55,113 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (Job-Executor-39:job-46) Destroying vm > VM[User|94ddc16f-04fc-4da1-8326-01d8d5cdeb44] > 2013-04-07 00:35:55,116 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-39:job-46) VM state transitted from :Running to Stopping wi= th > event: StopRequestedvm's original host id: 6 new host id: 6 host id befor= e > state transition: 6 > 2013-04-07 00:35:55,118 DEBUG [agent.transport.Request] > (Job-Executor-39:job-46) Seq 6-324993314: Sending { Cmd , MgmtId: 1, via= : > 6, Ver: v1, Flags: 100111, > [{"StopCommand":{"isProxy":false,"vmName":"i-2-13-VM","wait":0}}] } > 2013-04-07 00:35:55,118 DEBUG [agent.transport.Request] > (Job-Executor-39:job-46) Seq 6-324993314: Executing: { Cmd , MgmtId: 1, > via: 6, Ver: v1, Flags: 100111, > [{"StopCommand":{"isProxy":false,"vmName":"i-2-13-VM","wait":0}}] } > 2013-04-07 00:35:55,118 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-7:null) Seq 6-324993314: Executing request > 2013-04-07 00:35:55,216 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-7:null) 9. The VM i-2-13-VM is in Stopping state > 2013-04-07 00:35:55,532 INFO [xen.resource.CitrixResourceBase] > (DirectAgent-7:null) Removed network rules for vm i-2-13-VM > 2013-04-07 00:35:58,107 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3D042967f3-4fd4-4bcf-a646-999eeca872= 35&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165= 58105 > 2013-04-07 00:35:58,121 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3D042967f3-4fd4-4bcf-a646-999eeca872= 35&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165= 58105 > 2013-04-07 00:36:01,107 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3D042967f3-4fd4-4bcf-a646-999eeca872= 35&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165= 61105 > 2013-04-07 00:36:01,121 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3D042967f3-4fd4-4bcf-a646-999eeca872= 35&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165= 61105 > 2013-04-07 00:36:04,108 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3D042967f3-4fd4-4bcf-a646-999eeca872= 35&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165= 64106 > 2013-04-07 00:36:04,128 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3D042967f3-4fd4-4bcf-a646-999eeca872= 35&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165= 64106 > 2013-04-07 00:36:04,783 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-7:null) 10. The VM i-2-13-VM is in Stopped state > 2013-04-07 00:36:04,783 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-7:null) Seq 6-324993314: Response Received: > 2013-04-07 00:36:04,783 DEBUG [agent.transport.Request] > (DirectAgent-7:null) Seq 6-324993314: Processing: { Ans: , MgmtId: 1, vi= a: > 6, Ver: v1, Flags: 110, > [{"StopAnswer":{"vncPort":0,"result":true,"details":"Stop VM i-2-13-VM > Succeed","wait":0}}] } > 2013-04-07 00:36:04,783 DEBUG [agent.transport.Request] > (Job-Executor-39:job-46) Seq 6-324993314: Received: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 110, { StopAnswer } } > 2013-04-07 00:36:04,783 DEBUG [agent.manager.AgentAttache] > (DirectAgent-7:null) Seq 6-324993314: No more commands found > 2013-04-07 00:36:04,784 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (Job-Executor-39:job-46) VM[User|94ddc16f-04fc-4da1-8326-01d8d5cdeb44] is > stopped on the host. Proceeding to release resource held. > 2013-04-07 00:36:04,793 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-39:job-46) Changing active number of nics for network id=3D= 204 > on -1 > 2013-04-07 00:36:04,794 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-39:job-46) Asking ElasticLoadBalancerElement to release > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:36:04,794 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-39:job-46) Asking NiciraNvpElement to release > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:36:04,795 DEBUG [network.element.NiciraNvpElement] > (Job-Executor-39:job-46) Checking if NiciraNvpElement can handle service > Connectivity on network guestNetworkForBasicZone > 2013-04-07 00:36:04,795 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-39:job-46) Asking BigSwitchVnsElement to release > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:36:04,795 DEBUG [network.element.BigSwitchVnsElement] > (Job-Executor-39:job-46) Checking if BigSwitchVnsElement can handle servi= ce > Connectivity on network guestNetworkForBasicZone > 2013-04-07 00:36:04,795 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-39:job-46) Asking Ovs to release > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:36:04,795 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-39:job-46) Asking BareMetalDhcp to release > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:36:04,795 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-39:job-46) Asking BareMetalPxe to release > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:36:04,795 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-39:job-46) Asking BareMetalUserdata to release > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:36:04,795 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-39:job-46) Asking SecurityGroupProvider to release > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:36:04,795 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-39:job-46) Asking VirtualRouter to release > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:36:04,795 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-39:job-46) Asking VpcVirtualRouter to release > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:36:04,795 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-39:job-46) Asking NiciraNvp to release > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:36:04,795 DEBUG [network.element.NiciraNvpElement] > (Job-Executor-39:job-46) Checking if NiciraNvpElement can handle service > Connectivity on network guestNetworkForBasicZone > 2013-04-07 00:36:04,795 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-39:job-46) Asking JuniperSRX to release > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:36:04,795 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-39:job-46) Asking Netscaler to release > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:36:04,795 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-39:job-46) Asking F5BigIP to release > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:36:04,795 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-39:job-46) Asking CiscoNexus1000vVSM to release > Nic[19-13-a8349669-6ff2-443f-88d3-c5d69100df3a-192.168.56.146] > 2013-04-07 00:36:04,795 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (Job-Executor-39:job-46) Successfully released network resources for the = vm > VM[User|94ddc16f-04fc-4da1-8326-01d8d5cdeb44] > 2013-04-07 00:36:04,795 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (Job-Executor-39:job-46) Successfully released storage resources for the = vm > VM[User|94ddc16f-04fc-4da1-8326-01d8d5cdeb44] > 2013-04-07 00:36:04,836 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-39:job-46) VM state transitted from :Stopping to Stopped wi= th > event: OperationSucceededvm's original host id: 6 new host id: null host = id > before state transition: 6 > 2013-04-07 00:36:04,843 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-39:job-46) Hosts's actual total CPU: 2382 and CPU after > applying overprovisioning: 2382 > 2013-04-07 00:36:04,844 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-39:job-46) release cpu from host: 6, old used: 200,reserved= : > 0, actual total: 2382, total with overprovisioning: 2382; new used: > 100,reserved:100; movedfromreserved: false,moveToReserveredtrue > 2013-04-07 00:36:04,844 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-39:job-46) release mem from host: 6, old used: > 1178599424,reserved: 0, total: 1671695424; new used: > 104857600,reserved:1073741824; movedfromreserved: false,moveToReserveredt= rue > 2013-04-07 00:36:04,854 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-39:job-46) VM state transitted from :Stopped to Destroyed > with event: DestroyRequestedvm's original host id: 6 new host id: null ho= st > id before state transition: null > 2013-04-07 00:36:04,863 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-39:job-46) Hosts's actual total CPU: 2382 and CPU after > applying overprovisioning: 2382 > 2013-04-07 00:36:04,863 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-39:job-46) release cpu from host: 6, old used: 100,reserved= : > 100, actual total: 2382, total with overprovisioning: 2382; new used: > 100,reserved:0; movedfromreserved: true,moveToReserveredfalse > 2013-04-07 00:36:04,863 DEBUG [cloud.capacity.CapacityManagerImpl] > (Job-Executor-39:job-46) release mem from host: 6, old used: > 104857600,reserved: 1073741824, total: 1671695424; new used: > 104857600,reserved:0; movedfromreserved: true,moveToReserveredfalse > 2013-04-07 00:36:04,892 DEBUG [cloud.async.AsyncJobManagerImpl] > (Job-Executor-39:job-46) Complete async job-46, jobStatus: 1, resultCode: > 0, result: org.apache.cloudstack.api.response.UserVmResponse@519ba6bb > 2013-04-07 00:36:04,897 DEBUG [cloud.async.AsyncJobManagerImpl] > (Job-Executor-39:job-46) Done executing > org.apache.cloudstack.api.command.user.vm.DestroyVMCmd for job-46 > 2013-04-07 00:36:04,949 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-410:null) Ping from 6 > 2013-04-07 00:36:06,058 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-234:null) Ping from 5 > 2013-04-07 00:36:06,909 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-407:null) Seq 6-324993028: Executing request > 2013-04-07 00:36:07,097 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-407:null) VM missing i-2-13-VM old state stopped so removing= . > 2013-04-07 00:36:07,098 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-407:null) VM missing i-2-12-VM old state stopped so removing= . > 2013-04-07 00:36:07,098 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-407:null) Seq 6-324993028: Response Received: > 2013-04-07 00:36:07,098 DEBUG [agent.transport.Request] > (DirectAgent-407:null) Seq 6-324993028: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, > [{"ClusterSyncAnswer":{"_clusterId":2,"_newStates":{},"_isExecuted":false= ,"result":true,"wait":0}}] > } > 2013-04-07 00:36:07,109 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DqueryAsyncJobResult&jobId=3D042967f3-4fd4-4bcf-a646-999eeca872= 35&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165= 67107 > 2013-04-07 00:36:07,119 DEBUG [cloud.async.AsyncJobManagerImpl] > (1109449945@qtp-1008805148-34:null) Async job-46 completed > 2013-04-07 00:36:07,125 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DqueryAsyncJobResult&jobId=3D042967f3-4fd4-4bcf-a646-999eeca872= 35&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoVA%3D&_=3D13653165= 67107 > 2013-04-07 00:36:11,022 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-110:null) Seq 5-614334468: Executing request > 2013-04-07 00:36:11,171 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-110:null) Seq 5-614334468: Response Received: > 2013-04-07 00:36:11,171 DEBUG [agent.transport.Request] > (DirectAgent-110:null) Seq 5-614334468: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, [{"Answer":{"result":true,"wait":0}}] } > 2013-04-07 00:36:12,411 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVolumes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316572408 > 2013-04-07 00:36:12,426 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVolumes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316572408 > 2013-04-07 00:36:13,241 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316573239 > 2013-04-07 00:36:13,259 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316573239 > 2013-04-07 00:36:19,140 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVolumes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316579137 > 2013-04-07 00:36:19,155 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVolumes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316579137 > 2013-04-07 00:36:20,452 DEBUG > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone = 1 > is ready to launch secondary storage VM > 2013-04-07 00:36:20,498 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316580496 > 2013-04-07 00:36:20,519 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316580496 > 2013-04-07 00:36:20,554 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl= ] > (consoleproxy-1:null) Zone 1 is ready to launch console proxy > 2013-04-07 00:36:20,820 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:36:20,821 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:36:20,850 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:36:20,852 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:36:21,588 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVolumes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316581586 > 2013-04-07 00:36:21,602 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVolumes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316581586 > 2013-04-07 00:36:22,324 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316582321 > 2013-04-07 00:36:22,348 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316582321 > 2013-04-07 00:36:24,891 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-4:null) Ping from 4 > 2013-04-07 00:36:27,193 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-204:null) Ping from 1 > 2013-04-07 00:36:29,095 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-277:null) Seq 1-90046472: Executing request > 2013-04-07 00:36:29,354 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-277:null) Seq 1-90046472: Response Received: > 2013-04-07 00:36:29,355 DEBUG [agent.transport.Request] > (DirectAgent-277:null) Seq 1-90046472: Processing: { Ans: , MgmtId: 1, > via: 1, Ver: v1, Flags: 10, > [{"ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false= ,"result":true,"wait":0}}] > } > 2013-04-07 00:36:47,680 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-5:null) Ping from 3 > 2013-04-07 00:36:50,451 DEBUG > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone = 1 > is ready to launch secondary storage VM > 2013-04-07 00:36:50,554 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl= ] > (consoleproxy-1:null) Zone 1 is ready to launch console proxy > 2013-04-07 00:36:50,820 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:36:50,821 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:36:50,851 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:36:50,852 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:36:51,476 INFO [agent.manager.AgentMonitor] > (Thread-11:null) Found the following agents behind on ping: [6, 5] > 2013-04-07 00:36:51,477 DEBUG [cloud.host.Status] (Thread-11:null) Ping > timeout for host 6, do invstigation > 2013-04-07 00:36:51,479 DEBUG [cloud.host.Status] (Thread-11:null) Ping > timeout for host 5, do invstigation > 2013-04-07 00:36:51,479 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-9:null) Investigating why host 6 has disconnected with eve= nt > PingTimeout > 2013-04-07 00:36:51,479 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-9:null) checking if agent (6) is alive > 2013-04-07 00:36:51,482 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-12:null) Investigating why host 5 has disconnected with > event PingTimeout > 2013-04-07 00:36:51,482 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-12:null) checking if agent (5) is alive > 2013-04-07 00:36:51,483 DEBUG [agent.transport.Request] > (AgentTaskPool-9:null) Seq 6-324993315: Sending { Cmd , MgmtId: 1, via: = 6, > Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:36:51,484 DEBUG [agent.transport.Request] > (AgentTaskPool-9:null) Seq 6-324993315: Executing: { Cmd , MgmtId: 1, vi= a: > 6, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:36:51,484 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-169:null) Seq 6-324993315: Executing request > 2013-04-07 00:36:51,485 DEBUG [agent.transport.Request] > (AgentTaskPool-12:null) Seq 5-614334819: Sending { Cmd , MgmtId: 1, via: > 5, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:36:51,485 DEBUG [agent.transport.Request] > (AgentTaskPool-12:null) Seq 5-614334819: Executing: { Cmd , MgmtId: 1, > via: 5, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:36:51,485 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-498:null) Seq 5-614334819: Executing request > 2013-04-07 00:36:51,542 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-169:null) Seq 6-324993315: Response Received: > 2013-04-07 00:36:51,542 DEBUG [agent.transport.Request] > (DirectAgent-169:null) Seq 6-324993315: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":true,"details":"resource is > alive","wait":0}}] } > 2013-04-07 00:36:51,542 DEBUG [agent.transport.Request] > (AgentTaskPool-9:null) Seq 6-324993315: Received: { Ans: , MgmtId: 1, vi= a: > 6, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-04-07 00:36:51,542 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-9:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is alive > 2013-04-07 00:36:51,542 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-9:null) agent (6) responded to checkHeathCommand, reportin= g > that agent is Up > 2013-04-07 00:36:51,542 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-9:null) The state determined is Up > 2013-04-07 00:36:51,542 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-9:null) Agent is determined to be up and running > 2013-04-07 00:36:51,542 DEBUG [cloud.host.Status] (AgentTaskPool-9:null) > Transition:[Resource state =3D Enabled, Agent event =3D Ping, Host id =3D= 6, name > =3D Tut-XenServer] > 2013-04-07 00:36:51,546 DEBUG [cloud.host.Status] (AgentTaskPool-9:null) > Agent status update: [id =3D 6; name =3D Tut-XenServer; old status =3D Up= ; event > =3D Ping; new status =3D Up; old update count =3D 313; new update count = =3D 314] > 2013-04-07 00:36:51,549 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-498:null) Seq 5-614334819: Response Received: > 2013-04-07 00:36:51,549 DEBUG [agent.transport.Request] > (DirectAgent-498:null) Seq 5-614334819: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":true,"details":"resource is > alive","wait":0}}] } > 2013-04-07 00:36:51,549 DEBUG [agent.transport.Request] > (AgentTaskPool-12:null) Seq 5-614334819: Received: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-04-07 00:36:51,549 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-12:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is alive > 2013-04-07 00:36:51,549 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-12:null) agent (5) responded to checkHeathCommand, reporti= ng > that agent is Up > 2013-04-07 00:36:51,549 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-12:null) The state determined is Up > 2013-04-07 00:36:51,549 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-12:null) Agent is determined to be up and running > 2013-04-07 00:36:51,549 DEBUG [cloud.host.Status] (AgentTaskPool-12:null) > Transition:[Resource state =3D Enabled, Agent event =3D Ping, Host id =3D= 5, name > =3D Tut-XenServer2] > 2013-04-07 00:36:51,552 DEBUG [cloud.host.Status] (AgentTaskPool-12:null) > Agent status update: [id =3D 5; name =3D Tut-XenServer2; old status =3D U= p; event > =3D Ping; new status =3D Up; old update count =3D 150; new update count = =3D 151] > 2013-04-07 00:36:54,389 INFO [cloud.vm.UserVmManagerImpl] > (UserVm-Scavenger-1:null) Found 1 vms to expunge. > 2013-04-07 00:36:54,389 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (UserVm-Scavenger-1:null) Stopped called on > VM[User|c18ddf7c-fc61-40b0-af75-fdef05f8eae6] but the state is Destroyed > 2013-04-07 00:36:54,391 DEBUG [cloud.capacity.CapacityManagerImpl] > (UserVm-Scavenger-1:null) VM state transitted from :Destroyed to Expungin= g > with event: ExpungeOperationvm's original host id: 5 new host id: null ho= st > id before state transition: null > 2013-04-07 00:36:54,391 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (UserVm-Scavenger-1:null) Destroying vm > VM[User|c18ddf7c-fc61-40b0-af75-fdef05f8eae6] > 2013-04-07 00:36:54,391 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (UserVm-Scavenger-1:null) Cleaning up NICS > 2013-04-07 00:36:54,391 DEBUG [cloud.network.NetworkManagerImpl] > (UserVm-Scavenger-1:null) Cleaning network for vm: 12 > 2013-04-07 00:36:54,399 DEBUG [network.guru.DirectNetworkGuru] > (UserVm-Scavenger-1:null) Deallocate network: networkId: 204, ip: > 192.168.56.195 > 2013-04-07 00:36:54,409 DEBUG [cloud.network.NetworkManagerImpl] > (UserVm-Scavenger-1:null) Removed nic id=3D18 > 2013-04-07 00:36:54,409 DEBUG [cloud.storage.StorageManagerImpl] > (UserVm-Scavenger-1:null) Cleaning storage for vm: 12 > 2013-04-07 00:36:54,417 DEBUG [cloud.storage.StorageManagerImpl] > (UserVm-Scavenger-1:null) Expunging Vol[12|vm=3D12|ROOT] > 2013-04-07 00:36:54,424 DEBUG [agent.transport.Request] > (UserVm-Scavenger-1:null) Seq 5-614334820: Sending { Cmd , MgmtId: 1, vi= a: > 5, Ver: v1, Flags: 100111, > [{"storage.DestroyCommand":{"vmName":"i-2-12-VM","volume":{"id":12,"name"= :"ROOT-12","mountPoint":"/iSCSI_SR_3","path":"40a39639-e8aa-45b5-bfa1-591b6= 8571d0c","size":52428800,"type":"ROOT","storagePoolType":"PreSetup","storag= ePoolUuid":"iSCSI_SR_3","deviceId":0},"wait":0}}] > } > 2013-04-07 00:36:54,424 DEBUG [agent.transport.Request] > (UserVm-Scavenger-1:null) Seq 5-614334820: Executing: { Cmd , MgmtId: 1, > via: 5, Ver: v1, Flags: 100111, > [{"storage.DestroyCommand":{"vmName":"i-2-12-VM","volume":{"id":12,"name"= :"ROOT-12","mountPoint":"/iSCSI_SR_3","path":"40a39639-e8aa-45b5-bfa1-591b6= 8571d0c","size":52428800,"type":"ROOT","storagePoolType":"PreSetup","storag= ePoolUuid":"iSCSI_SR_3","deviceId":0},"wait":0}}] > } > 2013-04-07 00:36:54,424 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-411:null) Seq 5-614334820: Executing request > 2013-04-07 00:36:55,072 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-411:null) Seq 5-614334820: Response Received: > 2013-04-07 00:36:55,072 DEBUG [agent.transport.Request] > (DirectAgent-411:null) Seq 5-614334820: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 110, > [{"Answer":{"result":true,"details":"Success","wait":0}}] } > 2013-04-07 00:36:55,072 DEBUG [agent.transport.Request] > (UserVm-Scavenger-1:null) Seq 5-614334820: Received: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 110, { Answer } } > 2013-04-07 00:36:55,072 DEBUG [agent.manager.AgentAttache] > (DirectAgent-411:null) Seq 5-614334820: No more commands found > 2013-04-07 00:36:55,076 DEBUG [cloud.storage.StorageManagerImpl] > (UserVm-Scavenger-1:null) Volume successfully expunged from 257 > 2013-04-07 00:36:55,076 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (UserVm-Scavenger-1:null) Expunged > VM[User|c18ddf7c-fc61-40b0-af75-fdef05f8eae6] > 2013-04-07 00:36:55,076 DEBUG [cloud.vm.UserVmManagerImpl] > (UserVm-Scavenger-1:null) Starting cleaning up vm > VM[User|c18ddf7c-fc61-40b0-af75-fdef05f8eae6] resources... > 2013-04-07 00:36:55,080 INFO [network.security.SecurityGroupManagerImpl] > (UserVm-Scavenger-1:null) Disassociated 1 network groups from uservm 12 > 2013-04-07 00:36:55,081 DEBUG [network.security.SecurityGroupManagerImpl] > (UserVm-Scavenger-1:null) Security group mappings are removed successfull= y > for vm id=3D12 > 2013-04-07 00:36:55,090 DEBUG [network.firewall.FirewallManagerImpl] > (UserVm-Scavenger-1:null) No firewall rules are found for vm id=3D12 > 2013-04-07 00:36:55,090 DEBUG [cloud.vm.UserVmManagerImpl] > (UserVm-Scavenger-1:null) Firewall rules are removed successfully as a pa= rt > of vm id=3D12 expunge > 2013-04-07 00:36:55,093 DEBUG [network.rules.RulesManagerImpl] > (UserVm-Scavenger-1:null) No port forwarding rules are found for vm id=3D= 12 > 2013-04-07 00:36:55,093 DEBUG [cloud.vm.UserVmManagerImpl] > (UserVm-Scavenger-1:null) Port forwarding rules are removed successfully = as > a part of vm id=3D12 expunge > 2013-04-07 00:36:55,095 DEBUG [cloud.vm.UserVmManagerImpl] > (UserVm-Scavenger-1:null) Removed vm id=3D12 from all load balancers as a > part of expunge process > 2013-04-07 00:36:55,096 DEBUG [cloud.vm.UserVmManagerImpl] > (UserVm-Scavenger-1:null) Successfully cleaned up vm > VM[User|c18ddf7c-fc61-40b0-af75-fdef05f8eae6] resources as a part of > expunge process > 2013-04-07 00:37:04,802 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-110:null) Ping from 6 > 2013-04-07 00:37:06,042 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-409:null) Ping from 5 > 2013-04-07 00:37:06,909 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-239:null) Seq 6-324993028: Executing request > 2013-04-07 00:37:07,099 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-239:null) Seq 6-324993028: Response Received: > 2013-04-07 00:37:07,100 DEBUG [agent.transport.Request] > (DirectAgent-239:null) Seq 6-324993028: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, > [{"ClusterSyncAnswer":{"_clusterId":2,"_newStates":{},"_isExecuted":false= ,"result":true,"wait":0}}] > } > 2013-04-07 00:37:11,022 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-225:null) Seq 5-614334468: Executing request > 2013-04-07 00:37:11,170 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-225:null) Seq 5-614334468: Response Received: > 2013-04-07 00:37:11,171 DEBUG [agent.transport.Request] > (DirectAgent-225:null) Seq 5-614334468: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, [{"Answer":{"result":true,"wait":0}}] } > 2013-04-07 00:37:20,451 DEBUG > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone = 1 > is ready to launch secondary storage VM > 2013-04-07 00:37:20,554 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl= ] > (consoleproxy-1:null) Zone 1 is ready to launch console proxy > 2013-04-07 00:37:20,820 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:37:20,822 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:37:20,851 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:37:20,852 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:37:24,890 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-6:null) Ping from 4 > 2013-04-07 00:37:27,167 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-354:null) Ping from 1 > 2013-04-07 00:37:29,095 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-97:null) Seq 1-90046472: Executing request > 2013-04-07 00:37:29,317 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-97:null) Seq 1-90046472: Response Received: > 2013-04-07 00:37:29,317 DEBUG [agent.transport.Request] > (DirectAgent-97:null) Seq 1-90046472: Processing: { Ans: , MgmtId: 1, vi= a: > 1, Ver: v1, Flags: 10, > [{"ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false= ,"result":true,"wait":0}}] > } > 2013-04-07 00:37:47,679 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-7:null) Ping from 3 > 2013-04-07 00:37:50,451 DEBUG > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone = 1 > is ready to launch secondary storage VM > 2013-04-07 00:37:50,555 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl= ] > (consoleproxy-1:null) Zone 1 is ready to launch console proxy > 2013-04-07 00:37:50,798 INFO [cloud.ha.HighAvailabilityManagerImpl] > (HA-2:null) checking health of usage server > 2013-04-07 00:37:50,799 DEBUG [cloud.ha.HighAvailabilityManagerImpl] > (HA-2:null) usage server running? false, heartbeat: null > 2013-04-07 00:37:50,801 DEBUG [cloud.alert.AlertManagerImpl] (HA-2:null) > Have already sent: 1 emails for alert type '12' -- skipping send email > 2013-04-07 00:37:50,816 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] (RouterMonitor-1:null= ) > Found 0 running routers. > 2013-04-07 00:37:50,820 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:37:50,821 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:37:50,850 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] (RouterMonitor-1:null= ) > Found 0 running routers. > 2013-04-07 00:37:50,851 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:37:50,852 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:37:50,909 DEBUG > [cloud.network.ExternalLoadBalancerUsageManagerImpl] > (ExternalNetworkMonitor-1:null) External devices stats collector is > running... > 2013-04-07 00:37:50,920 DEBUG [storage.snapshot.SnapshotSchedulerImpl] > (SnapshotPollTask:null) Snapshot scheduler.poll is being called at > 2013-04-07 06:37:50 GMT > 2013-04-07 00:37:50,921 DEBUG [storage.snapshot.SnapshotSchedulerImpl] > (SnapshotPollTask:null) Got 0 snapshots to be executed at 2013-04-07 > 06:37:50 GMT > 2013-04-07 00:37:51,480 INFO [agent.manager.AgentMonitor] > (Thread-11:null) Found the following agents behind on ping: [6, 5] > 2013-04-07 00:37:51,481 DEBUG [cloud.host.Status] (Thread-11:null) Ping > timeout for host 6, do invstigation > 2013-04-07 00:37:51,482 DEBUG [cloud.host.Status] (Thread-11:null) Ping > timeout for host 5, do invstigation > 2013-04-07 00:37:51,483 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-10:null) Investigating why host 6 has disconnected with > event PingTimeout > 2013-04-07 00:37:51,483 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-10:null) checking if agent (6) is alive > 2013-04-07 00:37:51,484 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-13:null) Investigating why host 5 has disconnected with > event PingTimeout > 2013-04-07 00:37:51,484 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-13:null) checking if agent (5) is alive > 2013-04-07 00:37:51,486 DEBUG [agent.transport.Request] > (AgentTaskPool-10:null) Seq 6-324993316: Sending { Cmd , MgmtId: 1, via: > 6, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:37:51,486 DEBUG [agent.transport.Request] > (AgentTaskPool-10:null) Seq 6-324993316: Executing: { Cmd , MgmtId: 1, > via: 6, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:37:51,486 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-303:null) Seq 6-324993316: Executing request > 2013-04-07 00:37:51,488 DEBUG [agent.transport.Request] > (AgentTaskPool-13:null) Seq 5-614334821: Sending { Cmd , MgmtId: 1, via: > 5, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:37:51,488 DEBUG [agent.transport.Request] > (AgentTaskPool-13:null) Seq 5-614334821: Executing: { Cmd , MgmtId: 1, > via: 5, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:37:51,488 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-158:null) Seq 5-614334821: Executing request > 2013-04-07 00:37:51,537 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-303:null) Seq 6-324993316: Response Received: > 2013-04-07 00:37:51,538 DEBUG [agent.transport.Request] > (DirectAgent-303:null) Seq 6-324993316: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":true,"details":"resource is > alive","wait":0}}] } > 2013-04-07 00:37:51,538 DEBUG [agent.transport.Request] > (AgentTaskPool-10:null) Seq 6-324993316: Received: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-04-07 00:37:51,538 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-10:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is alive > 2013-04-07 00:37:51,538 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-10:null) agent (6) responded to checkHeathCommand, reporti= ng > that agent is Up > 2013-04-07 00:37:51,538 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-10:null) The state determined is Up > 2013-04-07 00:37:51,538 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-10:null) Agent is determined to be up and running > 2013-04-07 00:37:51,538 DEBUG [cloud.host.Status] (AgentTaskPool-10:null) > Transition:[Resource state =3D Enabled, Agent event =3D Ping, Host id =3D= 6, name > =3D Tut-XenServer] > 2013-04-07 00:37:51,541 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-158:null) Seq 5-614334821: Response Received: > 2013-04-07 00:37:51,541 DEBUG [agent.transport.Request] > (DirectAgent-158:null) Seq 5-614334821: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":true,"details":"resource is > alive","wait":0}}] } > 2013-04-07 00:37:51,541 DEBUG [agent.transport.Request] > (AgentTaskPool-13:null) Seq 5-614334821: Received: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-04-07 00:37:51,541 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-13:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is alive > 2013-04-07 00:37:51,541 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-13:null) agent (5) responded to checkHeathCommand, reporti= ng > that agent is Up > 2013-04-07 00:37:51,541 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-13:null) The state determined is Up > 2013-04-07 00:37:51,541 DEBUG [cloud.host.Status] (AgentTaskPool-10:null) > Agent status update: [id =3D 6; name =3D Tut-XenServer; old status =3D Up= ; event > =3D Ping; new status =3D Up; old update count =3D 314; new update count = =3D 315] > 2013-04-07 00:37:51,541 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-13:null) Agent is determined to be up and running > 2013-04-07 00:37:51,541 DEBUG [cloud.host.Status] (AgentTaskPool-13:null) > Transition:[Resource state =3D Enabled, Agent event =3D Ping, Host id =3D= 5, name > =3D Tut-XenServer2] > 2013-04-07 00:37:51,544 DEBUG [cloud.host.Status] (AgentTaskPool-13:null) > Agent status update: [id =3D 5; name =3D Tut-XenServer2; old status =3D U= p; event > =3D Ping; new status =3D Up; old update count =3D 151; new update count = =3D 152] > 2013-04-07 00:37:55,103 INFO [cloud.vm.UserVmManagerImpl] > (UserVm-Scavenger-1:null) Found 1 vms to expunge. > 2013-04-07 00:37:55,103 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (UserVm-Scavenger-1:null) Stopped called on > VM[User|94ddc16f-04fc-4da1-8326-01d8d5cdeb44] but the state is Destroyed > 2013-04-07 00:37:55,105 DEBUG [cloud.capacity.CapacityManagerImpl] > (UserVm-Scavenger-1:null) VM state transitted from :Destroyed to Expungin= g > with event: ExpungeOperationvm's original host id: 6 new host id: null ho= st > id before state transition: null > 2013-04-07 00:37:55,105 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (UserVm-Scavenger-1:null) Destroying vm > VM[User|94ddc16f-04fc-4da1-8326-01d8d5cdeb44] > 2013-04-07 00:37:55,105 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (UserVm-Scavenger-1:null) Cleaning up NICS > 2013-04-07 00:37:55,105 DEBUG [cloud.network.NetworkManagerImpl] > (UserVm-Scavenger-1:null) Cleaning network for vm: 13 > 2013-04-07 00:37:55,113 DEBUG [network.guru.DirectNetworkGuru] > (UserVm-Scavenger-1:null) Deallocate network: networkId: 204, ip: > 192.168.56.146 > 2013-04-07 00:37:55,124 DEBUG [cloud.network.NetworkManagerImpl] > (UserVm-Scavenger-1:null) Removed nic id=3D19 > 2013-04-07 00:37:55,124 DEBUG [cloud.storage.StorageManagerImpl] > (UserVm-Scavenger-1:null) Cleaning storage for vm: 13 > 2013-04-07 00:37:55,132 DEBUG [cloud.storage.StorageManagerImpl] > (UserVm-Scavenger-1:null) Expunging Vol[13|vm=3D13|ROOT] > 2013-04-07 00:37:55,139 DEBUG [agent.transport.Request] > (UserVm-Scavenger-1:null) Seq 6-324993317: Sending { Cmd , MgmtId: 1, vi= a: > 6, Ver: v1, Flags: 100111, > [{"storage.DestroyCommand":{"vmName":"i-2-13-VM","volume":{"id":13,"name"= :"ROOT-13","mountPoint":"/iSCSI_SR_3","path":"99154d9c-2665-465d-8c71-e60f1= 748895b","size":52428800,"type":"ROOT","storagePoolType":"PreSetup","storag= ePoolUuid":"iSCSI_SR_3","deviceId":0},"wait":0}}] > } > 2013-04-07 00:37:55,140 DEBUG [agent.transport.Request] > (UserVm-Scavenger-1:null) Seq 6-324993317: Executing: { Cmd , MgmtId: 1, > via: 6, Ver: v1, Flags: 100111, > [{"storage.DestroyCommand":{"vmName":"i-2-13-VM","volume":{"id":13,"name"= :"ROOT-13","mountPoint":"/iSCSI_SR_3","path":"99154d9c-2665-465d-8c71-e60f1= 748895b","size":52428800,"type":"ROOT","storagePoolType":"PreSetup","storag= ePoolUuid":"iSCSI_SR_3","deviceId":0},"wait":0}}] > } > 2013-04-07 00:37:55,140 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-87:null) Seq 6-324993317: Executing request > 2013-04-07 00:37:55,724 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-87:null) Seq 6-324993317: Response Received: > 2013-04-07 00:37:55,724 DEBUG [agent.transport.Request] > (DirectAgent-87:null) Seq 6-324993317: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 110, > [{"Answer":{"result":true,"details":"Success","wait":0}}] } > 2013-04-07 00:37:55,724 DEBUG [agent.manager.AgentAttache] > (DirectAgent-87:null) Seq 6-324993317: No more commands found > 2013-04-07 00:37:55,724 DEBUG [agent.transport.Request] > (UserVm-Scavenger-1:null) Seq 6-324993317: Received: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 110, { Answer } } > 2013-04-07 00:37:55,727 DEBUG [cloud.storage.StorageManagerImpl] > (UserVm-Scavenger-1:null) Volume successfully expunged from 257 > 2013-04-07 00:37:55,727 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (UserVm-Scavenger-1:null) Expunged > VM[User|94ddc16f-04fc-4da1-8326-01d8d5cdeb44] > 2013-04-07 00:37:55,727 DEBUG [cloud.vm.UserVmManagerImpl] > (UserVm-Scavenger-1:null) Starting cleaning up vm > VM[User|94ddc16f-04fc-4da1-8326-01d8d5cdeb44] resources... > 2013-04-07 00:37:55,730 INFO [network.security.SecurityGroupManagerImpl] > (UserVm-Scavenger-1:null) Disassociated 1 network groups from uservm 13 > 2013-04-07 00:37:55,732 DEBUG [network.security.SecurityGroupManagerImpl] > (UserVm-Scavenger-1:null) Security group mappings are removed successfull= y > for vm id=3D13 > 2013-04-07 00:37:55,736 DEBUG [network.firewall.FirewallManagerImpl] > (UserVm-Scavenger-1:null) No firewall rules are found for vm id=3D13 > 2013-04-07 00:37:55,737 DEBUG [cloud.vm.UserVmManagerImpl] > (UserVm-Scavenger-1:null) Firewall rules are removed successfully as a pa= rt > of vm id=3D13 expunge > 2013-04-07 00:37:55,739 DEBUG [network.rules.RulesManagerImpl] > (UserVm-Scavenger-1:null) No port forwarding rules are found for vm id=3D= 13 > 2013-04-07 00:37:55,739 DEBUG [cloud.vm.UserVmManagerImpl] > (UserVm-Scavenger-1:null) Port forwarding rules are removed successfully = as > a part of vm id=3D13 expunge > 2013-04-07 00:37:55,740 DEBUG [cloud.vm.UserVmManagerImpl] > (UserVm-Scavenger-1:null) Removed vm id=3D13 from all load balancers as a > part of expunge process > 2013-04-07 00:37:55,741 DEBUG [cloud.vm.UserVmManagerImpl] > (UserVm-Scavenger-1:null) Successfully cleaned up vm > VM[User|94ddc16f-04fc-4da1-8326-01d8d5cdeb44] resources as a part of > expunge process > 2013-04-07 00:38:04,813 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-442:null) Ping from 6 > 2013-04-07 00:38:06,064 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-374:null) Ping from 5 > 2013-04-07 00:38:06,909 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-157:null) Seq 6-324993028: Executing request > 2013-04-07 00:38:07,099 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-157:null) Seq 6-324993028: Response Received: > 2013-04-07 00:38:07,100 DEBUG [agent.transport.Request] > (DirectAgent-157:null) Seq 6-324993028: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, > [{"ClusterSyncAnswer":{"_clusterId":2,"_newStates":{},"_isExecuted":false= ,"result":true,"wait":0}}] > } > 2013-04-07 00:38:11,022 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-192:null) Seq 5-614334468: Executing request > 2013-04-07 00:38:11,181 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-192:null) Seq 5-614334468: Response Received: > 2013-04-07 00:38:11,181 DEBUG [agent.transport.Request] > (DirectAgent-192:null) Seq 5-614334468: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, [{"Answer":{"result":true,"wait":0}}] } > 2013-04-07 00:38:20,455 DEBUG > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone = 1 > is ready to launch secondary storage VM > 2013-04-07 00:38:20,573 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl= ] > (consoleproxy-1:null) Zone 1 is ready to launch console proxy > 2013-04-07 00:38:20,820 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:38:20,821 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:38:20,851 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:38:20,853 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:38:20,921 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Running Capacity Checker ... > 2013-04-07 00:38:20,921 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) recalculating system capacity > 2013-04-07 00:38:20,921 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Executing cpu/ram capacity update > 2013-04-07 00:38:20,931 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) Found 2 VMs on host 1 > 2013-04-07 00:38:20,932 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) Found 0 VM, not running on host 1 > 2013-04-07 00:38:20,935 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) No need to calibrate cpu capacity, host:1 usedCpu: > 200 reservedCpu: 0 > 2013-04-07 00:38:20,935 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) No need to calibrate memory capacity, host:1 > usedMem: 209715200 reservedMem: 0 > 2013-04-07 00:38:20,940 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) Found 0 VMs on host 5 > 2013-04-07 00:38:20,941 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) Found 0 VM, not running on host 5 > 2013-04-07 00:38:20,944 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) No need to calibrate cpu capacity, host:5 usedCpu:= 0 > reservedCpu: 0 > 2013-04-07 00:38:20,944 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) No need to calibrate memory capacity, host:5 > usedMem: 0 reservedMem: 0 > 2013-04-07 00:38:20,950 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) Found 1 VMs on host 6 > 2013-04-07 00:38:20,951 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) Found 0 VM, not running on host 6 > 2013-04-07 00:38:20,954 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) No need to calibrate cpu capacity, host:6 usedCpu: > 100 reservedCpu: 0 > 2013-04-07 00:38:20,954 DEBUG [cloud.capacity.CapacityManagerImpl] > (CapacityChecker:null) No need to calibrate memory capacity, host:6 > usedMem: 104857600 reservedMem: 0 > 2013-04-07 00:38:20,954 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Done executing cpu/ram capacity update > 2013-04-07 00:38:20,954 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Executing storage capacity update > 2013-04-07 00:38:20,961 DEBUG [cloud.storage.StorageManagerImpl] > (CapacityChecker:null) Successfully set Capacity - 31004332032 for capaci= ty > type - 9 , DataCenterId - 1, HostOrPoolId - 200, PodId 1 > 2013-04-07 00:38:20,965 DEBUG [cloud.storage.StorageManagerImpl] > (CapacityChecker:null) Successfully set Capacity - 97221701632 for capaci= ty > type - 9 , DataCenterId - 1, HostOrPoolId - 201, PodId 1 > 2013-04-07 00:38:20,970 DEBUG [cloud.storage.StorageManagerImpl] > (CapacityChecker:null) Successfully set Capacity - 97221701632 for capaci= ty > type - 9 , DataCenterId - 1, HostOrPoolId - 202, PodId 1 > 2013-04-07 00:38:20,975 DEBUG [cloud.storage.StorageManagerImpl] > (CapacityChecker:null) Successfully set Capacity - 2084569088 for capacit= y > type - 3 , DataCenterId - 1, HostOrPoolId - 256, PodId 1 > 2013-04-07 00:38:20,980 DEBUG [cloud.storage.StorageManagerImpl] > (CapacityChecker:null) Successfully set Capacity - 2084569088 for capacit= y > type - 3 , DataCenterId - 1, HostOrPoolId - 257, PodId 1 > 2013-04-07 00:38:20,985 DEBUG [cloud.storage.StorageManagerImpl] > (CapacityChecker:null) Successfully set Capacity - 2084569088 for capacit= y > type - 3 , DataCenterId - 1, HostOrPoolId - 262, PodId 1 > 2013-04-07 00:38:20,985 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Done executing storage capacity update > 2013-04-07 00:38:20,985 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Executing capacity updates for public ip and Vlans > 2013-04-07 00:38:20,995 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Done capacity updates for public ip and Vlans > 2013-04-07 00:38:20,996 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Executing capacity updates for private ip > 2013-04-07 00:38:21,003 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Done executing capacity updates for private ip > 2013-04-07 00:38:21,003 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Done recalculating system capacity > 2013-04-07 00:38:21,031 DEBUG [cloud.alert.AlertManagerImpl] > (CapacityChecker:null) Done running Capacity Checker ... > 2013-04-07 00:38:24,889 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-8:null) Ping from 4 > 2013-04-07 00:38:27,157 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-311:null) Ping from 1 > 2013-04-07 00:38:29,095 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-197:null) Seq 1-90046472: Executing request > 2013-04-07 00:38:29,323 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-197:null) Seq 1-90046472: Response Received: > 2013-04-07 00:38:29,324 DEBUG [agent.transport.Request] > (DirectAgent-197:null) Seq 1-90046472: Processing: { Ans: , MgmtId: 1, > via: 1, Ver: v1, Flags: 10, > [{"ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false= ,"result":true,"wait":0}}] > } > 2013-04-07 00:38:47,679 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-9:null) Ping from 3 > 2013-04-07 00:38:50,453 DEBUG > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone = 1 > is ready to launch secondary storage VM > 2013-04-07 00:38:50,560 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl= ] > (consoleproxy-1:null) Zone 1 is ready to launch console proxy > 2013-04-07 00:38:50,819 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:38:50,820 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:38:50,851 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:38:50,852 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:38:51,483 INFO [agent.manager.AgentMonitor] > (Thread-11:null) Found the following agents behind on ping: [6, 5] > 2013-04-07 00:38:51,485 DEBUG [cloud.host.Status] (Thread-11:null) Ping > timeout for host 6, do invstigation > 2013-04-07 00:38:51,486 DEBUG [cloud.host.Status] (Thread-11:null) Ping > timeout for host 5, do invstigation > 2013-04-07 00:38:51,486 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-11:null) Investigating why host 6 has disconnected with > event PingTimeout > 2013-04-07 00:38:51,486 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-11:null) checking if agent (6) is alive > 2013-04-07 00:38:51,487 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-16:null) Investigating why host 5 has disconnected with > event PingTimeout > 2013-04-07 00:38:51,488 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-16:null) checking if agent (5) is alive > 2013-04-07 00:38:51,489 DEBUG [agent.transport.Request] > (AgentTaskPool-11:null) Seq 6-324993318: Sending { Cmd , MgmtId: 1, via: > 6, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:38:51,489 DEBUG [agent.transport.Request] > (AgentTaskPool-11:null) Seq 6-324993318: Executing: { Cmd , MgmtId: 1, > via: 6, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:38:51,489 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-372:null) Seq 6-324993318: Executing request > 2013-04-07 00:38:51,491 DEBUG [agent.transport.Request] > (AgentTaskPool-16:null) Seq 5-614334822: Sending { Cmd , MgmtId: 1, via: > 5, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:38:51,491 DEBUG [agent.transport.Request] > (AgentTaskPool-16:null) Seq 5-614334822: Executing: { Cmd , MgmtId: 1, > via: 5, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:38:51,491 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-252:null) Seq 5-614334822: Executing request > 2013-04-07 00:38:51,546 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-372:null) Seq 6-324993318: Response Received: > 2013-04-07 00:38:51,547 DEBUG [agent.transport.Request] > (DirectAgent-372:null) Seq 6-324993318: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":true,"details":"resource is > alive","wait":0}}] } > 2013-04-07 00:38:51,547 DEBUG [agent.transport.Request] > (AgentTaskPool-11:null) Seq 6-324993318: Received: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-04-07 00:38:51,547 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-11:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is alive > 2013-04-07 00:38:51,547 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-11:null) agent (6) responded to checkHeathCommand, reporti= ng > that agent is Up > 2013-04-07 00:38:51,547 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-11:null) The state determined is Up > 2013-04-07 00:38:51,547 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-11:null) Agent is determined to be up and running > 2013-04-07 00:38:51,547 DEBUG [cloud.host.Status] (AgentTaskPool-11:null) > Transition:[Resource state =3D Enabled, Agent event =3D Ping, Host id =3D= 6, name > =3D Tut-XenServer] > 2013-04-07 00:38:51,549 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-252:null) Seq 5-614334822: Response Received: > 2013-04-07 00:38:51,549 DEBUG [agent.transport.Request] > (DirectAgent-252:null) Seq 5-614334822: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":true,"details":"resource is > alive","wait":0}}] } > 2013-04-07 00:38:51,549 DEBUG [agent.transport.Request] > (AgentTaskPool-16:null) Seq 5-614334822: Received: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-04-07 00:38:51,550 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-16:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is alive > 2013-04-07 00:38:51,550 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-16:null) agent (5) responded to checkHeathCommand, reporti= ng > that agent is Up > 2013-04-07 00:38:51,550 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-16:null) The state determined is Up > 2013-04-07 00:38:51,550 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-16:null) Agent is determined to be up and running > 2013-04-07 00:38:51,550 DEBUG [cloud.host.Status] (AgentTaskPool-11:null) > Agent status update: [id =3D 6; name =3D Tut-XenServer; old status =3D Up= ; event > =3D Ping; new status =3D Up; old update count =3D 315; new update count = =3D 316] > 2013-04-07 00:38:51,550 DEBUG [cloud.host.Status] (AgentTaskPool-16:null) > Transition:[Resource state =3D Enabled, Agent event =3D Ping, Host id =3D= 5, name > =3D Tut-XenServer2] > 2013-04-07 00:38:51,553 DEBUG [cloud.host.Status] (AgentTaskPool-16:null) > Agent status update: [id =3D 5; name =3D Tut-XenServer2; old status =3D U= p; event > =3D Ping; new status =3D Up; old update count =3D 152; new update count = =3D 153] > 2013-04-07 00:39:04,800 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-100:null) Ping from 6 > 2013-04-07 00:39:06,054 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-259:null) Ping from 5 > 2013-04-07 00:39:06,909 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-134:null) Seq 6-324993028: Executing request > 2013-04-07 00:39:07,104 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-134:null) Seq 6-324993028: Response Received: > 2013-04-07 00:39:07,104 DEBUG [agent.transport.Request] > (DirectAgent-134:null) Seq 6-324993028: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, > [{"ClusterSyncAnswer":{"_clusterId":2,"_newStates":{},"_isExecuted":false= ,"result":true,"wait":0}}] > } > 2013-04-07 00:39:11,022 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-188:null) Seq 5-614334468: Executing request > 2013-04-07 00:39:11,164 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-188:null) Seq 5-614334468: Response Received: > 2013-04-07 00:39:11,164 DEBUG [agent.transport.Request] > (DirectAgent-188:null) Seq 5-614334468: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, [{"Answer":{"result":true,"wait":0}}] } > 2013-04-07 00:39:20,451 DEBUG > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone = 1 > is ready to launch secondary storage VM > 2013-04-07 00:39:20,552 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl= ] > (consoleproxy-1:null) Zone 1 is ready to launch console proxy > 2013-04-07 00:39:20,819 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:39:20,820 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:39:20,851 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:39:20,852 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:39:24,890 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-10:null) Ping from 4 > 2013-04-07 00:39:27,161 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-400:null) Ping from 1 > 2013-04-07 00:39:27,661 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVolumes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316767658 > 2013-04-07 00:39:27,672 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVolumes&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRf= l8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316767658 > 2013-04-07 00:39:28,628 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316768625 > 2013-04-07 00:39:28,640 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistVirtualMachines&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT1= 3bMgnRRfl8GoVA%3D&listAll=3Dtrue&page=3D1&pagesize=3D20&_=3D1365316768625 > 2013-04-07 00:39:29,095 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-101:null) Seq 1-90046472: Executing request > 2013-04-07 00:39:29,311 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-101:null) Seq 1-90046472: Response Received: > 2013-04-07 00:39:29,311 DEBUG [agent.transport.Request] > (DirectAgent-101:null) Seq 1-90046472: Processing: { Ans: , MgmtId: 1, > via: 1, Ver: v1, Flags: 10, > [{"ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false= ,"result":true,"wait":0}}] > } > 2013-04-07 00:39:31,530 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3Dlogout&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoV= A%3D&_=3D1365316771528 > 2013-04-07 00:39:31,535 DEBUG [cloud.api.ApiServlet] > (1109449945@qtp-1008805148-34:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3Dlogout&response=3Djson&sessionkey=3DZ6QqzU0Fq1iT13bMgnRRfl8GoV= A%3D&_=3D1365316771528 > 2013-04-07 00:39:31,969 DEBUG [cloud.api.ApiServlet] > (2107564436@qtp-1008805148-38:null) =3D=3D=3DSTART=3D=3D=3D 127.0.0.1 --= GET > command=3DlistCapabilities&response=3Djson&sessionkey=3Dnull&_=3D1365316= 771968 > 2013-04-07 00:39:31,970 DEBUG [cloud.api.ApiServlet] > (2107564436@qtp-1008805148-38:null) =3D=3D=3DEND=3D=3D=3D 127.0.0.1 -- G= ET > command=3DlistCapabilities&response=3Djson&sessionkey=3Dnull&_=3D1365316= 771968 > 2013-04-07 00:39:47,679 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-11:null) Ping from 3 > 2013-04-07 00:39:50,451 DEBUG > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone = 1 > is ready to launch secondary storage VM > 2013-04-07 00:39:50,555 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl= ] > (consoleproxy-1:null) Zone 1 is ready to launch console proxy > 2013-04-07 00:39:50,819 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:39:50,820 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:39:50,850 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:39:50,851 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:39:51,486 INFO [agent.manager.AgentMonitor] > (Thread-11:null) Found the following agents behind on ping: [6, 5] > 2013-04-07 00:39:51,488 DEBUG [cloud.host.Status] (Thread-11:null) Ping > timeout for host 6, do invstigation > 2013-04-07 00:39:51,489 DEBUG [cloud.host.Status] (Thread-11:null) Ping > timeout for host 5, do invstigation > 2013-04-07 00:39:51,489 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-2:null) Investigating why host 6 has disconnected with eve= nt > PingTimeout > 2013-04-07 00:39:51,490 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-2:null) checking if agent (6) is alive > 2013-04-07 00:39:51,491 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-14:null) Investigating why host 5 has disconnected with > event PingTimeout > 2013-04-07 00:39:51,491 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-14:null) checking if agent (5) is alive > 2013-04-07 00:39:51,493 DEBUG [agent.transport.Request] > (AgentTaskPool-2:null) Seq 6-324993319: Sending { Cmd , MgmtId: 1, via: = 6, > Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:39:51,493 DEBUG [agent.transport.Request] > (AgentTaskPool-2:null) Seq 6-324993319: Executing: { Cmd , MgmtId: 1, vi= a: > 6, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:39:51,493 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-278:null) Seq 6-324993319: Executing request > 2013-04-07 00:39:51,494 DEBUG [agent.transport.Request] > (AgentTaskPool-14:null) Seq 5-614334823: Sending { Cmd , MgmtId: 1, via: > 5, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:39:51,494 DEBUG [agent.transport.Request] > (AgentTaskPool-14:null) Seq 5-614334823: Executing: { Cmd , MgmtId: 1, > via: 5, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:39:51,495 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-433:null) Seq 5-614334823: Executing request > 2013-04-07 00:39:51,547 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-278:null) Seq 6-324993319: Response Received: > 2013-04-07 00:39:51,548 DEBUG [agent.transport.Request] > (DirectAgent-278:null) Seq 6-324993319: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":true,"details":"resource is > alive","wait":0}}] } > 2013-04-07 00:39:51,548 DEBUG [agent.transport.Request] > (AgentTaskPool-2:null) Seq 6-324993319: Received: { Ans: , MgmtId: 1, vi= a: > 6, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-04-07 00:39:51,548 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-2:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is alive > 2013-04-07 00:39:51,548 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-2:null) agent (6) responded to checkHeathCommand, reportin= g > that agent is Up > 2013-04-07 00:39:51,548 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-2:null) The state determined is Up > 2013-04-07 00:39:51,548 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-2:null) Agent is determined to be up and running > 2013-04-07 00:39:51,548 DEBUG [cloud.host.Status] (AgentTaskPool-2:null) > Transition:[Resource state =3D Enabled, Agent event =3D Ping, Host id =3D= 6, name > =3D Tut-XenServer] > 2013-04-07 00:39:51,549 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-433:null) Seq 5-614334823: Response Received: > 2013-04-07 00:39:51,549 DEBUG [agent.transport.Request] > (DirectAgent-433:null) Seq 5-614334823: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":true,"details":"resource is > alive","wait":0}}] } > 2013-04-07 00:39:51,549 DEBUG [agent.transport.Request] > (AgentTaskPool-14:null) Seq 5-614334823: Received: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-04-07 00:39:51,549 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-14:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is alive > 2013-04-07 00:39:51,549 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-14:null) agent (5) responded to checkHeathCommand, reporti= ng > that agent is Up > 2013-04-07 00:39:51,549 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-14:null) The state determined is Up > 2013-04-07 00:39:51,549 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-14:null) Agent is determined to be up and running > 2013-04-07 00:39:51,551 DEBUG [cloud.host.Status] (AgentTaskPool-2:null) > Agent status update: [id =3D 6; name =3D Tut-XenServer; old status =3D Up= ; event > =3D Ping; new status =3D Up; old update count =3D 316; new update count = =3D 317] > 2013-04-07 00:39:51,551 DEBUG [cloud.host.Status] (AgentTaskPool-14:null) > Transition:[Resource state =3D Enabled, Agent event =3D Ping, Host id =3D= 5, name > =3D Tut-XenServer2] > 2013-04-07 00:39:51,554 DEBUG [cloud.host.Status] (AgentTaskPool-14:null) > Agent status update: [id =3D 5; name =3D Tut-XenServer2; old status =3D U= p; event > =3D Ping; new status =3D Up; old update count =3D 153; new update count = =3D 154] > 2013-04-07 00:40:04,836 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-238:null) Ping from 6 > 2013-04-07 00:40:06,653 WARN [xen.resource.CitrixResourceBase] > (DirectAgent-429:null) can not ping xenserver > 5e02c608-155d-432e-a20f-f8c600ef3ab7 > 2013-04-07 00:40:06,653 WARN [agent.manager.DirectAgentAttache] > (DirectAgent-429:null) Unable to get current status on 5 > 2013-04-07 00:40:06,655 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-1:null) Investigating why host 5 has disconnected with eve= nt > AgentDisconnected > 2013-04-07 00:40:06,655 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-1:null) checking if agent (5) is alive > 2013-04-07 00:40:06,658 DEBUG [agent.transport.Request] > (AgentTaskPool-1:null) Seq 5-614334824: Sending { Cmd , MgmtId: 1, via: = 5, > Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:40:06,658 DEBUG [agent.transport.Request] > (AgentTaskPool-1:null) Seq 5-614334824: Executing: { Cmd , MgmtId: 1, vi= a: > 5, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } > 2013-04-07 00:40:06,658 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-28:null) Seq 5-614334824: Executing request > 2013-04-07 00:40:06,681 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-28:null) Seq 5-614334824: Response Received: > 2013-04-07 00:40:06,682 DEBUG [agent.transport.Request] > (DirectAgent-28:null) Seq 5-614334824: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":false,"details":"resource is not > alive","wait":0}}] } > 2013-04-07 00:40:06,682 DEBUG [agent.transport.Request] > (AgentTaskPool-1:null) Seq 5-614334824: Received: { Ans: , MgmtId: 1, vi= a: > 5, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-04-07 00:40:06,682 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-1:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is not alive > 2013-04-07 00:40:06,684 DEBUG [cloud.ha.HighAvailabilityManagerImpl] > (AgentTaskPool-1:null) SimpleInvestigator unable to determine the state o= f > the host. Moving on. > 2013-04-07 00:40:06,691 DEBUG [agent.transport.Request] > (AgentTaskPool-1:null) Seq 6-324993320: Sending { Cmd , MgmtId: 1, via: = 6, > Ver: v1, Flags: 100011, > [{"CheckOnHostCommand":{"host":{"guid":"5e02c608-155d-432e-a20f-f8c600ef3= ab7","privateNetwork":{"ip":"192.168.56.11","netmask":"255.255.255.0","mac"= :"08:00:27:f7:0d:28","isSecurityGroupEnabled":false},"publicNetwork":{"ip":= "192.168.56.11","netmask":"255.255.255.0","mac":"08:00:27:f7:0d:28","isSecu= rityGroupEnabled":false},"storageNetwork1":{"ip":"192.168.56.11","netmask":= "255.255.255.0","mac":"08:00:27:f7:0d:28","isSecurityGroupEnabled":false}},= "wait":20}}] > } > 2013-04-07 00:40:06,691 DEBUG [agent.transport.Request] > (AgentTaskPool-1:null) Seq 6-324993320: Executing: { Cmd , MgmtId: 1, vi= a: > 6, Ver: v1, Flags: 100011, > [{"CheckOnHostCommand":{"host":{"guid":"5e02c608-155d-432e-a20f-f8c600ef3= ab7","privateNetwork":{"ip":"192.168.56.11","netmask":"255.255.255.0","mac"= :"08:00:27:f7:0d:28","isSecurityGroupEnabled":false},"publicNetwork":{"ip":= "192.168.56.11","netmask":"255.255.255.0","mac":"08:00:27:f7:0d:28","isSecu= rityGroupEnabled":false},"storageNetwork1":{"ip":"192.168.56.11","netmask":= "255.255.255.0","mac":"08:00:27:f7:0d:28","isSecurityGroupEnabled":false}},= "wait":20}}] > } > 2013-04-07 00:40:06,692 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-467:null) Seq 6-324993320: Executing request > 2013-04-07 00:40:06,909 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-367:null) Seq 6-324993028: Executing request > 2013-04-07 00:40:07,178 DEBUG [xen.resource.XenServer56Resource] > (DirectAgent-467:null) Heart beat is still going > 2013-04-07 00:40:07,178 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-467:null) Seq 6-324993320: Response Received: > 2013-04-07 00:40:07,178 DEBUG [agent.transport.Request] > (DirectAgent-467:null) Seq 6-324993320: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, > [{"CheckOnHostAnswer":{"determined":true,"alive":true,"result":true,"deta= ils":"Heartbeat > is still going","wait":0}}] } > 2013-04-07 00:40:07,178 DEBUG [agent.transport.Request] > (AgentTaskPool-1:null) Seq 6-324993320: Received: { Ans: , MgmtId: 1, vi= a: > 6, Ver: v1, Flags: 10, { CheckOnHostAnswer } } > 2013-04-07 00:40:07,179 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-1:null) Details from executing class > com.cloud.agent.api.CheckOnHostCommand: Heartbeat is still going > 2013-04-07 00:40:07,179 DEBUG [cloud.ha.HighAvailabilityManagerImpl] > (AgentTaskPool-1:null) XenServerInvestigator was able to determine host 5 > is in Up > 2013-04-07 00:40:07,179 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-1:null) The state determined is Up > 2013-04-07 00:40:07,179 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-1:null) Agent is determined to be up and running > 2013-04-07 00:40:07,179 DEBUG [cloud.host.Status] (AgentTaskPool-1:null) > Transition:[Resource state =3D Enabled, Agent event =3D Ping, Host id =3D= 5, name > =3D Tut-XenServer2] > 2013-04-07 00:40:07,182 DEBUG [cloud.host.Status] (AgentTaskPool-1:null) > Agent status update: [id =3D 5; name =3D Tut-XenServer2; old status =3D U= p; event > =3D Ping; new status =3D Up; old update count =3D 154; new update count = =3D 155] > 2013-04-07 00:40:07,321 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-367:null) Seq 6-324993028: Response Received: > 2013-04-07 00:40:07,322 DEBUG [agent.transport.Request] > (DirectAgent-367:null) Seq 6-324993028: Processing: { Ans: , MgmtId: 1, > via: 6, Ver: v1, Flags: 10, > [{"ClusterSyncAnswer":{"_clusterId":2,"_newStates":{},"_isExecuted":false= ,"result":true,"wait":0}}] > } > 2013-04-07 00:40:11,022 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-430:null) Seq 5-614334468: Executing request > 2013-04-07 00:40:11,052 DEBUG [xen.resource.XenServerConnectionPool] > (DirectAgent-430:null) Catch Exception: > com.xensource.xenapi.Types$HostOffline Host is offline 192.168.56.11 due = to > You attempted an operation which involves a host which could not be > contacted. > 2013-04-07 00:40:11,052 DEBUG [xen.resource.XenServerConnectionPool] > (DirectAgent-430:null) Trying to reset master of slave 192.168.56.11 to > 192.168.56.9 > 2013-04-07 00:40:20,452 DEBUG > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone = 1 > is ready to launch secondary storage VM > 2013-04-07 00:40:20,552 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl= ] > (consoleproxy-1:null) Zone 1 is ready to launch console proxy > 2013-04-07 00:40:20,820 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:40:20,821 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:40:20,852 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-04-07 00:40:20,853 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-04-07 00:40:21,055 DEBUG [xen.resource.XenServerConnectionPool] > (DirectAgent-430:null) localLogout has problem Failed to read server's > response: connect timed out > 2013-04-07 00:40:21,055 WARN [agent.manager.DirectAgentAttache] > (DirectAgent-430:null) Seq 5-614334468: Exception Caught while executing > command > com.cloud.utils.exception.CloudRuntimeException: Unable to reset master o= f > slave 192.168.56.11 to 192.168.56.9 due to > org.apache.xmlrpc.XmlRpcException: Failed to read server's response: > connect timed out > at > com.cloud.hypervisor.xen.resource.XenServerConnectionPool.PoolEmergencyRe= setMaster(XenServerConnectionPool.java:443) > at > com.cloud.hypervisor.xen.resource.XenServerConnectionPool.connect(XenServ= erConnectionPool.java:661) > at > com.cloud.hypervisor.xen.resource.CitrixResourceBase.getConnection(Citrix= ResourceBase.java:5380) > at > com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResour= ceBase.java:7248) > at > com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(Citri= xResourceBase.java:555) > at > com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenS= erver56Resource.java:73) > at > com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.ja= va:186) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439= ) > at > java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317= ) > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.acce= ss$101(ScheduledThreadPoolExecutor.java:98) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runP= eriodic(ScheduledThreadPoolExecutor.java:180) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(= ScheduledThreadPoolExecutor.java:204) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor= .java:895) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav= a:918) > at java.lang.Thread.run(Thread.java:680) > 2013-04-07 00:40:21,056 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-430:null) Seq 5-614334468: Response Received: > 2013-04-07 00:40:21,056 DEBUG [agent.transport.Request] > (DirectAgent-430:null) Seq 5-614334468: Processing: { Ans: , MgmtId: 1, > via: 5, Ver: v1, Flags: 10, > [{"Answer":{"result":false,"details":"com.cloud.utils.exception.CloudRunt= imeException: > Unable to reset master of slave 192.168.56.11 to 192.168.56.9 due to > org.apache.xmlrpc.XmlRpcException: Failed to read server's response: > connect timed out","wait":0}}] } > 2013-04-07 00:40:24,888 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-12:null) Ping from 4 > 2013-04-07 00:40:27,162 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-321:null) Ping from 1 > 2013-04-07 00:40:29,095 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-423:null) Seq 1-90046472: Executing request > 2013-04-07 00:40:29,364 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-423:null) Seq 1-90046472: Response Received: > 2013-04-07 00:40:29,364 DEBUG [agent.transport.Request] > (DirectAgent-423:null) Seq 1-90046472: Processing: { Ans: , MgmtId: 1, > via: 1, Ver: v1, Flags: 10, > [{"ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false= ,"result":true,"wait":0}}] > } > 2013-04-07 00:40:43,749 INFO [context.support.XmlWebApplicationContext] > (Shutdown:null) Closing Root WebApplicationContext: startup date [Sat Apr > 06 22:07:12 MDT 2013]; root of context hierarchy > 2013-04-07 00:40:43,751 INFO [factory.support.DefaultListableBeanFactory= ] > (Shutdown:null) Destroying singletons in > org.springframework.beans.factory.support.DefaultListableBeanFactory@74b7= 6ce4: > defining beans > [org.springframework.context.annotation.internalConfigurationAnnotationPr= ocessor,org.springframework.context.annotation.internalAutowiredAnnotationP= rocessor,org.springframework.context.annotation.internalRequiredAnnotationP= rocessor,org.springframework.context.annotation.internalCommonAnnotationPro= cessor,ClusterRestService,NetworkRestService,PodService,VirtualMachineRestS= ervice,VolumeRestService,zoneService,dataDisk,iso,rootDisk,volumeTypeHelper= ,VMComputeTagDaoImpl,VMEntityDaoImpl,VMNetworkMapDaoImpl,VMReservationDaoIm= pl,VMRootDiskTagDaoImpl,volumeReservationDaoImpl,virtualMachineEntityImpl,V= MEntityManagerImpl,dataCenterResourceManagerImpl,EngineDcDetailsDao,EngineC= lusterDao,EngineDataCenterDao,EngineHostDao,EngineHostPodDao,EngineHostDeta= ilsDao,EngineHostTagsDao,provisioningService,cloudOrchestrator,dataObjectMa= nagerImpl,dataStoreManagerImpl,dataStoreProviderDaoImpl,primaryDataStoreDao= Impl,primaryDataStoreDetailsDaoImpl,objectInDataStoreManagerImpl,dataStoreP= roviderManagerImpl,objectInDataStoreDaoImpl,defaultEndPointSelector,hypervs= iorHostEndPointRpcServer,imageDataStoreHelper,imageDaoStoreDaoImpl,imageDat= aDaoImpl,imageDataStoreProviderDaoImpl,BAREMETAL,imageFormatHelper,ISO,OVA,= imageformat_qcow2,unknown,image_format_vhd,dataMotionServiceImpl,primaryDat= aStoreHelper,templatePrimaryDataStoreDaoImpl,volumeDao2Impl,imageDataFactor= yImpl,imageServiceImpl,imageDataManagerImpl,imageDataStoreManagerImpl,defau= ltImageDataStoreProvider,defaultImageMotionStrategy,imageMotionServiceImpl,= snapshotDao2Impl,snapshotDataFactoryImpl,snapshotServiceImpl,hypervisorBase= dSnapshot,defaultPrimaryDataStoreProviderManagerImpl,defaultPrimaryDatastor= eProviderImpl,ISCSI,networkFileSystem,templateInstallStrategyImpl,volumeDat= aFactoryImpl,volumeManagerImpl,volumeServiceImpl,apiDiscoveryServiceImpl,ap= iRateLimitServiceImpl,regionDaoImpl,regionManagerImpl,regionServiceImpl,use= rContextInitializer,eventDaoImpl,usageEventDaoImpl,randomAllocator,baremeta= lDhcpDaoImpl,baremetalPxeDaoImpl,vmwareContextFactory,ciscoNexusVSMDeviceDa= oImpl,lunDaoImpl,poolDaoImpl,netappVolumeDaoImpl,netappManagerImpl,elasticL= oadBalancerElement,elasticLbVmMapDaoImpl,elasticLoadBalancerManagerImpl,net= ScalerPodDaoImpl,niciraNvpDaoImpl,niciraNvpNicMappingDaoImpl,niciraNvpRoute= rMappingDaoImpl,niciraNvpElement,ovsGuestNetworkGuru,ovsTunnelInterfaceDaoI= mpl,ovsTunnelNetworkDaoImpl,ovsTunnelManagerImpl,bigSwitchVnsDaoImpl,bigSwi= tchVnsElement,randomStoragePoolAllocator,domainChecker,agentMonitor,firstFi= tAllocator,recreateHostAllocator,testingAllocator,basicAgentAuthManager,ale= rtManagerImpl,clusterAlertAdapter,consoleProxyAlertAdapter,alertDaoImpl,sec= ondaryStorageVmAlertAdapter,apiDBUtils,apiDispatcher,apiResponseHelper,apiS= erver,apiServlet,accountJoinDaoImpl,asyncJobJoinDaoImpl,dataCenterJoinDaoIm= pl,diskOfferingJoinDaoImpl,domainRouterJoinDaoImpl,hostJoinDaoImpl,instance= GroupJoinDaoImpl,projectAccountJoinDaoImpl,projectInvitationJoinDaoImpl,pro= jectJoinDaoImpl,resourceTagJoinDaoImpl,securityGroupJoinDaoImpl,serviceOffe= ringJoinDaoImpl,storagePoolJoinDaoImpl,userAccountJoinDaoImpl,userVmJoinDao= Impl,volumeJoinDaoImpl,queryManagerImpl,asyncJobExecutorContextImpl,asyncJo= bManagerImpl,asyncJobDaoImpl,syncQueueDaoImpl,syncQueueItemDaoImpl,syncQueu= eManagerImpl,capacityManagerImpl,capacityDaoImpl,certificateDaoImpl,cluster= BasedAgentLoadBalancerPlanner,hostTransferMapDaoImpl,clusterFenceManagerImp= l,clusterServiceServletAdapter,managementServerHostDaoImpl,managementServer= HostPeerDaoImpl,stackMaidDaoImpl,managementServerNode,configurationManagerI= mpl,configurationDaoImpl,resourceCountDaoImpl,resourceLimitDaoImpl,entityMa= nagerImpl,clusterDetailsDaoImpl,accountVlanMapDaoImpl,clusterDaoImpl,cluste= rVSMMapDaoImpl,dataCenterDaoImpl,dataCenterIpAddressDaoImpl,dataCenterLinkL= ocalIpAddressDaoImpl,dataCenterVnetDaoImpl,dcDetailsDaoImpl,hostPodDaoImpl,= podVlanDaoImpl,podVlanMapDaoImpl,storageNetworkIpAddressDaoImpl,storageNetw= orkIpRangeDaoImpl,vlanDaoImpl,domainDaoImpl,actionEventUtils,alertGenerator= ,eventJoinDaoImpl,eventUtils,usageEventUtils,highAvailabilityDaoImpl,recrea= tableFencer,hostDaoImpl,hostDetailsDaoImpl,hostTagsDaoImpl,cloudZonesStartu= pProcessor,hypervisorCapabilitiesDaoImpl,hypervisorGuruManagerImpl,keystore= DaoImpl,keystoreManagerImpl,agentUpgradeDaoImpl,upgradeManagerImpl,autoScal= eManagerImpl,autoScalePolicyConditionMapDaoImpl,autoScalePolicyDaoImpl,auto= ScaleVmGroupDaoImpl,autoScaleVmGroupPolicyMapDaoImpl,autoScaleVmProfileDaoI= mpl,conditionDaoImpl,counterDaoImpl,externalFirewallDeviceDaoImpl,externalL= oadBalancerDeviceDaoImpl,firewallRulesCidrsDaoImpl,firewallRulesDaoImpl,inl= ineLoadBalancerNicMapDaoImpl,IPAddressDaoImpl,LBStickinessPolicyDaoImpl,loa= dBalancerDaoImpl,loadBalancerVMMapDaoImpl,networkAccountDaoImpl,networkDaoI= mpl,networkDomainDaoImpl,networkExternalFirewallDaoImpl,networkExternalLoad= BalancerDaoImpl,networkOpDaoImpl,networkRuleConfigDaoImpl,networkServiceMap= DaoImpl,physicalNetworkDaoImpl,physicalNetworkIsolationMethodDaoImpl,physic= alNetworkServiceProviderDaoImpl,physicalNetworkTagDaoImpl,physicalNetworkTr= afficTypeDaoImpl,portProfileDaoImpl,remoteAccessVpnDaoImpl,routerNetworkDao= Impl,site2SiteCustomerGatewayDaoImpl,site2SiteVpnConnectionDaoImpl,site2Sit= eVpnGatewayDaoImpl,userIpv6AddressDaoImpl,virtualRouterProviderDaoImpl,vpnU= serDaoImpl,externalLoadBalancerUsageManagerImpl,externalNetworkDeviceManage= rImpl,firewallManagerImpl,loadBalancingRulesManagerImpl,networkManagerImpl,= networkModelImpl,networkServiceImpl,networkUsageManagerImpl,virtualNetworkA= pplianceManagerImpl,vpcVirtualNetworkApplianceManagerImpl,portForwardingRul= esDaoImpl,rulesManagerImpl,securityGroupDaoImpl,securityGroupRuleDaoImpl,se= curityGroupRulesDaoImpl,securityGroupVMMapDaoImpl,securityGroupWorkDaoImpl,= vmRulesetLogDaoImpl,storageNetworkManagerImpl,privateIpDaoImpl,staticRouteD= aoImpl,vpcDaoImpl,vpcGatewayDaoImpl,vpcOfferingDaoImpl,vpcOfferingServiceMa= pDaoImpl,networkACLManagerImpl,vpcManagerImpl,remoteAccessVpnManagerImpl,si= te2SiteVpnManagerImpl,networkOfferingDaoImpl,networkOfferingServiceMapDaoIm= pl,projectAccountDaoImpl,projectDaoImpl,projectInvitationDaoImpl,projectMan= agerImpl,dummyHostDiscoverer,resourceManagerImpl,resourceLimitManagerImpl,c= ommandExecLogDaoImpl,configurationServerImpl,statsCollector,serviceOffering= DaoImpl,consoleServlet,registerCompleteServlet,garbageCollectingStoragePool= Allocator,useLocalForRootAllocator,diskOfferingDaoImpl,guestOSCategoryDaoIm= pl,guestOSDaoImpl,launchPermissionDaoImpl,s3DaoImpl,snapshotDaoImpl,snapsho= tPolicyDaoImpl,snapshotScheduleDaoImpl,storagePoolDaoImpl,storagePoolDetail= sDaoImpl,storagePoolHostDaoImpl,storagePoolWorkDaoImpl,swiftDaoImpl,uploadD= aoImpl,VMTemplateDaoImpl,VMTemplateDetailsDaoImpl,VMTemplateHostDaoImpl,VMT= emplatePoolDaoImpl,VMTemplateS3DaoImpl,VMTemplateSwiftDaoImpl,VMTemplateZon= eDaoImpl,volumeDaoImpl,volumeHostDaoImpl,downloadMonitorImpl,OCFS2ManagerIm= pl,s3ManagerImpl,secondaryStorageVmDefaultAllocator,snapshotManagerImpl,sna= pshotSchedulerImpl,storageManagerImpl,swiftManagerImpl,uploadMonitorImpl,re= sourceTagsDaoImpl,taggedResourceManagerImpl,hyervisorTemplateAdapter,templa= teManagerImpl,versionDaoImpl,databaseIntegrityChecker,externalPublicIpStati= sticsDaoImpl,usageDaoImpl,usageIPAddressDaoImpl,usageJobDaoImpl,usageLoadBa= lancerPolicyDaoImpl,usageNetworkDaoImpl,usageNetworkOfferingDaoImpl,usagePo= rtForwardingRuleDaoImpl,usageSecurityGroupDaoImpl,usageStorageDaoImpl,usage= VMInstanceDaoImpl,usageVolumeDaoImpl,usageVPNUserDaoImpl,usageServiceImpl,a= ccountDetailsDaoImpl,accountManagerImpl,accountDaoImpl,SSHKeyPairDaoImpl,us= erAccountDaoImpl,userDaoImpl,userStatisticsDaoImpl,userStatsLogDaoImpl,doma= inManagerImpl,identityDaoImpl,identityServiceImpl,consoleProxyDaoImpl,domai= nRouterDaoImpl,instanceGroupDaoImpl,instanceGroupVMMapDaoImpl,nicDaoImpl,se= condaryStorageVmDaoImpl,userVmDetailsDaoImpl,VMInstanceDaoImpl,itWorkDaoImp= l,componentContext,org.springframework.aop.config.internalAutoProxyCreator,= org.springframework.aop.aspectj.AspectJPointcutAdvisor#0,captureAnyMethod,o= rg.springframework.aop.aspectj.AspectJPointcutAdvisor#1,captureEventMethod,= transactionContextBuilder,actionEventInterceptor,onwireRegistry,messageSeri= alizer,transportProvider,rpcProvider,eventBus,premiumDatabaseUpgradeChecker= ,managementServerImpl,clusterManagerImpl,clusteredAgentManagerImpl,clustere= dVirtualMachineManagerImpl,highAvailabilityManagerExtImpl,userVmManagerImpl= ,consoleProxyManagerImpl,securityGroupManagerImpl2,premiumSecondaryStorageM= anagerImpl,userVmDaoImpl,ipv6AddressManagerImpl,VmwareManager,NetappManager= ,BaremetalManager,BaremetalDhcpManager,BaremetalKickStartPxeService,Baremet= alPingPxeService,BaremetalPxeManager,Ovs,BareMetalDhcp,BareMetalPxe,BareMet= alUserdata,SecurityGroupProvider,VirtualRouter,VpcVirtualRouter,NiciraNvp,J= uniperSRX,Netscaler,F5BigIP,CiscoNexus1000vVSM,FirstFitRouting,LocalStorage= PoolAllocator,FirstFitStoragePoolAllocator,UserConcentratedAllocator,Consol= eProxyAllocator,StaticRoleBasedAPIAccessChecker,ExteralIpAddressAllocator,B= areMetalTemplateAdapter,MD5UserAuthenticator,LDAPUserAuthenticator,CheckOnA= gentInvestigator,XenServerInvestigator,UserVmDomRInvestigator,ManagementIPS= ystemVMInvestigator,VmwareInvestigator,XenServerFencer,KVMFencer,OvmFencer,= VmwareFencer,XcpServerDiscoverer,SecondaryStorageDiscoverer,KvmServerDiscov= erer,BareMetalDiscoverer,HypervServerDiscoverer,OvmDiscoverer,vmwareServerD= iscoverer,FirstFitPlanner,UserDispersingPlanner,UserConcentratedPodPlanner,= BareMetalPlanner,StorageNetworkGuru,ExternalGuestNetworkGuru,PublicNetworkG= uru,PodBasedNetworkGuru,ControlNetworkGuru,DirectNetworkGuru,DirectPodBased= NetworkGuru,OvsGuestNetworkGuru,PrivateNetworkGuru,NiciraNvpGuestNetworkGur= u,XenServerGuru,KVMGuru,OvmGuru,VMwareGuru,BaremetalGuru,BaremetalPlannerSe= lector,HypervisorPlannerSelector,org.springframework.context.annotation.Con= figurationClassPostProcessor$ImportAwareBeanPostProcessor#0]; > root of factory hierarchy > > > On Sun, Apr 7, 2013 at 12:54 AM, Marcus Sorensen wro= te: > >> If you're running it the Dev way with jetty, look for vmops.log in your >> git >> root. If you've installed via package look for >> /var/log/cloudstack/management/management-server.log. >> On Apr 7, 2013 12:45 AM, "Mike Tutkowski" >> wrote: >> >> > Hi Marcus, >> > >> > I was just looking at the output in the console. >> > >> > Can you remind me again where the related logs are stored? >> > >> > Thanks! >> > >> > >> > On Sun, Apr 7, 2013 at 12:39 AM, Marcus Sorensen > > >wrote: >> > >> > > Have you by chance looked at the debug logs to see if it by chance >> tried >> > > the proper storage and failed? I'm not sure that's OK either, but it >> > would >> > > be interesting to know. >> > > On Apr 7, 2013 12:25 AM, "Mike Tutkowski" < >> mike.tutkowski@solidfire.com> >> > > wrote: >> > > >> > > > Hi, >> > > > >> > > > I'm currently using 4.1 (from like a week or so ago). >> > > > >> > > > I have three tiers of shared, iSCSI-based storage represented in >> three >> > > > storage repositories in XenServer: >> > > > >> > > > SR_2 >> > > > SR_3 >> > > > SR_4 >> > > > >> > > > SR_2 maps into CS via primary storage PS_2, which has the storage >> tag >> > > PS_2 >> > > > SR_3 maps into CS via primary storage PS_3, which has the storage >> tag >> > > PS_3 >> > > > SR_4 maps into CS via primary storage PS_4, which has the storage >> tag >> > > PS_4 >> > > > >> > > > I have three compute offerings: >> > > > >> > > > CO_2, which only uses storage tag PS_2 >> > > > CO_3, which only uses storage tag PS_3 >> > > > CO_4, which only uses storage tag PS_4 >> > > > >> > > > I walk through the wizard and select CO_3. My VM ends up on SR_4. >> > > > >> > > > I have double checked the relationships and don't see any errors i= n >> > how I >> > > > have CS configured. >> > > > >> > > > Does anyone know of this being noted as a current bug? >> > > > >> > > > Thanks! >> > > > >> > > > >> > > > -- >> > > > *Mike Tutkowski* >> > > > *Senior CloudStack Developer, SolidFire Inc.* >> > > > e: mike.tutkowski@solidfire.com >> > > > o: 303.746.7302 >> > > > Advancing the way the world uses the >> > > > cloud >> > > > *(tm)* >> > > > >> > > >> > >> > >> > >> > -- >> > *Mike Tutkowski* >> > *Senior CloudStack Developer, SolidFire Inc.* >> > e: mike.tutkowski@solidfire.com >> > o: 303.746.7302 >> > Advancing the way the world uses the >> > cloud >> > *(tm)* >> > >> > > > > -- > *Mike Tutkowski* > *Senior CloudStack Developer, SolidFire Inc.* > e: mike.tutkowski@solidfire.com > o: 303.746.7302 > Advancing the way the world uses the cloud > *(tm)* > -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkowski@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud *(tm)*