Return-Path: X-Original-To: apmail-cloudstack-issues-archive@www.apache.org Delivered-To: apmail-cloudstack-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C28FF118FD for ; Thu, 31 Jul 2014 20:06:40 +0000 (UTC) Received: (qmail 19241 invoked by uid 500); 31 Jul 2014 20:06:40 -0000 Delivered-To: apmail-cloudstack-issues-archive@cloudstack.apache.org Received: (qmail 19132 invoked by uid 500); 31 Jul 2014 20:06:40 -0000 Mailing-List: contact issues-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cloudstack.apache.org Delivered-To: mailing list issues@cloudstack.apache.org Received: (qmail 19015 invoked by uid 500); 31 Jul 2014 20:06:40 -0000 Delivered-To: apmail-incubator-cloudstack-issues@incubator.apache.org Received: (qmail 18972 invoked by uid 99); 31 Jul 2014 20:06:40 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 31 Jul 2014 20:06:40 +0000 Date: Thu, 31 Jul 2014 20:06:40 +0000 (UTC) From: "Prieur Leary (JIRA)" To: cloudstack-issues@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (CLOUDSTACK-7217) Cannot launch VM after 4.4 Upgrade on KVM MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CLOUDSTACK-7217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14081368#comment-14081368 ] Prieur Leary commented on CLOUDSTACK-7217: ------------------------------------------ Negative Erik. Neither Console or Storage SSVM's are running. Other info: 1. An error was made in the upgrade process (my fault); I missed the step of upgrading the SystemVM Template. 2. We realize no new VM's could start, and upgraded the SystemVM template to 4.4; following the procedure in the CS Wiki. 3. Upon recreating the SSVM's, they will not start, nor will any other VM. 4. All of the hosts and agents show up, and we have verified connectivity between management server and the hosts (ICMP, SSH, Agent Log). Please let me know if there is anything else that can be helpful. > Cannot launch VM after 4.4 Upgrade on KVM > ----------------------------------------- > > Key: CLOUDSTACK-7217 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7217 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the default.) > Components: KVM, Management Server > Affects Versions: 4.4.0 > Environment: CentOS 6 > Reporter: Prieur Leary > Priority: Critical > > Cannot launch VM after 4.4 upgrade. > Management server logs following: > 2014-07-31 15:43:21,111 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-157:ctx-089a5f26 job-30485/job-31053 ctx-1c0b8564) release cpu from host: 15, old used: 25500,reserved: 0, actual total$ > 2014-07-31 15:43:21,111 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-157:ctx-089a5f26 job-30485/job-31053 ctx-1c0b8564) release mem from host: 15, old used: 37044092928,reserved: 0, total:$ > 2014-07-31 15:43:21,183 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-157:ctx-089a5f26 job-30485/job-31053 ctx-1c0b8564) Invocation exception, caused by: com.cloud.exception.AgentUnavaila$ > 2014-07-31 15:43:21,183 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-157:ctx-089a5f26 job-30485/job-31053 ctx-1c0b8564) Rethrow exception com.cloud.exception.AgentUnavailableException: R$ > 2014-07-31 15:43:21,183 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-157:ctx-089a5f26 job-30485/job-31053) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 3783, job origin: 3$ > 2014-07-31 15:43:21,183 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-157:ctx-089a5f26 job-30485/job-31053) Unable to complete AsyncJobVO {id:31053, userId: 1, accountId: 1, instanceType: n$ > com.cloud.exception.AgentUnavailableException: Resource [Host:15] is unreachable: Host 15: Unable to start instance due to Unable to get answer that is of class com.cloud.agent.api.StartAnswer > at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1105) > at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:5190) > at sun.reflect.GeneratedMethodAccessor296.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107) > at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:5335) > at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102) > at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:503) > at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) > at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) > at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:460) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > Caused by: com.cloud.utils.exception.CloudRuntimeException: Unable to get answer that is of class com.cloud.agent.api.StartAnswer > at com.cloud.agent.manager.Commands.getAnswer(Commands.java:80) > at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1019) > ... 19 more > 2014-07-31 15:43:21,185 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-157:ctx-089a5f26 job-30485/job-31053) Complete async job-31053, jobStatus: FAILED, resultCode: 0, result: rO0ABXN$ > 2014-07-31 15:43:21,252 DEBUG [c.c.s.StatsCollector] (StatsCollector-2:ctx-e03eec0e) VmStatsCollector is running... > 2014-07-31 15:43:21,281 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-157:ctx-089a5f26 job-30485/job-31053) Done executing com.cloud.vm.VmWorkStart for job-31053 > 2014-07-31 15:43:21,586 WARN [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-a3cfb728) Exception while trying to start secondary storage vm > java.lang.RuntimeException: Job failed due to exception Resource [Host:15] is unreachable: Host 15: Unable to start instance due to Unable to get answer that is of class com.cloud.agent.api.StartA$ > at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:114) > at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:503) > at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) -- This message was sent by Atlassian JIRA (v6.2#6252)