Return-Path: X-Original-To: apmail-incubator-cloudstack-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-cloudstack-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8E55CE5A4 for ; Thu, 14 Feb 2013 03:00:16 +0000 (UTC) Received: (qmail 37556 invoked by uid 500); 14 Feb 2013 03:00:13 -0000 Delivered-To: apmail-incubator-cloudstack-dev-archive@incubator.apache.org Received: (qmail 37388 invoked by uid 500); 14 Feb 2013 03:00:13 -0000 Mailing-List: contact cloudstack-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: cloudstack-dev@incubator.apache.org Delivered-To: mailing list cloudstack-dev@incubator.apache.org Received: (qmail 37367 invoked by uid 99); 14 Feb 2013 03:00:13 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 14 Feb 2013 03:00:13 +0000 Date: Thu, 14 Feb 2013 03:00:12 +0000 (UTC) From: "angeline shen (JIRA)" To: cloudstack-dev@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (CLOUDSTACK-1269) Failed to start CPVM java.lang.NullPointerException Unable to start SSVM MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 angeline shen created CLOUDSTACK-1269: ----------------------------------------- Summary: Failed to start CPVM java.lang.NullPointerException = Unable to start SSVM Key: CLOUDSTACK-1269 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-1269 Project: CloudStack Issue Type: Bug Security Level: Public (Anyone can view this level - this is the defa= ult.) Components: Management Server Affects Versions: 4.1.0 Environment: MS rhel6.3 10.223.195.114 build CloudS= tack-non-OSS-23-rhel6.3.tar.gz host rhel6.3 kvm 10.223.51.2 build CloudStack-non-OSS-23-rhel6.3.= tar.gz 1. host installation:=20 build CloudStack-non-OSS-23-rhel6.3.tar.gz contains old version qemu-img-= 0.12.1.2-3.209.el6.4.x86_64 Due to 4.1 packaging, build does not have new qemu-img and qemu-kvm for te= sting kvm 6.3 snapshot manually replace qemu-img-0.12.1.2-3.209.el6.4.x86_64 with qemu-img-0.12.= 1.2-3.295.el6.4.x86_64 manually install qemu-kvm-0.12.1.2-3.295.el6.4.x86_64 as part of above , had to remove libvirt-0.9.10-21.el6.x86_64, download li= bvirt-0.9.10-21.el6.x86_64 Here are some rpms that was reinstalled: 1975468 Feb 13 20:56 libvirt-0.9.10-21.el6.x86_64.rpm 1361029 Feb 13 20:32 qemu-img-0.12.1.2-3.295.el6.10.x86_= 64.rpm 10878235 Feb 13 20:33 qemu-kvm-0.12.1.2-3.295.el6.10.x86_6= 4.rpm 375800 Feb 13 22:16 xnba-kvm-1.0.3-7.x86_64.rpm 2. create advance zone isolation mode. =20 CPVM unable to start SSVM CPVM Reporter: angeline shen Priority: Blocker Fix For: 4.1.0 2013-02-13 17:10:25,656 DEBUG [agent.transport.Request] (AgentManager-Handl= er-12:null) Seq 1-1481768980: Processing: { Ans: , MgmtId: 6809771312912, = via: 1, Ver: v1, Flags: 110, [{"Answer":{"result":false,"details":"java.lan= g.Nul lPointerException\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingR= esource.cleanupVMNetworks(LibvirtComputingResource.java:4214)\n\tat com.clo= ud.hypervisor.kvm.resource.LibvirtComputingResource.handleVmStartFailure(Li= bvirt ComputingResource.java:2983)\n\tat com.cloud.hypervisor.kvm.resource.Libvir= tComputingResource.execute(LibvirtComputingResource.java:3107)\n\tat com.cl= oud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(Libvirt= Compu tingResource.java:1163)\n\tat com.cloud.agent.Agent.processRequest(Agent.ja= va:525)\n\tat com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:8= 52)\n\tat com.cloud.utils.nio.Task.run(Task.java:83)\n\tat java.util.concur= rent. ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat java.util.= concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat= java.lang.Thread.run(Thread.java:679)\n","wait":0}},{"Answer":{"result":fa= lse," details":"Stopped by previous failure","wait":0}}] } 2013-02-13 17:10:25,657 DEBUG [agent.transport.Request] (secstorage-1:null)= Seq 1-1481768980: Received: { Ans: , MgmtId: 6809771312912, via: 1, Ver: = v1, Flags: 110, { Answer, Answer } } 2013-02-13 17:10:25,657 DEBUG [agent.manager.AgentAttache] (AgentManager-Ha= ndler-12:null) Seq 1-1481768981: Sending now. is current sequence. 2013-02-13 17:10:25,662 ERROR [cloud.vm.VirtualMachineManagerImpl] (secstor= age-1:null) Failed to start instance VM[SecondaryStorageVm|s-1-VM] com.cloud.utils.exception.CloudRuntimeException: Unable to get answer that = is of class com.cloud.agent.api.StartAnswer at com.cloud.agent.manager.Commands.getAnswer(Commands.java:80) at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachi= neManagerImpl.java:777) at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManag= erImpl.java:466) at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManag= erImpl.java:459) at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvo= cation.invokeJoinpoint(Cglib2AopProxy.java:689) at org.springframework.aop.framework.ReflectiveMethodInvocation.pro= ceed(ReflectiveMethodInvocation.java:150) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPo= int.proceed(MethodInvocationProceedingJoinPoint.java:80) at com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(Tra= nsactionContextBuilder.java:43) at sun.reflect.GeneratedMethodAccessor35.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethod= AccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdvi= ceMethodWithGivenArgs(AbstractAspectJAdvice.java:621) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdvi= ceMethod(AbstractAspectJAdvice.java:610) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(Aspec= tJAroundAdvice.java:65) at org.springframework.aop.framework.ReflectiveMethodInvocation.pro= ceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.= invoke(ExposeInvocationInterceptor.java:90) at org.springframework.aop.framework.ReflectiveMethodInvocation.pro= ceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedI= nterceptor.intercept(Cglib2AopProxy.java:622) at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSec= StorageVm(SecondaryStorageManagerImpl.java:264) at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCap= acity(SecondaryStorageManagerImpl.java:689) at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPo= ol(SecondaryStorageManagerImpl.java:1300) at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool= (PremiumSecondaryStorageManagerImpl.java:121) at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool= (PremiumSecondaryStorageManagerImpl.java:52) at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.ja= va:104) at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.= java:33) at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner= .java:81) at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:= 72) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.ja= va:471) at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask= .java:351) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFuture= Task.access$201(ScheduledThreadPoolExecutor.java:165) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFuture= Task.run(ScheduledThreadPoolExecutor.java:267) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec= utor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:603) at java.lang.Thread.run(Thread.java:679) 2013-02-13 17:10:25,667 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstor= age-1:null) Cleaning up resources for the vm VM[SecondaryStorageVm|s-1-VM] = in Starting state 2013-02-13 17:10:25,668 DEBUG [agent.transport.Request] (secstorage-1:null)= Seq 1-1481768983: Waiting for Seq 1481768981 Scheduling: { Cmd , MgmtId: = 6809771312912, via: 1, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":f= alse, "vmName":"s-1-VM","wait":0}}] } 2013-02-13 17:10:35,133 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:null= ) =3D=3D=3DSTART=3D=3D=3D 10.216.133.70 -- POST command=3DcreateAccount&r= esponse=3Djson&sessionkey=3DZPNnO6ZVMdSYISIfi%2FUga%2FM9H9A%3D 2013-02-13 17:10:35,154 DEBUG [cloud.user.AccountManagerImpl] (catalina-exe= c-10:null) Access granted to Acct[2-admin] to Domain:2/d1/ by DomainChecker 2013-02-13 17:10:35,161 DEBUG [network.security.SecurityGroupManagerImpl] (= catalina-exec-10:null) Created security group=20 2013-02-13 17:10:35,133 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:null= ) =3D=3D=3DSTART=3D=3D=3D 10.216.133.70 -- POST command=3DcreateAccount&r= esponse=3Djson&sessionkey=3DZPNnO6ZVMdSYISIfi%2FUga%2FM9H9A%3D 2013-02-13 17:10:35,154 DEBUG [cloud.user.AccountManagerImpl] (catalina-exe= c-10:null) Access granted to Acct[2-admin] to Domain:2/d1/ by DomainChecker 2013-02-13 17:10:35,161 DEBUG [network.security.SecurityGroupManagerImpl] (= catalina-exec-10:null) Created security group com.cloud.network.security.Se= curityGroupVO$$EnhancerByCGLIB$$53628a27@753f827a for account id=3D4 2013-02-13 17:10:35,163 DEBUG [cloud.user.AccountManagerImpl] (catalina-exe= c-10:null) Creating user: d1domain, accountId: 4 timezone:America/Los_Angel= es 2013-02-13 17:10:35,324 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:null= ) =3D=3D=3DEND=3D=3D=3D 10.216.133.70 -- POST command=3DcreateAccount&res= ponse=3Djson&sessionkey=3DZPNnO6ZVMdSYISIfi%2FUga%2FM9H9A%3D 2013-02-13 17:10:36,326 DEBUG [agent.transport.Request] (AgentManager-Handl= er-13:null) Seq 1-1481768981: Processing: { Ans: , MgmtId: 6809771312912, = via: 1, Ver: v1, Flags: 110, [{"Answer":{"result":false,"details":"java.lan= g.NullPointerException\n\tat com.cloud.hypervisor.kvm.resource.LibvirtCompu= tingResource.cleanupVMNetworks(LibvirtComputingResource.java:4214)\n\tat co= m.cloud.hypervisor.kvm.resource.LibvirtComputingResource.handleVmStartFailu= re(LibvirtComputingResource.java:2983)\n\tat com.cloud.hypervisor.kvm.resou= rce.LibvirtComputingResource.execute(LibvirtComputingResource.java:3107)\n\= tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeReque= st(LibvirtComputingResource.java:1163)\n\tat com.cloud.agent.Agent.processR= equest(Agent.java:525)\n\tat com.cloud.agent.Agent$AgentRequestHandler.doTa= sk(Agent.java:852)\n\tat com.cloud.utils.nio.Task.run(Task.java:83)\n\tat j= ava.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:11= 10)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExec= utor.java:603)\n\tat java.lang.Thread.run(Thread.java:679)\n","wait":0}},{"= Answer":{"result":false,"details":"Stopped by previous failure","wait":0}}]= } 2013-02-13 17:10:36,326 DEBUG [agent.manager.AgentAttache] (AgentManager-Ha= ndler-13:null) Seq 1-1481768983: Sending now. is current sequence. 2013-02-13 17:10:36,326 DEBUG [agent.transport.Request] (consoleproxy-1:nul= l) Seq 1-1481768981: Received: { Ans: , MgmtId: 6809771312912, via: 1, Ver= : v1, Flags: 110, { Answer, Answer } } 2013-02-13 17:10:36,339 ERROR [cloud.vm.VirtualMachineManagerImpl] (console= proxy-1:null) Failed to start instance VM[ConsoleProxy|v-2-VM] com.cloud.utils.exception.CloudRuntimeException: Unable to get answer that = is of class com.cloud.agent.api.StartAnswer at com.cloud.agent.manager.Commands.getAnswer(Commands.java:80) at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachi= neManagerImpl.java:777) at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManag= erImpl.java:466) at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManag= erImpl.java:459) at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvo= cation.invokeJoinpoint(Cglib2AopProxy.java:689) at org.springframework.aop.framework.ReflectiveMethodInvocation.pro= ceed(ReflectiveMethodInvocation.java:150) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPo= int.proceed(MethodInvocationProceedingJoinPoint.java:80) at com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(Tra= nsactionContextBuilder.java:43) at sun.reflect.GeneratedMethodAccessor35.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethod= AccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdvi= ceMethodWithGivenArgs(AbstractAspectJAdvice.java:621) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdvi= ceMethod(AbstractAspectJAdvice.java:610) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(Aspec= tJAroundAdvice.java:65) at org.springframework.aop.framework.ReflectiveMethodInvocation.pro= ceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.= invoke(ExposeInvocationInterceptor.java:90) at org.springframework.aop.framework.ReflectiveMethodInvocation.pro= ceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedI= nterceptor.intercept(Cglib2AopProxy.java:622) at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(Consol= eProxyManagerImpl.java:630) at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(Con= soleProxyManagerImpl.java:1164) at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(Consol= eProxyManagerImpl.java:1960) at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(Consol= eProxyManagerImpl.java:174) at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.ja= va:111) at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.= java:33) at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner= .java:81) at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:= 72) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.ja= va:471) at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask= .java:351) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFuture= Task.access$201(ScheduledThreadPoolExecutor.java:165) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFuture= Task.run(ScheduledThreadPoolExecutor.java:267) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec= utor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:603) at java.lang.Thread.run(Thread.java:679) 2013-02-13 17:10:36,343 DEBUG [cloud.vm.VirtualMachineManagerImpl] (console= proxy-1:null) Cleaning up resources for the vm VM[ConsoleProxy|v-2-VM] in S= tarting state 2013-02-13 17:10:36,344 DEBUG [agent.transport.Request] (consoleproxy-1:nul= l) Seq 1-1481768984: Waiting for Seq 1481768983 Scheduling: { Cmd , MgmtId= : 6809771312912, via: 1, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy"= :false,"vmName":"v-2-VM","wait":0}}] } 2013-02-13 17:10:36,395 DEBUG [agent.transport.Request] (AgentManager-Handl= er-14:null) Seq 1-1481768983: Processing: { Ans: , MgmtId: 6809771312912, = via: 1, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"wai= t":0}}] } 2013-02-13 17:10:36,395 DEBUG [agent.manager.AgentAttache] (AgentManager-Ha= ndler-14:null) Seq 1-1481768984: Sending now. is current sequence. 2013-02-13 17:10:36,395 DEBUG [agent.transport.Request] (secstorage-1:null)= Seq 1-1481768983: Received: { Ans: , MgmtId: 6809771312912, via: 1, Ver: = v1, Flags: 110, { StopAnswer } } -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrato= rs For more information on JIRA, see: http://www.atlassian.com/software/jira