Return-Path: X-Original-To: apmail-incubator-cloudstack-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-cloudstack-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B4036D8E0 for ; Fri, 15 Feb 2013 00:35:13 +0000 (UTC) Received: (qmail 70468 invoked by uid 500); 15 Feb 2013 00:35:13 -0000 Delivered-To: apmail-incubator-cloudstack-dev-archive@incubator.apache.org Received: (qmail 70377 invoked by uid 500); 15 Feb 2013 00:35:13 -0000 Mailing-List: contact cloudstack-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: cloudstack-dev@incubator.apache.org Delivered-To: mailing list cloudstack-dev@incubator.apache.org Received: (qmail 70124 invoked by uid 99); 15 Feb 2013 00:35:12 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 15 Feb 2013 00:35:12 +0000 Date: Fri, 15 Feb 2013 00:35:12 +0000 (UTC) From: "Marcus Sorensen (JIRA)" To: cloudstack-dev@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (CLOUDSTACK-1269) Failed to start CPVM java.lang.NullPointerException Unable to start SSVM MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CLOUDSTACK-1269?page=3Dcom.atla= ssian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId= =3D13578842#comment-13578842 ]=20 Marcus Sorensen commented on CLOUDSTACK-1269: --------------------------------------------- angeline, there is no need for qemu-kvm package to have the kvm kernel modu= le on your system. However, the qemu-kvm package may configure a modprobe f= ile somewhere that automatically loads it. Fang, I replied to your other email about agent logging:=20 Move /etc/cloudstack/agent/log4j-cloud.xml to /etc/cloudstack/agent/log4j.xml. If you don't have an /etc/cloudstack, but only /etc/cloud, you should build new 4.1 RPMs and install them. =20 > Failed to start CPVM java.lang.NullPointerException Unable to start SSV= M > -------------------------------------------------------------------------= - > > Key: CLOUDSTACK-1269 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-126= 9 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the defa= ult.)=20 > Components: Management Server > Affects Versions: 4.1.0 > Environment: MS rhel6.3 10.223.195.114 build Cloud= Stack-non-OSS-23-rhel6.3.tar.gz > host rhel6.3 kvm 10.223.51.2 build CloudStack-non-OSS-23-rhel6.= 3.tar.gz > 1. host installation:=20 > build CloudStack-non-OSS-23-rhel6.3.tar.gz contains old version qemu-im= g-0.12.1.2-3.209.el6.4.x86_64 > Due to 4.1 packaging, build does not have new qemu-img and qemu-kvm for = testing kvm 6.3 snapshot > manually replace qemu-img-0.12.1.2-3.209.el6.4.x86_64 with qemu-img-0.1= 2.1.2-3.295.el6.4.x86_64 > manually install qemu-kvm-0.12.1.2-3.295.el6.4.x86_64 > as part of above , had to remove libvirt-0.9.10-21.el6.x86_64, download = libvirt-0.9.10-21.el6.x86_64 > Here are some rpms that was reinstalled: > 1975468 Feb 13 20:56 libvirt-0.9.10-21.el6.x86_64.rpm > 1361029 Feb 13 20:32 qemu-img-0.12.1.2-3.295.el6.10.x8= 6_64.rpm > 10878235 Feb 13 20:33 qemu-kvm-0.12.1.2-3.295.el6.10.x86= _64.rpm > 375800 Feb 13 22:16 xnba-kvm-1.0.3-7.x86_64.rpm > 2. create advance zone isolation mode. =20 > CPVM unable to start SSVM CPVM > Reporter: angeline shen > Assignee: Fang Wang > Priority: Blocker > Fix For: 4.1.0 > > Attachments: management-server.log.gz, Screenshot-CloudStack - Mo= zilla Firefox.png > > > 2013-02-13 17:10:25,656 DEBUG [agent.transport.Request] (AgentManager-Han= dler-12:null) Seq 1-1481768980: Processing: { Ans: , MgmtId: 6809771312912= , via: 1, Ver: v1, Flags: 110, [{"Answer":{"result":false,"details":"java.l= ang.Nul > lPointerException\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputin= gResource.cleanupVMNetworks(LibvirtComputingResource.java:4214)\n\tat com.c= loud.hypervisor.kvm.resource.LibvirtComputingResource.handleVmStartFailure(= Libvirt > ComputingResource.java:2983)\n\tat com.cloud.hypervisor.kvm.resource.Libv= irtComputingResource.execute(LibvirtComputingResource.java:3107)\n\tat com.= cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(Libvi= rtCompu > tingResource.java:1163)\n\tat com.cloud.agent.Agent.processRequest(Agent.= java:525)\n\tat com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java= :852)\n\tat com.cloud.utils.nio.Task.run(Task.java:83)\n\tat java.util.conc= urrent. > ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat java.uti= l.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\t= at java.lang.Thread.run(Thread.java:679)\n","wait":0}},{"Answer":{"result":= false," > details":"Stopped by previous failure","wait":0}}] } > 2013-02-13 17:10:25,657 DEBUG [agent.transport.Request] (secstorage-1:nul= l) Seq 1-1481768980: Received: { Ans: , MgmtId: 6809771312912, via: 1, Ver= : v1, Flags: 110, { Answer, Answer } } > 2013-02-13 17:10:25,657 DEBUG [agent.manager.AgentAttache] (AgentManager-= Handler-12:null) Seq 1-1481768981: Sending now. is current sequence. > 2013-02-13 17:10:25,662 ERROR [cloud.vm.VirtualMachineManagerImpl] (secst= orage-1:null) Failed to start instance VM[SecondaryStorageVm|s-1-VM] > com.cloud.utils.exception.CloudRuntimeException: Unable to get answer tha= t is of class com.cloud.agent.api.StartAnswer > at com.cloud.agent.manager.Commands.getAnswer(Commands.java:80) > at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMac= hineManagerImpl.java:777) > at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineMan= agerImpl.java:466) > at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineMan= agerImpl.java:459) > at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) > at org.springframework.aop.framework.Cglib2AopProxy$CglibMethodIn= vocation.invokeJoinpoint(Cglib2AopProxy.java:689) > at org.springframework.aop.framework.ReflectiveMethodInvocation.p= roceed(ReflectiveMethodInvocation.java:150) > at org.springframework.aop.aspectj.MethodInvocationProceedingJoin= Point.proceed(MethodInvocationProceedingJoinPoint.java:80) > at com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(T= ransactionContextBuilder.java:43) > at sun.reflect.GeneratedMethodAccessor35.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMeth= odAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:616) > at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAd= viceMethodWithGivenArgs(AbstractAspectJAdvice.java:621) > at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAd= viceMethod(AbstractAspectJAdvice.java:610) > at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(Asp= ectJAroundAdvice.java:65) > at org.springframework.aop.framework.ReflectiveMethodInvocation.p= roceed(ReflectiveMethodInvocation.java:172) > at org.springframework.aop.interceptor.ExposeInvocationIntercepto= r.invoke(ExposeInvocationInterceptor.java:90) > at org.springframework.aop.framework.ReflectiveMethodInvocation.p= roceed(ReflectiveMethodInvocation.java:172) > at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvise= dInterceptor.intercept(Cglib2AopProxy.java:622) > at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startS= ecStorageVm(SecondaryStorageManagerImpl.java:264) > at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocC= apacity(SecondaryStorageManagerImpl.java:689) > at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expand= Pool(SecondaryStorageManagerImpl.java:1300) > at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPo= ol(PremiumSecondaryStorageManagerImpl.java:121) > at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPo= ol(PremiumSecondaryStorageManagerImpl.java:52) > at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.= java:104) > at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanne= r.java:33) > at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScann= er.java:81) > at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.jav= a:72) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.= java:471) > at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTa= sk.java:351) > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:17= 8) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutu= reTask.access$201(ScheduledThreadPoolExecutor.java:165) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutu= reTask.run(ScheduledThreadPoolExecutor.java:267) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx= ecutor.java:1110) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolE= xecutor.java:603) > at java.lang.Thread.run(Thread.java:679) > 2013-02-13 17:10:25,667 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secst= orage-1:null) Cleaning up resources for the vm VM[SecondaryStorageVm|s-1-VM= ] in Starting state > 2013-02-13 17:10:25,668 DEBUG [agent.transport.Request] (secstorage-1:nul= l) Seq 1-1481768983: Waiting for Seq 1481768981 Scheduling: { Cmd , MgmtId= : 6809771312912, via: 1, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy"= :false, > "vmName":"s-1-VM","wait":0}}] } > 2013-02-13 17:10:35,133 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:nu= ll) =3D=3D=3DSTART=3D=3D=3D 10.216.133.70 -- POST command=3DcreateAccount= &response=3Djson&sessionkey=3DZPNnO6ZVMdSYISIfi%2FUga%2FM9H9A%3D > 2013-02-13 17:10:35,154 DEBUG [cloud.user.AccountManagerImpl] (catalina-e= xec-10:null) Access granted to Acct[2-admin] to Domain:2/d1/ by DomainCheck= er > 2013-02-13 17:10:35,161 DEBUG [network.security.SecurityGroupManagerImpl]= (catalina-exec-10:null) Created security group=20 > 2013-02-13 17:10:35,133 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:nu= ll) =3D=3D=3DSTART=3D=3D=3D 10.216.133.70 -- POST command=3DcreateAccount= &response=3Djson&sessionkey=3DZPNnO6ZVMdSYISIfi%2FUga%2FM9H9A%3D > 2013-02-13 17:10:35,154 DEBUG [cloud.user.AccountManagerImpl] (catalina-e= xec-10:null) Access granted to Acct[2-admin] to Domain:2/d1/ by DomainCheck= er > 2013-02-13 17:10:35,161 DEBUG [network.security.SecurityGroupManagerImpl]= (catalina-exec-10:null) Created security group com.cloud.network.security.= SecurityGroupVO$$EnhancerByCGLIB$$53628a27@753f827a for account id=3D4 > 2013-02-13 17:10:35,163 DEBUG [cloud.user.AccountManagerImpl] (catalina-e= xec-10:null) Creating user: d1domain, accountId: 4 timezone:America/Los_Ang= eles > 2013-02-13 17:10:35,324 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:nu= ll) =3D=3D=3DEND=3D=3D=3D 10.216.133.70 -- POST command=3DcreateAccount&r= esponse=3Djson&sessionkey=3DZPNnO6ZVMdSYISIfi%2FUga%2FM9H9A%3D > 2013-02-13 17:10:36,326 DEBUG [agent.transport.Request] (AgentManager-Han= dler-13:null) Seq 1-1481768981: Processing: { Ans: , MgmtId: 6809771312912= , via: 1, Ver: v1, Flags: 110, [{"Answer":{"result":false,"details":"java.l= ang.NullPointerException\n\tat com.cloud.hypervisor.kvm.resource.LibvirtCom= putingResource.cleanupVMNetworks(LibvirtComputingResource.java:4214)\n\tat = com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.handleVmStartFai= lure(LibvirtComputingResource.java:2983)\n\tat com.cloud.hypervisor.kvm.res= ource.LibvirtComputingResource.execute(LibvirtComputingResource.java:3107)\= n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeReq= uest(LibvirtComputingResource.java:1163)\n\tat com.cloud.agent.Agent.proces= sRequest(Agent.java:525)\n\tat com.cloud.agent.Agent$AgentRequestHandler.do= Task(Agent.java:852)\n\tat com.cloud.utils.nio.Task.run(Task.java:83)\n\tat= java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:= 1110)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolEx= ecutor.java:603)\n\tat java.lang.Thread.run(Thread.java:679)\n","wait":0}},= {"Answer":{"result":false,"details":"Stopped by previous failure","wait":0}= }] } > 2013-02-13 17:10:36,326 DEBUG [agent.manager.AgentAttache] (AgentManager-= Handler-13:null) Seq 1-1481768983: Sending now. is current sequence. > 2013-02-13 17:10:36,326 DEBUG [agent.transport.Request] (consoleproxy-1:n= ull) Seq 1-1481768981: Received: { Ans: , MgmtId: 6809771312912, via: 1, V= er: v1, Flags: 110, { Answer, Answer } } > 2013-02-13 17:10:36,339 ERROR [cloud.vm.VirtualMachineManagerImpl] (conso= leproxy-1:null) Failed to start instance VM[ConsoleProxy|v-2-VM] > com.cloud.utils.exception.CloudRuntimeException: Unable to get answer tha= t is of class com.cloud.agent.api.StartAnswer > at com.cloud.agent.manager.Commands.getAnswer(Commands.java:80) > at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMac= hineManagerImpl.java:777) > at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineMan= agerImpl.java:466) > at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineMan= agerImpl.java:459) > at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) > at org.springframework.aop.framework.Cglib2AopProxy$CglibMethodIn= vocation.invokeJoinpoint(Cglib2AopProxy.java:689) > at org.springframework.aop.framework.ReflectiveMethodInvocation.p= roceed(ReflectiveMethodInvocation.java:150) > at org.springframework.aop.aspectj.MethodInvocationProceedingJoin= Point.proceed(MethodInvocationProceedingJoinPoint.java:80) > at com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(T= ransactionContextBuilder.java:43) > at sun.reflect.GeneratedMethodAccessor35.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMeth= odAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:616) > at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAd= viceMethodWithGivenArgs(AbstractAspectJAdvice.java:621) > at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAd= viceMethod(AbstractAspectJAdvice.java:610) > at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(Asp= ectJAroundAdvice.java:65) > at org.springframework.aop.framework.ReflectiveMethodInvocation.p= roceed(ReflectiveMethodInvocation.java:172) > at org.springframework.aop.interceptor.ExposeInvocationIntercepto= r.invoke(ExposeInvocationInterceptor.java:90) > at org.springframework.aop.framework.ReflectiveMethodInvocation.p= roceed(ReflectiveMethodInvocation.java:172) > at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvise= dInterceptor.intercept(Cglib2AopProxy.java:622) > at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(Cons= oleProxyManagerImpl.java:630) > at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(C= onsoleProxyManagerImpl.java:1164) > at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(Cons= oleProxyManagerImpl.java:1960) > at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(Cons= oleProxyManagerImpl.java:174) > at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.= java:111) > at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanne= r.java:33) > at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScann= er.java:81) > at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.jav= a:72) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.= java:471) > at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTa= sk.java:351) > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:17= 8) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutu= reTask.access$201(ScheduledThreadPoolExecutor.java:165) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutu= reTask.run(ScheduledThreadPoolExecutor.java:267) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx= ecutor.java:1110) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolE= xecutor.java:603) > at java.lang.Thread.run(Thread.java:679) > 2013-02-13 17:10:36,343 DEBUG [cloud.vm.VirtualMachineManagerImpl] (conso= leproxy-1:null) Cleaning up resources for the vm VM[ConsoleProxy|v-2-VM] in= Starting state > 2013-02-13 17:10:36,344 DEBUG [agent.transport.Request] (consoleproxy-1:n= ull) Seq 1-1481768984: Waiting for Seq 1481768983 Scheduling: { Cmd , Mgmt= Id: 6809771312912, via: 1, Ver: v1, Flags: 100111, [{"StopCommand":{"isProx= y":false,"vmName":"v-2-VM","wait":0}}] } > 2013-02-13 17:10:36,395 DEBUG [agent.transport.Request] (AgentManager-Han= dler-14:null) Seq 1-1481768983: Processing: { Ans: , MgmtId: 6809771312912= , via: 1, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"w= ait":0}}] } > 2013-02-13 17:10:36,395 DEBUG [agent.manager.AgentAttache] (AgentManager-= Handler-14:null) Seq 1-1481768984: Sending now. is current sequence. > 2013-02-13 17:10:36,395 DEBUG [agent.transport.Request] (secstorage-1:nul= l) Seq 1-1481768983: Received: { Ans: , MgmtId: 6809771312912, via: 1, Ver= : v1, Flags: 110, { StopAnswer } } -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrato= rs For more information on JIRA, see: http://www.atlassian.com/software/jira