Return-Path: X-Original-To: apmail-cloudstack-issues-archive@www.apache.org Delivered-To: apmail-cloudstack-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DF4FE10212 for ; Fri, 20 Dec 2013 19:40:09 +0000 (UTC) Received: (qmail 66360 invoked by uid 500); 20 Dec 2013 19:40:09 -0000 Delivered-To: apmail-cloudstack-issues-archive@cloudstack.apache.org Received: (qmail 66338 invoked by uid 500); 20 Dec 2013 19:40:09 -0000 Mailing-List: contact issues-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cloudstack.apache.org Delivered-To: mailing list issues@cloudstack.apache.org Received: (qmail 66330 invoked by uid 500); 20 Dec 2013 19:40:09 -0000 Delivered-To: apmail-incubator-cloudstack-issues@incubator.apache.org Received: (qmail 66327 invoked by uid 99); 20 Dec 2013 19:40:09 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Dec 2013 19:40:09 +0000 Date: Fri, 20 Dec 2013 19:40:09 +0000 (UTC) From: "Sangeetha Hariharan (JIRA)" To: cloudstack-issues@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (CLOUDSTACK-5573) KVM- SSVM/CPVM stuck in "Starting" state Caused by: java.lang.NullPointerException. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CLOUDSTACK-5573?page=3Dcom.atl= assian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangeetha Hariharan updated CLOUDSTACK-5573: -------------------------------------------- Summary: KVM- SSVM/CPVM stuck in "Starting" state Caused by: java.lang.= NullPointerException. (was: KVM- SSVM stuck in "Starting" state Caused by:= java.lang.NullPointerException.) > KVM- SSVM/CPVM stuck in "Starting" state Caused by: java.lang.NullPointer= Exception. > -------------------------------------------------------------------------= ---------- > > Key: CLOUDSTACK-5573 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-557= 3 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the defa= ult.)=20 > Components: Management Server > Affects Versions: 4.3.0 > Environment: Build from 4.3 > Reporter: Sangeetha Hariharan > Priority: Critical > Fix For: 4.3.0 > > Attachments: kvm-ssvm.rar > > > Set up: > Advanced zone set up with 2 KVM (rhel 6.3) hosts. > Few Vms running on both hosts. > I was testing use cases of bringing down hosts and brings them back up ag= ain . > During this testing , SSVM got stuck in "Starting" state for ever. > Following exception seen in agent log: > 2013-12-19 10:28:08,616 ERROR [agent.transport.Request] (agentRequest-Han= dler-5:null) Caught problem with [{"com.cloud.agent.api.StartCommand":{"vm"= :{"id":35,"name":"s-35-MyTestVM","type":"SecondaryStorageVm","cpus":1,"minS= peed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_= 64","os":"Debian GNU/Linux 5.0 (32-bit)","bootArgs":" template\u003ddomP ty= pe\u003dsecstorage host\u003d10.223.49.6 port\u003d8250 name\u003ds-35-MyTe= stVM zone\u003d1 pod\u003d1 guid\u003ds-35-MyTestVM resource\u003dcom.cloud= .storage.resource.PremiumSecondaryStorageResource instance\u003dSecStorage = sslcopy\u003dtrue role\u003dtemplateProcessor mtu\u003d1500 eth2ip\u003d10.= 223.138.133 eth2mask\u003d255.255.255.192 gateway\u003d10.223.138.129 publi= c.network.device\u003deth2 eth0ip\u003d169.254.0.251 eth0mask\u003d255.255.= 0.0 eth1ip\u003d10.223.58.137 eth1mask\u003d255.255.255.192 mgmtcidr\u003d1= 0.223.49.0/26 localgw\u003d10.223.58.129 private.network.device\u003deth1 e= th3ip\u003d10.223.58.147 eth3mask\u003d255.255.255.192 storageip\u003d10.22= 3.58.147 storagenetmask\u003d255.255.255.192 storagegateway\u003d10.223.58.= 129 internaldns1\u003d10.223.240.234 dns1\u003d10.223.240.232","rebootOnCra= sh":false,"enableHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":f= alse,"vncPassword":"6e5928251a8718f6","params":{},"uuid":"db3f9893-d98e-4fb= 4-a6a4-95f2c95ce407","disks":[{"data":{"org.apache.cloudstack.storage.to.Vo= lumeObjectTO":{"uuid":"488b20bf-e706-46b9-9039-4dd407aa23ba","volumeType":"= ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"= uuid":"4aedbaff-1e54-37a2-a150-0b67dbe58ed5","id":3,"poolType":"NetworkFile= system","host":"10.223.57.195","path":"/export/home/kvm/primary1","port":20= 49,"url":"NetworkFilesystem://10.223.57.195//export/home/kvm/primary1/?ROLE= \u003dPrimary\u0026STOREUUID\u003d4aedbaff-1e54-37a2-a150-0b67dbe58ed5"}},"= name":"ROOT-35","size":0,"path":"488b20bf-e706-46b9-9039-4dd407aa23ba","vol= umeId":35,"vmName":"s-35-MyTestVM","accountId":1,"format":"QCOW2","id":35,"= deviceId":0,"hypervisorType":"KVM"}},"diskSeq":0,"path":"488b20bf-e706-46b9= -9039-4dd407aa23ba","type":"ROOT","_details":{"managed":"false","storagePor= t":"2049","storageHost":"10.223.57.195","volumeSize":"0"}}],"nics":[{"devic= eId":2,"networkRateMbps":-1,"defaultNic":true,"uuid":"35eb2804-514b-40d5-8e= 20-a2f423ca2625","ip":"10.223.138.133","netmask":"255.255.255.192","gateway= ":"10.223.138.129","mac":"06:66:22:00:00:15","dns1":"10.223.240.232","broad= castType":"Vlan","type":"Public","broadcastUri":"vlan://1382","isolationUri= ":"vlan://1382","isSecurityGroupEnabled":false},{"deviceId":0,"networkRateM= bps":-1,"defaultNic":false,"uuid":"ea38c96f-cc88-463b-812e-a4a69b59d7f7","i= p":"169.254.0.251","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0= e:00:a9:fe:00:fb","broadcastType":"LinkLocal","type":"Control","isSecurityG= roupEnabled":false},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"= uuid":"aa865f74-1add-476c-ad0f-86aed6b84155","ip":"10.223.58.137","netmask"= :"255.255.255.192","gateway":"10.223.58.129","mac":"06:10:f0:00:00:06","bro= adcastType":"Native","type":"Management","isSecurityGroupEnabled":false},{"= deviceId":3,"networkRateMbps":-1,"defaultNic":false,"uuid":"032a8d30-fdf9-4= 93d-ad2c-e3c2627e1869","ip":"10.223.58.147","netmask":"255.255.255.192","ga= teway":"10.223.58.129","mac":"06:40:ce:00:00:10","broadcastType":"Native","= type":"Storage","isSecurityGroupEnabled":false}]},"hostIp":"10.223.58.131",= "executeInSequence":false,"contextMap":{},"wait":0}},{"com.cloud.agent.api.= check.CheckSshCommand":{"ip":"169.254.0.251","port":3922,"interval":6,"retr= ies":100,"name":"s-35-MyTestVM","contextMap":{},"wait":0}}] > com.google.gson.JsonParseException: The JsonDeserializer com.cloud.agent.= transport.InterfaceTypeAdaptor@6db22920 failed to deserialize json object {= "org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"488b20bf-e706-46= b9-9039-4dd407aa23ba","volumeType":"ROOT","dataStore":{"org.apache.cloudsta= ck.storage.to.PrimaryDataStoreTO":{"uuid":"4aedbaff-1e54-37a2-a150-0b67dbe5= 8ed5","id":3,"poolType":"NetworkFilesystem","host":"10.223.57.195","path":"= /export/home/kvm/primary1","port":2049,"url":"NetworkFilesystem://10.223.57= .195//export/home/kvm/primary1/?ROLE=3DPrimary&STOREUUID=3D4aedbaff-1e54-37= a2-a150-0b67dbe58ed5"}},"name":"ROOT-35","size":0,"path":"488b20bf-e706-46b= 9-9039-4dd407aa23ba","volumeId":35,"vmName":"s-35-MyTestVM","accountId":1,"= format":"QCOW2","id":35,"deviceId":0,"hypervisorType":"KVM"}} given the typ= e interface com.cloud.agent.api.to.DataTO > at com.google.gson.JsonDeserializerExceptionWrapper.deserialize(J= sonDeserializerExceptionWrapper.java:64) > at com.google.gson.JsonDeserializationVisitor.invokeCustomDeseria= lizer(JsonDeserializationVisitor.java:92) > at com.google.gson.JsonObjectDeserializationVisitor.visitFieldUsi= ngCustomHandler(JsonObjectDeserializationVisitor.java:117) > at com.google.gson.ReflectingFieldNavigator.visitFieldsReflective= ly(ReflectingFieldNavigator.java:63) > at com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:12= 0) > at com.google.gson.JsonDeserializationVisitor.visitChild(JsonDese= rializationVisitor.java:110) > at com.google.gson.JsonDeserializationVisitor.visitChildAsObject(= JsonDeserializationVisitor.java:99) > at com.google.gson.JsonArrayDeserializationVisitor.visitArray(Jso= nArrayDeserializationVisitor.java:70) > at com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:11= 2) > at com.google.gson.JsonDeserializationVisitor.visitChild(JsonDese= rializationVisitor.java:110) > at com.google.gson.JsonDeserializationVisitor.visitChildAsArray(J= sonDeserializationVisitor.java:106) > at com.google.gson.JsonObjectDeserializationVisitor.visitArrayFie= ld(JsonObjectDeserializationVisitor.java:82) > at com.google.gson.ReflectingFieldNavigator.visitFieldsReflective= ly(ReflectingFieldNavigator.java:67) > at com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:12= 0) > at com.google.gson.JsonDeserializationVisitor.visitChild(JsonDese= rializationVisitor.java:110) > at com.google.gson.JsonDeserializationVisitor.visitChildAsObject(= JsonDeserializationVisitor.java:99) > at com.google.gson.JsonObjectDeserializationVisitor.visitObjectFi= eld(JsonObjectDeserializationVisitor.java:63) > at com.google.gson.ReflectingFieldNavigator.visitFieldsReflective= ly(ReflectingFieldNavigator.java:69) > at com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:12= 0) > at com.google.gson.JsonDeserializationContextDefault.fromJsonObje= ct(JsonDeserializationContextDefault.java:76) > at com.google.gson.JsonDeserializationContextDefault.deserialize(= JsonDeserializationContextDefault.java:54) > at com.google.gson.Gson.fromJson(Gson.java:551) > at com.google.gson.Gson.fromJson(Gson.java:521) > at com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTy= peAdaptor.java:77) > at com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTy= peAdaptor.java:36) > at com.google.gson.JsonDeserializerExceptionWrapper.deserialize(J= sonDeserializerExceptionWrapper.java:51) > at com.google.gson.JsonDeserializationVisitor.invokeCustomDeseria= lizer(JsonDeserializationVisitor.java:92) > at com.google.gson.JsonDeserializationVisitor.visitUsingCustomHan= dler(JsonDeserializationVisitor.java:80) > at com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:10= 1) > at com.google.gson.JsonDeserializationContextDefault.fromJsonArra= y(JsonDeserializationContextDefault.java:67) > at com.google.gson.JsonDeserializationContextDefault.deserialize(= JsonDeserializationContextDefault.java:52) > at com.google.gson.Gson.fromJson(Gson.java:551) > at com.google.gson.Gson.fromJson(Gson.java:498) > at com.cloud.agent.transport.Request.getCommands(Request.java:246= ) > at com.cloud.agent.Agent.processRequest(Agent.java:438) > at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:80= 6) > at com.cloud.utils.nio.Task.run(Task.java:83) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx= ecutor.java:1110) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolE= xecutor.java:603) > at java.lang.Thread.run(Thread.java:679) > Caused by: java.lang.NullPointerException > at com.google.gson.FieldAttributes.getAnnotationFromArray(FieldAt= tributes.java:231) > at com.google.gson.FieldAttributes.getAnnotation(FieldAttributes.= java:150) > at com.google.gson.VersionExclusionStrategy.shouldSkipField(Versi= onExclusionStrategy.java:38) > at com.google.gson.DisjunctionExclusionStrategy.shouldSkipField(D= isjunctionExclusionStrategy.java:38) > at com.google.gson.ReflectingFieldNavigator.visitFieldsReflective= ly(ReflectingFieldNavigator.java:58) > at com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:12= 0) > at com.google.gson.JsonDeserializationContextDefault.fromJsonObje= ct(JsonDeserializationContextDefault.java:76) > at com.google.gson.JsonDeserializationContextDefault.deserialize(= JsonDeserializationContextDefault.java:54) > at com.google.gson.Gson.fromJson(Gson.java:551) > at com.google.gson.Gson.fromJson(Gson.java:521) > at com.cloud.agent.transport.InterfaceTypeAdaptor.deserialize(Int= erfaceTypeAdaptor.java:64) > at com.google.gson.JsonDeserializerExceptionWrapper.deserialize(J= sonDeserializerExceptionWrapper.java:51) > ... 39 more > 2013-12-19 10:28:08,620 WARN [utils.nio.Task] (agentRequest-Handler-5:nu= ll) Caught the following exception but pushing on > java.lang.NullPointerException > at com.cloud.agent.Agent.processRequest(Agent.java:525) > at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:80= 6) > at com.cloud.utils.nio.Task.run(Task.java:83) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx= ecutor.java:1110) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolE= xecutor.java:603) > at java.lang.Thread.run(Thread.java:679) > @ =20 -- This message was sent by Atlassian JIRA (v6.1.4#6159)