cloudstack-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Prashanth Manthena <prashanth.manth...@nuagenetworks.net>
Subject Re: Virtual router failed to start on KVM + Linux Bridges
Date Wed, 11 May 2016 11:50:18 GMT
Hi Will,

I was able to put a break-point and debug the actual issue in the VR
(system VM template), it's a Python import error of the package "netaddr",
which can be fixed by updating the system template with the "netaddr"
package installed in it. Hopefully, it fixes this issue.

Here is the error in VR's /var/log/cloud.log:

Wed May 11 10:29:37 UTC 2016 : VR config: configuation format version 1.0
Wed May 11 10:29:37 UTC 2016 : VR config: creating file:
/var/cache/cloud/ip_asss
ociations.json
Wed May 11 10:29:37 UTC 2016 : VR config: create file success
Wed May 11 10:29:37 UTC 2016 : VR config: executing:
/opt/cloud/bin/update_confii
g.py ip_associations.json
Traceback (most recent call last):
  File "/opt/cloud/bin/update_config.py", line 20, in <module>
    from merge import QueueFile
  File "/opt/cloud/bin/merge.py", line 23, in <module>
    import cs_ip
  File "/opt/cloud/bin/cs_ip.py", line 19, in <module>
    from netaddr import *
ImportError: No module named netaddr
Wed May 11 10:29:37 UTC 2016 : VR config: executing failed:
/opt/cloud/bin/updatt
e_config.py ip_associations.json

With regards,
Prashanth

On Wed, May 11, 2016 at 12:06 PM, Prashanth Manthena <
prashanth.manthena@nuagenetworks.net> wrote:

> Hi Will,
>
> I am hitting an issue similar to CLOUDSTACK-9013 on master (4.9.0). Here
> are the management server error logs:
>
> 2016-05-10 08:24:03,109 ERROR [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
> (logid:2735b868) VR config: execution failed:
> "/opt/cloud/bin/update_config.py ip_associations.json", check
> /var/log/cloud.log in VR for details
>
> 2016-05-10 08:24:03,109 WARN  [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
> (logid:2735b868) Command: com.cloud.agent.api.Command failed while starting
> virtual router
>
> 2016-05-10 08:24:03,109 INFO  [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
> (logid:2735b868) The guru did not like the answers so stopping
> VM[DomainRouter|r-30-VM]
>
> Response:
>
> 2016-05-10 08:24:03,067 DEBUG [c.c.a.t.Request]
> (AgentManager-Handler-10:null) (logid:) Seq 1-4347381015296081926:
> Processing:  { Ans: , MgmtId: 275619426932736, via: 1, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.StartAnswer":{"vm":{"id":30,"name":"r-30-VM","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian
> GNU/Linux 5.0 (64-bit)","platformEmulator":"Debian GNU/Linux
> 5","bootArgs":" template=domP name=r-30-VM eth2ip=10.100.100.117
> eth2mask=255.255.255.0 gateway=10.100.100.1 eth0ip=10.10.1.1
> eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
> dhcprange=10.10.1.1 eth1ip=169.254.2.130 eth1mask=255.255.0.0 type=router
> disable_rp_filter=true dns1=128.251.10.29 dns2=4.4.4.4
> baremetalnotificationsecuritykey=ODFTmygvs7oVAHVFZMmv7RpvsNNsawY9tf6sfeMvkUJlmEhWXGli5sO_oWAr52vrF18Z5xMgzjclu9P7G_w9Fg
> baremetalnotificationapikey=pguqxBGrlU2ItCuTHa7xb6pmjrpl9KbVMEE7o6TKrJ-mjDoaRayL_Nj21VkqrKvbtc10L8BxPqaYIhnGJkeHfw
> host=10.30.36.11
> port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"Pj8GDPW2vqLfkdOMoCOogg","vncAddr":"10.100.100.11","params":{},"uuid":"f406776f-3b4c-4d23-917e-715ceaea0a7a","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"f44bbb4e-a788-4034-9389-dc1fa47dce70","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"63a122cd-ac74-3cc1-85b0-e3ad105234dc","id":1,"poolType":"NetworkFilesystem","host":"
> andcvtb05.be.alcatel-lucent.com
> ","path":"/andcvtb05/storage","port":2049,"url":"NetworkFilesystem://
> andcvtb05.be.alcatel-lucent.com/andcvtb05/storage/?ROLE=Primary&STOREUUID=63a122cd-ac74-3cc1-85b0-e3ad105234dc
> "}},"name":"ROOT-30","size":304774144,"path":"f44bbb4e-a788-4034-9389-dc1fa47dce70","volumeId":30,"vmName":"r-30-VM","accountId":2,"format":"QCOW2","provisioningType":"THIN","id":30,"deviceId":0,"hypervisorType":"KVM"}},"diskSeq":0,"path":"f44bbb4e-a788-4034-9389-dc1fa47dce70","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"
> andcvtb05.be.alcatel-lucent.com","volumeSize":"304774144"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"697871c5-d76f-405d-952c-c2d598ae09ae","uuid":"db6e7bae-8dbf-4b31-813f-dba0cad7a817","ip":"10.100.100.117","netmask":"255.255.255.0","gateway":"10.100.100.1","mac":"06:4f:3c:00:00:8f","dns1":"128.251.10.29","dns2":"4.4.4.4","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"cloudbr0"},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"pxeDisable":true,"nicUuid":"c08c5f3b-8725-4006-9660-551ecdc492fe","uuid":"e118f6ac-d812-403c-b948-99a510f7fd93","ip":"10.10.1.1","netmask":"255.255.255.0","mac":"02:00:6b:7b:00:02","dns1":"128.251.10.29","dns2":"4.4.4.4","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://300","isolationUri":"vlan://300","isSecurityGroupEnabled":false,"name":"cloudbr1"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"fe94aabc-705f-47e3-9981-0139acf1af3d","uuid":"6f1abde1-d0cb-4411-9e9b-9db1fdd5f7ab","ip":"169.254.2.130","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:02:82","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"result":true,"wait":0}},{"com.cloud.agent.api.check.CheckSshAnswer":{"result":true,"wait":0}},{"com.cloud.agent.api.GetDomRVersionAnswer":{"templateVersion":"Cloudstack
> Release 4.4.0 Wed Mar 26 23:26:41 UTC
> 2014","scriptsVersion":"e54d6a03fe7d28ff66432d33c8897934\n","result":true,"details":"Cloudstack
> Release 4.4.0 Wed Mar 26 23:26:41 UTC
> 2014&e54d6a03fe7d28ff66432d33c8897934\n","wait":0}},{"com.cloud.agent.api.NetworkUsageAnswer":{"routerName":"r-30-VM","bytesSent":0,"bytesReceived":0,"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
> aggregation
> started","wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VR
> config: execution failed: \"/opt/cloud/bin/update_config.py
> ip_associations.json\", check /var/log/cloud.log in VR for details
> ","wait":0}}] }
> 2016-05-10 08:24:03,068 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
> (logid:2735b868) Seq 1-4347381015296081926: Received:  { Ans: , MgmtId:
> 275619426932736, via: 1(ovs-1.andcvtb05.be.alcatel-lucent.com), Ver: v1,
> Flags: 10, { StartAnswer, CheckSshAnswer, GetDomRVersionAnswer,
> NetworkUsageAnswer, Answer, Answer, Answer, Answer, Answer } }
> 2016-05-10 08:24:03,091 WARN  [o.a.c.alerts]
> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
> (logid:2735b868)  alertType:: 9 // dataCenterId:: 2 // podId:: 2 //
> clusterId:: null // message:: Command: com.cloud.agent.api.Command failed
> while starting virtual router
>
>
> With regards,
> Prashanth
>
>
>
>
> On Tue, May 10, 2016 at 6:18 PM, Will Stevens <wstevens@cloudops.com>
> wrote:
>
>> I am doing CI on KVM and I believe I am using bridged networking in this
>> environment.  Can you give more details of what you are seeing?
>>
>> *Will STEVENS*
>> Lead Developer
>>
>> *CloudOps* *| *Cloud Solutions Experts
>> 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
>> w cloudops.com *|* tw @CloudOps_
>>
>> On Tue, May 10, 2016 at 11:51 AM, Prashanth Manthena <
>> prashanth.manthena@nuagenetworks.net> wrote:
>>
>> > Hi All,
>> >
>> >  I am seeing CLOUDSTACK-9013 on master (4.9.0) with KVM+Linux Bridges.
>> >
>> > Any pointers on this issue ?
>> >
>> > CLOUDSTACK-9013: https://issues.apache.org/jira/browse/CLOUDSTACK-9013
>> >
>> > With reagrds,
>> > Prashanth
>> >
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message