cloudstack-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "La Motta, David" <David.LaMo...@netapp.com>
Subject Re: Instance on KVM + NFS fails
Date Wed, 16 Apr 2014 17:03:31 GMT
The instance creation worked on a manually created primary storage.  We’ll
take a look on our end to see what the difference is between manual vs.
API-created primary storage.

Thanks for the help.


David La Motta
Technical Marketing Engineer | Integrated Infrastructures

NetApp
Office: 1.919.476.5042
Mobile: 1.919.413.5600




On 4/16/14, 12:43 PM, "Marcus" <shadowsor@gmail.com> wrote:

>Yes, it wouldn't start without a disk :-)
>
>On Wed, Apr 16, 2014 at 10:39 AM, La Motta, David
><David.LaMotta@netapp.com> wrote:
>> Thanks, Marcus.   The virtual router can’t start, either.
>>
>>
>> 2014-04-16 09:28:52,874 DEBUG [kvm.resource.KVMHAMonitor]
>>(Thread-4:null)
>> Found NFS storage pool 9e3145ae-6074-4aa8-bbbf-05f2d8f284be in libvirt,
>> continuing
>> 2014-04-16 09:28:52,875 DEBUG [kvm.resource.KVMHAMonitor]
>>(Thread-4:null)
>> Executing:
>> /usr/share/cloudstack-common/scripts/vm/hypervisor/kvm/kvmheartbeat.sh
>>-i
>> 192.168.0.131 -p /kvmPrimary -m
>>/mnt/9e3145ae-6074-4aa8-bbbf-05f2d8f284be
>> -h 192.168.0.66
>> 2014-04-16 09:28:52,901 DEBUG [kvm.resource.KVMHAMonitor]
>>(Thread-4:null)
>> Execution is successful.
>> 2014-04-16 09:28:53,485 DEBUG [kvm.resource.LibvirtComputingResource]
>> (UgentTask-2:null) Executing:
>> /usr/share/cloudstack-common/scripts/vm/network/security_group.py
>> get_rule_logs_for_vms
>> 2014-04-16 09:28:53,623 DEBUG [kvm.resource.LibvirtComputingResource]
>> (UgentTask-2:null) Execution is successful.
>> 2014-04-16 09:28:53,626 DEBUG [cloud.agent.Agent] (UgentTask-2:null)
>> Sending ping: Seq 5-2:  { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>> 
>>[{"com.cloud.agent.api.PingRoutingWithNwGroupsCommand":{"newGroupStates":
>>{}
>> 
>>,"newStates":{},"_hostVmStateReport":{},"_gatewayAccessible":true,"_vnetA
>>cc
>> essible":true,"hostType":"Routing","hostId":5,"wait":0}}] }
>> 2014-04-16 09:28:53,640 DEBUG [cloud.agent.Agent] (Agent-Handler-5:null)
>> Received response: Seq 5-2:  { Ans: , MgmtId: 345040294157, via: 5, Ver:
>> v1, Flags: 100010,
>> 
>>[{"com.cloud.agent.api.PingAnswer":{"_command":{"hostType":"Routing","hos
>>tI
>> d":5,"wait":0},"result":true,"wait":0}}] }
>> 2014-04-16 09:29:03,044 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-5:null) Request:Seq 5-6225930:  { Cmd , MgmtId:
>> 345040294157, via: 5, Ver: v1, Flags: 100111,
>> 
>>[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apac
>>he
>> 
>>.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/3/535b2
>>e9
>> 
>>9-c2f9-37fa-9667-abdd091eee41.qcow2","origUrl":"http://download.cloud.com
>>/t
>> 
>>emplates/4.3/systemvm64template-2014-01-14-master-kvm.qcow2.bz2","uuid":"
>>bb
>> 
>>63ad7c-bbfc-11e3-bb63-00505601110d","id":3,"format":"QCOW2","accountId":1
>>,"
>> 
>>checksum":"85a1bed07bf43cbf022451cb2ecae4ff","hvm":false,"displayText":"S
>>ys
>> temVM Template
>> 
>>(KVM)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://19
>>2.
>> 168.0.131/svm1_ccp_secondary
>> 
>><http://192.168.0.131/svm1_ccp_secondary>","_role":"Image"}},"name":"rout
>>in
>> 
>>g-3","hypervisorType":"KVM"}},"destTO":{"org.apache.cloudstack.storage.to
>>.T
>> 
>>emplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/syst
>>em
>> 
>>vm64template-2014-01-14-master-kvm.qcow2.bz2","uuid":"bb63ad7c-bbfc-11e3-
>>bb
>> 
>>63-00505601110d","id":3,"format":"QCOW2","accountId":1,"checksum":"85a1be
>>d0
>> 7bf43cbf022451cb2ecae4ff","hvm":false,"displayText":"SystemVM Template
>> 
>>(KVM)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://19
>>2.
>> 168.0.131/kvmPrimary
>> 
>><http://192.168.0.131/kvmPrimary>","_role":"Primary","uuid":"9e3145ae-607
>>4-
>> 
>>4aa8-bbbf-05f2d8f284be"}},"name":"routing-3","hypervisorType":"KVM"}},"ex
>>ec
>> uteInSequence":true,"options":{},"wait":10800}}] }
>> 2014-04-16 09:29:03,045 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-5:null) Processing command:
>> org.apache.cloudstack.storage.command.CopyCommand
>> 2014-04-16 09:29:03,047 WARN  [cloud.agent.Agent]
>> (agentRequest-Handler-5:null) Caught:
>> java.lang.ClassCastException: com.cloud.agent.api.to.NfsTO cannot be
>>cast
>> to org.apache.cloudstack.storage.to.PrimaryDataStoreTO
>>         at
>> 
>>com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrimar
>>yS
>> torage(KVMStorageProcessor.java:150)
>>         at
>> 
>>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Sto
>>ra
>> geSubsystemCommandHandlerBase.java:75)
>>         at
>> 
>>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStora
>>ge
>> Commands(StorageSubsystemCommandHandlerBase.java:50)
>>         at
>> 
>>com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest
>>(L
>> ibvirtComputingResource.java:1359)
>>         at com.cloud.agent.Agent.processRequest(Agent.java:498)
>>         at 
>>com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)
>>         at com.cloud.utils.nio.Task.run(Task.java:83)
>>         at
>> 
>>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java
>>:1
>> 110)
>>         at
>> 
>>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav
>>a:
>> 603)
>>         at java.lang.Thread.run(Thread.java:722)
>> 2014-04-16 09:29:03,052 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-5:null) Seq 5-6225930:  { Ans: , MgmtId:
>> 345040294157, via: 5, Ver: v1, Flags: 110,
>> 
>>[{"com.cloud.agent.api.Answer":{"result":false,"details":"java.lang.Class
>>Ca
>> stException: com.cloud.agent.api.to.NfsTO cannot be cast to
>> org.apache.cloudstack.storage.to.PrimaryDataStoreTO\n\tat
>> 
>>com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrimar
>>yS
>> torage(KVMStorageProcessor.java:150)\n\tat
>> 
>>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Sto
>>ra
>> geSubsystemCommandHandlerBase.java:75)\n\tat
>> 
>>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStora
>>ge
>> Commands(StorageSubsystemCommandHandlerBase.java:50)\n\tat
>> 
>>com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest
>>(L
>> ibvirtComputingResource.java:1359)\n\tat
>> com.cloud.agent.Agent.processRequest(Agent.java:498)\n\tat
>> com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)\n\tat
>> com.cloud.utils.nio.Task.run(Task.java:83)\n\tat
>> 
>>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java
>>:1
>> 110)\n\tat
>> 
>>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav
>>a:
>> 603)\n\tat java.lang.Thread.run(Thread.java:722)\n","wait":0}}] }
>> 2014-04-16 09:29:03,176 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-1:null) Request:Seq 5-6225931:  { Cmd , MgmtId:
>> 345040294157, via: 5, Ver: v1, Flags: 100111,
>> 
>>[{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":
>>tr
>> ue,"checkBeforeCleanup":false,"vmName":"r-4-VM","wait":0}}] }
>> 2014-04-16 09:29:03,177 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-1:null) Processing command:
>> com.cloud.agent.api.StopCommand
>> 2014-04-16 09:29:03,186 DEBUG [kvm.resource.LibvirtConnection]
>> (agentRequest-Handler-1:null) can't find connection: KVM, for vm:
>>r-4-VM,
>> continue
>> 2014-04-16 09:29:03,198 DEBUG [kvm.resource.LibvirtConnection]
>> (agentRequest-Handler-1:null) can't find connection: LXC, for vm:
>>r-4-VM,
>> continue
>> 2014-04-16 09:29:03,198 DEBUG [kvm.resource.LibvirtConnection]
>> (agentRequest-Handler-1:null) can't find which hypervisor the vm used ,
>> then use the default hypervisor
>> 2014-04-16 09:29:03,202 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-1:null) Failed to get dom xml:
>> org.libvirt.LibvirtException: Domain not found: no domain with matching
>> name 'r-4-VM'
>> 2014-04-16 09:29:03,204 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-1:null) Failed to get dom xml:
>> org.libvirt.LibvirtException: Domain not found: no domain with matching
>> name 'r-4-VM'
>> 2014-04-16 09:29:03,205 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-1:null) Failed to get dom xml:
>> org.libvirt.LibvirtException: Domain not found: no domain with matching
>> name 'r-4-VM'
>> 2014-04-16 09:29:03,206 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-1:null) Executing:
>> /usr/share/cloudstack-common/scripts/vm/network/security_group.py
>> destroy_network_rules_for_vm --vmname r-4-VM
>> 2014-04-16 09:29:03,418 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-1:null) Execution is successful.
>> 2014-04-16 09:29:03,418 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-1:null) Try to stop the vm at first
>> 2014-04-16 09:29:03,420 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-1:null) VM r-4-VM doesn't exist, no need to stop
>>it
>> 2014-04-16 09:29:03,422 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-1:null) Seq 5-6225931:  { Ans: , MgmtId:
>> 345040294157, via: 5, Ver: v1, Flags: 110,
>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
>> 2014-04-16 09:29:03,600 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-2:null) Request:Seq 5-6225932:  { Cmd , MgmtId:
>> 345040294157, via: 5, Ver: v1, Flags: 100111,
>> 
>>[{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":
>>tr
>> ue,"checkBeforeCleanup":false,"vmName":"i-2-6-VM","wait":0}}] }
>> 2014-04-16 09:29:03,600 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-2:null) Processing command:
>> com.cloud.agent.api.StopCommand
>> 2014-04-16 09:29:03,604 DEBUG [kvm.resource.LibvirtConnection]
>> (agentRequest-Handler-2:null) can't find connection: KVM, for vm:
>> i-2-6-VM, continue
>> 2014-04-16 09:29:03,606 DEBUG [kvm.resource.LibvirtConnection]
>> (agentRequest-Handler-2:null) can't find connection: LXC, for vm:
>> i-2-6-VM, continue
>> 2014-04-16 09:29:03,606 DEBUG [kvm.resource.LibvirtConnection]
>> (agentRequest-Handler-2:null) can't find which hypervisor the vm used ,
>> then use the default hypervisor
>> 2014-04-16 09:29:03,609 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-2:null) Failed to get dom xml:
>> org.libvirt.LibvirtException: Domain not found: no domain with matching
>> name 'i-2-6-VM'
>> 2014-04-16 09:29:03,611 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-2:null) Failed to get dom xml:
>> org.libvirt.LibvirtException: Domain not found: no domain with matching
>> name 'i-2-6-VM'
>> 2014-04-16 09:29:03,612 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-2:null) Failed to get dom xml:
>> org.libvirt.LibvirtException: Domain not found: no domain with matching
>> name 'i-2-6-VM'
>> 2014-04-16 09:29:03,612 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-2:null) Executing:
>> /usr/share/cloudstack-common/scripts/vm/network/security_group.py
>> destroy_network_rules_for_vm --vmname i-2-6-VM
>> 2014-04-16 09:29:03,813 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-2:null) Execution is successful.
>> 2014-04-16 09:29:03,813 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-2:null) Try to stop the vm at first
>> 2014-04-16 09:29:03,815 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-2:null) VM i-2-6-VM doesn't exist, no need to
>>stop it
>> 2014-04-16 09:29:03,816 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-2:null) Seq 5-6225932:  { Ans: , MgmtId:
>> 345040294157, via: 5, Ver: v1, Flags: 110,
>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
>> 2014-04-16 09:29:04,352 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-3:null) Request:Seq 5-6225933:  { Cmd , MgmtId:
>> 345040294157, via: 5, Ver: v1, Flags: 100111,
>> 
>>[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apac
>>he
>> 
>>.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/3/535b2
>>e9
>> 
>>9-c2f9-37fa-9667-abdd091eee41.qcow2","origUrl":"http://download.cloud.com
>>/t
>> 
>>emplates/4.3/systemvm64template-2014-01-14-master-kvm.qcow2.bz2","uuid":"
>>bb
>> 
>>63ad7c-bbfc-11e3-bb63-00505601110d","id":3,"format":"QCOW2","accountId":1
>>,"
>> 
>>checksum":"85a1bed07bf43cbf022451cb2ecae4ff","hvm":false,"displayText":"S
>>ys
>> temVM Template
>> 
>>(KVM)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://19
>>2.
>> 168.0.131/svm1_ccp_secondary
>> 
>><http://192.168.0.131/svm1_ccp_secondary>","_role":"Image"}},"name":"rout
>>in
>> 
>>g-3","hypervisorType":"KVM"}},"destTO":{"org.apache.cloudstack.storage.to
>>.T
>> 
>>emplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/syst
>>em
>> 
>>vm64template-2014-01-14-master-kvm.qcow2.bz2","uuid":"bb63ad7c-bbfc-11e3-
>>bb
>> 
>>63-00505601110d","id":3,"format":"QCOW2","accountId":1,"checksum":"85a1be
>>d0
>> 7bf43cbf022451cb2ecae4ff","hvm":false,"displayText":"SystemVM Template
>> 
>>(KVM)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://19
>>2.
>> 168.0.131/kvmPrimary
>> 
>><http://192.168.0.131/kvmPrimary>","_role":"Primary","uuid":"9e3145ae-607
>>4-
>> 
>>4aa8-bbbf-05f2d8f284be"}},"name":"routing-3","hypervisorType":"KVM"}},"ex
>>ec
>> uteInSequence":true,"options":{},"wait":10800}}] }
>> 2014-04-16 09:29:04,352 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-3:null) Processing command:
>> org.apache.cloudstack.storage.command.CopyCommand
>> 2014-04-16 09:29:04,353 WARN  [cloud.agent.Agent]
>> (agentRequest-Handler-3:null) Caught:
>> java.lang.ClassCastException: com.cloud.agent.api.to.NfsTO cannot be
>>cast
>> to org.apache.cloudstack.storage.to.PrimaryDataStoreTO
>>         at
>> 
>>com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrimar
>>yS
>> torage(KVMStorageProcessor.java:150)
>>         at
>> 
>>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Sto
>>ra
>> geSubsystemCommandHandlerBase.java:75)
>>         at
>> 
>>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStora
>>ge
>> Commands(StorageSubsystemCommandHandlerBase.java:50)
>>         at
>> 
>>com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest
>>(L
>> ibvirtComputingResource.java:1359)
>>         at com.cloud.agent.Agent.processRequest(Agent.java:498)
>>         at 
>>com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)
>>         at com.cloud.utils.nio.Task.run(Task.java:83)
>>         at
>> 
>>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java
>>:1
>> 110)
>>         at
>> 
>>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav
>>a:
>> 603)
>>         at java.lang.Thread.run(Thread.java:722)
>> 2014-04-16 09:29:04,355 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-3:null) Seq 5-6225933:  { Ans: , MgmtId:
>> 345040294157, via: 5, Ver: v1, Flags: 110,
>> 
>>[{"com.cloud.agent.api.Answer":{"result":false,"details":"java.lang.Class
>>Ca
>> stException: com.cloud.agent.api.to.NfsTO cannot be cast to
>> org.apache.cloudstack.storage.to.PrimaryDataStoreTO\n\tat
>> 
>>com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrimar
>>yS
>> torage(KVMStorageProcessor.java:150)\n\tat
>> 
>>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Sto
>>ra
>> geSubsystemCommandHandlerBase.java:75)\n\tat
>> 
>>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStora
>>ge
>> Commands(StorageSubsystemCommandHandlerBase.java:50)\n\tat
>> 
>>com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest
>>(L
>> ibvirtComputingResource.java:1359)\n\tat
>> com.cloud.agent.Agent.processRequest(Agent.java:498)\n\tat
>> com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)\n\tat
>> com.cloud.utils.nio.Task.run(Task.java:83)\n\tat
>> 
>>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java
>>:1
>> 110)\n\tat
>> 
>>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav
>>a:
>> 603)\n\tat java.lang.Thread.run(Thread.java:722)\n","wait":0}}] }
>> 2014-04-16 09:29:04,441 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-4:null) Request:Seq 5-6225934:  { Cmd , MgmtId:
>> 345040294157, via: 5, Ver: v1, Flags: 100111,
>> 
>>[{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":
>>tr
>> ue,"checkBeforeCleanup":false,"vmName":"r-4-VM","wait":0}}] }
>> 2014-04-16 09:29:04,442 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-4:null) Processing command:
>> com.cloud.agent.api.StopCommand
>> 2014-04-16 09:29:04,446 DEBUG [kvm.resource.LibvirtConnection]
>> (agentRequest-Handler-4:null) can't find connection: KVM, for vm:
>>r-4-VM,
>> continue
>> 2014-04-16 09:29:04,448 DEBUG [kvm.resource.LibvirtConnection]
>> (agentRequest-Handler-4:null) can't find connection: LXC, for vm:
>>r-4-VM,
>> continue
>> 2014-04-16 09:29:04,448 DEBUG [kvm.resource.LibvirtConnection]
>> (agentRequest-Handler-4:null) can't find which hypervisor the vm used ,
>> then use the default hypervisor
>> 2014-04-16 09:29:04,453 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-4:null) Failed to get dom xml:
>> org.libvirt.LibvirtException: Domain not found: no domain with matching
>> name 'r-4-VM'
>> 2014-04-16 09:29:04,455 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-4:null) Failed to get dom xml:
>> org.libvirt.LibvirtException: Domain not found: no domain with matching
>> name 'r-4-VM'
>> 2014-04-16 09:29:04,457 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-4:null) Failed to get dom xml:
>> org.libvirt.LibvirtException: Domain not found: no domain with matching
>> name 'r-4-VM'
>> 2014-04-16 09:29:04,457 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-4:null) Executing:
>> /usr/share/cloudstack-common/scripts/vm/network/security_group.py
>> destroy_network_rules_for_vm --vmname r-4-VM
>> 2014-04-16 09:29:04,660 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-4:null) Execution is successful.
>> 2014-04-16 09:29:04,661 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-4:null) Try to stop the vm at first
>> 2014-04-16 09:29:04,663 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-4:null) VM r-4-VM doesn't exist, no need to stop
>>it
>> 2014-04-16 09:29:04,664 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-4:null) Seq 5-6225934:  { Ans: , MgmtId:
>> 345040294157, via: 5, Ver: v1, Flags: 110,
>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
>> 2014-04-16 09:29:04,834 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-5:null) Request:Seq 5-6225935:  { Cmd , MgmtId:
>> 345040294157, via: 5, Ver: v1, Flags: 100111,
>> 
>>[{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":
>>tr
>> ue,"checkBeforeCleanup":false,"vmName":"i-2-6-VM","wait":0}}] }
>> 2014-04-16 09:29:04,834 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-5:null) Processing command:
>> com.cloud.agent.api.StopCommand
>> 2014-04-16 09:29:04,837 DEBUG [kvm.resource.LibvirtConnection]
>> (agentRequest-Handler-5:null) can't find connection: KVM, for vm:
>> i-2-6-VM, continue
>> 2014-04-16 09:29:04,839 DEBUG [kvm.resource.LibvirtConnection]
>> (agentRequest-Handler-5:null) can't find connection: LXC, for vm:
>> i-2-6-VM, continue
>> 2014-04-16 09:29:04,839 DEBUG [kvm.resource.LibvirtConnection]
>> (agentRequest-Handler-5:null) can't find which hypervisor the vm used ,
>> then use the default hypervisor
>> 2014-04-16 09:29:04,842 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-5:null) Failed to get dom xml:
>> org.libvirt.LibvirtException: Domain not found: no domain with matching
>> name 'i-2-6-VM'
>> 2014-04-16 09:29:04,843 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-5:null) Failed to get dom xml:
>> org.libvirt.LibvirtException: Domain not found: no domain with matching
>> name 'i-2-6-VM'
>> 2014-04-16 09:29:04,845 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-5:null) Failed to get dom xml:
>> org.libvirt.LibvirtException: Domain not found: no domain with matching
>> name 'i-2-6-VM'
>> 2014-04-16 09:29:04,845 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-5:null) Executing:
>> /usr/share/cloudstack-common/scripts/vm/network/security_group.py
>> destroy_network_rules_for_vm --vmname i-2-6-VM
>> 2014-04-16 09:29:05,049 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-5:null) Execution is successful.
>> 2014-04-16 09:29:05,050 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-5:null) Try to stop the vm at first
>> 2014-04-16 09:29:05,052 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-5:null) VM i-2-6-VM doesn't exist, no need to
>>stop it
>> 2014-04-16 09:29:05,054 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-5:null) Seq 5-6225935:  { Ans: , MgmtId:
>> 345040294157, via: 5, Ver: v1, Flags: 110,
>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
>> 2014-04-16 09:29:08,977 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-1:null) Processing command:
>> com.cloud.agent.api.GetStorageStatsCommand
>> 2014-04-16 09:29:25,596 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-2:null) Processing command:
>> com.cloud.agent.api.GetHostStatsCommand
>> 2014-04-16 09:29:25,596 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-2:null) Executing: /bin/bash -c idle=$(top -b -n
>> 1|grep Cpu\(s\):|cut -d% -f4|cut -d, -f2);echo $idle
>> 2014-04-16 09:29:26,117 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-2:null) Execution is successful.
>> 2014-04-16 09:29:26,118 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-2:null) Executing: /bin/bash -c
>>freeMem=$(free|grep
>> cache:|awk '{print $4}');echo $freeMem
>> 2014-04-16 09:29:26,126 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-2:null) Execution is successful.
>> 2014-04-16 09:29:26,127 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-2:null) Executing: /bin/bash -c free|grep Mem:|awk
>> '{print $2}'
>> 2014-04-16 09:29:26,133 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-2:null) Execution is successful.
>> 2014-04-16 09:29:52,905 DEBUG [kvm.resource.KVMHAMonitor]
>>(Thread-5:null)
>> Found NFS storage pool 9e3145ae-6074-4aa8-bbbf-05f2d8f284be in libvirt,
>> continuing
>> 2014-04-16 09:29:52,906 DEBUG [kvm.resource.KVMHAMonitor]
>>(Thread-5:null)
>> Executing:
>> /usr/share/cloudstack-common/scripts/vm/hypervisor/kvm/kvmheartbeat.sh
>>-i
>> 192.168.0.131 -p /kvmPrimary -m
>>/mnt/9e3145ae-6074-4aa8-bbbf-05f2d8f284be
>> -h 192.168.0.66
>> 2014-04-16 09:29:52,943 DEBUG [kvm.resource.KVMHAMonitor]
>>(Thread-5:null)
>> Execution is successful.
>> 2014-04-16 09:29:53,485 DEBUG [kvm.resource.LibvirtComputingResource]
>> (UgentTask-3:null) Executing:
>> /usr/share/cloudstack-common/scripts/vm/network/security_group.py
>> get_rule_logs_for_vms
>> 2014-04-16 09:29:53,613 DEBUG [kvm.resource.LibvirtComputingResource]
>> (UgentTask-3:null) Execution is successful.
>> 2014-04-16 09:29:53,618 DEBUG [cloud.agent.Agent] (UgentTask-3:null)
>> Sending ping: Seq 5-3:  { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>> 
>>[{"com.cloud.agent.api.PingRoutingWithNwGroupsCommand":{"newGroupStates":
>>{}
>> 
>>,"newStates":{},"_hostVmStateReport":{},"_gatewayAccessible":true,"_vnetA
>>cc
>> essible":true,"hostType":"Routing","hostId":5,"wait":0}}] }
>> 2014-04-16 09:29:53,634 DEBUG [cloud.agent.Agent] (Agent-Handler-4:null)
>> Received response: Seq 5-3:  { Ans: , MgmtId: 345040294157, via: 5, Ver:
>> v1, Flags: 100010,
>> 
>>[{"com.cloud.agent.api.PingAnswer":{"_command":{"hostType":"Routing","hos
>>tI
>> d":5,"wait":0},"result":true,"wait":0}}] }
>> [root@rhelkvm1 agent]# tail -f  /var/log/cloudstack/agent/agent.log
>> 2014-04-16 09:30:56,988 DEBUG [kvm.resource.LibvirtConnection]
>> (agentRequest-Handler-1:null) can't find which hypervisor the vm used ,
>> then use the default hypervisor
>> 2014-04-16 09:30:56,990 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-1:null) Failed to get dom xml:
>> org.libvirt.LibvirtException: Domain not found: no domain with matching
>> name 'r-4-VM'
>> 2014-04-16 09:30:56,991 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-1:null) Failed to get dom xml:
>> org.libvirt.LibvirtException: Domain not found: no domain with matching
>> name 'r-4-VM'
>> 2014-04-16 09:30:56,993 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-1:null) Failed to get dom xml:
>> org.libvirt.LibvirtException: Domain not found: no domain with matching
>> name 'r-4-VM'
>> 2014-04-16 09:30:56,993 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-1:null) Executing:
>> /usr/share/cloudstack-common/scripts/vm/network/security_group.py
>> destroy_network_rules_for_vm --vmname r-4-VM
>> 2014-04-16 09:30:57,200 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-1:null) Execution is successful.
>> 2014-04-16 09:30:57,201 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-1:null) Try to stop the vm at first
>> 2014-04-16 09:30:57,203 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-1:null) VM r-4-VM doesn't exist, no need to stop
>>it
>> 2014-04-16 09:30:57,204 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-1:null) Seq 5-6225941:  { Ans: , MgmtId:
>> 345040294157, via: 5, Ver: v1, Flags: 110,
>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
>> 2014-04-16 09:31:09,451 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-2:null) Processing command:
>> com.cloud.agent.api.GetStorageStatsCommand
>> 2014-04-16 09:31:27,011 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-3:null) Processing command:
>> com.cloud.agent.api.GetHostStatsCommand
>> 2014-04-16 09:31:27,011 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-3:null) Executing: /bin/bash -c idle=$(top -b -n
>> 1|grep Cpu\(s\):|cut -d% -f4|cut -d, -f2);echo $idle
>> 2014-04-16 09:31:27,541 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-3:null) Execution is successful.
>> 2014-04-16 09:31:27,542 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-3:null) Executing: /bin/bash -c
>>freeMem=$(free|grep
>> cache:|awk '{print $4}');echo $freeMem
>> 2014-04-16 09:31:27,549 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-3:null) Execution is successful.
>> 2014-04-16 09:31:27,550 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-3:null) Executing: /bin/bash -c free|grep Mem:|awk
>> '{print $2}'
>> 2014-04-16 09:31:27,556 DEBUG [kvm.resource.LibvirtComputingResource]
>> (agentRequest-Handler-3:null) Execution is successful.
>> ^C^C
>> [root@rhelkvm1 agent]#
>>
>>
>>
>>
>>
>>
>> David La Motta
>> Technical Marketing Engineer | Integrated Infrastructures
>>
>> NetApp
>> Office: 1.919.476.5042
>> Mobile: 1.919.413.5600
>>
>>
>>
>>
>> On 4/16/14, 12:13 PM, "Marcus" <shadowsor@gmail.com> wrote:
>>
>>>turn on debugging for the agent:
>>>
>>>sed -i 's/INFO/DEBUG/g' /etc/cloudstack/agent/log4j-cloud.xml
>>>
>>>then look in /var/log/cloudstack/agent/agent.log
>>>
>>>
>>>On Wed, Apr 16, 2014 at 10:07 AM, La Motta, David
>>><David.LaMotta@netapp.com> wrote:
>>>> Hi Jang, where exactly is that log file?  :-)
>>>>
>>>>
>>>> David La Motta
>>>> Technical Marketing Engineer | Integrated Infrastructures
>>>>
>>>> NetApp
>>>> Office: 1.919.476.5042
>>>> Mobile: 1.919.413.5600
>>>>
>>>>
>>>>
>>>>
>>>> On 4/16/14, 11:25 AM, "Yitao Jiang" <willierjyt@gmail.com> wrote:
>>>>
>>>>>Hi, David
>>>>>
>>>>>Did u see anything wrong within kvm agent log file?
>>>>>
>>>>>
>>>>>
>>>>>Thanks,
>>>>>
>>>>>Yitao
>>>>>
>>>>>
>>>>>2014-04-16 22:59 GMT+08:00 La Motta, David <David.LaMotta@netapp.com>:
>>>>>
>>>>>> Hey everybody, I am trying to deploy a VM instance in KVM using NFS
>>>>>>for
>>>>>> primary storage (on 4.3).  Unfortunately, this is the exception I
am
>>>>>> getting:
>>>>>>
>>>>>> 2014-04-16 06:44:53,128 DEBUG [o.a.c.e.o.VolumeOrchestrator]
>>>>>> (Work-Job-Executor-6:job-30/job-31 ctx-b83982e8) Unable to create
>>>>>> Vol[4|vm=4|ROOT]:java.lang.ClassCastException:
>>>>>> com.cloud.agent.api.to.NfsTO cannot be cast to
>>>>>> org.apache.cloudstack.storage.to.PrimaryDataStoreTO
>>>>>> at
>>>>>>
>>>>>>com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPr
>>>>>>im
>>>>>>ar
>>>>>>yS
>>>>>> torage(KVMStorageProcessor.java:150)
>>>>>> at
>>>>>>
>>>>>>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute
>>>>>>(S
>>>>>>to
>>>>>>ra
>>>>>> geSubsystemCommandHandlerBase.java:75)
>>>>>> at
>>>>>>
>>>>>>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleS
>>>>>>to
>>>>>>ra
>>>>>>ge
>>>>>> Commands(StorageSubsystemCommandHandlerBase.java:50)
>>>>>> at
>>>>>>
>>>>>>com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeReq
>>>>>>ue
>>>>>>st
>>>>>>(L
>>>>>> ibvirtComputingResource.java:1359)
>>>>>> at com.cloud.agent.Agent.processRequest(Agent.java:498)
>>>>>> at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)
>>>>>> at com.cloud.utils.nio.Task.run(Task.java:83)
>>>>>> at
>>>>>>
>>>>>>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.
>>>>>>ja
>>>>>>va
>>>>>>:1
>>>>>> 110)
>>>>>> at
>>>>>>
>>>>>>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor
>>>>>>.j
>>>>>>av
>>>>>>a:
>>>>>> 603)
>>>>>> at java.lang.Thread.run(Thread.java:722)
>>>>>>
>>>>>>
>>>>>> Is this a known issue or are there any gotchas that I am
>>>>>>overlooking?
>>>>>>
>>>>>> Thanks!
>>>>>>
>>>>>> // David
>>>>>>
>>>>>>
>>>>>> P.s., good to have seen some of you at CCCNA14 last week.  Looking
>>>>>>forward
>>>>>> to Budapest.
>>>>>>
>>>>>>
>>>>
>>


Mime
View raw message